XSEDE Capability Delivery Plan for "HTC-04: Run a job set with dependencies, on multiple resources"

Use Case HTC-04: Run a set of interrelated jobs on several HTC resources

Area: Scientific Computing
URLs: Public, Review

Executive Summary: A researcher needs to run one or more applications many times with varying inputs on several community high-throughput computing (HTC) resources. Each application run is called a “job.” The complete set of jobs is called a “project.” Some jobs may use the outputs of other jobs as their inputs. Some jobs may need to run on the same resource as other jobs, possibly at the same time. (These are called “dependencies.”) Once the jobs and dependencies are specified to the system, the system executes them without further involvement by the researcher.

First CDP: 2018-08-31
Current CDP: 2018-08-31
Current Implementation Status: 
Issues Remaining: 
Time & Effort Summary: 

No effort or changes are proposed at this time.

Significant Revisions:
  • 2018-08-31 11:59 (current revision)
This capability is currently supported by the following 1 components:
Component User facing? Component’s role in the capability
Service Provider Batch Processing Services no XSEDE's HPC Service Providers (SPs) provide batch processing systems on their resources. The batch processing system accepts tasks to be executed on the resource into one or more queues, schedules the tasks in each queue according to the queue's scheduling policy, then executes the tasks on the resource as scheduled. This batch processing system processes the tasks described in this use case when they are submitted by the dependency manager.