HTC-02: Run a set of interrelated jobs on an HTC resource

Executive Summary: 
A researcher needs to run one or more applications many times with varying inputs on a single community high-throughput computing (HTC) resource. Each application run is called a “job.” The complete set of jobs is called a “project.” Some jobs may use the outputs of other jobs as their inputs. (This is called a “dependency.”) Once the jobs and dependencies are specified to the system, the system executes them without further involvement by the researcher.
User Importance Summary: 
Some research projects require a large sequence or pattern of jobs to be executed on one or more HTC resources. The human labor to manage individual jobs is a poor use of time for highly skilled researchers. A workflow system that automates job submission and management improves research productivity.
Target Communities and Sizes: 
Researchers - 1,000 < N < 10,000 Educators who use community resources - 100 < N < 1,000 Science gateway developers - 100 < N < 1,000
Documents:
Full description (public)
Full description (for review)
Full description (drafting version)
Capability delivery plan
Status: 
Approved
Use Case End User: 
researchers
educators
science gateway developers
Area: 
Scientific Computing
Sub-Area: 
High Throughput Computing
First Proposed Date: 
2013-05-30
Last Approved Date: 
2019-08-16

National Science Foundation (NSF)

© ACCESS All Rights Reserved.

ACCESS is an advanced computing and data resource supported by the National Science Foundation and made possible through these lead institutions and their partners:
Carnegie Mellon University, University of Colorado Boulder, University of Illinois at Urbana-Champaign, and State University of New York at Buffalo .


Administrative Login