XSEDE Capability Delivery Plan for "CB-15: Develop an application or gateway that submits tasks to any of the high-throughput computing queues available to a campus"
Use Case CB-15: Develop an application or gateway that submits tasks to any of the high-throughput computing queues available to a campusArea: Community Building
URLs: Public, Review
Executive Summary: An application developer or science gateway developer needs to write an application that submits computation tasks to one or more of the high-throughput computing (HTC) resources available to his or her campus.
First CDP: 2019-01-15
Current CDP: 2019-01-15
- XCI-539: Present campus queue idea to campus champions and gauge response
- XCI-540: Package campus queue distribution
In addition to the two JIRA activities listed here, the XCRI team would need to do the following things for each campus that elects to use the campus queue distribution.
- Roughly twenty hours (2.5 person-days) per campus of XCRI staff effort for configuration and integration with local authentication, storage and other local infrastructures. This per-campus effort will diminish over time as we integrate the campus queue with more common infrastructure components.
- Roughly 1-2 person-days per unique application to script the job submission step.
XSEDE does not currently offer this capability. The current proposal is to present the idea to XSEDE campus champions and gauge their reactions to judge whether further effort is worthwhile. (This would be less than one day of effort for the XCRI team.) Assuming the reaction is favorable, we could proceed with the 2 person-week packaging task (see JIRA link), begin deployments on campuses, and begin work with campus developers to use the campus queue in their applications.