XSEDE Capability Delivery Plan for "CAN-02: Managed File Transfer"
Use Case CAN-02: Managed File Transfer
Area: Enabling FunctionsURLs: Public, Review
Executive Summary: An XSEDE user needs to request the transfer of one or more files and/or directories from one file system to another. Once the request is made, the system must accomplish the transfer without interrupting the user unnecessarily. Significant requirements are that the system must be able to automatically recover from transient faults (reliability, robustness), reliably handle requests involving thousands to hundreds of thousands of individual files, reliably handle requests that require more than 24 hours to complete, and must be able to satisfactorily utilize high-bandwidth (~10Gb/s) wide-area network connections.
First CDP: 2016-06-01
Current CDP: 2016-06-01
- XCI-430: In CAN-02, "last accessed" timestamps cannot be synchronized across systems
- XCI-431: Cannot guarantee that file transfers will use 50% of theoretical maximum throughput
No effort is proposed at this time.
The functionality described in this use case is fully supported by the operational components listed here, with only a few minor gaps that will not be addressed at this time.
| Component | User facing? | Component’s role in the capability |
|---|---|---|
| Globus Auth | yes | Provides the ability for the user to authenticate to Globus Transfer using XSEDE-accepted credentials (including federated identity providers) |
| Globus Connect Server | no | Used by XSEDE SPs, campus IT providers, and end users to create endpoints from which and to which Globus Transfer can transfer files |
| Globus Toolkit GridFTP Service | no | Used by XSEDE SPs, campus IT providers, and end users to create endpoints from which and to which Globus Transfer can transfer files |
| Globus Transfer | yes | The hosted web application accessed by users via a web browser to select the file transfer source and destination and initiate, monitor, or cancel transfers, as well as managing the quality attributes regarding reliability, performance, scalability, and history accessibility. It also supports synchronizing a source file or directory to a destination, SSH-accessible commandline interface and a RESTful web API for application integration. |
| OAuth for MyProxy (OA4MP) | no | Used by Globus Transfer to acquires tokens for authenticating to source/destination endpoints |
| XSEDE User Portal (XUP) | yes | The XSEDE User Portal is the primary guide to XSEDE functionality and provides the starting point for the activity described in this use case. |
