JIRA Issue

[#XCI-672] CVMFS repository hosting

[XCI-672] CVMFS repository hosting Created: 10/25/2019  Updated: 12/20/2019

Status: Proposed
Project: XSEDE Cyberinfrastructure Integration
Component/s: None
Fix Version/s: PY9 (Sep '19 - Aug '20)

Type: XCI New Capability Priority: Normal
Reporter: Lee Liming Assignee: Unassigned
Resolution: Unresolved Votes: 0

Issue Links:
is blocked by XCI-656 Pilot XSEDE CVMFS service In Progress
XSEDE Priority: 3.6 UREP
Use Case Priority: Medium
Public activity link: https://software.xsede.org/display/xci-672
Devel Repository:
Use Cases:
RC-10: Create or modify the contents of a repository that will be accessed on many resources, SPI-11: Host a repository of files so it can be accessed on many resources and manually populated by authorized individuals, SPI-12: Host a repository of files so it can be accessed on many resources and automatically populated
Effort and Costs:
Staff Name (Lastname, Firstname) Effort (person weeks) Roles or Contributions Status
<Activity Lead Name – Last, First> 6 six weeks of effort to lead and implement the activity (required) none
<User Doc Drafter – Last, First> 0.2 one day of effort to draft user documentation (required ) none
TBD (tester) 1 one week of effort to test the software none
... ... .. none
Due by Activity Deliverable
DSR Design document*
TRR Implemented Software Capability
TRR Other type of deliverable
TRR Deployment plan*
TRR Test plan*
TRR User documentation*
TRR (post) TRR Baseline* (Shava)
Deployment Deployment Baseline* (Shava)
Deployment Test Report* (Shava)
  • Click on "Deliverables" tab for URL.
Lead Tester: Shava Smallen Shava Smallen


CVMFS is a scalable remote filesystem service that provides read-only access to remotely hosted filesystems. It is used in the Open Science Grid, Compute Canada, and Galaxy communities.

At present, XSEDE does not provide a service for hosting CVMFS repositories. When CvMFS is used on XSEDE resources, the repositories are hosted by Open Science Grid, Compute Canada, or the research community itself (e.g., Galaxy). Hosting a repository requires a robust IT support team, which puts it beyond the abilities of many research teams who would otherwise find CVFMS valuable in their research computing work.

This activity is to create a new XSEDE capability for hosting CVMFS repositories on behalf of research teams that use XSEDE resources. The goal is to provide a new option for research teams that would like to use CVMFS in their work: have XSEDE host the repository(ies) they use.

As a "new capability" activity, the following elements should be included in the plan:

  1. A design document explaining what the capability is, what the user experience should be, and how it will be implemented in XSEDE.
  2. A design & security review, in which important support and security issues are raised and resolved.
  3. Development of new XSEDE documentation, software packages or installers, and support processes as detailed in the design document.
  4. Additions to XSEDE's software & services registry and other information services for tracking deployment and status of the new capability.