JIRA Issue

[#XCI-419] Gateway attribute submission improvements for 2018

[XCI-419] Gateway attribute submission improvements for 2018 Created: 07/18/2018  Updated: 05/17/2019

Status: Design Review
Project: XSEDE Cyberinfrastructure Integration
Component/s: Gateway Submit Attributes, XSEDE Central Database (XCDB)
Fix Version/s: PY8 (Sep '18 - Aug '19)

Type: XCI Enhanced Capability Priority: Major
Reporter: JP Navarro Assignee: JP Navarro
Resolution: Unresolved Votes: 0

Attachments: PDF File XCI-419_Gateway Attribute Submission Improvements.pdf    
Target Operator:
XSEDE Enterprise Services, XSEDE Science Gateways
XSEDE Priority: 4.0 ECSS management
Public activity link: https://software.xsede.org/display/xci-419
Devel Repository: https://software.xsede.org/svn/xci/activities/xci-419/trunk/
Use Cases:
CAN-01: Run a Remote Job, SGW-03: Science Gateway community execution management
Effort and Costs:
Staff Name (Lastname, Firstname) Effort (person weeks) Roles or Contributions Status
Chourasia, Amit 1 Lead and facilitator none
Sakai, Scott 4 Design, implementation, and documentation none
Shapiro, Mike 1 XCDB and server side integration none
Pierce, Marlon; Sinkovits, Robert; Wilkins-Diehr, Nancy 0.1 Advisors none
Pamidihantam, Sudhakar; Abeysinghe, Eroma 0.5 Tester none
Chourasia, Amit + All current gateway admins 6 Work with all current gateway admins to update none
Chourasia, Amit + Gallo, Steven  + Shapiro, Mike TBD XDMod Integration none
Due by Activity Deliverable
by DSR Design document* (see attachments)
by TRR Implemented Software Capability
by TRR User (Gateway) documentation
by TRR Deployment plan*
by TRR Test plan*
by TRR (post) TRR Baseline* (Shava)
by Deployment Deployment Baseline* (Shava)
by Deployment Test Report* (Shava)
  • Click on "Deliverables" tab for URL.
Planned Launch Date:
Actual Launch Date:
Planned Design Review Date:
Actual Design Review Date:
Planned Test Readiness Review Date:
Planned Complete Date:
Activity Lead: Amit Chourasia
Lead Tester: Shava Smallen
Design Document: https://jira.xsede.org/secure/attachment/14159/XCI-419_Gateway%20Attribute%20Submission%20Improvements.pdf


Revisit the gateway attributes submission process to address the following issues and the fact that it is not used as widely as we would like:

  • Each SP has separate documentation and usage methods
  • SPs need to install and manage submission clients. This is not only burdensome to SPs, but also to gateways as they can’t submit attributes from compute nodes
  • APIKeys reside with SPs, which requires complex security and client processes
  • Older gateways may be using direct submission to database rather than REST API
  • Any user on an SP’s resource may submit gateway attributes for any gateway
  • Gateway attributes received by the REST API do not capture the user who submitted them, leading to concerns over data integrity
  • Gateway attributes received by the REST API do not undergo checks for consistency, leading to malformed or inconsistent data (e.g. the staging table contains many entries for a “gmail.com” gateway)

This activity will overhaul the REST API interface, submission process, and documentation to resolve the above issues and make improvements to usability as well as maintainability.


There are comments for XCI-419 that can be viewed with XSEDE authentication.