02 - External Data Management
Design Diagram
The External Data Management Composite Application supports the 02 - External Data Receipt and Ingest SA Process. The application services that interact with the external systems (e.g., Ops Tools and DKIST Operations) are all ReST endpoints awaiting data to be posted to them. Posts are authorized by verifying the value of the posted authentication token to the one held in the KV store of 01 - System Orchestration (DC Cloud). The Embargoed Proposal Ingester, Proposal Investigator Ingester and Experiment Description Ingester all ingest their data into the 07 - Metadata Store (03 - Search Support). The Data Acquisition Support Ingester and the Calibration Parameter Value Ingester both ingest their data into the 07 - Metadata Store (01 - Processing Support). Data that doesn't pass schema validation is rejected and responsibility for resolution handled by the posting system. The Data Acquisition Support Ingest service supports additional business rules (seen in the Data Acquisition Support Data Ingest Process), which can cause an ingest failure that is not resolvable by the posting system, and is therefore instead handled by generating a work ticket for Data Center operations to resolve. Work ticket generation is handled by the Ticket Requester, which decouples a service needing a ticket from the 02 - Ticketing system via the 06 - Interservice Bus.