04 - Search SA Process
| Related Page | Link |
|---|---|
| Composite Application | 04 - Science Data Search Management |
Scope
The scope of the Search and Discover Process covers the capabilities to discover the processed data holdings of the data center and to review and select datasets for download. Raw Data distribution is handled by special request, and therefore gets routed to Operations Support processes for approval and fulfillment.
Goals
Goals |
|---|
| Support the discovery of Processed Datasets |
| Enable the review and selection of Processed Datasets prior to download of full resolution data |
| Enable cursory evaluation of data quality prior to download (e.g., quality framework and mini-movies) |
| Enable the request for distribution of results |
| Constrain requested distribution based upon rules for authentication |
Key Concept: Dataset Inventory
When a Recipe Run produces output Frames, they are grouped together as a dataset. The dataset has metadata used for its discovery that apply to the set of Frames in the dataset.
Key Concept Embargo
A data embargo applies to the download of science frames specifically as opposed to its metadata, which remains visible regardless of embargo status. Embargo ACLs are applied at the time of proposal metadata ingest and are applied independently from data ingest/processing based upon the data received from ops tools.
Search
The Search process is responsible for enabling users to discover the Processed Data holdings of the Data Center. The primary methods for executing this search are via the web site or User Tools, which is a Data Center library implementing the Data Center Search API. Authorization is not required to perform a search, though it is required to see any embargoed proposals. The search criteria and responses are expected to evolve over time as they are adapted to user feedback and needs. The latest list of both (query criteria and display responses) can be found in the dataset searcher's docs: https://api.dkistdc.nso.edu/datasets/docs#/default/get_datasets_v1_get
Review Results
The Review Results process is responsible for displaying to users the results of their queries and facilitating further filtering.
