DKIST Level 1 Data Product Identifiers
The DKIST Data Center has created a new identifier for calibrated level 1 datasets, called the Product ID. This can be found on the details page for each dataset. The Product ID will become the primary reference ID for DKIST data going forward and will be the identifier listed in search results on the Data Portal shortly.
Why do we need another identifier?
The primary reason for a new identifier is one of persistence. Every time the DKIST dataset is recalibrated, it is given a new Dataset ID. However the Product ID will persist through recalibrations of the datasets. To encourage use of the Product ID, it has now been added to the search filters on the DKIST Data Center Portal
If you search by Product ID you will get a page much like the dataset details page. Below is an example of the search for Product ID L1-SRHKN.
In addition at the bottom of the dataset search (and by extension the Product ID search) is a processing / reprocessing history for the Product ID. This shows the Dataset ID of the current dataset, the previous ID and in future the older version of the dataset / Dataset ID which will have been deleted from the archive1.
In summary, the Data Center has created a new identifier, Product ID, which is associated one-to-one with a particular dataset. Although the Dataset ID, will change when datasets are reprocessed, the Product ID will not. You can also track the evolution of a Product ID at the bottom of the details page. In citing the datasets used in papers, we recommend that you use the Product ID. If you have any further questions about the Product ID, you can submit a question to the DKIST Data Center Help Desk.
Alisdair Davey
DKIST Data Center Scientist
1 As a reminder any version of a dataset can be regenerated should it be required.