Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Summary

The DKIST Data Center Archive (DC) provides calibrated (a.k.a. Level 1, “L1”) data to the community via the User Portal for download. It does not generally provide general access to raw (a.k.a. Level 0, “L0”) data. However, special requests can be made using a request form to the DC for raw data files for certain instruments. If the user has a justified reason to get these raw data, they can make a request to the DC for access. Requests will be reviewed on a case by case basis. It is assumed that a user will already have downloaded the L1 data before requesting the raw data. You are required to specify the dataset IDs from the L1 data that corresponds to the raw data you wish to download. Raw data is not searchable and cannot be filtered by instrument or other similar parameters. If the request is approved, the user will receive ALL the raw data for at least one observing program as executed at the telescope. 

...

Note

Warning: Raw data requests are for experts only. The dataset sizes are massive and working with these data requires a large amount of storage and processing power.

Info
Nearly all

Please note that VBI raw data is

speckle reconstructed and this data is then transferred to the data center. In such cases unreconstructed VBI data will not be available. If you requested unreconstructed data in your proposal, then this data will still have gain and dark corrections applied. If you are going to need unreconstructed VBI data, you must request it in your proposal

NOT available for request.

Info

Submitting a raw data request does NOT guarantee that the request will be granted. Requests will be vetted on a case by case basis. Note that proprietary data can only be released to the PI and proposal team members.

Requests will be reviewed by a DKIST committee that will vet the request based on:

  1. How does the request (if granted) benefit the solar community?

  2. How does the request (if granted) benefit DKIST (e.g. donated improvement to calibration pipeline)?

...

  1. The user must have an active Globus account (see: How to create a globus account (for DKIST data))

  2. The user must have an active endpoint for Globus data transfers (see: Globus Connect & Endpoints)

  3. The user should already have downloaded and looked at the Level 1 datasets

Instructions

  1. Visit the DKIST Data Portal Raw Data request form (link available soon).

  2. Log into the Data Portal if you have not already.

  3. Fill in the following mandatory fields on the request form; please be as descriptive as possible:

    1. Datasets Requested: Dataset ID(s) where the FITS header keyword = “DSETID” in the L1 data

    2. Justification: Statement for the reason for this raw data request

...

Filter by label (Content by label)
showLabelsfalse
max5
spacescom.atlassian.confluence.content.render.xhtml.model.resource.identifiers.SpaceResourceIdentifier@200014
showSpacefalse
sortmodified
showSpacetypefalsepage
reversetrue
typelabelspageDC pipeline calibration
cqllabel in ( "calibration" , "pipeline" , "dc" , "data-center" , "data" , "portal" ) and type = "page"labelsDC pipeline calibration
Page Properties
hiddentrue

Related issues