Difference: WebHome (r8 vs. r7)

NRAO Science Ready Data Products

The Science Ready Data Products (SRDP) project is an will maximize the cutting-edge science enabled by NRAO Telescopes through:

  • Decreasing the barriers to using our facilities to the broader astronomical community.
  • Allowing our existing user-base to focus more on science and less on data reduction
  • Curating a rich archive of images for archival study

The SRDP project will develop and implement the software tools, scientific heuristics, and operations structures to deliver science quality data product to the NRAO user community, both as it exists now, and the foreseen expansion of the community to include non-traditional radio astronomers. The SRDP Project complements, supports, and extends the ongoing efforts of the ALMA and VLA data reduction pipelines as well as the VLA Sky Survey.

The large data volumes, and relatively high compute load of the next generation of telescopes cannot be sustained by current data processing models. Radio astronomy is transitioning to data processing as a service models to meet this challenge. The NRAO SRDP project delivers this capability for the existing NRAO telescopes and prepares for the next generation VLA.

SRDP Project Related News

Available Information

Requirements Committee

Draft stakeholder requirements for the SRDP project are being developed by an internal committee and will be reviewed by the NRAO Users Committee and CASA Users Committee prior to the beginning of implementation. The draft version is currently in preparation, and will be made available here once it has been completed.

The requirements committee encompasses NRAO staff from across the observatory and was designed to be inclusive of individual with varied experience and roles in the observatory. The current membership of the requirements committee is:

Claire Chandler Josh Marvil
Rafael Hiriart Drew Medlin
Amanda Kepley Eric Murphy
Daniel Lyons Catarina Ubach

In addition to the above committee members Walter Brisken and James Robnett attend the meetings as observers to give expert advice.

This group has identified nine key use cases which define the overall scope of the project these are:

  • Standard Calibration the automated generation of a science quality assured calibration for supported observational modes.
  • Standard Imaging the automated generation of science quality assured images for supported observational modes. Objective is a homogeneous set of images in the archive to support telescope and archive users.
  • Optimized Imaging targeted generation of science quality assured images as requested by a science user. Images will be quality assured (in conjunction with the user) and delivered to both the requestor and to the archive.
  • Data Delivery describes the process by which SRDP products are made accessible to user, this includes an archive interface that supports data discovery and exploration.
  • Restore one or more measurement sets to the calibrated and flagged state they were at the end of the standard calibration process. The calibrated measurement sets might be delivered to the PI directly or serve as the initial state for other processes.
  • Recalibration is the process of redoing a calibration, either with a different version of the supporting software tools, or with additional inputs from the user. Quality assured recalibration products are stored in the archive.
  • Combined Imaging takes data taken from multiple configurations (including the ALMA Total Power Array) to produce quality assured images with better flux recovery.
  • Time Critical Observationís modifies the standard processes to support triggered and target of opportunity observations.
  • Large Projects represent a large investment both on the part of the observatory, and the user. This use case focuses on maximizing the return to all stakeholders, and leveraging the special relationship between these projects and the observatory.
  • Curation and Reproducibility describes how the SRDP project will assist the NRAO user community in documenting reproducible data reduction processes.
  • Use Cases: Use cases and questions to be answered

SRDP Web Utilities

View topic | View difference side by side | History: r10 < r9 < r8 < r7 | More topic actions
 
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback