1 / 17

Using ADL for NPP Climate Raw Data Record Production

Using ADL for NPP Climate Raw Data Record Production. James C. Biard Cooperative Institute for Climate and Satellites – NC (CICS-NC)* North Carolina State University, Asheville, NC USA, and NOAA’s National Climatic Data Center (NCDC ) Climate Data Record Program Asheville, NC USA.

hope-gibbs
Download Presentation

Using ADL for NPP Climate Raw Data Record Production

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using ADL for NPP Climate Raw Data Record Production James C. Biard Cooperative Institute for Climate and Satellites – NC (CICS-NC)* North Carolina State University, Asheville, NC USA, and NOAA’s National Climatic Data Center (NCDC) Climate Data Record Program Asheville, NC USA

  2. What is a Climate Raw Data Record? A C-RDR is an intermediate step between a Raw Data Record and a Sensor Data Record. Raw measurements collected into time series variables, accompanied by the coefficients and tables needed to convert them to science units and calibrate them. (NOAA Level 1b) Needed for climatescience processing done many years from now.

  3. C-RDR Features • Standards-based Platform Independence • netCDF-4 • Measurements, Processing Coefficients, and LUTs stored as variables (no C structs). • Robust Metadata • Each variable annotated with information extracted from the CDFCB-X and MDFCB. • Climate and Forecast Conventions • Attribute Convention for Dataset Discovery • Includes relevant NPP file-level metadata

  4. C-RDR Data Products • C-RDRs planned for ATMS, CrIS, OMPS, and VIIRS. • One C-RDR contains two types of files: • Data files (contain raw data from RDRs) • Support Data (SD) files (contain PCs and LUTS) • VIIRS C-RDR to go into production in January 2013.

  5. ADL: The perfect C-RDR application framework Provides all the code needed to access the raw measurements, PCs, and LUTs Able to decompress images, perform geolocation, etc Object-oriented design allows for customization without modification of framework source code Was able to build a C-RDR framework layer

  6. C-RDR Framework • Two types of applications needed for each product (ATMS, CrIS, OMPS, & VIIRS) • C-RDR Packer (RDRs to C-RDRs) • Support Data Packer (AUX files to C-RDR SDs) • Two types of applications needed for verification testing • C-RDR Unpacker (C-RDRs to SDRs) • Support Data Unpacker (C-RDR SDs to AUX files)

  7. Basic ADL Application Structure

  8. C-RDR Packer Requirements Do per-job initializations common to all C-RDR packer algorithms (reading C-RDR-specific config parameters, creating output netCDF file, …). Do common per-granule initializations. Do common per-job finalizations (writing file-level metadata, closing output netCDF file, …).

  9. C-RDR Packer Implementation

  10. C-RDR Support Data Packer Implementation

  11. C-RDR Support Data Unpacker Requirements Create “binary blob” AUX files from the input C-RDR SD file. Populate “.asc” metadata files for the AUX files with values from the input C-RDR SD file.

  12. C-RDR Support Data Unpacker Implementation

  13. C-RDR Unpacker Requirements Populate task list from science data granules in the input C-RDR file. Populate the input map with spacecraft diary granules from the input C-RDR file. Put appropriate metadata on all input and output data objects so that processing can continue as if the data came from original “binary blob” RDR files.

  14. C-RDR Unpacker Implementation

  15. Raw VIIRS Image from C-RDR

  16. Conclusions The ADL framework is complex, but provides ample room for customization. Finding the right method to override can be tricky. ADL saved the C-RDR project a tremendous amount of time.

  17. For more information: Jim Biard – jim.biard@noaa.gov Drew Saunders – drew.saunders@noaa.gov Linda Copley – linda.copley@noaa.gov This work was supported by NOAA through the Cooperative Institute for Climate and Satellites - North Carolina under Cooperative Agreement NA09NES4400006 This work is a project of the NOAA NCDC Climate Data Record Program

More Related