1 / 18

Support for NPP/NPOESS by The HDF Group

Support for NPP/NPOESS by The HDF Group. Mike Folk, Elena Pourmal The HDF Group Annual HDF Briefing to ESDIS March 31, 2009. To develop and adapt HDF5 software and provide HDF5 support for NPP/NPOESS. Goal. NPOESS Priorities and HDF5. Data calibration/validation

laurawatson
Download Presentation

Support for NPP/NPOESS by The HDF Group

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Support for NPP/NPOESS by The HDF Group Mike Folk, Elena Pourmal The HDF Group Annual HDF Briefing to ESDIS March 31, 2009 Annual HDF Briefing to ESDIS

  2. To develop and adapt HDF5 software and provide HDF5 support for NPP/NPOESS. Goal Annual HDF Briefing to ESDIS

  3. NPOESS Priorities and HDF5 • Data calibration/validation • Data accessibility and usability • Tool development • System maintenance • User support Annual HDF Briefing to ESDIS

  4. Areas of immediate need • Ensure easy and intuitive access and use by diverse communities • Enable producers and consumers to view content, manage metadata, and convert data to other formats. • Provide high-quality, rapid-response support of HDF5 for NPOESS users at all levels. Annual HDF Briefing to ESDIS

  5. 1. Ensure easy and intuitive data access and use by diverse communities Annual HDF Briefing to ESDIS

  6. Region references Root -/ Product Group Agg Root - / Reference Object Data Array Gran N Reference Region Reference Region Annual HDF Briefing to ESDIS

  7. New routines to facilitate data access • Access data pointed to by region references • Retrieving data pointed to by region references requires a series of complex function calls. • New API would encapsulate these into a few routines. • Rewrite region references in datasets • When a dataset with region references is moved from one file to another, the references of the datasets are invalid in the new file. • The process of updating reference values is complex and error prone. • New functions can address both of these concerns. Annual HDF Briefing to ESDIS

  8. Access individual quality flags. • NPOESS quality flags are packed into an integer. • In HDF5, integer types are “atomic” – any I/O operation access an entire integer. • To access individual NPOESS quality flags in a convenient and consistent manner, routines are needed that can unpack and return individual quality flags represented by bits packed in an HDF5 integer. Annual HDF Briefing to ESDIS

  9. 2. Enable producers and consumers to view content, manage metadata, and convert data to other formats. Annual HDF Briefing to ESDIS

  10. Tools enhancements • There is interest in tools to view and export packed quality flag values, as well as data pointed to by region references. • Tools of particular interest: • h5dump – a command line utility for dumping information from an HDF5 file. • HDFView – a graphical tool for displaying and editing the contents of HDF5 files. Annual HDF Briefing to ESDIS

  11. Tool enhancements • H5dump modifications • Extract, display, and export a subset of packed bits corresponding to NPOESS quality flags. • Extract, display, and export data pointed to by region references. • HDFView modifications • Display a rectangular region of data in a dataset corresponding to set of region references. • Display packed bits corresponding to the NPOESS quality flags. Annual HDF Briefing to ESDIS

  12. 3. Provide high-quality, rapid-response support of HDF5 for NPOESS users at all levels. Annual HDF Briefing to ESDIS

  13. Support enhancements • Assign high priority to helpdesk requests from the NPOESS user community, and ensure a one business-day response to all queries known to be NPOESS-related. • Support HDF5 on AIX 5.2. Annual HDF Briefing to ESDIS

  14. Status • Region reference • API • Initial design defined, implemented • Requirements/design draft doc, RFC • Tools • H5dump, HDFView: gathering requirements • Quality flags • API: requirements/design draft doc, RFC • Tools: just starting to think about Annual HDF Briefing to ESDIS

  15. Status • HDF5 support • Small but steady stream of requests to helpdesk from NPP/NPOESS community • Request range from simple questions to requests for new features • AIX 5.2 • AIX 5.3 tested daily on borrowed system • Hoping to get access on IDPS system at NASA Annual HDF Briefing to ESDIS

  16. Future plans • Complete current tasks by August 31, 2009. • Working on long-term agreement to continue the same three-pronged approach • Technology development to improve usability for users of NPOESS/NPP data products • High quality, rapid response support to NPOESS/NPP HDF5 users at all levels • System maintenance and support Annual HDF Briefing to ESDIS

  17. Thank You! This report is based upon work to be supported by a Cooperative Agreement with NASA under NASA contract NNG08HZ14C. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Aeronautics and Space Administration. Annual HDF Briefing to ESDIS

  18. Questions/comments? Annual HDF Briefing to ESDIS

More Related