1 / 18

Software to access HDF5 Datasets via OPeNDAP

A comprehensive review and status update on accessing HDF5 datasets with OPeNDAP, including challenges, proposed improvements, and ongoing developments presented at the HDF and HDF-EOS Workshop XI in Landover, MD.

delong
Download Presentation

Software to access HDF5 Datasets via OPeNDAP

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Software to access HDF5 Datasets via OPeNDAP MuQun Yang, Hyo-Kyung Lee The HDF Group HDF and HDF-EOS Workshop XI, Landover, MD

  2. Previous work review HDF5-OPeNDAP server: • Incomplete mapping from HDF5 to OPeNDAP • No comprehensive test suite • Only tested a few examples on two platforms • Incomplete documentation HDF5-OPeNDAP client: • No client at all HDF and HDF-EOS Workshop XI, Landover, MD

  3. Previous HDF5-OPeNDAP Support HDF5 DAP Prototyped Server No Client HDF and HDF-EOS Workshop XI, Landover, MD

  4. Proposed work First Year HDF5 HDF5 server Clients: Matlab etc. DAP HDF and HDF-EOS Workshop XI, Landover, MD

  5. Current Status HDF5 HDF5 server Clients: Matlab etc. DAP HDF and HDF-EOS Workshop XI, Landover, MD

  6. HDF and HDF-EOS Workshop XI, Landover, MD

  7. HDF5 Server Status – New Features • Mapping Compound datatype to DAP Structure • *Mapping EOS Grid to DAP Grid • *Mapping HDF5 group to DAP • *Mapping HDF5 object and regional references to DAP DONE HDF and HDF-EOS Workshop XI, Landover, MD

  8. HDF5 Server Status - Test • Code Cleanup – updating to the latest version of HDF5 • Comprehensive testsuite – DejaGNU • Internal Aura EOS file testsuite • Inside OPeNDAP’s nightly build system DONE HDF and HDF-EOS Workshop XI, Landover, MD

  9. HDF5 Server Status – Special Support • Partial Support of CF conventions • Relative Object Path Support • Configuration Options • HDF5-OPeNDAP handler Website DONE HDF and HDF-EOS Workshop XI, Landover, MD

  10. HDF5 Server Status - Documentation • Mapping HDF5 group to DAP -- Done! • Limitations of HDF5-OPeNDAP handler – In progress! • Mapping Object reference to DAP – In Progress! • Experiments with OPeNDAP clients – In Progress! In Progress ! HDF and HDF-EOS Workshop XI, Landover, MD

  11. Using OPeNDAP Clients to serve HDF5 data • Matlab Client – in progress • Testing OPeNDAP Clients to read NASA HDF-EOS5 files • Ferret • ncBrowse • IDV • ODC • GrADS HDF and HDF-EOS Workshop XI, Landover, MD

  12. Several Highlights • HDF5-OPeNDAP Handler Website • Limitations of the current handler • Demo: Visualizing HDF-EOS5 Aura data with existing OPeNDAP clients • Limitations of the existing clients HDF and HDF-EOS Workshop XI, Landover, MD

  13. HDF5 OPeNDAP Website • URL: http://hdfdap.hdfgroup.uiuc.edu:8080/ HDF and HDF-EOS Workshop XI, Landover, MD

  14. Limitations of the handler • No support for HDF5 files that have a '.' inside a group/dataset name • No support for any variable length types except for 1 dimensional variable-length string array • No support for ENUM,BITFIELD,OPAQUE types • 64 bit integer (array) is not supported • Both signed and unsigned char map to Byte HDF and HDF-EOS Workshop XI, Landover, MD

  15. Demo • Ferret • NCBrowser • IDV HDF and HDF-EOS Workshop XI, Landover, MD

  16. Summary of accessing Aura L3G Data via OPeNDAP clients HDF and HDF-EOS Workshop XI, Landover, MD

  17. Second year Plan • High-level HDF5 client • Working with GrADS team • We really would like to hear feedbacks from Users Please send emails to ymuqun@hdfgroup.org hyoklee@hdfgroup.org HDF and HDF-EOS Workshop XI, Landover, MD

  18. Acknowledgement • This work was supported basing upon the Cooperative Agreement with the National Aeronautics and Space Administration (NASA) under NASA grant NNX06AC83A and NNX06AG75A.  Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of NASA.  HDF and HDF-EOS Workshop XI, Landover, MD 18

More Related