1 / 45

Important ESDIS 2009 tasks review

Annual review highlights updates to HDF-EOS website tools, examples, and software evaluation for better data access. Statistical analysis and future work plans are discussed. Current phase focuses on enhancing OPeNDAP handler for HDF5 and HDF4 data streams.

susanwalker
Download Presentation

Important ESDIS 2009 tasks review

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, 2010 Annual briefing to ESDIS

  2. Outline • HDF-EOS Website • HDF OPeNDAP support • HDF-EOS5 Augmentation tool Annual briefing to ESDIS

  3. HDF-EOS Web Sitehttp://hdfeos.org Annual briefing to ESDIS

  4. Main page:http://hdfeos.org New Webpage Old Webpage • Reorganize the overall structure • Update the main page 12/20/2019 Annual briefing to ESDIS 4

  5. Help: http://www.hdfeos.org/help 12/20/2019 Annual briefing to ESDIS 5

  6. Examples Added a new “Examples” section - C, Fortran, IDL and MatLab examples to access HDF-EOS2 and HDF-EOS5 Grid and Swath files - Examples on how to use tools such as HEG, GrADS, NCL, Using IDV via OPeNDAP to access HDF-EOS 2 and HDF-EOS5 data Annual briefing to ESDIS 6

  7. Software Evaluated 35 tools and libraries Added 11 tools and libraries Added detailed descriptions November 3-5, 2009 HDF/HDF-EOS Workshop XIII Annual briefing to ESDIS 7

  8. Forum November 3-5, 2009 HDF/HDF-EOS Workshop XIII Annual briefing to ESDIS 8

  9. HDF-EOS website statistics Current Period: Nov. 1st 2009 – Feb. 28th 2010 Previous Period: July 4th 2009 – Oct. 31st 2009 Annual briefing to ESDIS

  10. Definitions Visits – The total number of visits to the website. Pageviews – The total number of pages viewed on the website. Repeated views of a single page are counted. Pages/Visit – The average number of page views per visitor. Bounce Rate – The percentage of single-page visits. (Total number of visits viewing one page) / (Total number of visits) Avg. Time on Site – The average visit duration. % New visits – The percentage of visits by people who had never visited the website before. Organic – Web traffic which comes from unpaid listing at search engines or directories. Annual briefing to ESDIS

  11. HDF-EOS Website Statistics Comparison Oct Jul Aug Sep Annual briefing to ESDIS

  12. Month by Month Visits Comparison Annual briefing to ESDIS

  13. Traffic Sources - Visitors who typed in the URL directly • Visitors who clicked a link from another • website - Visitors who used a search engine Annual briefing to ESDIS

  14. Annual briefing to ESDIS

  15. Pageviews Annual briefing to ESDIS

  16. Top Pages Viewed Annual briefing to ESDIS

  17. Annual briefing to ESDIS

  18. Annual briefing to ESDIS

  19. Annual briefing to ESDIS

  20. Annual briefing to ESDIS

  21. Current work Annual briefing to ESDIS

  22. Current Work • Collect sample files for NASA HDF4/HDF-EOS2 products • Provide special HDF-EOS description for each sample file • Examine the access of each sample file with widely used tools • Provide the codes and the plots generated from the tools for each sample file Annual briefing to ESDIS

  23. Tools to access the HDF data • NCL • MatLab • IDL Annual briefing to ESDIS

  24. Datapool Example 12/20/2019 Annual briefing to ESDIS 24

  25. HDF OPeNDAP Work Update Annual briefing to ESDIS

  26. HDF5 –OPeNDAP Handler • Four official releases from OPeNDAP website • The latest release date is February 2010 • Add the support for HDF-EOS5 Aura swath files • Aura MLS, OMI, HIRDLS files are served via OPeNDAP • URL: http://opendap.org/download/hdf5_handler.html Annual briefing to ESDIS

  27. Access Aura MLS data via OPeNDAP http://hdfeos.org/software/ncl_opendap_mls.php Annual briefing to ESDIS

  28. HDF4 OPeNDAP Handler Annual briefing to ESDIS

  29. Phase 1 work review • Time: April 2009 – October 2009 • Enhanced the original HDF4-OPeNDAP handler • Some HDF-EOS2 data can be served via OPeNDAP • Provided a version to GES DISC Annual briefing to ESDIS

  30. Phase 2 work • Time: November 2009 – July 2010 • Goal: Enhance the HDF4-OPeNDAP handler so that more NASA HDF-EOS2 and HDF4 data can be served via OPeNDAP Annual briefing to ESDIS

  31. Phase 2 work • Comprehensive examinations of all NASA HDF-EOS2 data products - NASA Data pool in the previous slides • Come up with the re-design based on the examinations • Re-implement the HDF-EOS2 module of HDF4-OPeNDAP handler • Add the support for handling some NASA pure HDF4 data Annual briefing to ESDIS

  32. Phase 2 - Current Status • We finished the examination of NASA HDF-EOS2 products • We finished the design note of HDF-EOS2 module of HDF4-OPeNDAP handler • We finished implementing 90% features of the HDF-EOS2 module • We provided a customized version for GES DISC to test Annual briefing to ESDIS

  33. Phase 2 – Current Work Highlights • Focus on making the data accessible by Java-based OPeNDAP clients • Strictly Follow CF/COARD conventions • Handle different HDF-EOS2 cases Annual briefing to ESDIS

  34. Phase 2 work plan • Time: Now to July 14th, 2010 • Finish all features for the HDF-EOS2 module • Handle Hybrid HDF-EOS2 files • Handle some NASA HDF4 files Annual briefing to ESDIS

  35. HDF-EOS5 augmentation tool Annual briefing to ESDIS

  36. HDF-EOS5 and NetCDF-4 • Enabling NetCDF4 to access HDF-EOS5 data • Conversion • Augmentation • One file can be used for both EOS5 and NetCDF-4. • Note that EOS5 users are not affected at all. NetCDF-4 file Augmentation HDF-EOS5 file HDF-EOS5 Augmented HDF-EOS5 file NetCDF4 HDF5 HDF5 Annual briefing to ESDIS

  37. Goals • Augmented file must be readable through • NetCDF-4 API as well as HDF-EOS5 API • How? • Read info in theHDF-EOS5 part. • Transform it to conform to NetCDF-4 model. . • Append the new info. + = Annual briefing to ESDIS

  38. Past Work Review Collected and Examined different HDF-EOS5 data • Not all Aura HDF-EOS5 files use projection for storing dimension values. • For example, OMI L2G grid files store lat/lon in data fields. • TES grid files use both ways. Annual briefing to ESDIS

  39. Past Work Review Provided a customized version for HIRDLS team • To follow the netCDF4 data model, we need users to provide the information about the dimension fields. • MLS and HIRDLS data are vertical profilers. The dimension fields are Pressure and Time. • We need similar information for other instruments. Annual briefing to ESDIS

  40. Future Work • Handle other cases: OMI L2G,future HIRDLS/MLS grid • Design a general input file for insufficient information • Continue testing with NetCDF-4 snapshots • Consistency checker • If one modifies dim info in an augmented file, file becomes inconsistent. • Testing, Documentation Annual briefing to ESDIS

  41. Thank You! Annual briefing to ESDIS

  42. Acknowledgements This work was supported by the Cooperative Agreement with the National Aeronautics and Space Administration (NASA) under NASA grant NNX06AC83A and NNX08A077A. Any opinions, findings, conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of NASA. Annual briefing to ESDIS

  43. Questions/comments? Annual briefing to ESDIS

  44. Backup slides Annual briefing to ESDIS

  45. Role of HDF4-OPeNDAP handler OPeNDAP Clients OPeNDAP HDF-EOS2 HDF4-OPeNDAP handler Annual briefing to ESDIS

More Related