1 / 17

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC

HDF-EOS Data Extractor & Metadata Updater. Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003. HEEX.

kinsey
Download Presentation

Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. HDF-EOS Data Extractor & Metadata Updater Zhangshi Yin, Jingli Yang, Bob Bane, Muhammad Rabi, Richard Ullman Data Usability Group, NASA/GSFC NASA/GSFC, Code 423 For HDF-EOS Workshop VII September 23-25, 2003

  2. HEEX • HDF-EOS Data Extractor (HEEX) is a tool for data users to extract HDF-EOS data to binary or ASCII data format in HTML or XML.

  3. Motivation • Flat binary and ASCII data are required by some users. • They can be imported to IDL, ARC/INFO and used in any programming. • Extracted flat binary and ASCII data can be another intermediate data format for storing EOS data.

  4. HEEX Flowchart HDF-EOS Data HTML XML Binary Data ASCII Data Binary Data ASCII Data

  5. Usage heex [-aehx] [-f] [FieldName] -o OutputDirectory HDF-EOS5FileName HDF-EOS5FileName: HDF-EOS5 file name. Required. -a Extract data to ASCII format. Default is binary. Optional. -e Extract every field. Optional. -f FieldName: extract a field data specified by objec/field. Optional. If no -e and -f options, only index file, no data. -h Help message. Optional. -o OutputDirectory: the directory to put data. Required. -x Extract IndexFile data to XML format. Default is html. Optional.

  6. Extracted Data • HEEX will extract all data into a directory indicated in -o optional by user.A file called Index.html or Index.xml in the directory will show all HDF-EOS data structure and where data are.

  7. Inex File  -HDFEOS-File Name=grid.he Type="HDFEOS" -HDFEOS -GRIDS -Grid +Parameters +Dimension -GridDataField +sst_mask_1 -HDFEOS_INFORMATION -COREMETADATA +CoreMetadata.0 +ARCHIVEMETADATA

  8. Inex File  -sst_mask_1 DataType=Integer Sign=false Size=1 +DimList +FieldStorage Data: ./Grid/sst_mask_1.dat

  9. HEMU • HDF-EOS Metadata Updater (HEMU) is a tool for data producers or usersto update metadata inside an HDF-EOS file (HDF-EOS2 and HDF-EOS5).

  10. Motivation • Users need to read metadata from HDF-EOS data. • Users need to write metadata files to HDF-EOS data replace all metadata in the HDF-EOS data. • Users need to update metadata in HDF-EOS data by merging metadata inside HDF-EOS data and metadata from .met files.

  11. Capabilities  1. Extract metadata from a dataset (-x option) to a text file which can then be modified with any text editor. This option does not modifythe HDF-EOS file. 2. Replace metadata with text from an external file (-f option). Thetext is syntax-checked for validity as ODL before updating.  3. Update metadata with text from an external file (-m option). Thisoption is designed to update metadata using a .met file.

  12. HEMU Read Flowchart HDF-EOS Data Read CoreMetadata InventoryMetadata ArchiveMetadata Metadata

  13. HEMU Write Flowchart .Met Data HDF-EOS Data Read Metadata Read Metadata Check Syntax Check Syntax Check Values: SHORTNAME PRODUCTIONDATETIME VERSIONID If equal, replace metadata in HDF-EOS using metadata in .met If not equal, exit

  14. HEMU Merge Flowchart .Met Data HDF-EOS Data Read Metadata Read Metadata Check Syntax Check Syntax Check Values: SHORTNAME PRODUCTIONDATETIME VERSIONID If equal, replace metadata in HDF-EOS using CollectionMetadata InventoryMetadata in .met and ArchiveMetadata in HDF-EOS If not equal, exit

  15. Usage  hemu [-h] HDF-EOSFileName -xmf [MetadataFileName] -h Print help message. -x Extract metadata from HDFEOS file. -m Update metadata with a .met file input. -f Forcibly replace metadata with metadata from input. HDF-EOSFileName: HDF-EOS file. Required. MetadataFileName: Metadata file. Optional (default is standard input/output).

  16. Syntax and Value Check • HEMU will check metadata syntax by ODL program. For -m and –f options (update metadata with a .met file), three parameters in INVENTORYMETADATA group (SHORTNAME, PRODUCTIONDATETIME, and VERSIONID) must match before the tool will modify the metadata.

  17. Get HEEX & HEMU   http://hdfeos.gsfc.nasa.gov/hdfeos/index.cfm

More Related