1 / 15

ECS-HSA the HEW Subsetting Appliance

ECS-HSA the HEW Subsetting Appliance. HDF-EOS Workshop VII Silver Spring, MD – September 23-25, 2003 Dr. Sara Graves, Bruce Beaumont, Matt Smith Presented by Matt Smith University of Alabama in Huntsville Information Technology and Systems Center http://SUBSET.ORG. Outline. HEW’s History

mcclellana
Download Presentation

ECS-HSA the HEW Subsetting Appliance

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ECS-HSAthe HEW Subsetting Appliance HDF-EOS Workshop VII Silver Spring, MD – September 23-25, 2003 Dr. Sara Graves, Bruce Beaumont, Matt Smith Presented by Matt Smith University of Alabama in Huntsville Information Technology and Systems Center http://SUBSET.ORG HDF-EOS Workshop VII

  2. Outline • HEW’s History • HSA: Integration with ECS • HSE: A new Subsetting Engine • Configuration options HDF-EOS Workshop VII

  3. HEW’s history • HDF-EOS Web-based Subsetter • Prototype software designed to be dataset-independent (HDF-EOS) • Optional Front-end/GUI • Uses HTML forms and JavaScript • Back-end • Needs subset criteria and HDF-EOS data • Performs subsetting as a “batch” job HDF-EOS Workshop VII

  4. HEW Back-end • Uses HDF-EOS (and HDF) library • Instructed via a subset criteria file (ODL) • Handles multiple similar files • Handles Swath and/or Grid objects • Unix (SGI & Sun) executables available • Subsetted output files contain: • StructMetadata (HDF-EOS) • ArchiveMetadata* • ProductMetadata (added by HEW  ODL file) • CoreMetadata* (w/ modified bounding box & time info) • optionally placed in .met file * if present in parent file HDF-EOS Workshop VII

  5. Example Subset Criteria File GROUP = SUBSET PARENT_FILE =(“/AQUA/AMSR/AE_L2A.hdfeos”) LATITUDE_RANGE = (35.000000, 40.000000) LONGITUDE_RANGE = (-77.000000, -72.000000) EMAIL = “matt.smith@msfc.nasa.gov” MET_FILE = YES GROUP = SPOG NAME = “swath_1” TYPE = “SWATH” PARAMETERS = (“89.0V_Res.1_TB”, “89.0V_Res.2_TB”) SUBSAMPLING = (“GeoTrack”, 1, “GeoXtrack”, 1) END_GROUP = SPOG END_GROUP = SUBSET END HDF-EOS Workshop VII

  6. HEW Subsettable datasets EOS DATASETS • Terra • MODIS • MOPITT • ASTER • Aqua • AMSR-E • AIRS • Aura • HIRDLS OTHERS • TRMM • TMI • NOAA-15, 16, 17 • AMSU-A • Any other HDF-EOS datasets written with HDF-EOS calls in mind HDF-EOS Workshop VII

  7. HSA: HEW Subsetting Appliance UAH/ITSC, working with ESDIS, ECS (EOS-DIS Core System), and DAACs, have incorporated the HSA into the ECS, via the EOS-DIS Data Gateway (EDG). Infrastructure written by ITSC/UAH to allow other appliances (subsetting, reprojecting, reformatting, etc.) to be added by other data centers. HDF-EOS Workshop VII

  8. HEW integration with ECS HDF-EOS Workshop VII

  9. ECS integration status • EDG v3.5.1 has basic subsetting options • Operational at NSIDC • Testing at LPDAAC (EDC) • Testing to begin at GDAAC soon • Further enhancements for DAACs HDF-EOS Workshop VII

  10. HSE: HEW Subsetting Engine A new packaging option for the HDF-EOS Subsetter designed for sites that want subsetting, but do not want to host the full HEW installation or even the standalone HEW back-end. HDF-EOS Workshop VII

  11. Existing HEW Back-End Architecture • Front end supplies subsetting criteria file • Subsetter writes messages to status file • Subsetter writes messages to log file • Subsetter sends e-mail to end-user Many sites do not want to create ODL files or the hassle of dealing with message or log files or e-mail. HDF-EOS Workshop VII

  12. New HSE Architecture • User application code builds subsetting criteria structure • Subsetting engine function calls user’s functions for status and log messages • No e-mail is sent All subsetting functionality is contained within a callable function HDF-EOS Workshop VII

  13. HSE Availability • Version 1.0 available mid October 2003 • SOM grids cannot be subsetted yet • Binary object module supplied • Subsetting engine • Utilities to create and manage structures • “Discovery” routines HDF-EOS Workshop VII

  14. Software packaging available Binary distributions available for SGI & Sun • HSE • Object modules (HSE and add’l functions) • HEW • Full front-and back-end • Back-end only HDF-EOS Workshop VII

  15. HDF-EOS Workshop VII

More Related