170 likes | 302 Views
An HDF-EOS Data Server Based on OPeNDAP and ECHO. Bob Bane, Mohammad Rabi, Weijun Su, Richard Ullman, Jingli Yang, Zhangshi Yin Data Usability Group, NASA/GSFC. HDF-EOS data access via web. Findable With standard search engines With domain-specific engines Browseable Per-granule web page
E N D
An HDF-EOS Data ServerBased on OPeNDAP and ECHO Bob Bane, Mohammad Rabi, Weijun Su, Richard Ullman, Jingli Yang, Zhangshi Yin Data Usability Group, NASA/GSFC
HDF-EOS data access via web • Findable • With standard search engines • With domain-specific engines • Browseable • Per-granule web page • Readable metadata • Links for fetching data • Retrievable • Whole dataset • Metadata only • Individual fields • Sectorized fields
Intended Audience • Groups that are generating HDF-EOS products • Need a straightforward, inexpensive way to publish them to the web • Major archives already have their own systems - this is for everyone else
Tools used Standard tools Unix shell scripts Apache web server Earth science standards and protocols OPeNDAP ECHO Our tools ODL <-> XML <-> HTML
OPeNDAP “netCDF via HTTP” Also works for HDF 4/5 and HDF-EOS 2/5 http://opendap.org
ECHO EOS ClearingHouse Searchable repository for earth science metadata Based on standard commercial tools Databases E-commerce middleware http://echo.eos.nasa.gov
Our Tools hemu - extracts ODL metadata odl2xml - converts ODL to EOS-compatible XML heex - breaks an HDF-EOS dataset into field files with an HTML/XML table of contents XSLT stylesheets - convert XML to pretty HTML
HDF_EOS files OPeNDAP server Fetch/sectorize hemu heex DODS client ODL metadata Web server Web browser XML contents Field files Browse/fetch odl2xml ECHO client Search/query XML metadata Search engines Pretty HTML XSLT File transfer ECHO XML ECHO server XSLT Web/HTTP Implemented by us Other tools Client-side services
Installation Foundation Unix Apache Java Libraries HDF4/5, HDF-EOS2/5 SDP Toolkit OPeNDAP server Our software heex, odl2xml, hemu heserve scripts
Use Two shell scripts ingest granule-file.hdf Publishes granule to the web echoingest metadata.xml Publishes web links for granule to ECHO Optionally called by ingest
Screen shot Showing link dragged into DODS client
Where is the software? http://hdfeos.gsfc.nasa.gov ’Tools’ link heserve system