1 / 21

Registration/Visualization of Volume Data in netCDF format

Registration/Visualization of Volume Data in netCDF format. Ashraf Memon. Acknowledgement. Chuck Meertens (UNAVCO) Unidata NSF Grant No. 0225673 (GEON). Overview. Introduction Usecase Background GEONgrid portal netCDF data format Opendap Server Thredds Catalog Thredds Data Server

eamon
Download Presentation

Registration/Visualization of Volume Data in netCDF format

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Registration/Visualization of Volume Data in netCDF format Ashraf Memon

  2. Acknowledgement • Chuck Meertens (UNAVCO) • Unidata • NSF Grant No. 0225673 (GEON)

  3. Overview • Introduction • Usecase • Background • GEONgrid portal • netCDF data format • Opendap Server • Thredds Catalog • Thredds Data Server • Architecture • Overview • Registration • Visualization • Action Items and Timeline • Conclusion • Questions

  4. Introduction • UseCase • “Searching, Accessing, Integrating, and Visualizing Distributed Data” – (Courtesy: Chuck Meertens) • Specific Example: Searching, Accessing, Integrating and Visualizing distributed volume data stored in netCDF format and/or served on openDAP server. Performing these tasks through GEONgrid Portal.

  5. Background • GEONgrid Portal • GEON Portal incorporates - Search, Contribute, Access, Integrate, Process, and Visualization of resources (data, tools, applications, and ontologies) • Data Formats and Service types supported • Shape • RDBMS • GeoTIFF • EXCEL • OGC WMS Services • ASCII • Web Services • Arbitrary Data Objects (CUAHSI .zip file bundles)

  6. Working in the GEON Portal: GEON Search with constraints Search for Resources Current Types: ASCII CUAHSI Data GMT Raster GeoTiff Relational Database Shapefile Tool WMS Service Web Service Future to handle 4-D Data: netCDF OPeNDAP Search Constraints: Metadata Relation, Type, Subject, Keyword Spatial Coverage Temporal Coverage Ontology/Concept Relation Sample search for: Resource Type - “Relational Database” Keyword - “GPS” (Courtesy: Chuck Meertens)

  7. netCDF • NetCDF (network Common Data Form) is an interface for array-oriented data access for representing scientific data and a library that provides an implementation of the interface. • Together, the interface, library, and format support the creation, access, and sharing of scientific data.

  8. netCDF • A dataset has dimensions, variables, and attributes. • Attributes can be global or apply to individual variables. • There is a very limited set of low level data types.

  9. OPeNDAP • The Open Source Project for a Network Data Access Protocol (OPeNDAP) • The DAP has been designed to be as general as possible without being constrained to a particular discipline or world view. • The DAP is a discipline neutral data access protocol; it can be used in astronomy, medicine, earth science,…

  10. Flat Binary CODAR General netCDF HDF4 Matlab DSP Tables SQL FITS CDF CEDAR Data Data Data Data Data Data Data Data Data Data Data Data ESML netCDF Matlab JGOFS FITS FreeFrom CODAR HDF4 DSP JDBC CDF CEDAR OPeNDAP Server • Servers receive requests and provide responses via the DAP. • Servers convert the data from the form in which they are stored to the OPeNDAP data model. • Servers provide for subsetting of the data.

  11. IDL Client Matlab Client netCDF Java netCDF C Ferret GrADS IDV VisAD ncBrowse Matlab IDL Access Excel OPeNDAP Clients

  12. THREDDS Catalog • THREDDS (Thematic Realtime Environmental Distributed Data Services) • THREDDS is • a prototype system for cataloguing, browsing, and accessing remote, retrospective, and other data types through a set of middleware technologies. • is infrastructure needed for publishing and accessing scientific data in a similarly convenient fashion.

  13. THREDDS Data Server HTTP Tomcat Server IDV Catalog.xml Application THREDDS Server • OPeNDAP • HTTPServer • WCS WCS Application NetCDF-Java library OPeNDAP hostname.edu Datasets WMS Server

  14. THREDDS Data Server • Integrates data access with THREDDS catalogs and services • Tomcat/Servlet, 100% Java, single war file • Data input is netCDF Java 2.2 library • Data output: • OPeNDAP • HTTP Server • OGC Web Coverage Server (gridded)

  15. UNAVCO/GEON PoP Server Details Data, Models, Catalogs, Metadata Data Access http • UNAVCO/GEON • PoP Data Server • 1D/2D/3D/4D • Tomography • GPS data/vectors • Earthquakes • Focal Mechanisms • Strain rate • Topography • Image maps • Geodynamics • Faults • Paleogeography • Plus IDV visualization • “Bundles” (.xidv files) srb ftp gridftp OGC* • OPeNDAP • Data • Servers • netCDF • Freeform OPeNDAP • Thredds • Catalog elements • Digital Library • Metadata elements • (via OAI or DLESE • Webservice) • WMS Catalog *OGC=WMS/WFS/WCS Thredds Catalog Dataset Catalogs and Metadata Access *OGC: WMS/WCS/WFS

  16. UNAVCO/ GEON Data Server and Visualization Access UNAVCO/GEON Data Node OPeNDAP Server Example: Seismic Tomography in NetCDF format WMS Server Example: GPS Seamless Archive Postgres/PostGIS Database Integrative Data Viewer THREDDS/OPeNDAP Catalog WMS Catalog HTML File Other distributed data servers Local File GEON goal, by May, 2006: registration of netCDF files and OPeNDAP servers into the GEON Portal; embedded GEONSearch within the IDV

  17. Users view • GEON Portal • Data/Model • Registration • Data Search / • Discovery Volume Data (ascii grid or netCDF) Data Data Contributor GEON Query & Data Preview Thredds -Catalog -Digital Library Metadata Raw Data Processed Data User Contributed “Concepts” Data access • UNAVCO GEON PoP • Data/Metadata Server Node • Data Conversion Webservice Data User Metadata Access

  18. Data Registration Architecture OPeNDAP Register OPeNDAP URL (URL, ADN, FGDC) Register netCDF (URL, ADN, FGDC) Register xidv (.xidv, ADN, FGDC) Data Registration Service User Machine .nc .nc .xidv OPeNDAP URL OPeNDAP URL THREDDS Archival adn WCS SRB fgdc THREDDS Data Server HPSS GEON Catalog

  19. Search, Access and Visualization Webstart (.jnlp, ixidv) User Machine Download, OPeNDAP, WCS, JPG Data Integration And Visualization Service .jnlp(.xidv) adn fgdc .nc Tools Repository OPeNDAP URL GEON Catalog OPeNDAP URL THREDDS wms WCS Tools THREDDS Data Server OPeNDAP URL

  20. Action Items • Installation and Understanding TDS (1 week) • GEON hosts TDS (WCS/OPeNDAP/THREDDS) Server of hosted integrated data (1/2 week) • Data registration system for .nc file (3 Weeks) • Data Registration for OPeNDAP URL (3 Weeks) • netCDF download from GEON-hosted data (possible http link to data) (Already Implemented) • GEON points to non hosted THREDDS server (2 weeks) • GEON hosts THREDDS catalog of integrated data (only selected data, proxy server-could be non hosted service as well as GEON hosted) (2 weeks) • GEON provides webstart to IDV with IDV catalog (points to hosted and non hosted data) (1 week) • GEON provides webstart to IDV with IDV catalog a default view appropriate for type of data (1 week) • GEON also provides a jpg preview from IDV scripting API (2 days) • GEON to host WCS through TDS (1 week)

  21. Questions • We are opening the phone lines for questions, please call in at 1.888.629.9921 and put in the passcode 5383118#

More Related