1 / 35

Peter Cornillon University of Rhode Island Presented at the 10 September 2003 NVODS Workshop

The National Virtual Ocean Data System (NVODS): A Status Report. Peter Cornillon University of Rhode Island Presented at the 10 September 2003 NVODS Workshop Washington DC. Workshop Objectives. Inform the community – NVODS status.

gizi
Download Presentation

Peter Cornillon University of Rhode Island Presented at the 10 September 2003 NVODS Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The National Virtual Ocean Data System (NVODS): A Status Report Peter Cornillon University of Rhode Island Presented at the 10 September 2003 NVODS Workshop Washington DC

  2. Workshop Objectives • Inform the community – NVODS status • Solicit input with regard to the future direction of NVODS. • Encourage participation in the NVODS effort.

  3. Workshop Objectives • Develop a Comprehensive IOOS Data Model • Deliver time-critical (real-time) data to data assembly and operational modeling sites • Develop DMAC Middleware • Make data available using IOOS middleware solution • Data Manipulation Services • Develop Metrics and Implement Performance Monitoring • Implement Middleware Security (Cross-discipline effort with all DMAC) • Provide guaranteed geo-temporal-referenced browse for all IOOS data

  4. To Inform - Outline • Overview of NVODS • OPeNDAP – the NVODS core infrastructure • NVODS/OPeNDAP Status • The future

  5. What is NVODS? • NVODS involves for oceanographic data all data system aspects from data discovery through delivery to the user’s application. • NVODS is operated from URI, but involves significant participation from a number of oceanographic institutions in the US and abroad. • Data transport within NVODS is based on the OPeNDAP data access protocol.

  6. Specifically, NVODS • Facilitates access to oceanographic data and data products via the Internet regardless of: • data type, • where the data are stored, • the format in which they are stored, • the user's visualization package, or • the user's level of expertise, • Is envisioned as a component of IOOS, the Integrated Ocean Observing System,

  7. NVODS • Has been desgined to evolve with • the Internet, • computer hardware, • computer software, and • the interests of its users, • Involves a major population effort, and • Makes use of the GCMD, the Global Change Master Directory, for data discovery.

  8. NVODS does NOT deal with • The acquisition of data at the sensor, • Issues related to the long term storage of these data, • A system processing capability, • The actual network (hardware) infrastructure, nor • The very low level data transport protocols, such as tcp/ip.

  9. NVODS and the End-to-End Data System

  10. NVODS Evolved from DODS DODS, the Distributed Oceanographic Data System begun in the early 1990s, consisted of two fundamental parts: • a discipline independent core infrastructure for moving data on the net, • a discipline specific portion related to data–population, location, specialized clients, etc.

  11. DODS  NVODS & OPeNDAP To isolate the discipline independent part of the system from the discipline specific part, two entities have been formed: • National Virtual Ocean Data System (NVODS) • Open Source Project for a Network Data Access Protocol (OPeNDAP)

  12. OPeNDAP • OPeNDAP was formed to maintain and evolve the DODS core infrastructure, • OPeNDAP is a non-profit corporation, and • OPeNDAP is a discipline neutral data access protocol.

  13. OPeNDAP in the End-to-End Data System

  14. NVODS/OPeNDAPStatus

  15. OPeNDAP/NVODS Server Sites

  16. Institutions with OPeNDAP Servers • NOAA • NASA • USGS • Navy • Universities/NGO Research Labs • State Organizations • Carolinas Coastal Ocean Observing and Prediction System (Caro-COOPS) • Center for Ocean Land Atmosphere Studies (COLA) • Columbia University/LDEO - International Research Institute (IRI/LDEO) • Florida State University - Center for Ocean-Atmospheric Prediction Studies (COAPS) • George Mason University - Seasonal to Interannual Earth Science Information Partner • Gulf of Maine Ocean Observing System (GoMOOS) • Maine - Department of Marine Resources (Maine DMR) • Monterey Bay Aquarium Research Institute (MBARI) • Naval Oceanographic Office (NAVOCEANO) • NASA/GSFC - Goddard Distributed Active Archive Center (GDAAC) • NASA/JPL - Physical Oceanography Distributed Active Archive Center (PODAAC) • NASA/JPL - Ocean Earth Science Information Partner (OceanESIP) • NCAR - Vegetation/Ecosystem Modeling and Analysis Project (VEMAP) • New York University - Center of Atmosphere Ocean Science • NOAA - Climate Diagnostic Center (CDC) • NOAA - Geophysical Fluid Dynamics Laboratory (GFDL) • NOAA - National Center for Environmental Prediction (NCEP)

  17. Institutions with OPeNDAP Servers • NOAA • NASA • USGS • Navy • Universities/NGO Research Labs • State Organizations • NOAA - National Climatic Data Center (NCDC) • NOAA - National Data Buoy Center (NDBC) • NOAA - Northeast Fisheries Science Center (NMFS/NEFSC) • NOAA - Pacific Marine Environmental Laboratory (PMEL) • Oregon State University - Remote Sensing Ocean Optics (ORSOO) • Science Applications International Corporation (SAIC) • Texas A&M University (TAMU) • UCAR - Unidata Internet Data Distribution (IDD) • United States Geological Survey - Woods Hole Field Center (USGS) • University of Alabama/Huntsville - Global Hydrology Resource Center (GHRC) • University of Hawaii/SOEST - International Pacific Research Center • University of Hawaii/SOEST - Sea Level Center • University of Kansas - Kansas Geological Survey • University of Massachusetts - School of Marine Science and Technology • Universite Pierre et Marie Curie - Laboratoire de Meteorlogie Dynamique du C.N.R.S • University of Rhode Island - Graduate School of Oceanography • Woods Hole Oceanographic Institution - US/GLOBEC Georges Bank Program (GLOBEC) • Woods Hole Oceanographic Institution - Upper Ocean Mooring Data Archive (UOP)

  18. OPeNDAP Client and Server Status

  19. Special Servers

  20. Interesting OPeNDAP Access Statistics LDEO data accesses for 1st quarter of 2002 LDEO data accesses for 4th quarter of 2002

  21. The Future • Near term plans – existing funding (sort of) • New funding • Challenges

  22. Near Term Plans • OPeNDAP • DAP 4 • Provide web service access to the DAP • XML version of the DAP • SOAP interface to the DAP • Add bit-image data type • Add cataloging capabilities to OPeNDAP-servers using THREDDS technology • Extend Ancillary Information Services (AIS) capabilites • Complete the OPeNDAP data Connector

  23. Near Term Plans • NVODS • Populate Ancillary Information Services (AIS) site for oceanographic data • Work with groups implementing pilots

  24. New Funding • NASA REASoN CAN – Thematic Portals for Satellite-Derived Surface Ocean Parameters • 2003-2008 - Between $500 and $750/year to NVODS • About ½ of funding for OPeNDAP • Will provide OPeNDAP/LAS access to satellite-derived SST, Surface Winds, Ocean Color, Precipitation and SSH data sets. • NOPP – GODAE • 2003-2005 - $70k/year to OPeNDAP • Will work with the data assimilation community to make their data accessible via OPeNDAP/LAS

  25. Challenges • Data discovery – Directory population • GIS access • Consistent semantic data model(s)

  26. Challenges • Data discovery – Directory population • Finding new servers and new data sets at existing servers • OPeNDAP-enabled servers are rapidly being installed • New data sets are being added at existing server sites • Obtaining complete and consistent data set descriptions • Inadequate data set descriptions • No link between the data set description and OPeNDAP access to the data. • Data sets consisting of collections of holdings pose special problems • Each of the individual items may be well defined, but not the collection as a whole, or • There may not be a single entry point for the collection

  27. Challenges • Data discovery – Directory population (cont.) • Handling virtual data sets and server services • New data sets obtained by combining data from several sites • The collection of mooring data obtained from several sites • New data objects obtained via operations on the data at a site • Wind stress curl derived from the wind stress field • Handling replicated data sets • Some of the more popular data sets are replicated at several sites

  28. Challenges • GIS access • Access from GIS-based servers • Grid access • Feature access • Access from GIS packages • Grid access • Feature access

  29. Challenges • Consistent semantic data model(s)

  30. Data System URLS NVODS:http://nvods.org OPeNDAP:http://opendap.org DODS:http://unidata.ucar.edu/packages/dods

More Related