1 / 19

Using Community-Driven Metadata Conventions with On-Line Data

Using Community-Driven Metadata Conventions with On-Line Data. James Gallagher*, Daniel Holloway * , Dan Lohaus** *OPeNDAP **Northrop-Grumman. Overview. What are ‘Community-Driven Standards?’ How Does OPeNDAP’s new data server support them?. Community-Driven Standards.

Download Presentation

Using Community-Driven Metadata Conventions with On-Line Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Using Community-Driven Metadata Conventions with On-Line Data James Gallagher*, Daniel Holloway*, Dan Lohaus** *OPeNDAP **Northrop-Grumman

  2. Overview • What are ‘Community-Driven Standards?’ • How Does OPeNDAP’s new data server support them?

  3. Community-Driven Standards • Origin: Solutions as opposed to descriptions of problems • Most often developed by users or developers that are also users • Once implemented, ‘convention’ promoted to a ‘standard’ after a significant number of users ‘vote with their feet.’

  4. More characteristics… • Generally small and focused on a part of a problem • Good components • The ‘insides’ are comprehensible. • Flexible; easy to use in unforeseen ways

  5. Wow, these sound perfect…

  6. Wow, these sound perfect… • Implementations can limit growth (success creates users with an expectation of stability) • Uncontrolled proliferation is possible • Free-wheeling; lack of rigor • Many ‘Community-Driven Standards’ actually do go through a formal process • IETF and IETF-like (e.g. NASA/ESE/SPG) • Technology adopted by ISO • Test bed to voting body (IEEE, OGC)

  7. Examples Relevant to Data Systems • Well known, with broad appeal: HTTP, MIME • XML: micro formats • Services: SOAP • Data standards: DAP (aka OPeNDAP), WxS • Metadata conventions: COARDS, CF, THREDDS

  8. OPeNDAP’s Server4 • Uses a modular architecture to support different application-level protocols • Data access using DAP • Catalogs using THREDDS • Browsing using HTML and ASCII • Modules for data access • Different file types • Potential for database and scripting • Modules for commands • Commands provide varying operations for different protocols

  9. OLFS BES Java Servlet Engine Unix Daemon Server4 BES Commands DAP2 THREDDS HTML XML- encapsulated object Optional THREDDS catalogs File system with data files, SQL Database, …

  10. BES Commands/ XML Documents OLFS OLFS DAP2 Request/Reply Logic DAP2 Java Servlet Engine

  11. BES Commands/ XML Documents OLFS OLFS DAP2 Request/Reply Logic DAP2 THREDDS R/R Logic THREDDS Java Servlet Engine

  12. BES Commands/ XML Documents OLFS OLFS DAP2 Request/Reply Logic DAP2 THREDDS R/R Logic THREDDS HTML R/R Logic HTML Java Servlet Engine

  13. BES Commands/ XML Documents OLFS OLFS DAP2 Request/Reply Logic DAP2 THREDDS R/R Logic THREDDS HTML R/R Logic HTML SOAP-DAP R/R Logic SOAP Java Servlet Engine

  14. BES BES Framework Network Protocol and Process start/stop activities PPT* BES Commands/ XML Documents Commands** Data Store Interfaces *PPT is built in **Some commands are built in

  15. BES BES Framework Network Protocol and Process start/stop activities PPT* Initialization/ Termination BES Commands/ XML Documents Commands** Data Store Interfaces *PPT is built in **Some commands are built in

  16. BES BES Framework Network Protocol and Process start/stop activities PPT* Initialization/ Termination DAP2 Access Data Catalogs BES Commands/ XML Documents Commands** Data Store Interfaces *PPT is built in **Some commands are built in

  17. BES BES Framework Network Protocol and Process start/stop activities PPT* Initialization/ Termination DAP2 Access Data Catalogs BES Commands/ XML Documents Commands** NetCDF3 HDF4 FreeForm Data Store Interfaces … *PPT is built in **Some commands are built in

  18. To Learn More… • Attend the OPeNDAP Developer’s Meeting: Boulder, CO 21-23 Feb. • Visit opendap.org • Join opendap-tech@unidata.ucar.edu • Participate at wiki.opendap.org

  19. Thank You!

More Related