1 / 35

John Graybeal, Luis Bermudez, Kevin Gomes, Michael Godin marinemetadata

Integrating Distributed Data Systems Using Ontologies, Web Services and Standards: An MMI Case Study. John Graybeal, Luis Bermudez, Kevin Gomes, Michael Godin http://marinemetadata.org December 6, 2005. The data systems. MBARI-developed data systems Shore Side Data System (SSDS)

hachi
Download Presentation

John Graybeal, Luis Bermudez, Kevin Gomes, Michael Godin marinemetadata

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Integrating Distributed Data Systems Using Ontologies, Web Services and Standards: An MMI Case Study John Graybeal, Luis Bermudez, Kevin Gomes, Michael Godin http://marinemetadata.org December 6, 2005

  2. The data systems • MBARI-developed data systems • Shore Side Data System (SSDS) • Adaptive Ocean Sampling Network (AOSN) • Pre-existing systems • SSDS in development for 5 years • AOSN built for 2003 campaign • Different but overlapping users • Different but overlapping data

  3. SSDS

  4. AOSN

  5. The problem SSDS AOSN get me Data for Parametertemperature_1 (deg C) get me Data for Variableocean_temperature (C)

  6. This is (in part) a metadata problem

  7. The Marine Metadata Initiative • NSF starter funding, with SURA(ONR) in-kind support, NOAA CSC bridge funds • International contributions and support • Main deliverables: web site, and a community • Goal for future: Solve the metadata problem • At least, create effective processes to improve it • Asking world-wide contributors to work with us • Identifying strategies and partners for operations

  8. MMI as of Dec 2005http://marinemetadata.org • ~ 200 members • > 800 documents available • First place in Google search for "marine metadata” • 11 major presentations in first year • IOOS DMAC, OBIS, Oceans, GEON, OOSTech, AGU, Quartod • 10 virtual tutorials given related to marine ontologies, tools and web services • One workshop “Advancing Domain Vocabularies” (August 2005, Boulder, CO) • Tools: VINE, VOC2OWL, Ontology Web Services, Tethys, Tethys-Axis • Most are available at Sourceforge

  9. Data life cycle Data Source processes: formats/archives sends gets Community gets Guides & Tools sends Technology processes: formats/archives processes: uses/analyzes gets Data User publishes Data Provider

  10. The answer: Community Agreements • A way to map different vocabularies • A set of agreed services to • Use the mappings • Find the data of interest • Get the data Tethys MMI Interoperability Demonstration http://marinemetadata.org/tethys

  11. First: Understanding each other vocabularies via vocabulary mappings

  12. Tethys FrameworkData Producer Mappings Convert the parameters, datasources, units and flags used in their system to an ontology(tool Voc2OWL changes ASCII to OWL). Map the terms used in the system to the following widely used standard vocabularies for discovery (GCMD) and for usage (CF), which are available as ontologies at MMI. Register your maps with the Tethys catalog.

  13. Conversion Harmonize: Convert dictionary of parameters, sources, units and flags to the Web Ontology Language (OWL), that is a common format to express vocabularies/ontologies (recommended by W3C) Comma Separated Values Tab Separated Values DTD HTML XML/XSD OWL Relational Database RDF

  14. Achieve fast conversions VOC2OWL can help you ! - More about IN41B-07 Thursday at 09:30

  15. Doing semantics by mapping terms

  16. Doing semantic mapping fast VINE can help you !

  17. We’ve tried this! A Domain Mapping Workshop

  18. Now, we use the mappings

  19. Tethys FrameworkSemantic Mediation View • Data producersubmitsmappings to semantic mediator as an ontology file. • Userasks the semantic mediator for terms related to the concept of interest • Semantic mediatorlooks up mappings • Responds with related terms used by other vocabularies (= data producers) • Other mediators may provide different relationships • http://marinemetadata.org/tethys

  20. Tethys Portal: User Interface

  21. Finding the related data

  22. WSDL files describe the available methods Tethys: SOAP based

  23. Tethys Portal - Service Broker Type of terms the data producer is using Knows about the DataProducers End point of the SOAP Web Service

  24. Tethys Portal: User Interface

  25. Tethys: Methods • getMetadata • arguments: parameter, source, start, end, • downLimit, upLimit, northLimit, • westLimit, southLimit, eastLimit, verticalPositive • returns: Dublin Core Metadata in RDF/XML • note: An ID of the data is returned as URIDataSet

  26. Getting the related data

  27. Tethys: Methods • getMetadata • arguments: parameter, source, start, end, • downLimit, upLimit, northLimit, • westLimit, southLimit, eastLimit, verticalPositive • returns: Dublin Core Metadata in RDF/XML • note: An ID of the data is returned as URIDataSet • getASCII • arguments: URIDataSet, start, end, • downLimit, upLimit, northLimit, • westLimit, southLimit, eastLimit, verticalPositive • returns: An ASCII file (1 header, tab separated)

  28. Tethys Portal in Action • Invoking MMI Ontology Web Services to get sameASandnarrowerThan terms for: OceanTemperature. • FoundTemperature_8in the SSDS ontology. • Found sea_surface_temperaturein the AOSN onto. • Looking for SSDS in the Tethys catalogue. • Found SSDS SOAP Web Service endpoint at: http://ssds.shore.mbari.org:8080/axis/services/DataProducer • Invoking the method getMetadata with the parameter: Temperature_8. • Found 4 data sets, metadata added to the portal cart. • Looking for AOSN in the Tethys Catalogue. • …

  29. Tethys Portal Search Results Results (based on Dublin Core Metadata) Variable Sea Surface Temperature in data set nps_aircraft (downloadplot) Autonomous Ocean Sampling Network 2003 Field Campaign data (AOSN-II). By Data Source/Observation Data/Aircraft/Sea Surface … Creator is: Naval Postgraduate School (NPS), Monterey CA Time range is: from: 2003-08-05 to: 2003-08-30 Coordinates are: north: 37.275 east: -121.79 south: 36.295 west: -123.08 ID: urn:aosn.mbari.org.recordVariable.id:243483

  30. Tethys Portal Gets the Data • Invokes the method getASCII with the URIDataset urn:aosn.mbari.org.recordVariable.id:243483, possibly refining the query in time and space. • ASCII data is returned: • time vertical (m down) latitude (degrees_north) longitude (degrees_east) sea_surface_temperature (C) • 2003-08-16T20:34:53-0700 702.861 36.7296 -122.705 4.915 • 2003-08-16T20:36:03-0700 708.112 36.7298 -122.705 4.892 • 2003-08-16T20:37:13-0700 713.256 36.7299 -122.705 4.87 • 2003-08-16T20:38:24-0700 718.301 36.73 -122.705 4.863 • ……

  31. Tethys Framework: Status • Mappingprocesses and tools tested in workshop and with SSDS and AOSN. • The methods (interfaces) were defined and iterated using SSDS and AOSN systems. • Ontologies and mappings to date are available via Onrtology Web Services. • We worked hard to make this easy for you. • Helper methods (JAVA API) to create metadata were developed. • Tethys-AXIS created to quickly deploy web services in Tomcat. • Documentation… a lot of documentation http://marinemetadata.org/tethys

  32. Conclusions • Interoperability requires semantic solutions • Fastest (best?) answer mixes web services and semantic mappings • Domain-specific mappings are inevitable (so, go ahead and start doing them) • Later, full ontologies can be integrated • Initial prototype software availablenow • You can participate in the demo at the link below • Many data providers plan to work with the demo http://marinemetadata.org/tethys

  33. Our Guides Executive Committee • John Graybeal, MBARI. (PI) • Philip Bogden, SURA/SCOOP • Stephen Miller, SIO. • Francisco Chavez, MBARI. • Stephanie Watson, Texas A&M Steering Committee • Roy Lowry, BODC • Robert Arko, LDEO • Julie Bosch, NOAA • Ben Domenico, Unidata • Karen Stocks, SDSC • Steve Hankin, NOAA - Ocean.US/DMAC • Mark Musen, Stanford Univ • Michael Parke, Univ of Hawaii • Lola Olsen, NASA Goddard • Bob Weller, WHOI • Dawn Wright, Oregon State University

  34. MMI:Your Handy Reference Guide MMI: http://marinemetadata.org Help Line: ask@marinemetadata.org Post an event: addthisevent@marinemetadata.org Post an item: addcontent@marinemetadata.org Get info re site: info@marinemetata.org Workshop: http://marinemetadata.org/workshop05 Ontologies: http://marinemetadata.org/ns Term Search: http://mmi.mbari.org:9600/mmi2/search.jsp Tethys: http://marinemetadata.org/tethys

  35. Thank you Luis Bermudez bermudez@mbari.org http://marinemetadata.org

More Related