1 / 34

New Internet Developments: Marine XML

New Internet Developments: Marine XML. Peter Pissierssens & Greg Reed (IOC/IODE). Summary. Background Why MarineXML? IODE and MarineXML Benefits for marine community Current initiatives. Background.

brent
Download Presentation

New Internet Developments: Marine XML

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. New Internet Developments: Marine XML Peter Pissierssens & Greg Reed (IOC/IODE) The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  2. Summary • Background • Why MarineXML? • IODE and MarineXML • Benefits for marine community • Current initiatives The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  3. Background • Emergence of XML as a data transfer protocol provides the global oceanographic community with a mechanism to support the exchange of marine data. • A marine XML structure will encapsulate marine data and provide an efficient means to store, transfer and display marine data. • XML: describes content, not style The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  4. Why marineXML? • Exchange of data • Extensibility • Plain Text • Data Identification • Stylability • Hierarchical The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  5. IODE and marineXML • 16th Session of the IOC Committee on International Oceanographic Data and Information Exchange (IODE) in 2000 proposed to develop an XML interoperability framework based on a ‘Marine Mark-Up Language’ (MML) specification The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  6. Benefits for Ocean Community • MML interoperability framework will have considerable benefits to the oceanographic community, supporting the objectives of data interoperability • Data providers can operate without changing their existing data structures and systems • Developers can build common programs and instruments to support multiple formats • Users can access heterogeneous datasets across the internet or local networks The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  7. Current Initiatives • Current international initiatives include: • The ICES/IOC SG-XML • XML ‘Brick’ concept • The EU Marine XML Project • The MEDI metadata authoring tool • GE-TADE activities • Establishment of a MarineXML community portal site • OIT Pilot Project The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  8. SG-XML The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  9. SG-XML • Study Group on the Development of Marine Data Exchange Systems Using XML (SG-XML) • Jointly established by ICES-IOC The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  10. SG-XML TOR The Terms of Reference for the Group: • develop a framework and methodology for the use of XML in marine data exchange in close consultation with IOC and the Marine XML Consortium; • develop a workplan that within 4 years will lead to published protocols for XML use in the marine community; • explore how to best define XML tags and structures so that many ocean data types can be represented using a common set of tags and structures; • test and refine these common tags and structures using designated case studies i.e.: • Point (physical/chemical) data (profile, underway, water sample); • Metadata (cruise information, building from the ROSCOP/Cruise Summary Report); • Marine Biology data (integrated tows, e.g., zooplankton-phytoplankton tows, demonstrate the use of taxonomy). The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  11. SG-XML actions • First meeting April 2002 • Action plan developed to include: • Parameter Dictionary. Create, evaluate and discuss intersessional work on SGXML parameter dictionary including the population of the dictionary for distribution via a defined XML structure. • Point Data Investigation. Evaluate the generalised brick approach with application to various point data types. Evaluate the point data structure from the perspective of the IODE data centres. Provide biological and taxonomic input to the bricks. • Metadata Investigation. Evaluate linkages to other metadata standards and the implications of a generalised metadata model to existing models. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  12. XML Bricks The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  13. XML Bricks • Concept developed by R. Keeley of MEDS • The brick structure represents a basic building block for packaging data and metadata • Employs a small number of generally defined structures that can be assembled in different ways to reflect the structures of a variety of data collected over a broad spectrum of disciplines. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  14. XML Bricks • Bricks can describe • data units • measured (or computed) variables • space and time location of the measurement • data quality flags • supporting information such as sampling techniques, species taxonomy, etc. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  15. XML Bricks – current list The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  16. XML Bricks: Example • Example: the Provenance Brick • Holds information about the originator of the data. • Where data is collected from a single source, would take the form: provenance >originator >project >country >date_received > platform_name > agency > originator_identifier > data_grouping > description > platform_type The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  17. EU MarineXML Project The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  18. EU MarineXML Project The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  19. Project Overview • To demonstrate that XML technology can be used to develop a framework that improves the interoperability of data for the marine community and specifically in support of marine observing systems • To develop a prototype of an XML-based Marine Mark-up Language (MML) The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  20. Partnerships! • MarineXML is to be developed in partnership with international agencies, government departments and organisations responsible for data standards to ensure that the research meets the needs of key stakeholders with interests in global ocean observing systems. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  21. Consortium Participants • HRW HR Wallingford UK (Coordinator) • UKMIC UK Marine Information Council UK • 7CS SevenCs DE • NERSC Nansen Environmental and Remote Sensing Centre NO • CLRC Central Laboratory of the Research Council UK • RIKZ Rijkswaterstaat NL • VLIZ Flemish Marine Institute BE • SCO Social-change On-line AU • SMHI Swedish Metrological and Hydrological Institute (EuroGOOS) SE • IOC/IODE International Oceanographic Data and Information Exchange Committee INT The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  22. Other Initiatives The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  23. MEDI • Marine Environmental Data Inventory • A directory system for marine related datasets and data inventories within the framework of the IOC’s International Oceanographic Data and Information Exchange (IODE) programme. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  24. MEDI Authoring Tool • The MEDI authoring tool has been developed to encourage data collectors and scientists to produce metadata descriptions for their datasets. • MEDI authoring tool is browser-enabled and operates in a client-server configuration. Clients can access MEDI on a local network or over the internet The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  25. MEDI format • MEDI uses the Directory Interchange Format (DIF) developed by NASA's Global Change Master Directory • A DIF is a collection of fields which detail specific information about the data which are necessary for users to decide whether a particular dataset would be useful for their needs • Metadata are stored as DIF-XML files • XML is used to transfer DIF records The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  26. Operates as a service under Apache Tomcat 4.0.4 using HTML Uses standard HTTP protocol, hence can be accessed via internet or intranet Metadata records are stored as DIF-XML files Spatial functionality is delivered using Scalable Vector Graphics (SVG) Data can be tranferred using XML MEDI flow The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  27. GE-TADE • IODE Group of Experts on Technical Aspects of Data Exchange • Mission of its work plan: “The development of an End-to-End Marine Data Management Framework” • Present situation: • large number of data formats in existence • many different data types • many different systems • result is a high level of duplication of effort. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  28. GE-TADE and MarineXML • Objective is the development of marine XML as a mechanism to facilitate format and platform independent information, metadata and data exchange. • A limited pilot project to demonstrate an activity within the E2EDM framework is currently in progress at the Russian NODC. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  29. Marine XML Portal • Establishedto provide a discussion forum for MarineXML activities. • Hosted by IOC http://www.marinexml.net The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  30. News About marineXML EU MarineXML Project ICES-IOC SGXML Events Documents XML Links Forum FAQ Uses IODE BeeBox: You can register Content informer Multiple writers Marine XML Portal The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  31. OIT-PP • Ocean Information Technology Pilot Project • JCOMM / GOOS / IODE The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  32. OIT: Why? • We have only 5-10% of the needed telemetry capacity • Data Assembly - no broad agreement on how we ensure coherent, integrated data sets • Lack of agreement on standards, formats and practices • Poormodes of data transport, both routinely for operational requirements and for science • Poor or inappropriate uptake of modern information technology • No proper assessment of the future need. The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  33. OIT Vision • “Create an efficient and effective data and information management system for the ocean and marine environment, based on leading-edge [ocean] information technology, and serving the oceanographic community and beyond.” • Project Leader: Neville Smith The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

  34. MarineXML MEDI OIT IODE http://www.marineXML.net http://ioc.unesco.org/MEDI http://ioc.unesco.org/oit http://www.iode.org References The Colour of Ocean Data, Brussels, Belgium, 25-27 November 2002

More Related