250 likes | 353 Views
Intercommission Coordination Group on WIS. IODE/JCOMM Distributed Marine Data System: E2EDM and Ocean Data Portal Pilot Projects Nikolay Mikhailov, IODE/JCOMM ETDMP Chair, RIHMI-WDC Russian Federation. Brazil, 14-17 July 2008.
E N D
Intercommission Coordination Group on WIS IODE/JCOMM Distributed Marine Data System: E2EDM and Ocean Data Portal Pilot Projects Nikolay Mikhailov, IODE/JCOMM ETDMP Chair, RIHMI-WDC Russian Federation Brazil, 14-17 July 2008
Data&information exchange is important for World Ocean studies – on regional and global levels Data and product delivering systems Observation systems Delay-mode data base’s • The IOC IODE system forms a worldwide service-oriented network consisting of NODC’s, DNA’s, WDC’s. • The IODE/JCOMM initiatives • for Distributed Marine Data System development • IODE/JCOMM E2EDM technology prototype Pilot Project (2004-2006) • IODE Ocean Data Portal (2007-…) Analysis and Forecasting systems
IODE/JCOMM Ocean Data Portal/E2EDM Technology • Vision “The Oceans Data Portal will deliver a standards based infrastructure that provides integration of marine data and information from a network of distributed IODE NODCs as well as resources from other participating systems.“ • Ocean Data Portal supports the data access requirements of all IOC programmes areas, including GOOS, JCOMM, HAB and the Tsunami warning system. • Ocean Data Portal will provide the JCOMM WIGOS operations
Data and Services • The Ocean Data Portal will provide on-line access to the marine data and information resources of the participating data centres including: • operational and delayed-mode data • data and services from the oceanographic and marine meteorological domains • from multiple data source formats and local data systems (DBMS, data files, map services, electronic documents) • from multiple data providers in different geographic regions
ODP/E2E Distributed Marine Data System Principles • The ODP will be interoperability with existing systems • IODE data centres will need to accept and implement a set of agreed interoperable arrangements including the technical specifications and Web-services • Interoperability will be achieved through the use of internationally endorsed standards (such as SOA, ISO and OGC) • NODCs will not be required to change their internal (local) data management systems
Portal Web-services IODE Portal Internet Portal Web-services Portal Web-services Portal of system 1 (e.g. SeaDataNet) Portal of system N (e.g. WIS) Metadata Metadata Dedicated data sources network- E2E Data Data Network of distributed IODE data centres ODP/E2E Technical Concept
E2EDM Architecture Software Metadata • Use • E2EUserMD • E2EInterfaceMD External layer Discovery - E2ESeachMD, Access - E2ELinkMD Integration Server layer • Encoding • E2EElementsMD, • - E2ECodesMD Request/Responce - E2E Request, - E2EResponce, - Transport Data File (Point, Profile, Grid) – NetCDF, ASCII, XML Communication layer Config.file Mapping file Data Provider layer Local data system layer
Users Publishing services (end-user applications) E2E Integration Server Monitoring, Administrating, Discovery, Interaction services Ocean Data Portal System Coordinator Centre – global, regional, task-oriented IODE/JCOMM Data Centres – national and specialized Data Access Distributed Marine Data System E2E Data Provider E2E Data Provider E2E Data Provider Local Data Systems DBMS, Data files (structured), Object files (documents,…) Model of IODE/JCOMM Distributed Marine Data System
Integration Server Integration Server Integration Server Model of IODE/JCOMM Distributed Marine Data System Portal
IODE/JCOMM Distributed Data System operation (current status) Portal User access HTTP communication API‘s Registry Metadata management Data discovery Data Delivery Monitoring & Security E2E Integration Server HTTP communication Web-services Registry Connection Mapping Data Access Data providers community Request message E2E Data Provider Response message netCDF transport data-file Local Data system Data Centers Network
IODE/JCOMM Distributed Marine Data System coverage Data Provider (VLIZ) Data Providers JCOMM PAs RIHMI-WDC mirror Integration server Integration server operational planned finished PP IODE Project Office Data Provider (RIHMI-WDC) Data Providers IODE ODINs Data Provider (IFREMER) Data Provider (MetOffice)
IODE Ocean Data Portal prototype http://e2edm.vliz.be/e2edmclient/
IODE Ocean Data Portal prototype Providing some Google-like search
IODE Ocean Data Portal prototype - Result of data search
IODE Ocean Data Portal prototype - Advanced metadata search
IODE Ocean Data Portal prototype (WOD, North sea) User data view page
IODE Ocean Data Portal prototype User data view page – different type of products
Links to ODP/E2E • E2EDM Web site http://e2edm.meteo.ru – documentation • E2EDM Integration Server - IODE Project Office (VLIZ) http://e2edm.vliz.be/iserv/backend - RIHMI-WDC (mirror) http://data.meteo.ru:8080/iserv/backend • JCOMM/IODE Data Portal -http://e2edm.vliz.be/e2edmclient • JCOMM/IODE Data Portal web-site will be launched soon
Interaction with other systems (WIS case) GISC catalogue / registry OAI Client (GISC) WMO «Request» Schema « B » «Register» «Response» OAI Server VGISC protocol communication E2EDM records are reformatted into WMO standard records are migrated from (A) to (B) DCPC Obninsk « A » E2EDM Data Provider E2EDM Integration Server) WMO metadata records (all with global unique ID) Resource catalogue
The IODE/JCOMM DDS organization • The dedicated data center should support the Integration Server operations • The data center which agrees to be the E2E data provider should provide: • the appropriate middleware for communications: web server and application server • installation of the E2E Data Provider software to connect the local data system with E2E Integration Server • registration of the data source and its resources • support of the local data system. • .
ODP Future Plan (IODE Officers and DMCG-3 meetings) • Establish the pilot project working group – in process • Draft of a detailed work plan – Oct.2008 • The JCOMM WIGOS basing on E2E Technology with expanding the DPs – 2008-2010 • The Design Docs and take into account other similar initiatives to avoid duplication of effort – beginning 2009