1 / 27

Partnership Centre for IODE Ocean Data Portal Review 2013-2018

This report provides a comprehensive review of the Partnership Centre for IODE Ocean Data Portal (ODP) from 2013-2018. It covers topics such as results, users, funding, mission, and more.

nwillis
Download Presentation

Partnership Centre for IODE Ocean Data Portal Review 2013-2018

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Report on operation of the Partnership Centre for the IODE Ocean Data Portal in 2013-2018 Dr Sergey Belov, et al. Partnership Centre for the IODE Ocean Data Portal Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  2. Table of contents • Summary on results and achievements (MoU based) • Users and clients • Quality of services and products • Funding and staff • Mission and strategy • Operational environment • Partnership Centre organizational motivation • Partnership Centre organizational capacity Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  3. Introduction Partnership Centre for IODE ODP is responsible for: • develop, host and maintain the tools and specifications for the portal and its distributed marine data system operation • assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives • develop, strengthen and maintain the IODE ODP data management training programmes and tools • monitor and report on the status and availability of the IODE ODP portal, websites, tools and specifications used by the IODE ODP node • Provide an infrastructure to develop and test the web-based technologies and tools and also to generate new ideas and perspectives of the IODE ODP; • Promote collaboration between relevant experts in integrated marine data management in IOC programmes and projects, other organisations and systems (e.g. OBIS, WIS, GEOSS) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  4. 1. Summary on results and achievements “(i)Develop, host and maintain the tools and specifications for the portal and its distributed marine data system operation” Results achieved: • ODP V2 toolkit, including single components, virtual machine images and technical documentation for the deployment of regional/specialized and national nodes has been developed. Toolkit is available upon request through the website www.oceandataportal.org or by e-mail. • ODP V2 has been deployed in ODP global node and SNDM specialized node. • Metadata registry has been established to support the exchange of metadata with other systems, projects and programmes - http://metadata.oceandataportal.net (Geonetwork- and jOAI-based) • Monitoring system for hardware, software and information resources of the ODP node based on the Zabbix software (http://mon.odp.meteo.ru/zabbix/) has been created. • ODP V2 portal includes improved search, retrieval, subscription services and web GIS service. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  5. 1. Summary on results and achievements “(ii)Assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives” Following ODP nodes are deployed and technically supported: • IODE ODP global node (RIHMI-WDC); • National Marine Data System of Argentina (SNDM); • ODIN for Africa - ODINAFRICA (Kenya); • ODIN for the West Pacific - ODINWESTPAC (China); Work in progress: • ODIN for the Black Sea - ODINBlackSea (Turkey, preparatory work) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  6. 1. Summary on results and achievements “(ii)Assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives” Following ODP nodes are deployed and technically supported: • IODE ODP global node (RIHMI-WDC); • National Marine Data System of Argentina (SNDM); • ODIN for Africa - ODINAFRICA (Kenya); • ODIN for the West Pacific - ODINWESTPAC (China); Work in progress: • ODIN for the Black Sea - ODINBlackSea (Turkey, preparatory work) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  7. 1. Summary on results and achievements “(ii)Assist IODE's Ocean Data Information Networks (ODINs), NODCs and other IODE ODP nodes to achieve their regional and thematic objectives” IODE ODP includes more than 700 data sets (information resources) and connects over 30000 data sets (metadata with references to data, by metadata harvesting) obtained from interacting with related systems: European Data Network - SeaDataNet, WMO Information System - WIS, NOAA National Environmental Information Centre (US NODC), Australian Ocean Data Network (AODN). Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  8. 1. Summary on results and achievements “(iii)Develop, strengthen and maintain the IODE ODP data management training programmes and tools” Specialists from the following organizations were trained in IODE ODP technologies and practices: • National Marine Data System of Argentina, regional Southeast Pacific Data and Information Network (SPINCAM); • ODINAfricanetwork; • ODINWESTPAC network on the basis of the National marine Data and Information Service (NMDIS), China. Training materials (video lectures, presentations and practical exercises) are available from the IODE OceanTeacher resource (http://classroom.oceanteacher.org/course/search.php?search=ODP) and www.oceandataportal.org web site. Training videos are also available at Vimeo service https://vimeo.com/15185383 Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  9. 1. Summary on results and achievements “(iv) Monitor and report on the status and availability of the IODE ODP portal, websites, tools and specifications used by the IODE ODP node” • Annual reports to Roshydromet • Annual reports to IODE (as project) • Reports to IODE Committee (every 2 years) • Reports to JCOMM (every 5 year under JCOMM/IODE ETDMP) • Daily reports on data provider availability and data/products accessibility (example: http://is.oceandataportal.net/iserv/stat/10-09-2018_T1.htmlhttp://is.oceandataportal.net/iserv/stat/10-09-2018_T1.html) • ODP monitoring system in place (http://mon.odp.meteo.ru/zabbix/) • External monitoring services used for ODIN nodes (Uptimerobot) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  10. 1. Summary on results and achievements “(v) Provide an infrastructure to develop and test the web-based technologies and tools and also to generate new ideas and perspectives of the IODE ODP” • The IODE ODP global node is deployed on RIHMI-WDC’s telecommunication and computation infrastructure. • Agile methodology is used to develop ODP software • Bug-tracking and project management system (JIRA) - http://dev.meteo.ru:8080 • Source code repository (GITBlit) - http://10.20.147.135:8040 • Continuous Integration services (Jenkins) for automated testing and evaluation - http://10.20.147.136:8080 • Wiki for the developers (Russian language only) - http://10.20.147.134/dokuwiki/doku.php?id=:ru:welcome • “Digital playground” to test new ideas and technologies – brokering services, Big Data, etc. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  11. 1. Summary on results and achievements “(vi)Promote collaboration between relevant experts in integrated marine data management in IOC programmes and projects, other organisations and systems” • Participation in JCOMM/IODE Expert Team on Data Management Practices (ETDMP); • Participation in WMO Expert Team on Evolution of WIS (TT-eWIS); • Participation in SeaDataCloud project; • Participation in EMODNet project • The Partnership Centre participated in key global partnership activities, such as the development of connections compatible with GEOSS within the Ocean Data Interaction Platform (ODIP). The IODE ODP technology played the role of an integrator of metadata and references to data of marine information systems of the USA, Europe and Australia. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  12. 1. Summary on results and achievements “(vi)Promote collaboration between relevant experts in integrated marine data management in IOC programmes and projects, other organisations and systems” Approaches and methods are studied with respect to: • mechanisms of interaction (data, metadata and services) with EMODNet Physics; • mechanisms of interaction (data and metadata provision) with ODIP and SeaDataCloud; • meeting the requirement and recommendations of the Inter-Programme Expert Team on for Integrated Marine Meteorological and Oceanographic Services within WMO and IOC Information Systems (IPET-MOIS); • interaction and interoperability of WIS with the World Data System (WDS, updated ICSU WDC system) and the GEO/GEOSS system. Above listed results formed the basis of the IODE ODP of new generation that serves as an infrastructure of the IOC Oceanographic Data and Information System (ODIS). The prototype of the ODIS component related to metadata management is under design. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  13. 2. Users and clients Users: • Average number of IODE ODP unique visitors is 2 700/year. Geography – worldwide. Registered users – over 100 (global node + ODIN nodes). Clients: • Data is delivered to the external systems, such as EuroGOOS and EMODNet Physics on routine basis • Among them present clients are – WIS (emerging need ocean data in meteo community), ODIP (Prototype 1), GEO/GEOSS. Notice: It should be noted that the level of service depends on the information content in the ODP and during the reporting period it was not possible to solve the organizational issues of attracting data providers (ODIN, NODC, etc.) to the required scale (this activity was carried out by the IODE SG-ODP). SeaDataNet has similar requirements, which are provided through contracts with the EU. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  14. 3. Quality of services and products As a result of the activities of the Partnership Centre, ODP software and documentation have been developed and maintained as a modern integration platform for ocean data share and exchange. In the context of users, the results of the work of the Partnership Centre allowed: • integrate over 700 heterogeneous and distributed sets of oceanographic data in 2 ODIN-regions - ODINAfricaand ODINWESTPAC; • to cooperate with SeaDataNet, WIS and EuroGOOS, access to the data and services of these systems directly from the IODE; contribute such projects as ODIP (ODIP-I, ODIP-II) • to provide access to the above-mentioned oceanographic observational data and products from consumers of ocean information (at least 2700 unique visitors per year to the IODE ODP with average duration of the session 4.5 minutes); • strengthen IODE training programs in data management. The Partnership Centre fulfilled the requirements of the Memorandum. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  15. 4. Funding and staff • During 2013-2018total funding of the Partnership Centre by Roshydromet and UNESCO IOC was 14.036.400 rubles(US$202.100), around US $33500/year with UNESCO IOC funding (IODE budget) being US$15.000for the same period. • IODE ODP is based on RIHMI-WDC’s technology reserves following the similar Russian System of Information on the World Ocean (ESIMO). In this regard, the results of the development and implementation of the IODE ODP significantly exceed the direct costs for the activities of the Partnership Centre. • The effectiveness of the project is also reflected in the development of methodological and technological IODE platform that provides the foundation for building effective ODIS data type systems in the future. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  16. 4. Funding and staff • 3 funded staff positions • In 2015 – 2017 a rotation of two staff positions in the Partnership Centre took place • At present, the Partnership Centre is completely staffed Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  17. 5. Mission and strategy Adaptation of mission The activities of the Partnership Centre have been adapted to the work of IODE through the work of, both directly, the Partnership Centre, and through the work of the JCOMM/IODE ETDMP. The decisions for the IODE ODP establishment were, in turn, based on: • concepts of IODE ODP (adopted by IODE-19, Resolution 19); • recommendations of IODE and JCOMM officials for IODE ODP establishment and incorporation to the JCOMM/WIGOS Pilot Project; • technical review of the IODE Ocean Data Portal (Steering Group for IODE ODP and WMO Integrated Global Observing System - WIGOS pilot project, 2008) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  18. 5. Mission and strategy Benefits for data providers: • Scalable environment to support the capacity of the data provider’s environment • Promotes defactostandards • Engaged with other IODE data systems • Supported technology for data discovery, evaluation, and access • Improved visibility of data and geospatial web services • Improved interoperability with other major marine data systems Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  19. 5. Mission and strategy Benefits for data users: • One-stop shop for data and web services • Increased visibility for one’s research data The ODP provides two primary implementation options: • Light Data Provider • Hosted on ODP Global or Regional infrastructure– • Zero client install • Simplest path to contribute data • Full Node Implementation (pre-configured Virtual Machines): • Modular design • Customizable client install - only enable the required services • Advanced path to provide data, portal, GIS services Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  20. 6. Operational environment Policies - Russian Federation is interested in the development of IODE and its elements in the form of IODE ODP and other elements which are the major source of international oceanographic data and products for the country Legislation - The legislation of the Russian Federation contains no laws and other regulations that would prohibit or restrict the activity of the Partnership Centre for IODE ODP Regulations - The regulations of the Memorandum of the Partnership Centre for IODE ODP are being realized. Other requirements are not imposed Funding – total funding for 2013-2018is about US $202.100 (approx. US $33.700 per year) Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  21. 6. Operational environment Allocation decisions - The project for the Partnership Centre activity is included in the Roshydromet R&D Programme(3-year period) for 2014-2016 and 2017-2019. It is expected that the project will continue in Roshydromet’sprogrammes for the period after 2019. Technological literacy - Modern information technologies are used in the IODE ODP establishment and development. Partnership Centre specialists graduated from higher education institutions with a degree in IT and have a good technological knowledge. Infrastructure and utilities - Partnership Centre’s infrastructure comprises: • servers for the software development (allocated by NODC) • servers for the maintenance of the IODE ODP central node (two servers of medium power: 2xIntel Xeon E5-2660 @2.2 GHz,128 GB of mainframe memory, 1.63 TB of disk space) • local network and Internet • 21 sq. m office Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  22. 7. Partnership Centre organizational motivation Proof of concept – Partnership Centre was established in 2013. For 6 years of operation it has delivered a series of node deployments, data providers installations, data provision on regular basis, support of IODE training activities, collaboration with other initiatives on interoperability issues, metadata and data exchange. Major challenges - Difficulties in expanding the number of IODE ODP data sources from NODCs of IOC member states. The organizational decision of IOC and assistance/monitoring of IOC member states are required Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  23. 7. Partnership Centre organizational motivation Adjustments – IODE ODP activities supports the decisions of the Steering Group for IODE ODP and JCOMM/IODE Expert Team for data management practices in close cooperation with IOC Project Office for IODE • The change in Partnership Centre’s priorities is based on IODE IOC and JCOMM decisions concerning the development of: • - Marine JCOMM Climatic Data System (recommendation IODE-XXIV/3.5, recommendation JCOMM-5 No.4) • - IOC Ocean Data and Information System (OCEAN DATA AND INFORMATION SYSTEM, ODIS) (recommendation IODE-XXIV.6.2.1, resolution JCOMM-5 No.9, Recommendation JCOMM-5 No.2). Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  24. 8. Partnership Centre organizational capacity Leadership– head of Partnership Centre for IODE ODP since 2017 is a coordinator of JCOMM Data Management Programme Area (DMPA). 17+ years of service in NODC from scientific officer to head of laboratory Strategic planning Strategic planning is implemented through: • definition of the mission and goals; • analyzing the environment, including data collection, analysis of Centre’s strengths and weaknesses, as well as its potentialities; • choosing a strategy (SWOT analysis); • implementing the strategy: the personnel of the Centre are informed of the strategy goals and plans to let them understand for what the organization strives and to involve them in the strategy implementation; • implementation assessment and monitoring. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  25. 8. Partnership Centre organizational capacity Business model The basis of Partnership Centre business model is “Human capital assets as a key factor” and “Everything as a service”. Financial planning Financial planning is done at the level of Roshydromet. The Partnership Centre regularly sends its funding-related demands and wishes to the chief executives of Roshydromet. Governance Governance is implemented by Roshydromet and RIHMI-WDC Facilities and technology management The Partnership Centre is using ITIL, ITSM and Agile approaches. A clear mechanism for the development of software, its testing and implementation is established. Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  26. Wants and needs • it is vitally to expand the number of employees of the Partnership Centre to 5 persons to ensure that all areas of work are well secured • long-term financing strategy • greater support from IOC member states with data, metadata and services Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

  27. Questions? Review of the Ocean Data Portal (ODP) Partnership Centre (10-13 September, Obninsk, Russian Federation)

More Related