EMODNet Physics + My Ocean – SeaDataNet

1. EMODNet Physics + My Ocean – SeaDataNet Dick Schaap (MARIS) – Brussels – 1 March 2013

2. Common Data Index (CDI) Data Discovery and Access Service • It provides users a highly detailed insight and unified access to the large volumes of marine and oceanographic data sets managed by the distributed data centres • is a fine-grained index (ISO 19115) to individual data measurements (such as a CTD cast or moored instrument record).

4. CDI Data Discovery and Access service interface Search results

5. Relation with EMODNet Physics • CDI gives access to quality controlled and long time series of physical observations from fixed stations for winds, temperature, pressure, waves, currents, and sea level • These archives are complimentary to the NRT data (60 days time window) and monthly NRT history files as derived from the MyOcean – EuroGOOS exchange

6. Matching and coverage difficulties: • In practice it is quite difficult to match the NRT stations with the CDI records as recorded in SeaDataNet • Different names are used for the stations by EuroGOOS operators versus SeaDataNet NODCs • Lat Lon positions are given with different resolution; SeaDataNet has higher resolution • Gaps in coverage – can be both ways: • no CDI entries available for specific NRT stations • CDI entries available for stations which are not included in the NRT exchange

7. Activities underway: • SeaDataNet partners are asked to give priority to populate SeaDataNet with CDI and related long term data sets for physical monitoring stations • This is guided by giving each SeaDataNet partner a list of NRT stations for its country as first line instruction + request to go wider for full monitoring network coverage

8. Activities underway: • Activity has started between SeaDataNet (BODC + ICES + US NODC) and JCOMMOPS to build and maintain a platform register with name attributes of fixed stations, bridging between operational oceanography and world of data managers

9. Activities planned for EMODNet Physics II: • Increased engagement of EuroGOOS operators for improving the NRT exchange: • Improving the MyOcean index, e.g. by using more SeaDataNet controlled vocabularies (platform register, EDMO) and higher resolution coordinates • Improved synchronisation between metadata variables in the index and in the actual data files as transferred • Less outfall and interruptions in timeseries • Reconsideration of choice of stations in NRT exchange, striving for full coverage of all stations and parameters => more NRT stations

10. European Directory of Ocean Observing Systems EDIOS

11. European Directory of Ocean Observing Systems • EDIOS is an information system for marine observing stations (including moored buoys, coastal installations, seabed stations, drifting buoys, repeated sections and sampling stations, airborne repeated tracks, etc) where there are routine, repeated, and consistent long-term observations of the marine environmental conditions. • Initiative of EuroGOOS in cooperation with SeaDataNet

14. Activities: • Upgrade of original EDIOS service done: • Upgraded metadata format with full support of SeaDataNet vocabs, following ISO 19115 • MIKADO XML editor • Upgraded import and user interface • Updated manual for data providers • Gathering of new content underway: • Lead by SeaDataNet partners • Priority on physical monitoring networks • Progress made with: UK, France, Germany, Ireland, Greece, Italy, Estonia, Norway, Spain, Slovenia, Montenegro • Other countries underway

15. Updated MOU SeaDataNet - MyOcean Oct 2012 • The 2 projects recognise that their in-situ data management activities are complementary and cooperation can provide synergy for operations and products => Aims: • Developing and adopting common standards for formats, vocabs and QC flags with SDN leading • Encouraging data providers and operators to adopt these standards and protocols • Operating data exchanges and sharing data sets • Sharing efforts for compiling and maintaining EDIOS

16. Implementation by: • Technical cooperation, in practice by MyOcean technicians joining SeaDataNet TTG, for sharing and synergy • New standards and protocols are forwarded to both Steering Committees for acceptance • Tuning dissemination and promotion, where appropriate • Initiating and cooperating in new projects, such as EMODNet Physics, and EU Research and GMES Calls • Collaborating on joint Products

17. Joint product SeaDataNet - MyOcean • Both projects are working on aggregated Temperature and Salinity products: • MyOcean for reanalysis purposes; • SeaDataNet for demonstrating the value of the Infrastructure and improving the quality and coherence of data provision. • Efforts have been joined for elaborating together a Regional T&S product for 25 years reanalysis.

18. Joint product SeaDataNet - MyOcean • SeaDataNet has collated a first “raw” Collection of Observations in January 2013. This includes all Temperature and Salinity observations (profiles and time series) with free access (unrestricted and under SDN License) from all the instruments for the time period 1990-2012. This includes all the existing QC flags but not yet further validation by SDN analysis centers (RCs). • The gathered data set has been imported into ODV by AWI and a first QC has taken place. The resulting dataset is impressive and consists of 1,771,489 stations and 91,944,203 samples • This has been delivered to MyOcean end January 2013

19. Joint product SeaDataNet - MyOcean

20. Joint product SeaDataNet - MyOcean • MyOcean will perform a scientific assessment on SDN T&S product and deliver in April 2013 a joint MyO-SDN product, which will contain also data from other sources. • The result of MyOcean validation will be shared with SDN RCs and a list of alerts will be sent the RCs. The RCs will perform independently their quality control analysis on the SDN data aggregate set, will reply to MYO alerts and report to both MyO and NODCs (through ODV log files) about the QC analysis. • The first feedback on the quality of the SDN aggregate data set will be shared in April 2013 in a Joint Meeting SDN - MyO.

21. Joint product SeaDataNet – MyOcean planning

22. Cooperation In JERICO • JERICO is an FP7 project to develop a Cookbook for how to establish coastal observation networks and how to arrange its data flows, management and distribution • Participation from EuroGOOS., MyOcean and SeaDataNet communities • This includes preparing a joint Handbook for operators, including QA/QC aspects • This also includes looking at formulation and prototyping of OGC Sensor Web Enablement (SWE) for streamlining the flow of data from the sensors at the observing platforms to the data centres to the users in real-time: • Formulating SensorML profiles for specific instruments, in dialogue with manufacturers • Formulating Observations & Measurements profiles for specific Data Types • Setting up and testing a Sensor Observation Service (SOS) Cooperation in ODIP • ODIP - Ocean Data Interoperability Platform is a new project for collaboration between EU, USA (research institutes, NOAA, IOOS) and Australia (IMOS) exploring differences and commonalities in approaches (standards & protocols) for handling ocean and marine data • Focus on establishing common standards and interoperability solutions through a series of prototypes as well as exploring innovative options to be worked out in future cooperation projects

23. Conclusion: • In practice already a lot of cooperation and synergy is taking place between SeaDataNet and MyOcean, supported by EuroGOOS, with an overall aim for more quality and quantity of observation data: • Common standards and protocols for handling marine in-situ observations • Wider availability of observation data, urging operators to join and populate exchanges • Quality Control and documentation • Streamlining of the flow of data from sensors to data centres to users • Real-time, NRT and delayed mode (archives) • International tuning • Joint products • Work flows • Assessing needs and formulating plans for additional monitoring sites