390 likes | 513 Views
Recent experiences and future plans in oceanographic data management of the Mediterranean and Black Sea. MAMA Workshop on Marine Data & Information Management Malta, 28 th January 2004. 1996-1999 MTPII-MATER www.ifremer.fr/sismer/program/mater/
E N D
Recent experiences and future plans in oceanographic data management of the Mediterranean and Black Sea MAMA Workshop on Marine Data & Information Management Malta, 28th January 2004
1996-1999 MTPII-MATERwww.ifremer.fr/sismer/program/mater/ 1998-2001 MEDAR/MEDATLAS IIwww.ifremer.fr/sismer/program/mater/ MFSPP-MFSTEP1998-20012003-2006 www.bo.ingv.it/mfstep/ + meta-data: Sea-search, EDIOS They have been made possible by the development of common standards and infrastructures WOCE/JGOFS, OMEX, CANIGO GODAR ARGO Several data management actions have been made in a global international context
MTPII-MATER 1996-1999MAss Transfer and Ecosystem Response A reference good quality multidisciplinary database > 200 parameters collected by: • 58 research groups from 10 EU Member States and 3 non-EU States • 108 cruises (more than 1000 days of ship time) • 130 long time series from fixed mooring and lagrangian drifters • 254 main scientific equipments
Data Management Structure Three regional Data Centres • Western • Central • Eastern Publication of the Database on CDRom
MEDAR/MEDATLAS II EC-MAST Concerted Action (MAS3-CT98-0174/ERBIC20-CT98-0103)
CLIMATOLOGYMethodology • Computation of Climatological Analysis by Variational Inverse Model (VIM) algorithms • Computation made on finite elements and then re-interpolated on a regular grid (0.2 degrees in Latitude and Longitude), with smaller scales for local computations • T, S and bio-chemical climatology reviewed by regional experts and modellers http://modb.oce.ulg.ac.be/Medar
CLIMATOLOGY - Results Selected numerical fields depending on data availability: • Annual , seasonal and monthly climatology • Temperature, Salinity • Annual and seasonal • Oxygen, Silicate, Phosphate • Hydrogen sulphide (H2S) in the Black Sea • Annual only • Nitrate, Nitrite, pH, Ammonium, Alkalinity, Chlorophyll • No climatology • Total Phosphorus, Total Nitrogen + 2500 horizontal maps, vertical sections and data location
CD-ROM 3: ClimatologyGlobal + W-Mediterranean CD-ROM 4: climatologyBlack Sea + E-Mediterranean DATA PRODUCT(A set of 4 CD-ROMs) • CD-ROM 1: Documentationon the project and its results Cruise inventory Software QCmedarODV CD-ROM 2: DatabaseObserved data + SELMED interface for extraction (according to various criteria), interpolation and visualization - export formats: MEDATLAS, CSV or ODV.
MFSPP Real time data management • VOS Voluntary Observing Ship • M3A Multisensor Moored Array • MEDARGO Subsurface Profiling System • GLIDERS Basin Wide Monitoring Technology • Atmospheric forcing data • Satellite Data
Standardization • mandatory meta-data • ISO 19115 • common exchange format(s) : • ASCII : MEDATLAS • NetCdf : ARGO/MFSTEP • quality controls • On data • On products • Requested for interoperability :Communication protocol • Marine XML
QUALITY CHECKS QCO : Automatic check of the format QC1 : Automatic and visual check of the headers QC2 : Automatic and visual check of the data points • a quality flag to each numerical value (GTSPP flag scale)
QC-2 : check of the data points Automatic Checks Result Pressure + one more observation (E) Out of the regional scale (min & max values) Increasing pressure Data below the bottom depth Coherence with pre-existing statistics(LEVITUS, MODB, MEDATLAS) No constant profiles Spikes Vertical stability E= Elimination
Conclusion 1: Present available data infrastructure and services for the Mediterranean and Black Sea The data management network of NODC/DNA disseminate data from national and international programs provides basic data services: • Implementation of internationally agreed protocols (when available) and practices for data formatting and checking, • Continuous compilation of national data, quality checking with feedback to source scientists, perennial archiving, • Data dissemination : routine regional or thematic subsets, and answers to specific requests, • State of the art watch to develop standards and make use of the communication technology.
Conclusion 2:What remain to be done • Direct internet access to the most complete and integrated data sets : historical data + data released in recent projects +real time data • more quality data and products such as estimates of the mean, decadal, seasonal, monthly statistics at basin, regional and shelf scales • Insure continuity and integration with other Pan-European and international programs: • Avoid to stop the dynamics • Compatibility with other networks • Develop the standardization with ISO 19115 and Marine XML, especially for meta-data and communication • Develop marketing to and feedback from the users • Avoid to create new non compatible systems
SEA-DATANET : New concerted actions in preparation to develop : • An internet integrated portal • A communication protocol (ISO19115, Marine XML) between local systems • Quality Control procedures to be applied on data and products according to the existing international standards or standards developed in the project, especially for non-physical data • Marketing of the user community, to get more data and provide better services • Enhanced international cooperation & capacity building activities
a semi-distributed model that incorporates, but enhances, the existing infrastructures professional archiving centres scientific centres SMEs Sea Data network
Data Centres Science Centres Elements of the Oceanographic Data System Data & Meta Data Scientific Products Standard Products User
Phases of Sea-Datanet • Design study : protoype of the system • On line networking of a limited number of centre to provide data • Access to all via internet • Test of feasibility and cost estimation for any current parameter • Development of the system • On extended network of data sources • On a limited number of parameters • Implementation and evolution
Expected long term results of Sea DataNet • Standardize, secure and disseminate the data holding of the Pan-European community • Decrease or optimisation of the overall costs of the data management of the projects • Training on standards and methodologies developed in the project • Robust statistics and trends over the last decades of the physical and bio-chemical parameters • A recognised Pan-European data infrastructure able to contributes to international programmes related to GOOS/MEDGOOS, CLIVAR,JGOFS..