1 / 45

Giuseppe M.R. Manzella – ENEA La Spezia – Italy

Implementation of observing systems, data management and services in ADRICOSM-EXT. Giuseppe M.R. Manzella – ENEA La Spezia – Italy. Vital Contributions. Vanessa Cardin OGS Vlado Dadic IOF Franco Reseghetti ENEA Leda Pecci ENEA Maurizio Massi TecnoEl

alyson
Download Presentation

Giuseppe M.R. Manzella – ENEA La Spezia – Italy

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Implementation of observing systems, data management and services in ADRICOSM-EXT Giuseppe M.R. Manzella – ENEA La Spezia – Italy

  2. Vital Contributions • Vanessa Cardin OGS • Vlado Dadic IOF • Franco Reseghetti ENEA • Leda Pecci ENEA • Maurizio Massi TecnoEl • Stefano Nativi CNR • Giovanni Coppini INGV

  3. Content • Meteorological station • XBT and CTD measurements • NRT data management/services • Archiving and data services • THREDDS catalogs and merger

  4. Meteorological station • Adricosm provided the opportunity to add atmospheric data to XBT • Data Logger Campbel Scientific Inc • Thermo Igrometer Rotronic • Weather & Radiation TecnoEl • Barometer TecnoEl • Sonic anemometer WindObserverII

  5. Meteorological station • Only in Summer 2006 the stations were available • GPS recently acquired and delivered • 3 manuals delivered (Campbel, +2 TecnoEl) • OGS and IOF will present results

  6. Operational requirements • Provide repetitive measurements along transects • Transects crossing significant features • Stations distance resolving significant scales • Simple technologies

  7. XBT & CTD measurements XBT and CTD measurements from Oct. 2005 to Nov. 2006 • Adricosm Ext observing system is part of a wider MOON network • MOON provides BC to Adricosm

  8. XBT & CTD data flow

  9. XBT & CTD: protocols Protocols for Field Work (how, what, if, best practices) QC procedures (IOC, MedAtlas, IAEA/MEL) Calibration and Intercomparison

  10. XBT QC Calibration of XBTs at NURC 4 temperatures (12.5, 16.0, 20.0 and 24.0 °C) XBTs temperature values were larger than reference ones, with maximum differences ranging from 0.04 °C (at 12.5 °C) to 0.08 °C (at 24.0 °C). Comparison with CTD and MedArgo

  11. XBT Data Acquisition Sippican hand launcher LM3, MK12 or MK21 redout card personal computer plastic tube from the hand launcher to (near)the sea surface, to eliminate the wind effect on the XBT copper wire

  12. CTD Data Acquisition Idronaut & SeaBird probes Calibrated Quality assured by experience of groups

  13. Format & metadata: XBT *IE4820050101191099 Data Type=H13 Ship Name=URANIA CallSign=IQSU*DATE=01012005 TIME=1910 LAT=N33 20.56 LON=E 28 22.68 DEPTH=-999. QC=1119 *NB PARAMETRES=02 RECORD LINES=00779 *PRES SEA PRESSURE sea surface=0 (DECIBAR=1000 PASCALS) def.= -999.99 *TEMP SEA TEMPERATURE (CELSIUS DEGREE) def.= 99.999 *GLOBAL PROFILE QUALITY FLAG=1 GLOBAL PARAMETERS QC FLAGS=11 *DC HISTORY=XBTs;ACQUISITION TIME(s)=122.6;Z(T)=AT-BT^2: A=6.691000;B=0.002250; *XBT TYPE= DEEP BLUE; MANUFACTURER: LOCKHEED MARTIN SIPPICAN-USA; *DM HISTORY=QC IN NEAR REAL TIME - MFS SOFTWARE * *COMMENT:PROJECT=MFSTEP ; LAUNCH H(m)=03; SPEED(kn)=09-11; WIND SPEED(kn)=NA; * *SURFACE SAMPLES= * *PRES(DBAR) TEMP(°C) 4.0 18.671 11 5.0 18.666 11 6.0 18.666 11 7.0 18.667 11 8.0 18.668 11 9.0 18.669 11 10.0 18.667 11 11.0 18.666 11 ….

  14. Format & metadata: CTD *48ER20061009092657 Data Type=H10 Ship Name=DAPHNE II CallSign=IWSV *DATE=09102006 TIME=0926 LAT=N44 45.49 LON=E 12 22.81 DEPTH=10.1 QC=1111 *NB PARAMETRES=06 RECORD LINES=00020 *PRES SEA PRESSURE sea surface=0 (DECIBAR=1000 PASCALS) def.= -999.99 *TEMP SEA TEMPERATURE (CELSIUS DEGREE) def.= 99.999 *PSAL PRACTICAL SALINITY (P.S.U.) def.= 99,999 *DOX3 DISSOLVED OXYGEN ( %) def = 99.999 *DOX4 DISSOLVED OXYGEN ( ppm) def = 99.999 *CPHL CHLOROPHYLL-A TOTAL (milligram/m3) def = 999.99 *GLOBAL PROFILE QUALITY FLAG=1 GLOBAL PARAMETERS QC FLAGS=111111 *DC HISTORY=1002 * *DM HISTORY=QC IN NEAR REAL TIME - Emilia Romagna * *COMMENT: * *SURFACE SAMPLES= * *PRES(DBAR) TEMP(°C) PSAL(PSU) DOX3(%) DOX4(ppm) CPHL 1.0 19.92 27.30 108.20 8.37 6.41 111111 1.5 20.00 28.94 108.50 8.29 7.13 111111 2.0 20.09 29.25 109.00 8.30 9.10 111111 2.5 20.55 30.76 109.40 8.19 10.62 111111 ….

  15. Data access

  16. Data access

  17. Data access: NRT

  18. Data access: Archived QC

  19. Data access: Archived QC

  20. Data access: Archived QC

  21. Data access: Archived QC

  22. Data access: Archived QC

  23. Portal for satellite, in situ and model data output P. Mazzetti CNR IMAA /University of Florence S. Nativi CNR IMAA /University of Florence L. Bigagli CNR IMAA /University of Florence L. Pecci ENEA ACS La Spezia Giuseppe M.R. Manzella – ENEA La Spezia - Italy

  24. Modelling centres Satellite network GTS WMO Data flow organisation U S E R S Thematic Assembling Centres In situ network U S E R S Dissemination to global systems (IFREMER) U S E R S

  25. Few definitions (1) • Inventory: is an index of distributed data, documentation, and information products relevant to users. Data Inventory may provide hyperlinks to distributed sites where data and metadata are housed (e.g. WWW pages, FTP sites, data repositories, …). • Catalog: describes the entities (e.g., fields or columns in the data base), the quality, the method used, the platforms, and other detailed information for accessing the data. For practical reasons the metadata contained in the catalog are quite limited.

  26. Few definitions (2) • Interoperability: Ability to access, exchange, relate and combine information from multiple heterogeneous sources • Information: knowledge acquired through study or experience or instruction • Data: a representation of information in a form suitable to be automatically managed

  27. Ideal data service (1) • User-friendly interface • Transparency (format, protocol, …) • Capabilities for server-side operations (e.g. subsetting, subsampling, etc) • Aggregation of data and products • Integration across data types, formats, and protocols

  28. Ideal data service (2) • Interoperability across components and services • Flexibility, extensibility, and scalability • Support on array of tools for accessing, processing, management, and visualization • …

  29. Data variety • Simple point or vector data • Grid data as RS • Model output or other hierarchically structured data • Flat files • Binary files • RDMBS

  30. Data storage and convention • Store data in a machine-independent, self-describing format (e.g.) • NetCDF (Network Common Data Form) • HDF (Hierarchical Data Format) • GRIB (Gridded Binary) • Use a ‘standard’ convention (e.g. Climate and Forecast /COARDS)

  31. Find data portal Metadata query Metadata Web API service users Data, Metadata management metadata Aggregated catalog Distributed catalogs

  32. Data transport query Web API & Metadata Data suppliers server server Metadata data data Transport protocol metadata metadata

  33. Data servers • OPeNDAP • ADDE (Abstract Data Distribution Environment) • NetCDF via HTTP protocol In many cases data access systems are augmented and integrated with THREDDS catalog services (inventory list and metadata access)

  34. A layered approach • ’80s microprocessor based computer systems, Internet connectivity, TCP/IP communication standard for data transport TCP/IP 1st layer • ‘90s WWW (interactive services), digital library, open access – open source – open standards interrelated concepts

  35. OPeNDAP/DODS • OPeNDAP (Open source Project for a Network Data Access Protocol) is a preferred platform by DMAC, MERSEA, oceanographic and meteorological communities • DODS and OPeNDAP projects are technically distint efforts. DODS servers are the only ones capable to serve OPeNDAP protocol

  36. The second layer • DODS requests are HTTP GET request. • For gridded data DODS is a ‘good’ candidate. Second layer OPeNDAP HTTP TCP/IP First layer

  37. DODS DODS Data Access Protocols (DAP) servers (some of them) • netCDF • HDF • RDBS (for RDMBS) • FreeForm • COLA GrADS (GRIB, netCDF, HDF,GrADS binary) • Matlab

  38. The third layer • There is ongoing work to enable DODS servers to span files. OPeNDAP aggregation server is (in my opinion) being obsolesced by THREDDS THREDDS OPeNDAP HTTP TCP/IP

  39. Underway efforts • IOOS DMAC efforts • OPENDAP • THREDDS • SOAP/XML • GIS • UNIDATA • THREDDS/OPeNDAP • OGC

  40. The CNR / ENEA solution OPeNDAP Servers THREDDS catalogs TDM http://zeus.pin.unifi.it/projects/TDM/new/

  41. Authentication Authorization TAC1 Authorization TAC2 The Security issue CAS for authentication LDAP for authorization

  42. Lesson Learned • The SOOP in the Mediterranean is still on a pilot phase. It has been demonstrated that it is working. • For the coastal areas it is important to have very well organised and motivated groups (e.g. Daphne) • The passage to operational system requires some internationa agreements

  43. Lesson Learned • The NRT and Delayed mode data management is qualitatively high • A distributed information service is still at an early stage • Different architectures are under development for different communities • Security issues have to be resolved

  44. Suggested changes in the Portal Could be replaced by:

  45. Lesson Learned • The success of an operational system is based on a strong collaboration Best thanks to all colleagues

More Related