1 / 42

WWW portal and Data management

WWW portal and Data management. Session Goal : Assess the MERSEA Information Management system (MIM), the visible and hidden face, and links with data centers Prepare next move (TOP2, MERSEA closure, start of MCS) Agenda:

mervin
Download Presentation

WWW portal and Data management

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WWW portal and Data management • Session Goal: • Assess the MERSEA Information Management system (MIM), the visible and hidden face, and links with data centers • Prepare next move (TOP2, MERSEA closure, start of MCS) • Agenda: • 9h00 - 9h40: Presentation of MIM & project review – WP2.6 – (F. Blanc) • 9h40 - 9h50: WWW and data management status from altimetry (O. Lauret) • 9h50 – 10h00: WWW and data management status from Ocean Color (N. Hoeppfner) • 10h00 -10h10: WWW and data management status from SST (H. Roquet) • 10h10 – 10h20 WWW and data management status for Sea Ice (S. Sandven) • 10h20 - 11h00: Discussion to improve WP2 produtcs visibility, on ashort term issue • 11h00 - 11h30: Coffee break • 11h30 – 12h30: Discussion to improve WP2 produtcs visibility & organisation Page 1

  2. Prerequesites Page 2

  3. Mersea: the target system • Project overall objective to build the backbone of GMES ocean, ie. : • Provide qualified observations and forecasts at global and regional scales,  R&D to improve individual systems for real-time ocean monitoring (common modelling framework, nesting of models, downscaling) • Integrate and organise present systems, improve and facilitate access to data, products and services • Pre-Operational services - Seasonal weather forecasting • - Ecosystem modelling in regional & shelf seas • - Specific applications (marine safety, wave forecasts, offshore operations, ship routing, oil spill drift). Page 3

  4. Met Office ECMWF Météo-France Mercator CNES/CLS TOPAZ ISAC/GOS Users NOAA FOAM CMC NSIDC HCMR MFS GTS OSI/SAF Coriolis From where did we start? Web server Mersea Std.1 Portal Forcing fields SST Altimetry Sea-ice Salinity, T° Biological Web server ? FTP server Physical medium ? Web server FTP server Physical medium Page 4

  5. Measurement Networks Marine Forecast Centers Observation Data Centers Forcing data ECMWF FNMOC NCEP Global MERCATOR Prediction NWP NOP Reanalysis Satellite data Sea Level Sea Surface Temperature Sea Ice Ocean Colour Space Ground Segments CNES-ESA EUMETSAT NASA-NOAA Regional NW Shelves (NCOF) Mediterranean Sea (MFS) Arctic (TOPAZ) Baltic (BSH) In Situ data CORIOLIS EuroGOOS In Situ Networks ARGO SOOP GOSUD Forecasts State variables Analysis Mersea, a System of Systems • Physical Ocean and primary ecosystem • Policy service  Research  Public Service  Commercial Page 5

  6. Mersea, an Integrated System Search & Discover See & Understand Access & Manipulate } Generic - standard } Downstream Real time – daily production – + 15 years of data for a few parameters • Portals and Services • Not just to access data and information; • Services to different users, reliable and operational data access; • Research and development, training • Classes of services (and classes of users): • Monitoring and basic mapping; • Operational forecasting; • Emergency response and crisis management; • On-demand customized products and information Page 6

  7. High-Level Integration • Integrated Project European Research Area • Bring together diverse teams into joint effort • Capitalize on research developments • Coordinated partnership, agreement on needs & solutions • Integrated System • Common approach, standards, vocabulary, protocols, formats, coverages, services, data policy, .. • Networking, information management, data exchange and delivery, • Physical interfaces : nesting of models, forcing fields • Integrated Strategy • Policy, funding issues, interagency arrangements, GMES framework • Quality service to users, reliability of products, interoperability & sustainability of services Page 7

  8. What is MIM ? Page 8

  9. Integrated and Distributed Infrastructure ORGANISATION IMPLEMENTATION Page 9

  10. Information Management System Unique address / multiple servers [Single Sign On] [List] [Search] [Browse] [Viewing] [Transformation] [Download] Discovery ACCESS CATALOG Metadata / Inventory TEP # i Information Diffusion Virtual datasets TEP # j Information Diffusion Virtual datasets TEP # k Information Diffusion Virtual datasets TEP # l Information Diffusion Virtual datasets USERS Archival Archival Archival Archival Archival Archival • System • Administration • Coordination & Synchronisation • Information • Order desk • Dissemination • High-level workflow(data / metadata / services) • Add product in catalog • Delete product in catalog • Correspondance inventory / transport services Information and management system (central & distributed) M O N I T O R I N G / Q U A L I T Y • User • Management • Data policy • Service policy • Userauthorisation • Help desk Standard data transport [FTP] [Opendap (http/https)] [WCS (hhtp/https)] [Other http(s)] Data providers

  11. DIP1 • To organise Development Implementation Plan (1/3) • Project  System • Integrated System = • all components operated and interconnected together (observations & downscaling) • V1: System definition & system in operation • V2: Consider internal «SLA» between components Page 11

  12. DIP1 • To organise • DIP2 (V1) • To produce Development Implementation Plan (2/3) • Functions = • Production, Data Management • Monitoring, Assessment, User Desk • V1: at MIM level: Catalogue / Discovery • + Integrated Quick View –MIV v1– (operational) at TAC level: Data sharing requirements • V2: Inventory & Downloading for end to end demo through Single Sign On system : oil spill, GODIVA2 Monitoring (technical KPI) & Assessment (scientific metrics) • User desk (access + help desk) MIV v2 (forecasts, time-series through class 2 & 3 – sections, moorings, transports –, ocean indicators) • Project  System (& functions)  Services Page 12

  13. DIP1 • To organise • DIP2 (V1) • To produce • DIP3 (V2) • To provide information+ Demo Development Implementation Plan (3/3) • Services feedback = • A clear understanding of the Core Service definition (internal & external) • Assess the quality of the products and the end-to-end performance of the system • Demonstration: link with core users • Project  System (& functions)  Services to Users Page 13

  14.  Functions  Services to Users (Core + Value added) Observations Acquisition Data Processing Data Assimilation Data Assimilation Nowcasts Forecasts Hindcasts Ocean Modelling Model Nesting Information& Quality Assessment Data Management Production Integration Delivery User Desk Monitoring & Control  Components Page 14

  15. The visible face (V1) Page 15

  16. Web portal http://www.mersea.eu.org IFREMER (product coord.) CLS (services coord.) MERCATOR NCOF INGV ENEA (help desk) DMI NERSC CORIOLIS AVISO/ALTIMETRY/SSALTO/DUACS GHRSST-PP/MEDSPIRATION/ JRC Ocean/ICE SAF • Unique and common access • Network of web sites and services Page 16

  17. Remote Sensing portal Page 17

  18. Remote Sensing portal Catalogue Page 18

  19. Marine Forecast Centers portal Same model ID card for all models Page 19

  20. Catalogue Core Services pages Access Services Discovery Page 20

  21. Catalogue Search Search in metadatabase Google Search like Page 21

  22. Arctic NE Atlantic Baltic Global Mediterranean Browsing Mersea Quick-View service Page 22

  23. Browsing Mersea Quick-View service • V1 features • Easy access, all regions, parameters in one click, 3 level of depths 0-100-1000m • No data, “low-resolution” maps or images for browsing • Input= gridded products served via Opendap, only one Mersea official product per region (observation or analysis/forecast type, qualified to region scale) • Homogeneous maps and color scales, coherent navigation bar • 4 levels of zooms, products approppriate per area and change areas like into a mappy system • Keep images on computers (pop up windows) • Direct link to the appropriate product information into the catalogue (and its real resolution) • No specific interpretation (report) of images is given Page 23

  24. North Pacific North Atlantic Tropical Pacific Viewing per large ocean region Tropical Atlantic South Pacific Antarctic South Atlantic Indian Browsing Mersea Quick-View service Link to data center Link to catalogue information Page 24

  25. Ocean model Observations  15 ocean parameters in coherent way Temperature Sea Level Current Salinity Temperature Geosptrophic Current Sea Level Anomaly Salinity Page 25

  26.  15 ocean parameters in coherent way • Observations • MSLA (DUACS) • SST (MF) • Analysis • T (MERCATOR Océan) Page 26

  27. Standalone Downloading Operational Indicators Viewing Services Access to Operator Access to TEP Access Services Page 27

  28. Integrated LAS Other Viewing Page 28

  29. Monitoring for Inventory (V0) MERSEA V2: KPI to be implemented + user help desk Page 29

  30. The hidden face (V1) • at MIM level • at TAC level Page 30

  31. Documentation available MERSEA-WP05-MERCA-STR-005 Overall Specification of the Mersea IS MERSEA-WP05-MERCA-STR-0010 Services specification for V1 MERSEA-WP05-ASP-STR-001 Definition of technical indicators (KPI) MERSEA-WP05-MERCA-STR-007 Definition of scientific indicators (metrics) MERSEA-WP06-IFR-UMAN-001 Guidelines to partners for system integration MERSEA-WP06-IFR-UMAN-002 Guidelines for provider: Catalogue MERSEA-WP06-CLS-UMAN-001 Guidelines for Provider: Gridded Data Format MERSEA-WP06-CLS-UMAN-002 Guidelines for Provider: Opendap Installation & Configuration Guide MERSEA -WP02-CLS-UMAN-001 Guidelines to edit the document listing products MERSEA-WP02-CLS-UMAN-002 Guidelines to edit the User ManualMERSEA -WP02-CLS-UMAN-003 Guidelines to edit the User Tutorial MERSEA-WP01-IFR-TECN-001 Basic structure of Mersea website MERSEA-WP01-IFR-TECN-002 Guidelines for Mersea webmasters (+ the webmaster kit) MERSEA-WP06-CLS-TECN-001 Guideline for Ocean Forecast TEP administrators & webmasters MERSEA-WP02-CLS-TECN-001 Guideline for Remote Sensing TEP administrators & webmasters Page 31

  32. Catalogue and Inventory • Catalogue describes • What (systems, qualification, parameters, …) • Where (geographical extent, geographical resolution) • When (temporal extent (without exact dates), temporal resolution) • Who (producers, …) • Delivery (license, description of available services, …) • Update (versions, release …) • Catalogue & data management issues • Inventory describes • Exact dates of a data set (begin date, end date, delivery date) • Actual name of dataset (file name(s), file size, …) • Services (actual addresses, …) Page 32

  33. Discovery metadata Page 33

  34. Process to understand Page 34

  35. Process to register Page 35

  36. Demonstration exercise on North-Atlantic region with a few TACs (see later) Ocean data sharing requirements • Catalogue Information[XML schema + ISO19115 metadata (FGDC) + ocean vocabulary (COARDS/CF)] • Production[daily production with quality assessment – error bar - & operational monitoring – KPI] • Numerical data format [NetCDF format + some discovery metadata] • Gridded images format[georeferenced maps, OGC rules] • Services offered with production • TransportFTP, Opendap with aggregation in time, WCSSingle Sign On access • InventoryTHREDDS technology • ViewingAt MIM level: public browse for window/demo (MIV)+ for swath data ?At User level: DQV (Google Earth type, GIS functions) • Monitoring and Operational Reporting(KPI = Key Process Indicators, metrics for operationality)At TAC level: KPI1 = Quality of production, At MIM level: KPI2 = Quality of organisation (delivery fiability), KPI3 = Redundancy (back up) • Others -Documentation [minimum required] • Manuals • Qualifiers + Context file V1 V1 V1 V2 V2 V1 V2 V2 V2 V1 V2 Page 36

  37. Feedback on MIM during presentation of thematic leaders • Discussion to improve all this • in second part of session Page 37

  38. Project Review Page 38

  39. WP2.6 objectives • General objectives • Coordinate efforts in remote sensing data availability and distribution • Develop a two-way link with MIM • DIP3 focus • consolidate Mersea web services • decentralise the Remote Sensing portal (from TEP to TAC level) • check application of data sharing plan requirements • support TOP2 goals • thinking beyond Mersea Page 39

  40. Milestones To+24 (march 2006) Start of year 2 and next DIP, Mersea yearly meeting Annual year 2 report and DIP3 To+30 (september 2006  november 2006) Preparation for TOP2, MEC meeting Review of MERSEA integrated system and Remote Sensing integration To+36 (march 2007) Start of TOP2, end of year 3, Mersea yearly meeting Assessment & prospective workshop Annual year 3 report and preparation of project end* To + 42 (september 2007) - every 6 month milestone - Final documentation To + 48 (march 2008) - end of DIP3, end of project - Final assessment Page 40

  41. Deliverables (1/2) • List of products (product lines identification & discovery metadata) • D2.6.3 for satellite altimetry (CLS) OK (30/06/2005) • D2.6.4 for SST (IFREMER  MF)OVERDUE  compilation of metadata • D2.6.5 for ocean colour (JRC) OK (30/06/2005) • D2.6.6 for sea ice (MetNo)OK (30/06/2005) • User manual • D2.6.9 for satellite altimetry (CLS) OK (30/06/2005) • D2.6.10 for SST (IFREMER  MF) OVERDUE  GHRSST-PP User guide • D2.6.11 for ocean colour (JRC) OK (with D2.6.5) • D2.6.12 for sea ice (MetNo) OVERDUE  OK (14/11/2006) • User tutorial • D2.6.13 for satellite altimetry (CLS)OK (31/12/2005) • D2.6.14 for SST (IFREMER  MF) OVERDUE • D2.6.15 for ocean colour (JRC) OVERDUE • D2.6.16 for sea ice (MetNo) OVERDUE How to handle it ? Page 41

  42. Deliverables (2/2) Report on web site uses & feedback every six month D2.6.830/06/2005 OK D2.6.17 31/12/2005 OVERDUE OK D2.6.18 01/06/2006 -30/06/2006 OK D2.6.22 at To+30 (30/09/2006) (CLS) D2.6.31 at To+36 (30/03/2007) (CLS) D2.6.33 at To+42 (30/09/2007) (CLS) Monitoring/Assessment report (with implementation status) (ie. monitoring tables filled by each operator and annexed) D2.6.19 All (30/09/2006) OVERDUE  Minutes of the meeting  and next yearly activity report Decentralisation status Only Ocean colour Who is next ? Page 42

More Related