1 / 12

WP9 Earth Observation Applications Demonstration

WP9 Earth Observation Applications Demonstration. Pedro Goncalves : pedro.goncalves@esa.int Christine Leroy: clipsl@ipsl.jussieu.fr. http://documents.cern.ch/AGE/current/fullAgenda.php?ida=a021814. The EO WebMap Portal.

alva
Download Presentation

WP9 Earth Observation Applications Demonstration

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP9 Earth Observation ApplicationsDemonstration Pedro Goncalves : pedro.goncalves@esa.int Christine Leroy: clipsl@ipsl.jussieu.fr http://documents.cern.ch/AGE/current/fullAgenda.php?ida=a021814

  2. The EO WebMap Portal • The scientist interacts with the GOME information system using the WebMap portal • This allows the user to choose a geographic area and time interval to be investigated • The WebMap portal retrieves and displays the available GOME products on the map • It does this by communicating with several background services : • Web Map Server – provides map images • Web Service Broker – provides GRID web services • EO Grid Engine – integrates the Data Grid services • Products which were recently requested will be already available • Other products will be processed “on the fly” using the GRID resources

  3. EO Grid Engine GRID Surfer (Desktop application) Web Portal Application Web Mapping Technology Application Web ServiceInterface Earth ObservationGRID Engine Web Services Technology Interface Metadata Management Archive Management JDL Composition Job Execution Data Transfer & Replication GRID + other Technology Data Grid Services Fabric & Resources GRID

  4. Global Ozone (GOME) Data Processing and Validation • The DataGrid testbed provides a collaborative processing environment for 3 geographically distributed EO sites (Holland, France, Italy) • Level-1 data (raw satellite measurements) are analysed to retrieve the physical quantities : Ozone Profiles (Level-2 data) • Ozone Profiles contain measurements of OZONE within a vertical column of atmosphere at a given lat/lon location above the Earth’s surface • Two different Grid processing techniques are being investigated • OPERA (Holland) - Tightly coupled - based on MPI • NOPREGO (Italy) - Loosely coupled - based on Neural Networks • Selected Profiles are validated by comparing them with ground-based LIDAR measurements in a coincident area and time

  5. EDG EO challenge: Processing / validation of 1y of GOME data Raw satellite data from the GOME instrument (~75 GB - ~5000 orbits/y) Level 1 ESA(IT) – KNMI(NL) Processing of raw GOME data to ozone profiles. 2 alternative algorithms ~28000 profiles/day (example of 1 day total O3) LIDAR data (7 stations, 2.5MB per month) IPSL(FR) Validate some of the GOME ozone profiles (~106/y) Coincident in space and time with Ground-Based measurements DataGrid environment Level 2 Visualization & Analyze

  6. EO Use Case File Numbers 1 Year of GOME data : (just one part of a 5-year dataset)

  7. Overview • Demo Part 1 • Ozone Profile Processing • Demo Part 2 • Ozone Profile Validation

  8. Part 1 - GOME Ozone Profile Processing • Select geographic area and time to be investigated • Retrieve list of available Level-1 data files from the Product Catalogue • Transfer files to the GRID • Perform Level-1 Processing, retrieve Ozone Profiles • Visualize results

  9. Processing Sequence 1. Search Level-1 catalogue 12. Return new Level-2 products 2. Retrieve Level-2 products 3. Level-2 Products already registered in RC? 6. Transfer Level-1 data from Archive to the Grid 7. Register Level-1 data 11. Register level-2 data 8. Submit jobs to process Level-1 data 9. Process Level-1 data 10. Transfer Level-2 data to SE EO Product Catalogue Web Portal EO Product Archive EO Grid Engine Yes? 4. Return available Level-2 products  No? 5. Perform GRID processing on-the-fly EDG User Interface EO Replica Catalogue EDG Resource Broker EDG Storage Element EDG Computing Element

  10. ComputingElement Validation Processing Sequence Satellite data validation Lidar site Level 2 Catalogue 2 Level 2 Catalogue Queries and data information retrieval from the Gome Level 2 orbit or pixel metadata catalogues Queries and data information retrieval from the Lidar metadata catalogue 3 Submission of the Job in the GRID GRID Portal Lidar data catalogue 1 GRID Storage Elements with Lidar data 4 When completed comparison between lidar and satellite ozone profiles Storage Elements with Gome L2 data (5/02/2003)

  11. Part 2 - GOME Ozone Profile Validation ERS/GOME satellite 50 km OZONE LAYER 10 km • Goals of the DataGrid application to point out : the capability to validate satellite data with all ground based data available in an easy way: • Comparison of ozone profiles provided by satellite with lidar data in differents locations and times (see the web portal) • Statistical comparison and analysis in order to improve algorithms. Lidar at the Haute Provence Observatory (5/02/2003)

  12. Summary • The Web Portal Integrates several components of the EO Infrastructure • The EO GRID Engine provides a standard way for Web Clients to request GRID operations • The Web Portal and the EO Grid Engine allow the complexity of the underlying components to be hidden from the user • This Framework can be adapted to provide new tools for the satellite end-users

More Related