1 / 24

APA Conference, London, 8-9 November 2011 Mirko Albani

ESA Long Term Data Preservation Activities and SCIDIP-ES project. APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department, European Space Agency). Presentation Outline. ESA Earth Observation Long Term Data Preservation (LTDP) Activities

nadda
Download Presentation

APA Conference, London, 8-9 November 2011 Mirko Albani

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ESA Long Term Data Preservation Activities and SCIDIP-ES project APA Conference, London, 8-9 November 2011 Mirko Albani (Earth Observation Ground Segment Department, European Space Agency)

  2. Presentation Outline • ESA Earth Observation Long Term Data Preservation (LTDP) Activities • SCIDIP-ES Project • ESA LTDP future programme • ESA Earth Observation Long Term Data Preservation (LTDP) Activities • SCIDIP-ES Project • ESA LTDP future programme

  3. Earth Explorers GOCE Earth Watch ESA and Earth Observation missions Since 1977 1990 2000 2010 Earthnet:Access for European users to non-ESA missions: Landsat, SPOT, CZCS, J-ERS, SeaWiFS, ALOS ... Meteo METEOSAT Second GenerationMSG-1, -2, -3 METEOSATM-1, 2, 3, 4, 5, 6, 7 MTG in cooperation with EUMETSAT METOP-1, -2, -3 (Gravity and Ocean Circulation Explorer) Science (Gravity and Ocean Circulation Explorer) to better understand the Earth System (Soil Moisture and Ocean Salinity) SMOS (Polar Ice Monitoring) CryoSat2 (Atmospheric Dynamics Mission) ADM/Aeolus SWARM (Magnetic Mission) (Clouds, Aerosols & Radiation Mission) EarthCARE EE 7 ERS-1, -2 ENVISAT Applications Services Sentinel 1 Sentinel 2 to initiate long term monitoring systems and services Sentinel 3 Sentinel 5P Sentinel 4/5 GMES in cooperation with EC

  4. Long Term Data Preservation: the need • We have now reached about 20 years of continuous measurements from space for many geophysical parameters (even 30 years for some parameters) • Earth Observation data are becoming an essential tool for Earth Science • Long term series of data needed for several applications in different Earth Science domains

  5. Carbon dioxide Courtesy M. Buchwitz, Univ. of Bremen The preservation of EO data (the “bytes”) is useless without the preservation of the knowledge associated with the data (e.g. the “quality”)

  6. Brazil South Atlantic Ocean There is still a lot to discover in the EO data archives A recent example of unexpected result with the 20 years data archive: Geographical variation of the peak localization of the South Atlantic Anomaly since 1992 (using ATSR data) “Monitoring the South Atlantic Anomaly using ATSR instrument series”,S. Casadio & O. Arino [paper published in COSPAR Advance in Space Research]

  7. EO Archives Data volume expected trend The plans of new ESA missions indicates 5-10 times more data to be archived (Level 0) in next 10-15 years.

  8. ESA EO LTDP Preliminary Programme 2009-2011 Objectives: • For all ESA Earth Observation and TPM ESA managed missions: • Ensure and secure the preservation of archiveddataand associated knowledge for an unlimited time span. • Ensure, enhance and facilitate archived data accessibility. • As part of a coordinated and harmonized collective approach among the data owners in Europe (i.e. European EO LTDP Framework) aimed at preserving all European EO data and associated knowledge, at favouring their exploitation and sustained through cooperative (multi-source) long term funding schemes. Most urgent activities to prevent data loss and to enhance accessibility implemented in the ESA archives following the “European LTDP Common Guidelines” and “Data Set Content Standard” defined in cooperation with European EO data owners in the last years

  9. LTDP Workplan 2009 - 2011 European LTDP LTDP Analysis & Implementation Framework Programme Studies ( ESA archives ) Coordination Preparation Technical Content Knowledge ( activities for period Consolidate user preservation beyond Complete , maintain & 2012 onwards ) requirements data archiving evolve the LTDP Common Guidelines Integrity of archived data ESA archives ( involving CEOS / /GEO ) Define data set to be archived beyond telemetry European LTDP Create a European Data access and security Framework collaborative technical Evaluate impact of framework Cost latest technologies Interoperability and standardization Funding options Analyse & coordinate with other international ESA general and Archives exploitation LTDP projects ( e . g . mandatory budgets funded by EC) EC relation / Interfaces National Budgets Schedule ESA EO LTDP Preliminary Programme 2009-2011 Work Plan Analysis and Studies Implementation activities Evolution activities

  10. International EO LTDP Context ESA membership Participation to several projects Standards (e.g. OAIS) WGISS LTDP task

  11. SCIence Data Infrastructure for Preservation – Earth Science Project Overview Contacts: Mirko.Albani@esa.int www.scidip-es.eu (under construction)

  12. Introduction and Participants Project: SCIence Data Infrastructure for Preservation – Earth Science (SCIDIP-ES) INFRA-2011-1.2.2 Data infrastructures for e-Science • Project ID:283401 • Project Type: CP-CSA • Start Date: 01.09.2011 • Duration: 36 Months • Website: www.scidip-es.eu • Total Budget: 7,721,082 € • EC Funding: 6,599,992€ • Total funded effort in person/months: 605 • Coordinator: European Space Agency • Contact Person: Mirko Albani (EOP-GS) Project Consortium (17 partners):

  13. Digital data preservation: the need “A fundamental characteristic of our age is the raising tide of data – global, diverse, valuable and complex . In the realm of science, this is both an opportunity and a challenge.” Report of the High-Level Group on Scientific Data, October 2010 “Riding the Wave: how Europe can gain from the raising tide of scientific data” SCIDIP -ES Earth Science 2

  14. SCIDIP-ES Context European preservation agenda High Level Expert Group European E-Infrastucture Other Communities From generic to specific Virtual Centre of Excellence From specific to generic Earth Science Case The case The users Earth Science 3 2

  15. Main Objectives • Deliver generic sustained services for long-term preservation and usability as part of the data infrastructure for e-Science. • Harmonize data preservation policies, approaches and tools in the Earth Science Domain. • Demonstration through advanced test-beds.

  16. Approach: the HLEG Vision • “Researchers and practitioners from any discipline are able to find, access and process the data they need. They can be confident in their ability to use and understand data and they can evaluate the degree to which the data can be trusted”. SCIDIP-ES addresses these points in the following ways: • By working closely with real users. • By ensuring the availability of an effective governance and • maintenance of the services from the start, and by not trying to impose • a top-down system. • By addressing disciplinary and cross-disciplinary strategies for • metadata definition to ensure that data can be re-used. • By applying the subsidiarity and taking advantage of the growing need for • researchers to use data from outside their own discipline.

  17. Action Plan Combine a top-down, data centric point of view, using a proven design for generic infrastructure services for persistent storage, access and management, with a bottom- up, user-centric view, based on requirements, development, testing and validation, from the Earth Science community, within the framework of OAIS.

  18. SCIDIP-ES Work packages relation

  19. SCIDIP-ES Services

  20. Projects & Dissemination links ESA LTDP APA Members Organizations APA Virtual Center of Excellence Earth Science Community Research Projects

  21. SCIDIP-ES results • SCIDIP-ES will provide by the end of the project: • Generic sustained long-term preservation services tested, validated and used in different domains and in particular in the Earth Science one. • Harmonized Earth Science data preservation policies, approaches and architecture. SCIDIP - ES is a practical answer to one of the most challenging problems of the current digital era using the sensitive Earth Science domain as pathfinder.

  22. Presentation Outline • ESA Earth Observation Long Term Data Preservation (LTDP) Activities • SCIDIP-ES Project • ESA LTDP future programme • ESA Earth Observation Long Term Data Preservation (LTDP) Activities • SCIDIP-ES Project • ESA LTDP future programme

  23. ESA LTDP Future Programme • It covers the period beyond 2013 and will be submitted to ESA delegations in 2012 for approval as part of the ESA mandatory activities. • Objective to guarantee long term preservation, access and exploitation of data, and associated knowledge, archived at ESA facilities and generated by ESA and ESA-managed Third Party missions in ALL fields of space Science and in particular: • Scientific data generated by payloads and instruments onboard space platforms (e.g. spacecrafts, ISS) today not preserved systematically. • Enabling and supporting ESA’s and European Exploitation Programmes and activities requiring long term data series (e.g. Climate Change Initiative) or the utilization of old data holdings in the long term (e.g. in astronomy for change detection in stars, pre-ISS missions in Life & Physical Sciences) and to support new missions. • In coordination with other space science data owners in Europe aiming at coherently preserve all European space data and associated knowledge. • Preservation and access to spaceborn Science data and associated knowledge is fundamental. The ESA LTDP Programme will significantly contribute to the future of science (and in particular Earth Science).

  24. Thank you ! Contacts: Mirko.Albani@esa.int

More Related