1 / 28

Information System and Data Center for Earth Observation Data

Information System and Data Center for Earth Observation Data. The Electronic Geophysical Year. Bernd Ritschel, GFZ Potsdam, Data Center rit@gfz-potsdam.de. ISDC collaboration projects. CHAMP and GRACE satellite missions

lucas
Download Presentation

Information System and Data Center for Earth Observation Data

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Information System and Data Centerfor Earth Observation Data The Electronic Geophysical Year Bernd Ritschel, GFZ Potsdam, Data Center rit@gfz-potsdam.de CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  2. ISDC collaboration projects • CHAMP and GRACE satellite missions Orbit/Gravity + Magnetic/Electric Field + Atmosphere data • GGP (Global Geodynamic Project) Superconducting Gravimeter + auxiliary data • GNSS (Galileo testbed phase 1 project) GFZ Potsdam GPS ground stationdata • GPS-PDR (Potsdam-Dresden-Reprocessing) GPS Orbit +Earth rotation parameterdata CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  3. ISDC collaboration projects • GGSP (Galileo Geodetic Service Provider) GPS time series, orbit, ERP, SLR, auxiliary data • TerraSAR-X Orbit + Atmosphere/Ionosphere data • ICGEM (International Centre for Global Earth Models) Global Earth gravity models • GGOS (Global Geodetic Observing System) CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  4. ISDC portal homepage:isdc.gfz-potsdam.de CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  5. ISDC portal – Product types:isdc.gfz-potsdam.de/product_types CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  6. Number and volume of data • 275 different product types from different geoscience domains • 92 product types for public use • 4 product types with extended rights for specific science team members • 183 product types for internal use only • > 10 Terra Byte of data • > 12 Million products • > 1500 national and international users and user groups • 14 data provider (scientific groups) GFZ + NASA CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  7. ISDC user - country graph CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  8. User Development graph User development (2007-05-04) 1471 users and user groups CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  9. Product data flow Number of data files flow (2007-05-04) CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  10. ISDC architecture schema Provider User ISDC ISDC CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  11. ISDC main system components deployment CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  12. Data pump Producer User Meta data ISDC Metadata Standard = Parent DIF (V. 9.x) + Extended Child DIF(s)* http://gcmd.nasa.gov/User/difguide/difman.html *in preparation CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  13. ISDC data lifecycle management (1) • ISDC product philosophy (product = metadata + data) • Providing the input of data via proprietary FTP directories (GFZ-intern + extern) for data providers • Ensuring the sustainability of data by • Long-term archiving (storage of original data set + copy) • Online Product Archive (OPA) • Filling and maintaining the ISDC clearinghouse = product catalog CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  14. ISDC data lifecycle management (2) • GUI and API for product retrieval • Product type dependent retrieval forms • Product browser • Product request list file for bulk requests • Providing the output of data and metadata by proprietary FTP directories (GFZ-intern + extern) for each user • Personalization (favorites, Really Simple Syndication [RSS] feeds, notification mail configuration) • User management, user forum, monitoring components, … CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  15. ISDC data lifecycle management (3) Missing tasks: • Harmonization of data • Tailoring of data • Merging of data • Aggregation of data • Delete of data • Prediction data • Semi-finished products • Back up files Science driven data review process is necessary => Enhancement of data interoperability => Providing data for other scientific domains => Keeping the operational status CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  16. Recent activities (1) • Preparing the TerraSAR-X data management • Improving metadata (management) interoperability • Using and developing the Directory Interchange Format Standard Version 9.x • Changing from ASCII-based DIF to XML-based DIF documents • Introduction of specific ISDC parent - child principle • Using XML database for parent DIF XML documents • Providing thematic catalog product search using ISDC catalog metadata ontologies CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  17. Recent activities (2) • Developing a service for publication of data via unique identifier (e.g. DOI, URN) • ISDC is part of CEOS International Directory Network (IDN) gateway to Earth science data and information maintained by NASA's GCMD • Implementing framework S/W and preparing ISDC DIF metadata XSLT for ISO 19115 compliant CWS CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  18. CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  19. ISDC and GCMD DIF (1) • 1988: evaluating metadata standards for the management of data and information for the multi-domain GFZ CHAMP satellite mission • Adapting GCMD DIF for unique identifying data sets => developing DIF based ISDC product philosophy • 2000: using enhanced DIF metadata for CHAMP products => CHAMP ISDC • 2004: using enhanced ISDC DIF for American-German GRACE satellite mission products => GRACE ISDC • Developing a portal framework based data and information manangement portal => ISDC portal CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  20. ISDC and GCMD DIF (2) • 2006: integrating more projects (GGP, GGSP, …) into the new ISDC portal using ISDC DIF metadata • 2006/2007: providing XML based ISDC DIF documents to the GCMD (using GCMD DIF builder) • 2007: evaluating and adopting XML DIF V. 9.x standard XML schema for ISDC objectives => introducing new ISDC parent – child DIF (1:n) relation for product types as well as for data files of a specific product type • ISDC is using the new parent – child DIF relation for the products of the GPS-PDR project (GPS orbits, Earth rotation parameters, quality files) CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  21. ISDC and GCMD DIF (3) • Product type independent base DIF V.9 XML schema • Product type dependent parent DIF V.9 XML schema • Product (data file) dependent child DIF XML schema Generating GCMD DIF standard compliant metadata documents • Product typ referencing parent DIF V.9 XML document • Product (data set) referencing child DIF XML document • (containing skinny DIF + data file describing data) CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  22. ISDC Parent DIF V.9 XML document CH-OG-3-RSOXML schema: base-dif.xsd, CH-OG-3-RSO.xsd ... -<DIF: xmlns: ...“http://isdc.gfz-potsdam.de/xsd/base-dif.xsd”> CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  23. ISDC Child DIF V.9 XML document CH-OG-3-RSO+CTS-CHA_2000_219_10 <Parent_DIF>CH-OG-3-RSO</Parent_DIF> +<Data_Parameters> CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  24. CH-OG-3-RSO Data Parameters CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  25. ISDC DIF XML schema • ISDC DIF is complex type => product type dependent DIF documents inherit base DIF schema attributes • Using references via complex type definitions (e.g. roles) • Using enumeration constructions for attributes like role, data progress, … • Entry_id with “+”sign in the name (necessary for data file depenent child DIF documents • Using XSLT or database procedures for DIF to ISO 19115 transformation process => is there a GCMD DIF2ISO implementation available? => why not changing completely to ISO19115? CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  26. GCMD ISDC Collaboration • Joint developing geoscience standards for metadata and services • DIF Version … (down compatible!) • Catalog web services (CWS) and interfaces • Networking catalogs using CWS techniques (OGC ISO 1911x, Z39.50, …) • Connecting data and publications using DOI concept(unique identifyer for data files) • Evaluating the ESML (Earth Science Markup Language) and derivates (e.g. QuakeML, …) for usage for metadata and data description as well as exchange • Developing an API for uploading DIF documents CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  27. More about GGOS on Friday at the plenary CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

  28. Thank you very much for your attention! rit@gfz-potsdam.de CEOS Working Group on Information Systems and Services, WGISS-23, Hanoi, May 21 - 25, 2007

More Related