330 likes | 659 Views
Introduction to WDCC / CERA Database. The CERA Database World Data Center for Climate Long Term Data Archiving Retrieval and Download of Data. CERA Database: Some Facts. Oracle Database (Enterprise Edition Version 9.2) Hardware: NEC SX-6 nodes (6) 24 TByte attached disk space
E N D
Introduction to WDCC / CERA Database • The CERA Database • World Data Center for Climate • Long Term Data Archiving • Retrieval and Download of Data
CERA Database: Some Facts • Oracle Database (Enterprise Edition Version 9.2) • Hardware: NEC SX-6 nodes (6) • 24 TByte attached disk space • 280 TByte of data • Largest Database in the World • 900 named Users • Data accessible via Internet • Free Access to Metadata • Account needed for Download
IPCC IPCC-DDC WOCE BALTEX GEBCO ERA40 HOAPS CEOP ENSEMBLES COSMOS CARIBIC ERA15/40 EH5/MPI-OM IPCC-AR4 NCEP Simulations @ MPI, GKSS,… CERA Database Content March 2007: 280 TB / 900 Experiments / 110.000 Data Sets Data from Earth System Modelling and Related Observations
CERA Metadata Model Data and Meta data
WDCC (World Data Center Climate) • Start: Approved in January 2003 • Maintenance: Model and Data (M&D/MPIMET) and German Climate Computing Centre (DKRZ) • Mission: Data for climate research are collected, stored and disseminated • ICSU Policy: long-term archiving and unrestricted data access for scientists • Restriction: Only climate data products in CERA DB, no raw data storage. • Content:Emphasis is on climate modelling and related data products. • Co-operation:with thematically corresponding data centres like WDC-MARE (Bremen) and WDC-RSAT (Oberpfaffenhofen) • URL: http://www.wdc-climate.de/
Long Term Data Archiving in WDCC • Interested in Long Term Archiving Climate Data in WDCC? • Inclusion can be done (by Model & Data) if following conditions are met: • climate data are of general interest • data should become available to a broader community • data size is small relative to the data archive size
Archiving Data in CERA Database • Provide data in a structure that can be transferred into the data base without further processing (timeseries) • meta data: Provide XML-files (experiment / datasets / dataset_group) • XML-templates available from : • http://cera-www.dkrz.de/Meta_Fill/or • http://cera-www.dkrz.de/Meta_Fill/mod_metadata.html • First Step: please contact data@dkrz.de !
Further Information • M&D's webpage: • http://www.mad.zmaw.de • WDC Climate: • http://www.wdc-climate.de • CERA Database: • http://cera-www.dkrz.de • Help: • data@dkrz.de(Request Tracker)
Browse and Download data • Access CERA Database • http://cera-www.dkrz.de
Batchjob: jblob, jblob.dat Interface 2:‘jblob‘ command line based tool Batch download and download of large datasets: • Java based: Unix/Linux: jblob Windows: jblob.dat • JDBC Connection (Java Database Connectivity) • Examples:jblob –datasetname <name> -optionsjblob –datasetid <id> -optionsjblob –showdatasets “<search_string>” (% as wildcard) See http://cera-www.dkrz.de
Summary: WDCC based on CERA db infrastructure • Use CERA GUI to Browse and Search Data • Add datasets to Process List for download • Large datasets / Batch download: use jblob • Help: write mail to data@dkrz.de
Contact Coverage Reference ENTRY - Experiment - (dataset_group) - dataset Status Parameter Spatial Reference Distribution Local Adm. Data Org Data Access Data Catalogue … based on CERA-2 Metadata model (PIK, AWI, DKRZ)