220 likes | 314 Views
Introduction Course 2006 Services and Facilities of DKRZ and M&D Integrating Model and Data Infrastructure (IMDI) and the World Data Center for Climate (WDCC). Michael Lautenschlager + Hannes Thiemann Modelle und Daten Max-Planck-Institut für Meteorologie, Hamburg Hamburg, 29.03.06. WDCC
E N D
Introduction Course 2006Services and Facilities of DKRZ and M&DIntegrating Model and Data Infrastructure (IMDI)and theWorld Data Center for Climate (WDCC) Michael Lautenschlager + Hannes Thiemann Modelle und Daten Max-Planck-Institut für Meteorologie, Hamburg Hamburg, 29.03.06
WDCC • IMDI
Central Components of IMDI SCE: Standard Compile Environment for flexible model assemblage and compilation SRE: Standard Run Environment for efficient use of HPC architectures WDCC: World Data Center for Climate for long-term archiving and international, interdisciplinary data dissemination according to the rules of the ICSU WDC system
IMDI objective: Integrate any earth system model on any platform …. requires standards for .... Source Codes Component models Coupling software Compilation environment Running environment Quality assessment Postprocessing environment Visualization environment Objective and requirements
Common look-and-feel for all models Common look-and-feel for all platforms Portability profit from future developments Support (M&D, PRISM Team, vendors) Wide community of users Facilitation of model exchange within a coupled configuration between institutes Post-processing, visualisation tools Benefits from IMDI
Sea Ice OASIS3 LandSurface MarineBiogeo- chemistry Complexity of Earth System Models in IMDI OCEAN ATMOSPHERE Atmospheric Chemistry
(Coupled) ModelComponent models ECHAM5 ECHAM5 ECHO (=MPI-AO) ECHAM5 + MPI-OM EOL ECHAM5 + OPA+LIM MPI-AOB ECHAM5 + MPI-OM+HAMOCC MPI-AO-PISCES ECHAM5 + MPI-OM+PISCES MPI-OM MPI-OM MPI-OB MPI-OM+HAMOCC MPI-O-PISCES MPI-OM+PISCES IPSL_CM4 OPA+LIM + LMDZ+ORCHIDEE OPATOY OPA+LIM + TOY4OPA TOYCLIM TOYATM + TOYOCE + TOYCHE Model configurations adapted to the SCE and SRE
Linux i686 divers inst. Cray X1 Cray, France IBM Power4 ECMWF, Reading Fujitsu Opteron Cluster F.S.E. Toulouse Fujitsu VPP5000 Meteo France, Toulouse NEC SX-5 IPSL, Paris NEC SX-6 e.g. DKRZ, Hamburg SGI Altix 3000 e.g. CERFACS, Toulouse SGI IRIX64 SGI, Munich SGI Origin 3800 KNMI, De Bilt PRISM Platforms
Retrieving the code Source code modifications Compilation CVS Repository Experiment Flow in SCE + SRE Compile script generation Experiment configuration Tasks generation Output Data Post-processing Model Execution Archiving Visualisation
archive output data Restart files Standard Running Environment executables mod1_ID.MPI[1,2].frm mod2_ID.MPI[1,2].frm oasis3.MPI[1,2].frm Input data Create_TASKS.frm cplmod expid [node] RUN_cplmod_expid model execution POST_cplmod_expid postprocessing VIS_cplmod_expid visualization SAVE_cplmod_expid archiving
comments_cplmod.h queue_commands_node.h setup_cplmod_expid complete_setup_cplmod.h functions.h calendar.h create_directories.h get_executables_cplmod.h get_input_data_model.h namelist_model.h launching_cplmod_node.h save_output_model.h submit_next_jobs.h The Runscript Definitions Preprocessing Execution Postprocessing Job submission cplmod: coupled model node: node name expid: experiment ID model: component model for all component models and the coupler
WDCC The WDCC is IMDI's central component for data archiving and data dissemination Start: Approved in January 2003 Maintenance: Model and Data (M&D/MPIMET) and German Climate Computing Centre (DKRZ) Mission: Data for climate research are collected, stored and disseminated ICSU Policy: long-term archiving and unrestricted data access for scientists Restriction: Only climate data products in CERA DB, no raw data storage. Content:Emphasis is on climate modelling and related data products. Co-operation:with thematically corresponding data centres like WDC-MARE (Bremen) and WDC-RSAT (Oberpfaffenhofen) URL: http://www.wdc-climate.de/
IPCC IPCC-DDC WOCE BALTEX GEBCO ERA40 HOAPS CEOP ENSEMBLES COSMOS CARIBIC ERA15/40 EH5/MPI-OM IPCC-AR4 NCEP Simulations @ MPI, GKSS,… WDCC Content March 2006: 220 TB / 566 Experiments / 77.000 Data Sets Data from Earth System Modelling and Related Observations
Contact Coverage Reference Entry Status Parameter Spatial Reference Distribution Local Adm. Data Org Data Access WDCC Data Catalogue … based on the CERA-2 data model
WDCC Database Size March March
M&D's webpage: http://www.mad.zmaw.de WDC Climate: http://www.wdc-climate.de Assistance: model@dkrz.de data@dkrz.de Further information