170 likes | 323 Views
IS-ENES [ees-enes] I nfra S tructure for the E uropean N etwork for E arth S ystem Modelling. IS-ENES will develop a virtual Earth System Modelling Resource Centre (vERC). Martin Juckes, BADC. IS- ENES:key facts.
E N D
IS-ENES [ees-enes]InfraStructure for the European Network for Earth System Modelling IS-ENES will develop a virtual Earth System Modelling Resource Centre (vERC) Martin Juckes, BADC
IS-ENES:key facts • Funded by EU Framework Programme 7 to develop infrastructure for Earth System Modelling, 7.6M€, 4 years. • 20 partners, led by IPSL. • Objectives include: • education, • enhancing model efficiency, • model evaluation tools, • data management and • services for data users.
IS-ENES: data management • Core funding objective: enhance European capability to deal with large and diverse datasets from Earth System Modelling projects, using distributed data archives. • Software to support EU contribution to CMIP5/AR5 archive
Challenges • Flexibility: an archive distributed between partners with different funding sources and development priorities. • Accessibility: diverse and growing user group • Getting CMIP5/AR5 archive running • Enhancing user services • Preparing for future archives
Background • CMIP3 [PCMDI], ESG [USA] • METAFOR: develop common information model [EU] • NERC Data Grid: discovery service [BADC] • C3CGrid [DKRZ] • IPCC Data Distribution Centre [BADC/DKRZ] • UK Climate Impacts Programme Data Delivery Package [BADC + UK partners] • GRelC [BSC] • Grid superscalar [CMCC]
www.ipcc-data.org/maps Visualisation
www.ipcc-data.org/maps Visualisation
A few aims • A comprehensive data policy • Optimise resource usage in execution of user services • Enhance the efficiency of metadata transfer between nodes • OGC, wget and OPeNDAP • Visualisation • Regional model support (OPeNDAP + OASIS) • Slice, regrid, differences and aggregates • Checksums • Post download support {e.g. fileStatusAtProvider: <url> }
How might a distributed archive work? Data transformations Core archive Users Data providers
X pdf-maxtemp-bristol UKCIP08 Data Delivery Package
Barcelona Supercomputer Centre Founded in 2004 as Spain’s national computer centre Run the 95Teraflop MareNostrum supercomputer Will provide software for data analysis across a distributed archive
National Computer Centre, Sweden (Linköping University) 59Tflop www.nsc.liu.se
Euro-Mediterranean Centre for Climate Change (CMCC) www.cmcc.it provides models, simulations, middleware, application software and high quality personnel training both in the specific field of climate dynamics and computer technolog
Core archive Core archive • High value data • High service reliability • Provide