100 likes | 221 Views
Advanced Computing Services for Research Organisations. Bob Jones Head of openlab IT dept CERN.
E N D
Advanced Computing Services for Research Organisations Bob JonesHead of openlabIT deptCERN This document produced by Members of the Helix Nebula consortium is licensed under a Creative Commons Attribution 3.0 Unported License.Permissions beyond the scope of this license may be available at http://helix-nebula.eu/. The Helix Nebula project is co-funded by the European Community Seventh Framework Programme (FP7/2007-2013) under Grant Agreement no 312301
Data flow to permanent storage: 4-6 GB/sec 200-400 MB/sec 1-2 GB/sec 1.25 GB/sec 1-2 GB/sec 3
WLCG – what and why? • A distributed computing infrastructure to provide the production and analysis environments for the LHC experiments • Managed and operated by a worldwide collaboration between the experiments and the participating computer centres • The resources are distributed – for funding and sociological reasons • Our task was to make use of the resources available to us – no matter where they are located • Secure access via X509 certificates issued by network of national authorities - International Grid Trust Federation (IGTF) • http://www.igtf.net/ • Tier-0 (CERN): • Data recording • Initial data reconstruction • Data distribution Tier-1 (11 centres): • Permanent storage • Re-processing • Analysis • Tier-2 (~130 centres): • Simulation • End-user analysis 4
Broader Impact of the LHC Computing Grid • WLCG has been leveraged on both sides of the Atlantic, to benefit the wider scientific community • Europe (EC FP7): • Enabling Grids for E-sciencE (EGEE) 2004-2010 • European Grid Infrastructure (EGI) 2010-- • USA (NSF): • Open Science Grid (OSG) 2006-2012 (+ extension?) • Many scientific applications Archeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences … 5
How to evolve WLCG? • A distributed computing infrastructure to provide the production and analysis environments for the LHC experiments • Collaboration - The resources are distributed and provided “in-kind” • Service - Managed and operated by a worldwide collaboration between the experiments and the participating computer centres • Implementation - Today general grid technology with high-energy physics specific higher-level services Evolve the Implementation while preserving the collaboration & service 6
CERN openlab in a nutshell • A science – industry partnership to drive R&D and innovation with over a decade of success • Evaluate state-of-the-art technologies in a challenging environment and improve them • Test in a research environment today what will be used in many business sectors tomorrow • Train next generation of engineers/employees • Disseminate results and outreach to new audiences Contributor (2012) http://openlab.cern.ch 7
A European Cloud Computing Partnership big science teams up with big business 8 Email:contact@helix-nebula.eu Twitter: HelixNebulaSC Website: http://www.helix-nebula.eu/
Open to new members Users ServiceProviders Adopters Interested Parties http://www.helix-nebula.eu 9
Looking to the future • Massive adoption of virtualisation techniques by e-Science centres • To reduce operation costs & simplify deployment of applications using images • Federated identity system • network of trust across public & private organisationssee paper https://cdsweb.cern.ch/record/1442597 • “Grid extensions” added to clouds (first private then public) • Federated identity system, support for virtual organisations, etc. • Use of commercial cloud services as extensions to in-house resources • Blurring of the borders between elements of e-infrastructure (networking, grid & supercomputing) • Because the users & funding agencies demand it • Emergence of a data e-infrastructure • Such systems are helping to create the Digital European research Area by ensuring secure access to and preservation of research data 10