180 likes | 274 Views
Overview of GGF1 (Global Grid Forum) and Datagrid meeting, NIKHEF, Mar 5-9 http://www.globalgridforum.nl/. F Harris(Oxford). Overview of presentation. Programme and purpose of meetings Summary of WP8 (HEP applications) reaction Some specific LHCb reaction
E N D
Overview of GGF1 (Global Grid Forum) and Datagrid meeting, NIKHEF, Mar 5-9http://www.globalgridforum.nl/ F Harris(Oxford) F Harris LHCb Software Week
Overview of presentation • Programme and purpose of meetings • Summary of WP8 (HEP applications) reaction • Some specific LHCb reaction • Actions arising out of meeting - the LHCb programme of work F Harris LHCb Software Week
Programme and Purpose of meetings • GGF1 (Mar 5-7) • First in sequence of ‘global’ meetings -US and Europe coming together. Origins in US. • Attendance ~ 400 • Working groups to develope GRID Services and Applications • Tutorials (Globus, Advanced XML etc.) • Datagrid (Mar 7-9) • First meeting since contract start Jan 1,2001 • Attendance ~200; LHCb~12 - Nikhef,UK,Fr, It,CERN • Working groups on middleware,testbeds, networking,applications F Harris LHCb Software Week
Cosmology Chemistry Environment Applications High Energy Physics Biology Distributed Data- Remote Problem Remote Collaborative Computing Intensive Visualization Solving Instrumentation Application Applications Applications Applications Applications Applications Toolkits Toolkit Toolkit Toolkit Toolkit Toolkit Toolkit Grid Services Resource-independent and application-independent services (Middleware) authentication, authorization, resource location, resource allocation, events, accounting, remote data access, information, policy, fault detection Resource-specific implementations of basic services Grid Fabric E.g., Transport protocols, name servers, differentiated services, CPU schedulers, public key (Resources) infrastructure, site accounting, directory service, OS bypass The Grid from a Services View Applications : E.g., : F Harris LHCb Software Week
Five Emerging Models of Networked Computing From The Grid • Distributed supercomputing • synchronous processing • High-Throughput Computing • large scaleasynchronous processing • On-Demand Computing (and interactive) • dynamic resources • Data-Intensive Computing • databases • Collaborative Computing (sharing) • scientists • Last 4 models apply to HEP F Harris LHCb Software Week
Reminder of WP8 aims, and the LHCb rolehttp://datagrid-wp8.web.cern.ch/DataGrid-WP8/ • Interfacing HEP applications to GRID, and developing the applications to take advantage of GRID • Year 1 milestones • end June Planning doc ‘ Requirements for GRID services ’ • end Dec Report on Run 0 with M9 release • Activity in several institutes (e.g interfacing MC production to GRID; thinking about analysis model and data management) F Harris LHCb Software Week
Relationship of applications to GRID Architecture Group HEP applications TWG I.Augustin (Chair, CERN) C.Charlot (CNRS) A.Tricomi (INFN) K.Bos (NIKHEF) D.Newbold (PPARC) P.Cerello (ALICE) C.Tull (ATLAS) A.Sciabà (CMS) E.VanHerwijnen (LHCb) D.Brugnoni (WP9) R.Medina (WP10) ATF EO applications Biology applications F Harris LHCb Software Week
The multi-layer hourglass Specific application layer ALICE ATLAS CMS LHCb WP9 WP 10 VO common application layer WP8-9-10 TWG HEP Earth Obs. Biology DataGRID middlewarePPDG, GriPhyn, EuroGRID DataGRID ATF GLOBUS team Bag of Services (GLOBUS) OS & Net services F Harris LHCb Software Week
Status of WP 8-10 use case and requirements documents • ‘User cases and urgent requirements for Test Bed 0 & 1’ (meet with ATF 26 Mar and security Mar 29) • Available for WP8 • Available for WP9(ESA) • User cases for Test Bed 2 & 3 (analysis etc..) • Draft in one month for WP8 • There will be discussions next week in WP8 • Common user requirements (Specifications) • Together with WP9 and WP10 • First draft in one month • First release at PM6 (EU reqt) F Harris LHCb Software Week
Strategy for Test Beds • Need test beds to • Validate existing software (applications & DataGRID) • Develop our long-term vision (not only use cases) • Move to at least one site per ‘active’ country - but carefully, otherwise chaos! • Start first serious tests for CERN and RAL. Move to others (Liverpool,Lyon,Nikhef,Bologna...) according to success • Usable environment for test • High-availability stable release of GLOBUS • Separation from development and production F Harris LHCb Software Week
Minimal Requirements for Testbed 0 (NOW!) • Working release of GLOBUS • Plus support for it! • Uniform, dependable () certification / authentication mechanism • One single login good for all test bed sites • Possibility to add users from experiments F Harris LHCb Software Week
Test bed installation kits • Products requiring root(system privileges) access • OS, compilers, Objectivity… • To be installed by WP6 • CERN products installation kits • CLHEP, GEANT4, CERNLIB… • Kits provided by CERN / IT and installed by WP6 • Experiment environment installation kits • Kits provided by experiment and installed by WP8 funded effort F Harris LHCb Software Week
Some Reactions to ATF (preliminary) • Do we really want to use files? • ??Higher level data handling concept needed • We may want to use objects when interacting with DataGRID middleware • We may need UML/IDL models • Is interactive use taken into account in the design? • We need to talk more here • We will propose interactive use cases F Harris LHCb Software Week
Reactions to ATF (preliminary) • MPI and CORBA will be needed (Biology) • There will be read/write databases! • Database update has to be taken into account • Concerns on portability • Running on Linux and Solaris is not enough • The code should be written to run on any machine with a reasonable cc/java • Worries about the use of CONDOR • Will we all have to install CONDOR? • Is the code Open Source? F Harris LHCb Software Week
Reactions to ATF (preliminary) • Security is a concern for the M9 release • All implementations should go via some secure mechanism (globus init?) • We met with ATF Mar 26 to discuss our reaction to M9 deliverables draft • ‘Decided’ to decouple M9 deliverables and long term architecture planning F Harris LHCb Software Week
Specific LHCb reactions (post Amsterdam) • We should broaden the GRID involvement of LHCb sites ( but maybe not make all of them part of first Datagrid Testbed?) • installation of Globus and LHCb s/w at our sites • In parallel broaden our production but separate from GRID tests to start with • We must develop our data and analysis models and map them to the GRID • Atlas are looking at mapping Athena/GAUDI to GRID • ?our physics application layer running above GAUDI F Harris LHCb Software Week
Execution Control/Location(some thoughts from C Tull(Atlas) • Execution in a fully grid-enabled manner involves locating, authenticating, brokering, and scheduling the use of appropriate grid resources (Security Services should be included here). • The Athena/Gaudi Application Manager as the entity responsible for execution control in the framework might interface to appropriate grid services. F Harris LHCb Software Week
More on actions arising out of meeting - the LHCb programme of work • Setting up LHCb GRID testbed (see Eric’s and Martin’s talks) • Developing our analysis model (see Glenn’s talk) • Interfacing our OO software to the GRID (see Pere’s talk) • Hoping to organise brainstorming workshop ( ? Bologna late May/early June) F Harris LHCb Software Week