News from the EB & LCG Nick Brook University of Bristol

1. News from the EB & LCG Nick Brook University of Bristol • EB News • LCG News • Structures • Review of RTAGs Nick Brook – University of Bristol

2. EB News • Roger Barlow re-elected as deputy chair of the EB • will take over as chair September’03 • Reporting structures in place • Measures manpower effort and deadlines but also requests expt reqts of UK (Tier1/A) resources • First reports appear for Q2’02 – available on EB web page • Next submissions are due now Nick Brook – University of Bristol

3. EB News • 6 application submissions to Sheffield All-Hands conference • Applications are beginning to deliver their projects • New format to GridPP expt sessions • All but one application position is now filled (last remaining vacant post will be filled beginning of October) • Successful joint ATLAS-LHCb workshop at Coseners • http://www.phy.bris.ac.uk/research/pppages/LHCb/coseners/CosenersHouse.htm Nick Brook – University of Bristol

4. Fundamental Goal of the LCG To help the experiments’ computing projects get the best, most reliable and accurate physics results from the data coming from the detectors Phase 1 – 2002-05prepare and deploy the environment for LHC computing Phase 2 – 2006-08acquire, build and operate the LHC computing service Nick Brook – University of Bristol

5. Phase 1 - High-level Goals To prepare and deploy the environment for LHC computing • development/support for applications – libraries, tools, frameworks, data management (inc. persistency), …….. common components • develop/acquire the software for managing a distributed computing system on the scale required for LHC –the local computing fabric, integration of the fabrics into a global grid • put in place a pilot service– • “proof of concept” – the technology and the distributed analysis environment • platform for learning how to manage and use the system • provide a solid service for physics and computing data challenges • produce a TDR describing the distributed LHC computing system for the first years of LHC running • maintain opportunities for re-use of developments outside the LHC programme Nick Brook – University of Bristol

6. The LHC Computing Grid Project Organisation Common Computing RRB (funding agencies) LHCC Reviews Resources Reports Project Overview Board Requirements, Monitoring ProjectExecutionBoard Software andComputingCommittee(SC2) Nick Brook – University of Bristol

7. SC2 & PEB Roles • SC2 includes the four experiments, Tier 1 Regional Centres • SC2 identifies common solutions and sets requirements for the project • may use an RTAG – Requirements and Technical Assessment Group • limited scope, two-month lifetime with intermediate report • one member per experiment + experts • PEB manages the implementation • organising projects, work packages • coordinating between the Regional Centres • collaborating with Grid projects • organising grid services • SC2 approves the work plan, monitors progress Nick Brook – University of Bristol

8. SC2 Monitors Progress of the Project • Receives regular status reports from the PEB • Written status report every 6 months • milestones, performance, resources • estimates time and cost to complete • Organises a peer-review • about once a year • presentations by the different components of the project • review of documents • review of planning data Nick Brook – University of Bristol

9. Project Execution Organisation Four areas – each with area project manager • Applications • Grid Technology • Fabrics • Grid deployment Nick Brook – University of Bristol

10. RTAG status • in application software area • data persistency completed – 5th April 02 • software support process completed – 6th May 02 • mathematical libraries completed – 2nd May 02 • detector geometry description running • Monte Carlo generators running • applications architectural blueprint running • detector simulation running • in fabric area • mass storage requirements completed – 3rd May 02 • in Grid technology and deployment area • Grid technology use cases completed – 7th June 02 • Regional Centre categorisation completed – 7th June 02 Current status of RTAGs (and available reports) on www.cern.ch/lcg/sc2 Nick Brook – University of Bristol

11. Data Persistency (RTAG1) Technology • Streaming layer should be implemented using the ROOT framework’s I/O services • Components with relational implementations should make no deep assumptions about the underlying technology • Nothing intentionally proposed that precludes implementation using such open source products as MySQL Nick Brook – University of Bristol

12. Data Persistency (RTAG1) • Implementation – POOL • Five work package areas: • Storage Manager & refs • File catalog & Grid integration • Collections & Metadata • Dictionary & Conversion • Infrastructure, Integration & testing • http://lcgapp.cern.ch/projects/persist Nick Brook – University of Bristol

13. Grid Use Cases (RTAG4) 79 page report & 43 use cases Global Summary of EDG Response • Use case is already implemented (release 1.2) – 19 • Mostly basic job submission and basic data management • For half of these, WP8 agrees that the functionality is implemented in 1.2, but the implementation is quite a bit more complex than that outlined in the use case (esp. data management). The release 2.0 implementations look simpler. • Planned for release 2 – 10 • Will be considered for release 3 – 4 • Use case not detailed enough – 4 • VO-wide resource allocation to users – HEPCAL did not make strong requirements on security • “Job Splitting” and “Production Job” – were purposely vague in HEPCAL due to lack of clear vision of how massive productions will be run on the Grid. One job auto-split into thousands? Or thousands of jobs somehow logically grouped into one production? • Not planned for any release – 7 • Software publishing • Virtual Datasets (reliant on GriPhyn) Nick Brook – University of Bristol

14. Regional Centres (RTAG6) • A service oriented view should be adopted for categorization of regional centres • It could be profitable to revisit the overall computing model in terms of services around 2004 • The important aspects to categorize RCs are • Commitment to guarantee data management at a high QoS for the lifetime of LHC • Commitment to guarantee state-of-the-art network bandwidth to ensure efficient inter-operation • Commitment to contribute to collaborative services Nick Brook – University of Bristol

15. LCG Blueprint (RTAG8 - ongoing) Precepts • Software structure: STL/utilities, “core” infrastructure, “specialised” infrastructure • Component model: APIs (embedding frameworks, “own” plug-ins, end users), physical/logical module granularity, role of abstract interfaces, … • Service model: Uniform, flexible access to basic framework functionality • Object models: dumb vs. smart, enforced policies with run-time checking, clear and bullet-proof ownership model • Distributed operation • Global objects • Dependencies: minimisation between components, run-time rather than compile-time • Interface to external components: generic adapters – version & variant identification • Exception handling Nick Brook – University of Bristol

16. LCG Blueprint (RTAG8 - ongoing) • Scripting, interpreter (ROOTCINT, PYTHON) • GUI toolkits (to build expt specific interfaces) • Graphics (underlying general tools) • Analysis tools (histogramming, fitting, graphical representation, …) • Math libraries and statistics (already established) • Job management • Core services (platform indep interface to system resources on LCG platforms – Linux (gnu & intel compilers), Solaris & Windows) • Foundation and utility libraries (essentially maths libs & core services) • Grid middleware interfaces (already an agreed 2 expt “common” project - GANGA) Nick Brook – University of Bristol

17. LCG Blueprint (RTAG8 - ongoing) • Object dictionary and object model (in context of POOL) • Persistency and data management (in context of POOL) • Event processingframework (poss. long term common project components) • Event model • Event generation (ancilliary services & support) • Detector simulation (ditto) • Detector geometry and materials (standard tools for describing, storing & modeling detector geometry) • Trigger/DAQ • Event reconstruction • Detector calibration Nick Brook – University of Bristol

18. LCG Summary • GridPP input to both overall management structure on LCG and the RTAG activities • Activities are beginning to take off • Persistency (POOL) • Software processing & infrastructure • Grid deployment board – Oct 4th first meeting • Interaction with middleware providers (not just EDG) • RTAG procedures seems to be slow at taking off • Lack of consistency early on – addressed by “Blueprint” RTAG • Time consuming, often overlap of necessary experts Nick Brook – University of Bristol