1 / 21

The DataGrid Project

This presentation showcases the EDG Testbed, demonstrating how to submit a job on the Grid and highlighting the various modules and services involved in the process.

jenner
Download Presentation

The DataGrid Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The DataGrid Project http://www.eu-datagrid.org/ http://www.dutchgrid.nl NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

  2. Presentation “a quatre mains” EDG and the testbed Kors Job submission (slides) Jeff Job submission (hands on) David 100 Atlas jobs on the Grid Stan …… and all this in 20’ NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

  3. The Project status • at 2/3 of its lifetime • second EU review February 4 and 5 2003 • writing started on a follow-up project in the 6th FP for 2005 • LHC has accepted grid technology for its computing challenge: LCG • EDG software release 1.4 on the testbed • on the testbed: CERN, CNAF, CCIn2P3, NIKHEF, RAL prime sites • currently stress tested by Atlas and CMS with their prod.programs • others, D0, Earth Observ, biologists, etc. are testing as well • EDG tutorials given everywhere, last week at NIKHEF

  4. What we will show you • the layout of the testbed • how to submit a job on the Grid • what modules/services are involved in job submission • how to get/look at the output of your job • how to deal with in- and output- files • Security is very important, but will not be shown • We assume Authentication and Authorisation are done • Once authorised a user can access all resources on the grid • Authentication: once a year, Authorisation: once per session

  5. Current EDG Testbed Testbed1 EDG sites NorduGrid Reference site CERN NorduGrid is as a Grid infrastructure in the Nordic countries Tutorial and Core site Manchester NIKHEF RAL 21 sites 8 sites are in Europe CERN Lyon CNAF About 340 machines are available. Some of them are dual processor. Some machines are only used for EDG. They are split into: - Production - Development

  6. Request Request Result Data On the EDG testbed: Client Application Server Data Server Computing Element/Worker Nodes User Interface Storage Element A 3 Tier Architecture

  7. User Interface (UI) Resource Broker (RB) Information Service (IS) Computing Element (CE) Gatekeeper (Front-end Node) Worker Nodes (WN) Storage Element (SE) Replica Catalog (RC) EDG Logical Machine Types

  8. UI JDL Job Submission Scenario Replica Catalogue (RC) Information Service (IS) Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element CE)

  9. Input Sandbox UI JDL Job Submit Event Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element (CE)

  10. waiting UI JDL Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element (CE)

  11. UI JDL ready Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) waiting Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element (CE)

  12. UI JDL scheduled BrokerInfo Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) waiting ready Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element (CE)

  13. UI JDL Input Sandbox running Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) waiting ready scheduled Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element (CE)

  14. UI JDL running Job Status Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) waiting ready scheduled Resource Broker (RB) Storage Element (SE) Logging & Bookkeeping (LB) Job Submission Service (JSS) Compute Element (CE)

  15. UI JDL done Job Status Job Status A Job Submission Example submitted Replica Catalogue Information Service waiting ready scheduled Resource Broker running Storage Element Logging & Bookkeeping Job Submission Service Compute Element

  16. UI JDL outputready Output Sandbox Job Status Job Status A Job Submission Example submitted Replica Catalogue Information Service waiting ready scheduled Resource Broker running Storage Element done Logging & Bookkeeping Job Submission Service Compute Element

  17. UI JDL Output Sandbox cleared Job Status A Job Submission Example submitted Replica Catalogue (RC) Information Service (IS) waiting ready scheduled Resource Broker (RB) running Storage Element (SE) done Logging & Bookkeeping (LB) Job Submission Service (JS) outputready Compute Element (CE)

  18. The End NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002

  19. Sites Used in this Demo • CERN Production test bed • RB, II, CE, SE and a couple of worker nodes • CNAF Bologna • CE, SE and worker nodes • Rutherford Appleton Lab (GridPP) • CE, SE and worker nodes • CC IN2P3 Lyon • CE and worker nodes • NIKHEF • UI, CE, SE, worker nodes, Replica Catalogue

  20. Local Application Test Bed application test bed node18-*.farmnet.nikhef.nl ui02 (a.k.a. tbn08) ce02 se02 edgmds.dutchgrid.nl CERN lxshare0382 grid-vo.nikhef.nlRC ui01,ce01,se01 RB IS

  21. Example of a Higgs analysis Search in 4-electron channel Choose decay via HZZ  e+e-e+e- ~80% of background given by qq ZZ  e+e-e+e- Fast Atlfast simulation Pythia event generation Parameterization detector response Selection criteria on ‘Reconstructed’ Electron cluster EM Calorimeter information All electrons pT>7 GeV 2 electrons pT>20 GeV Even number of electrons Al least 1 Z with |91.175-m(Z*)|<15 GeV Both Z’s: m(Z*)>20 GeV Cross sections: Background: BR ~ 17 fb Signal (mH=130-200): BR ~ 1-3 fb Luminosity: One grid job of 500 events corresponds to approximately 1 year of running (low luminosity, 30 fb-1) with LHC Higgs analysis at Atlas

More Related