1 / 10

Short to middle term GRID deployment plan for LHCb

Detailed plan for deploying GRID technology in LHCb collaboration involving Globus installation, data transfer, and integration between CERN, RAL, and MAP institutes.

horne
Download Presentation

Short to middle term GRID deployment plan for LHCb

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Short to middle term GRID deployment plan for LHCb Eric van Herwijnen Tuesday, 27 June 2000

  2. Overview • GRID unique opportunity to unify CPU resources in the collaborating institutes • Need a common deployment plan • Mini project

  3. LHCb GRID working group • Glenn Patrick • Chris Brew • Frank Harris • Ian McArthur • Nick Brook • Girish Patel • Themis Bowcock • Eric van Herwijnen • first meeting june 14th, RAL

  4. Mini project (1) • Install Globus 1.1.3 at CERN, RAL and Liverpool • CERN: installation completed on a single Linux node (pcrd25.cern.ch) running Redhat 6.1, not available to public yet • RAL: installation by the end of this week • MAP: no news yet • Members to get access to respective sites • Eric and Glenn have access to CERN. • Eric, Glenn, and Chris have access to RAL. • Girish has access to MAP. • Timescale: 1st week in july

  5. Mini project (2) • 1st checkpoint during LHCb software week, Wednesday 5 july • inform collaboration • invite other members to join • Run SICBMC at CERN, RAL and Liverpool • Eric to prepare a script using Globus commands to run sicbmc and copy the data back to the host where the job was executed from • Other partners to test the script from their sites • Timescale: end of july

  6. Mini project (3) • Verify data can be shipped back to CERN and written onto tape • Use globus commands • Some scripting required to use SHIFT and update bookkeeping database • Time scale: early August • Second checkpoint meeting at Liverpool 2nd half of August • Benchmark sustained datatransfer rates • Report completed project at LHCb week in Milano

  7. Integration of the GRID between CERN, RAL and MAP (1) • Eric, Chris, Glenn, Girish and Gareth attended course at RAL during 21,22 june: • Globus toolkit has a C API (easy to integrate with Gaudi) • Globus commands for remotely running scripts (or executables), recovering data from std output, saving consulting metadata through LDAP • The gains: • Everyone uses the same executable • Everyone uses the same scripts • Data is handled in a uniform way • Batch system (LSF, PBS, Condor) to be discussed in Lyon on june 30th

  8. Integration of the GRID between CERN, RAL and MAP (2) • Explore the use of LDAP for our bookkeeping database: • API in C would solve current Oracle -> Gaudi interface problem • Simplification of DB updating by MC production • Everybody is heading in this direction • Oracle have an LDAP server product, someone should investigate • Java job submission tools should be modified to create Globus jobs. Timescale: October (to be done in parallel with current NT production)

  9. Integration of the GRID between CERN, RAL and MAP (3) • RAL NT farm to be converted to Linux this autumn • MAP uses Linux • CERN have been asked to install Globus on the Linux batch service (Tony Cass) • Should LHCb abandon NT for MC production? To be discussed with collaboration next sw week • A full MC production run using Globus is aimed for in december

  10. Extension to other institutes • Establish a “GRID” architecture: • Intel PCs running Linux Redhat 6.1 • LSF, PBS or Condor for job scheduling • Globus 1.1.3 for managing the GRID • LDAP for our bookkeeping database • java tools for connecting production, bookkeeping & GRID

More Related