1 / 11

GridPP 5 th Collaboration Meeting

GridPP 5 th Collaboration Meeting. D0&CDF SAM and The Grid Act I: Grid, Sam and Run II Rick St. Denis – Glasgow University Act II: Sam4CDF and Core Sam Stefan Stonjek – Oxford University Act III: Core Sam and SamGrid Rod Walker – Imperial College. OutLine. Sam For CDF

ramona-robles
Download Presentation

GridPP 5 th Collaboration Meeting

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GridPP 5th Collaboration Meeting D0&CDF SAM and The Grid Act I: Grid, Sam and Run II Rick St. Denis – Glasgow University Act II: Sam4CDF and Core Sam Stefan Stonjek – Oxford University Act III: Core Sam and SamGrid Rod Walker – Imperial College

  2. OutLine • Sam For CDF • Run 2 Director’s Review and R2D2 • FTE’s • Usage by CDF • Evolution of SAM into Grid/SAM Rick St. Denis – Glasgow

  3. SAM for CDF • History: 4 posts for CDF and D0 • Monte Carlo, SAM for CDF, 2 SAM/Grid • Risk and Resource assessment: Define 3 phases: pilot, integration, Grid-ification • Enormous Thanks to D0 and FNAL CD for help! • To work for Anyone, It must work for someone Plan For Success Rick St. Denis – Glasgow

  4. Pre Pilot Project (done) • (Lets get going!) [The Snake Oil Test] • Adapt to CDF software - AC++ interface: Done • Tape access- Enstore: Done • Database and Server Installation: Done • Distribution of Stations: Difficult: SAM for CDF project Rick St. Denis – Glasgow

  5. Commissioning of SAM for CDF (done) remote sam_station (analysis) remote remote remote remote sam_station (analysis) sam_station (analysis) sam_station (analysis) sam_station (analysis) fndaut (sun) fcdfora2 Border Router Oracle DB (dev, int) name service sam db server optimizer logger web server monitoring ~1TB Cache Cache Cache Cache Cache Cache Cache Perm. Disk fcdfsam fcdfora1 Oracle DB (prd) sam station enstore stat STKen 100 MB (multiple) CD Switch CDF Offline 6509 nglas09 sam_station (analysis) 1 GB DCache CDF portakamp 6509 Fermilab 100 MB CDFen 5TB • GOALS • support 5 groups that do data analysis • enable access to datasets of interest • production availability of the systems • limit impact on CDF enstore • STATUS • Hardware and Software there • Translation of the CDF DFC shadowed in SAM • Developed AC++ interfaces to SAM to retrieve and analyze files. Automatic output to SAM not ready, yet. • Enabled access to DCache. • Deploying sites Rick St. Denis – Glasgow

  6. Directors Review of Run2 computing 4/6/02: Report (12/6/02) • “The committee recognized that [distributed computing] for CDF is in its early stages and encourages the continued development and particularly in collaboration with D0 and CD to achieve that. That collaboration is clearly beginning with the move towards the use of SAM in CDF.” • “ … Joint projects have been strongly encouraged.” • “We believe that the use of SAM by both experiments is clearly the right choice.” • Recommenation: “CDF Should be encouraged to contribute dedicated effort to the SAM project since now both experiments are making use of it.” • Remote Analysis and Grid Development: “…recommends that both collaborations develop more detailed plans for coordinated use of remote facilities.” • “The committee believes that GRID is a promising technology… The first step of GRID-enabling SAM is a reasonable goal and is endorsed by the Committee.” Rick St. Denis – Glasgow

  7. R2D2: Run 2 Data Handling and Distributed Computing Steering Committee • Joint project • D0/CDF priorities • Translation to tasks • CDF, D0 Liaisons (Rick St. Denis, Chip Brock) • CD departments: CDF, D0, DB, Tape (Harris, Merritt, Votava, Petravick • US Grid (Pordes) • CDF/D0 IT Managers (Boehnlein,Qian,Wuertwein) Rick St. Denis – Glasgow

  8. FTE’s • E-science student at IC will do SAM • E-science students at Glasgow use SAM for real world input • Stefan and Rod, E-sci student Oxford • Alan Flavell: network • Dave Waters,Todd & I • Attracting manpower (U Chicago, Karlsruhe, Trieste) Rick St. Denis – Glasgow

  9. Analysis Now: A real use case • Now • J/Psi Dataset on tape • Remake Ntuple on FNAL Desktop • 150 Files (150G) overnight, but memory leak killed it! • Wanted to run parallel jobs off the same dataset anyway… Rick St. Denis – Glasgow

  10. CDF still sceptical, does not have to have sam/Grid right now: lumi targets off by 10 times:”I don’t need grid for 80G of ntuples” New management in great support of Sam: proactive New management wants to give users tools and let them choose the best way to the physics. Usage Rick St. Denis – Glasgow

  11. From Grid Development to Experiment Grid Development GridFTP GridPP, EDG, ComputerScientists SAM/Grid GridFTP Teststationsetup samcp SAM GridFTP PhysicsAnalysis BBFTP ftp Rick St. Denis – Glasgow

More Related