1 / 10

CDF and the Grid

CDF and the Grid. Presented on Behalf of CDF-UK Rick St. Denis, University of Glasgow. Requirements and Anti-Requirements CDF-o-Centric View Proposal Conclusion: CDF/D0 Deliverables. Basic Requirement. What you really really want: One place to log in and submit jobs Space for input

blaze-berg
Download Presentation

CDF and the Grid

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CDF and the Grid Presented on Behalf of CDF-UK Rick St. Denis, University of Glasgow • Requirements and Anti-Requirements • CDF-o-Centric View • Proposal • Conclusion: CDF/D0 Deliverables GridPP Collaboration Meeting

  2. Basic Requirement What you really really want: • One place to log in and submit jobs • Space for input • Space for output • Ability to find data • Someone else to manage it • Works to 2007 (or more?) In short: Sufficient resources for CDF’s Life GridPP Collaboration Meeting

  3. Anti-requirement Case in Point: Ray Culbertson at Rutgers • Different batch system (not lsf) • Failed, Offline ace no help (“nonstandard” installation) • Not enough feedback as to what was wrong • Turned out to be a hardware error • 2 weeks later: back to central systems with severe limitations on physics GridPP Collaboration Meeting

  4. The CDF View of Grid AC++ Grid rutgers fcdfsgi2 uchep2 ukcdfjifa GridPP Collaboration Meeting

  5. CDF Proposal • CDF does not currently use SAM and we have to sell it to them. Assume we do. (Resources speak volumes) • Three Project Phases: • Pilot • Integration • Gridification GridPP Collaboration Meeting

  6. Pilot Project • Set up the initial fabric. • Evaluate usage patterns and user requirements. • Deploy SAM as well as standard Grid tools for evaluation. 3 months Snake Oil Test GridPP Collaboration Meeting

  7. Integration • Deployment and support of SAM stations in UK. • Adapt CDF software to function with SAM. • CDF data handling tools: translate cataloguing information to SAM. Key component: interfacing of the Database schema compatible with SAM (or even in common with DØ). • Data input modules:Differences with CDF/D0 in Event Data Model and how data files are catalogued. GridPP Collaboration Meeting

  8. Gridification (with D0) • Standard middleware for interoperability. • Globus security and Kerberos, CAS in future. • GridFTP. • Globus job submission as a supported system. • Condor and extensions as a supported system. • Publish SAM station resources/services availability using emerging Grid middleware. • Publish catalogue of data files using emerging PPDG/DataGrid standards. GridPP Collaboration Meeting

  9. Gridification (with D0) • Grid functionality for Job spec., submit, tracking • Condor: migration, checkpointing, CDF/D0/Condor mods. • Incremental enhancement: Job spec, submission language,co-location of job execution/data files. • Reliable, dependencies between job steps. (DAGMAN starts). • Monitoring, diagnostic, logging: use Grid Mon.Tools • Fabric Management: UK CDF JIF , the UK DØ JIF computers, Lancaster farms, Liverpool MAP plus future facilities such as Mosix or SMP clusters. GridPP Collaboration Meeting

  10. Conclusion:CDF/D0 Deliverables GridPP Collaboration Meeting

More Related