1 / 6

SAM-Grid DØ Status

SAM-Grid DØ Status. Addendum to SAM-Grid Demo Monte Carlo Production. http://d0db.fnal.gov/sam. Status. Working SAM-Grid (previous) Met all deliverables for GridPP GridFTP standard for DØ data transfers >50% DØ Production MC generated in UK

dana
Download Presentation

SAM-Grid DØ Status

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SAM-Grid DØ Status • Addendum to SAM-Grid Demo • Monte Carlo Production Iain Bertram http://d0db.fnal.gov/sam

  2. Status • Working SAM-Grid (previous) • Met all deliverables for GridPP • GridFTP standard for DØ data transfers • >50% DØ Production MC generated in UK • Near Term Goal MC Production Running on SAM-Grid in UK • 3.6.6 Prototype SAM Monte Carlo Production system using Resource Broker 31-Mar-03 • 3.6.9 Pilot SAM Grid for D0 users. 30-Sep-03 Iain Bertram

  3. MC Production • Runjob Package to integrate DØ production executables with SAM-Grid • Also used by FNAL-CMS Group • maintained and developed within UK • Used by all remote DØ production centres. • Being Considered as standard reconstruction interface for DØ. • Controls Metadata production • Uses macro script to control job. Iain Bertram

  4. MC Production Outline • User Requests MC • Describes a virtual data set using keyword:value pairs • Stores Request in DØ database • <<<< Grid Here >>>> • Production Site • Gets next MC set • produces events and delivers to user Iain Bertram

  5. MC Production on SAM-Grid • Plan to run MC in the UK on a SAM-Grid by March • ICL, Lancs, Mancs, and RAL • Use Resource Broker to advertise MC site (Pure Condor) • Runjob controls execution on remote sites • store all output files using the Grid • Extensions • Automatic code installation • Data Reconstruction • Long Term: Generic User Job Iain Bertram

  6. Lessons • Biggest Problem at DØ • Defining user datasets • Metadata is very complex and requires very good database table design • This complexity is necessary so users can find the data they need • Once have list of file all OK • Conclusion • rapid Progress, full steam ahead Iain Bertram

More Related