1 / 11

Online Steering of HEP Applications

Online Steering of HEP Applications. Daniel Lorenz University of Siegen Cracow Grid Workshop 06 14. 10. 2006 – 19.10. 2006. Online Steering of HEP Applications. Daniel Lorenz. CGW `06. Background: D-Grid. German Grid initiative

kera
Download Presentation

Online Steering of HEP Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Online Steering of HEP Applications Daniel Lorenz University of Siegen Cracow Grid Workshop 06 14. 10. 2006 – 19.10. 2006 Online Steering of HEP Applications Daniel Lorenz CGW `06

  2. Background: D-Grid • German Grid initiative • Funded by the Bundesministerium für Bildung und Forschung, BMBF • 6 Community Grids and one common integration project • HEP Community Grid (HEPCG) Online Steering of HEP Applications Daniel Lorenz CGW `06 2

  3. Introduction • New particle accelerator LHC at CERN (CH) • Several different experiments • Experiments struggle with huge amounts of data • Deploy the LHC Computing Grid (LCG) • Online steering tool for ATLAS experiment • Basic functionality just requires to change the job options • Advanced functionality can be added with source code instrumentation Online steering saves time and resources Online Steering of HEP Applications Daniel Lorenz CGW `06 3

  4. Integration into ATLAS experiment software Athena and ROOT visualization toolkit Athena framework: Event based List of algorithms Executed for every event Easy to add new algorithms and services Environment (1) job options Svc1 algorithm1 algorithm2 algorithm3 algorithm4 algorithm5 Svc2 Athena Job Online Steering of HEP Applications Daniel Lorenz CGW `06 6

  5. Environment (2) • Integration into Athena: • New algorithm RM_Spy • Job execution steering • Most common results in ROOT files • Restart with changed job options without resubmitting the job • Only changes in job options (no source code changes) • New service RM_SteeringSvc • Steering and monitoring of user defined data • Source code instrumentation necessary Online Steering of HEP Applications Daniel Lorenz CGW `06 7

  6. Visualization tool ROOT Command line for C++ commands Extendable with shared libraries Environment (3) Online Steering of HEP Applications Daniel Lorenz CGW `06 8

  7. Layered architecture steering tool grid job visualization application data processing data processing data consistency data consistency communication communication Online Steering of HEP Applications Daniel Lorenz CGW `06 9

  8. Communication (1) • Secure communication • User side • Administrator side • Cope with typical site configurations • Firewalls • Private IP • Job runs on unknown host • Connection by job id • Hide complexity from user • Dynamically deal with different site topologies • Enable steering in as many cases as possible Online Steering of HEP Applications Daniel Lorenz CGW `06 10

  9. Communication (2) • Job registers itself to naming service (NS) e.g. R-GMA • Steering tool gets location from NS • Steering tool connects to communication service (CS) • Connection between CS and job • All connections use Globus GSSAPI • Additional end to end authentication private IP network internet firewall NS CS CE WN UI job steering tool firewall Online Steering of HEP Applications Daniel Lorenz CGW `06 11

  10. Communication (3) naming service security layer security layer grid connection grid connection grid connection security layer security layer message layer message layer TCP connection TCP connection steering tool communication service grid job Online Steering of HEP Applications Daniel Lorenz CGW `06 12

  11. Conclusion and outlook • Goals: • Secure online connection • Easy integration into ATLAS software framework • Status: • Prototype has been implemented • First release scheduled for November • Outlook: • Extend for automated error detection and handling • Steering of parallel jobs • Communication between jobs Online Steering of HEP Applications Daniel Lorenz CGW `06 14

More Related