1 / 14

New Data Analysis Environment

New Data Analysis Environment. In H1. Transition to OO technologies in a running experiment. U. Berthon Ecole Polytechnique, Palaiseau berthon@in2p3.fr. Plan. Motivations Current Analysis Environment New Analysis Environment Benefits Prospects. Motivations.

arturosimmons
Download Presentation

New Data Analysis Environment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. New Data Analysis Environment In H1 Transition to OO technologies in a running experiment U. Berthon Ecole Polytechnique, Palaiseau berthon@in2p3.fr

  2. Plan • Motivations • Current Analysis Environment • New Analysis Environment • Benefits • Prospects U. Berthon

  3. Motivations • H1 is an experiment at the e-p collider HERA at DESY ( Hamburg) • More than 300 physicists • Data taking since 1992, currently 10**7 evts/year • Long shutdown before HERA II, collider and detector upgrades till 2005 • Physics program at HERA II extending beyond 2005 Software (r)evolution possible? Now or never! U. Berthon

  4. Motivations ... • Essential parts of the H1 software have been established nearly 10 years ago: drawbacks (difficulties of maintenance, heterogeneous frameworks, outdated design...) • Shortcomings mostly felt in the field of analysis • Promising technologies (OO) emerged in the last few years, already widely used, mature Project launched in 1999 for a major upgrade of analysis environment U. Berthon

  5. Data I/O BOS (+ FPACK) difficult in small pieces: long jobs (selection 1 week, rewrite DST several weeks) 2 levels of abstraction, no transparency between them: POT, 200 kB/event 10 000 GB/year DST, 15 kB/event, 500 GB/year Modern data model (DDL, entity relationship model) oldfashioned user interfaces: difficult learning phase oldfashioned graphics (GKS) 3 completely separate environments: H1PHAN + HBOOK (Physics tools) PAW LOOK (graphics framework) Current analysis environment Data storage framework Most critical part ! U. Berthon

  6. New Analysis Environment • For new data storage • For new unique framework ROOT U. Berthon

  7. New Data Storage • ROOT as technolgy for data storage: • highly optimised I/O (multiple parallel buffering) • possibility of writing logically coherent data onto separate streams (different locations according to frequency of access) • possible access to very small parts of the data • New streams • MICRO-ODS (Object Data Store, 4 vector level, 3 kB/evt, 100 GB/year) • HAT (H1 Analysis Tag database, kinematical variables, 0.5 kB/evt, 15 GB/year) U. Berthon

  8. New analysis framework • ROOT as analysis framework: • Replaces PAW: Complete Data analysis capabilities (histogram, minimisation, formula evaluation,..) • Replaces LOOK: 2D, 3D, MOTIF GUI classes well adapted for event display • Object Runtime Support: ROOT dictionary allows interactive access to names, types,… • Unique language C++ for scripts, interactive use and programming U. Berthon

  9. H1PHAN + HBOOK NTUPLES NTUPLES HAT tag db (evt variables,Q2…) H1PHAN++ ROOT Event DISPLAY new M-ODS (4-vectors) PAW new DST bos2root ODS (tracks, clusters..) eventlist root2bos 500 +100 +15 GB/year Event Display POT POT bos2root 10000 GB/year FUTURE CURRENT

  10. New Physics tools package • Rewritten in ROOT (C++) • Allows analysis on all levels (not only DST as before) • Standardized and improved algorithms • Profit from CLHEP classes where possible • Gradual transition using C-wrappers U. Berthon

  11. New Event display • Adapted from ALICE Display • Requirement backwards compatibility: integration of previous 2D display (under the way) • Interactivity, 3D inherited from Alice • pick and know • change image according to Physics (sliders) • fancy 3D (OPENGL,X3D) • Dialogue analysis-display • event selection • immediate feedback of results of interactive analysis U. Berthon

  12. Benefits • General speedup of analysis jobs: • fast event selection at the tag database level (kinematical variables) • major part of analysis can be done at level of kinematical variables or 4-vectors • read/write small portions, only what you need • Easy transparent access to data on all levels (visual way by ROOT Browser) • Lower threshold for learning • modern GUI • unique language • unique framework U. Berthon

  13. Prospects • Thorough reform of higher levels of H1 software (actually hard core of 4-5 people involved) • Ambitious! • touching most visible and widely used parts of the software • short timescale (< 2 years) • needs education of actual developers and future users Could not succeed without the expertise and the help of the ROOT developers and users community Cultural revolution of H1 physicists still to come! U. Berthon

More Related