1 / 19

Data processing

Data processing. P. Valente. Event data model. Legenda :. RECO. RAW. DCS. System. Event data. Task. Database. Super-THIN. Skimming. Analysis tasks. THIN. THIN. Skimming. RECO. Calibration task. RECO. COST. Reconstruction. CALB. RAW. Calibration task. CONF. COND. TDAQ.

caine
Download Presentation

Data processing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data processing P. Valente

  2. Event data model Legenda: RECO RAW DCS System Event data Task Database

  3. Super-THIN Skimming Analysis tasks THIN THIN Skimming RECO Calibration task RECO COST Reconstruction CALB RAW Calibration task CONF COND TDAQ DCS Detector

  4. Data flow Legenda: Trigger primitives data fragments PC Data Trigger Switch

  5. GTK Sub-detectors LKr Analog sums ADC TELL1 TDC CREAM RAM GTK readout LKr L0 1 Gbit Eth LKr L0 L0 L0 decision LKr L0 L0 L0TP

  6. TELL1 TDC GTK readout L0 L0 1 Gbit Eth data fragments data L0 assert data transmit to L1 Detector “boxes” L0TP T0 L0 L1M data fragments L1 PCs sub-detector events

  7. L1 selection L1M sub-detector events L1 PCs L1 accepted sub-events

  8. ADC CREAM RAM 1 Gbit Eth L1 LKr data Event building & L2 10 Gbit Eth LKr fragments L1 L1M L1 LKr fragments T1 T1 L2M sub-events L1 PCs Full event L2/EB PCs

  9. Record events L2 accepted event To Data Logging System L2 L2M T2 Full event L2/EB PCs

  10. GTK Sub-detectors LKr Analog sums ADC TELL1 TELL1 TDC TDC CREAM RAM GTK readout L0 L0 LKr L0 1 Gbit Eth 1 Gbit Eth 10 Gbit Eth Detector “boxes” L0TP L0 L1M L1M L2M Putting all together… L1 PCs L2/EB PCs

  11. Event sizes from TD

  12. Network links from TD

  13. Sub-detector PC’s from TD ?

  14. Data storage & processing Legenda: T0D1 T1D0 T1D1 Application Data server Farm Network transfer

  15. NA62 computing room CERN computing center (Tier-0) Off-site center(Tier-1/2) ? RAW RAW Online farm Replicate RAW offsite? If the answer is “Yes” A. RAW need to be transferred if one wants to make use of off-site computing power not only for analysis purposes RAW storage If instead the answer is: “No”, the question is: How to handle (re-)processing? If RAW are recorded on disk&tape at CERN computing center: B. the (re-)processing should run there

  16. NA62 computing room CERN computing center (Tier-0) Off-site center(Tier-1/2) A RAW RAW processing RAW Online farm RECO analysis Off-site processing

  17. NA62 computing room CERN computing center (Tier-0) Off-site center(Tier-1/2) A RAW RAW processing RAW Online farm RECO RECO analysis (If tape storage is not available off-site) Off-site processing

  18. NA62 computing room CERN computing center (Tier-0) Off-site center(Tier-1/2) B RAW RECO RAW Online farm analysis processing RECO CERN-IT processing If data are processed at CERN-IT center, only RECO are replicated off-site in order to run analysis jobs

  19. NA62 computing room CERN computing center (Tier-0) Off-site center(Tier-1/2) C RAW RECO RAW processing RECO RECO analysis An alternative is to have a enough computing power (and disk buffer) in the NA62 farm to run (re-)processing from disk NA62 farm Processing How much computing power? How much disk-space? Again, RECO only are replicated off-site in order to run analysis jobs

More Related