100 likes | 236 Views
Reprocessing Planning: considerations for discussion. Offline Week, 19-21 November 2014 C. Zampolli. Reprocessing: Timing 1. Data. CPass0. OCDB. (* ) Short periods merged. Run level: all runs from a period(*). QA. Data. CPass1. OCDB. Manual Calibration.
E N D
Reprocessing Planning: considerations for discussion Offline Week, 19-21 November 2014 C. Zampolli
C. Zampolli - Offline Week - Reprocessing Reprocessing: Timing 1 Data CPass0 OCDB (*) Short periods merged Run level: all runs from a period(*) QA Data CPass1 OCDB Manual Calibration Generally <1 week to process a period (e.g.: LHC10e for pass4: from 01/10 to 04/10 = 5 d) 1 week from the end of the processing of the period
C. Zampolli - Offline Week - Reprocessing Reprocessing: Timing 2 Data CPass0 OCDB (*) Short periods merged QA Data CPass1 OCDB Generally 2-3 d to process the full period (e.g.: LHC10d from 22.10 to 25.10 = 2.5 d) Manual Calibration 1 week from the end of the processing of the period Data VPass QA Run level: all runs from a period(*)
C. Zampolli - Offline Week - Reprocessing Reprocessing: Timing 3 Data CPass0 OCDB (*) Short periods merged QA Data CPass1 OCDB Manual Calibration Data VPass QA Generally 6-7 d to process the full period (e.g.: LHC10d from 06.11 to 12.11 = 6 d) Run level: all runs from a period(*) 1 week from the end of the processing of the period Data PPass QA
C. Zampolli - Offline Week - Reprocessing Reprocessing: Delays with Current Approach • Requires to wait for calibration and QA readiness • After CPass1 to start VPass • After VPass to start PPass • 1 week given, but very often more time needed • E.g. LHC10e: from CPass1 to VPass: 18 d • E.g. LHC10e: from VPass to PPass: 12 d
C. Zampolli - Offline Week - Reprocessing Reprocessing: Data Samples • 2012, 2011 • 2012 has higher priority • 2012 more under control – the whole chain was already processed, we have some experience • 2011 was high-rate, many TPC HV trips, missing chambers… • Could be challenging in the procedures, higher probability of failure • From summer 2014, processing of 177011 (LHC12a) and 188362 (LHC12g) for TRD alignment: 1y 86d (not including snapshots, Calib Merging, QA merging) • 2012 has 565 runs ~350y
C. Zampolli - Offline Week - Reprocessing Dependencies (main ones) • Filtering of TPC high-occupancy events PWGPP-71 • Status: • Laser events were not filtered understood, threshold for filtering to be modified • Memory increase during processing autoexpansion of TClonesArray, can be improved • Physics events with high memory allocation HLT reconstruction (which was not showing up for 2010 reprocessing, since HLT was not used here) under investigation • All technical fixes, should take till Monday 24.11 (hopefully) • TPC space point distortion calibration using outer detectors (TRD, TOF) for involving TRD in tracking (ATO-98) • Status: • Not yet completed, time estimate unknown (needs to create new TPC calibration + realign TRD and TOF) • Needs reprocessing (CPass0 and CPass1 only) of 3 runs from LHC12 (B><=0) which currently have problems
C. Zampolli - Offline Week - Reprocessing First Estimate (2012+2011) CPass0/CPass1 (1 week) QA + Calib feedback (1 week or 20 d) VPass (2 d) QA of VPass (1 week or 20 d) PPass (1 week) QA of PPass (1 week) Supposing to reconstruct 1 LHC12 period up to the validation of its VPass; all the rest of CPass for 2012 done over Xmas; 20 days given for QA and manual calibration when many periods have to be checked Not waiting for PPass to start next Cpass For 2011, CPasses in cascade, w/o waiting From Nov 24 (2014) to May 22 (2015) Rough estimates!
C. Zampolli - Offline Week - Reprocessing Second Estimate: Skipping VPass (2012+2011) CPass0/CPass1 (1 week) QA + Calib feedback (1 week or 20 d) VPass (2 d) QA of VPass (1 week or 20 d) PPass (1 week) QA of PPass (1 week or 20 d) Supposing to reconstruct 1 LHC12 period up to the validation of its CPass1 feedback; all the rest of Cpass of 2012 done over Xmas; 20 days given for QA and manual calibration when many periods have to be checked. For 2011, CPasses in cascade, w/o waiting From Nov 24 (2014) to April 8 (2015) Rough estimates!