1 / 73

Tutorial for shifter at the MDT Calibration Centers

Tutorial for shifter at the MDT Calibration Centers. Elena Solfaroli Camillocci Università La Sapienza & INFN Roma. What has the shifter to do?. NEW. For each one of the three Calibration Centers: Check the correct running of the Local Calibration Data Splitter (LCDS).

ava-herman
Download Presentation

Tutorial for shifter at the MDT Calibration Centers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Tutorial for shifter at the MDT Calibration Centers Elena Solfaroli Camillocci Università La Sapienza & INFN Roma

  2. What has the shifter to do? NEW For each one of the three Calibration Centers: • Check the correct running of the Local Calibration Data Splitter (LCDS). • Monitor the transfer of the data from the Calibration Stream. • Start the Data Quality (DQ) analysis and the calibration fits for interesting runs. • Monitor the correct processing of each operation. • Alert the expert in case of anomaly. • Report the DQ results and store the global flags in the ATLAS database. • Validate the calibration results. Compare and merge the results from the three sites with the help of the expert on shift. Present the DQA results at the “Muon Daily Operations and Data Quality Meeting” at 15:10. Tutorial for shifter - Elena Solfaroli Camillocci

  3. Before to start the shift at the MDT Calibration Centers, the shifter has to • Have a GRID certificate • installed in a browser; • DN registered in the LCDS to enable the shifter access; • installed to provide a valid proxy. • Belong to the e-group atlas-dataQuality-automatic-notifications to receive the daily list of interesting runs to be analyzed • Go to https://e-groups.cern.ch; • Search e-group name contains: “atlas-dataQuality-automatic-notifications”; • Click on subscribe. • Book the shift on OTP http://atlas-otp.cern.ch/ Task 529188 - MUON CALIBRATION CENTER Shifter (Contact Fabrizio Petrucci to be added to the shifter list). • Check the connection to the web interfaces Rome LCDShttps://atlas-splitter.roma1.infn.it:9613 Munich LCDShttps://lcg-lrz-muon.grid.lrz-muenchen.de:9613/ Michigan LCDShttps://splitter.aglt2.org:9613/ • Read the NEW twiki for shifters available at https://twiki.cern.ch/twiki/bin/viewauth/Atlas/AtlasMdtCalibShift NEW Tutorial for shifter - Elena Solfaroli Camillocci

  4. NEW My OTP page HOW TO BOOK THE SHIFT 3 shifters per day 6-14 morning 14-22 afternoon 22-6 night The night time slot is more suitable for people sitting in the US. Tutorial for shifter - Elena Solfaroli Camillocci

  5. Let’s start a shift • Check the status of the proxy. • Read previous elog messages and the name of the expert on shift. • Register your shift. Tutorial for shifter - Elena Solfaroli Camillocci

  6. Go to https://atlas-splitter-test.roma1.infn.it:9613/ (version for tutorial) • Check the proxy validity • Click on Documentation to open the menu Tutorial for shifter - Elena Solfaroli Camillocci

  7. Click on calibration elog Tutorial for shifter - Elena Solfaroli Camillocci

  8. Read the messages left by the previous shifter. • Check the name of the expert on shift during the week. • Click on New and register your shift. • Report each operation you will do as shifter. NEW Tutorial for shifter - Elena Solfaroli Camillocci

  9. Calibration stream • Check data transfer. • Monitor dataset splitting and ntuple production. Tutorial for shifter - Elena Solfaroli Camillocci

  10. Click on General (in LCDS tools) to open the menu. • Click ondatasets Tutorial for shifter - Elena Solfaroli Camillocci

  11. Compare dataset list with last 10 runs stored, seeing the database run query. • Check the data transfer to Calibration Center browsing the link replication status. 3 4 Tutorial for shifter - Elena Solfaroli Camillocci

  12. Runs closed at CERN have to be transferred to the Calibration Centers. Tutorial for shifter - Elena Solfaroli Camillocci

  13. Check the status of the runs at the Tier2 (repeat after 2 hours). Datasets are sorted by date. DISCOVER = dataset scanning, WAIT_FOR_DATA = dataset discovered but no data in DDM  wait some minutes, then alert the expert, SPLITTING = dataset splitting in calibration regions, SPLIT = operation concluded. • Check the ntuples: n_Files/5 x n_Regions(204) = n_Fragments All ntuples READY = production completed. (move the mouse on READY to show more information on the ntuple status) • Click on READY or on ntuples in the LCDS tools menu. Tutorial for shifter - Elena Solfaroli Camillocci

  14. 10000 *150419* (per calibration region) • Click on READY or click on ntuples. • To select a dataset, a detailed search is available in the bar on the top (i.e. search a run number: ‘*150419*’ and select max records per page >204). • Check the status of each ntuple (one per calibration region) • PENDING = wait for running  alert the experts after many minutes, • CREATING = ntuple creation is running, • FAILED = failure of the ntuple creation  try to recreate it, • READY = ntuple created, ready for running DQA and calibration, • ADVISORY_FIT = calibration job submitted, • FIT_FAILED = calibration failed, • FITTED = calibration completed. Tutorial for shifter - Elena Solfaroli Camillocci

  15. (per calibration region) • Check the DQA Status • READY = ntuple ready for DQA analysis, • DISABLE = user disabled this ntuple for DQA analysis, • ADVISORY_DQA_CREATE = DQA job submitted, • DQA_CREATE_FAILED = DQA failed  check the details browsing the DQA menu, • DQA_CREATE_DONE = DQ analysis correctly completed. • Shifter can download the ntuple file, clicking on the floppy icon. Tutorial for shifter - Elena Solfaroli Camillocci

  16. Data Quality Assessment • Submit a DQA job. • Monitor the job processing. • Provide a report. Tutorial for shifter - Elena Solfaroli Camillocci

  17. NEW HOW TO CHANGE FILE FOR DQ REFERENCE • Open the MDT DQA/DQMF menu - Click on dqa create. • BEFORE TO SUBMIT THE DQ JOB • Click on “here” to change the reference file for the data quality assessment. • Choose the reference file, clicking on Set Reference. • Check the new reference name. 1 3 2 ONLY IF IT IS REQUESTED BY THE EXPERT Tutorial for shifter - Elena Solfaroli Camillocci

  18. 2 • Open the MDT DQA/DQMF menu • Click on dqa create. • “Click+Ctrl” on the runs to be analyzed (Default: last run) and click on the button Select. • Select (all or someone) the spectrometer regions to be analyzed. • Start the DQ with the button on the bottom. • Only one set of runs can be processed per time. 1 3 4 Runs to be analyzed are those in the daily mail notification. Tutorial for shifter - Elena Solfaroli Camillocci

  19. Click on dqa histo. • Click on a set of runs to see the details of the operation status. Tutorial for shifter - Elena Solfaroli Camillocci

  20. Check the operation status for each spectrometer region • CREATING = processing; • FAILED = the histogram filling failed  investigate the log file and report to the expert; • READY = histograms filled, waiting for histogram file merging; • MERGING = merging the histogram files for each spectrometer region (BA, BC, EA, EC); • MERGE_FAILED = crash in the histogram merging  try to re-submit this job; • MERGE_DONE = histogram filling and merging well done. • Shifter can download the histogram file. • To investigate job crash, click on the status to see the job view and click on the job status to see the log file. Tutorial for shifter - Elena Solfaroli Camillocci

  21. 4 regions (so far) • Click on dqa merge. • Click on a set of runs to see the details of the operation status. • Check the status of each regions (BARRELA/C, ENDCAPA/C) • MERGING = merging the histogram files of the same spectrometer region, • MERGE_FAILED = job failed  try to re-submit this job, • MERGE_DONE = operation completed. Tutorial for shifter - Elena Solfaroli Camillocci

  22. Click on dqa finalize. • Click on a set of runs to see the details of the operation status. • Check the status of each spectrometer regions (BA, BC, EA, EC) • FINALIZING = running the DQ histogram analysis; • FINALIZE_FAILED = DQ histogram analysis failed  investigate the log file; • FINALIZE_DONE = MdtDqa analysis done, start automatically the DQMF analysis; • To investigate job crash: click on status to see the job view and click on the job status to see the log file of the DQA job. Then report the crash reason to the expert. Tutorial for shifter - Elena Solfaroli Camillocci

  23. Click on dqmf • Check the quality flag for each spectrometer regions (BA, BC, EA, EC). • Click on the set of runs to see the details. Tutorial for shifter - Elena Solfaroli Camillocci

  24. Check the status for each region (BA, BC, EA, EC) • PROCESSING = running of DQMF • FAILED = DQMF checks failed  investigate the log file and report to the expert • DONE = DQA completed • Shifter can download the dqmf output file. Tutorial for shifter - Elena Solfaroli Camillocci

  25. Click on the button “Start Macro”, to produce and publish the report file.pdf in the DQA web page (at Rome http://classis01.roma1.infn.it/dqmf/dqmf.php) • NEW = waiting for the other regions, • READY = click the button to submit the macro, • ADVISORY_REPORT = macro submitted, • PROCESSING = macro is running, • FAILED = report failed  try to resubmit, then alert the expert, • DONE = report.pdf published. • Click ondqmf summary Tutorial for shifter - Elena Solfaroli Camillocci

  26. DQA report .pdf Barrel Some histograms already in the DQMF web display, to show a global vision of the muon spectrometer. Endcap Tutorial for shifter - Elena Solfaroli Camillocci

  27. http://classis01.roma1.infn.it/dqmf/dqmf.php DQA report .pdf • Click on the balloon to browse the DQMF web display. • Provide a report for the afternoon shifter. • Afternoon shifter has to attend the “Muon Daily Operations and Data Quality Meeting” at 15:10 and present the DQ results of those runs listed in the daily notification mail. (At the beginning the shifter will be supported by the expert on shift). Tutorial for shifter - Elena Solfaroli Camillocci

  28. Template for report NEW Tutorial for shifter - Elena Solfaroli Camillocci

  29. Check-list for DQA NEW • Check the global hit maps and report the percentage of active multilayers for each muon station (Inner, Middle, Outer) in BA, BC, EA, EC. • Check the efficiency distributions: alert if the average efficiency is <99%. • Report the global flags on BA, BC, EA, EC. • Browse the dqmf web dispaly and report red alarms on: • Dead multilayers; • TDC and ADC spectra; • Low efficient or dead channels. Tutorial for shifter - Elena Solfaroli Camillocci

  30. a. Percentage of active Multilayers NEW Page 3 from report.pdf BARREL Tutorial for shifter - Elena Solfaroli Camillocci

  31. a. Percentage of active Multilayers NEW Page 4 from report.pdf ENDCAPS Tutorial for shifter - Elena Solfaroli Camillocci

  32. b. Average efficiencies NEW Page 10 from report.pdf BARREL <99% <99% Tutorial for shifter - Elena Solfaroli Camillocci

  33. b. Average efficiencies NEW Page 11 from report.pdf ENDCAPS Tutorial for shifter - Elena Solfaroli Camillocci

  34. c. Global flags • Green  Detector ON > 90% • Red  Detector ON < 90% • Grey  Low statistics Tutorial for shifter - Elena Solfaroli Camillocci

  35. d. DQMF web display • Click on Barrel_A (or Barrel_C, Endcap_A/C); • Click on MDT; • Click on AllSectors See this note for details on histograms and DQ assessment “The MDT data quality assessment at the Calibration Centers” ATL-MUON-INT-2011-001 Tutorial for shifter - Elena Solfaroli Camillocci

  36. Barrel_C/MDT/AllSectors OUTER INNER MIDDLE Click on the histogram to see the details. • Check the hit maps with RED frame: HitsPerML_XXXX Tutorial for shifter - Elena Solfaroli Camillocci

  37. Barrel_A/MDT/AllSectors//A_HitsPerML_Inner NEW DEAD Sector 14Eta 6 Already known Sector 6Eta 1 Detector alive (%): Read the NEW_ML_OFF and check the chamber status inside the sector folder. Tutorial for shifter - Elena Solfaroli Camillocci

  38. Barrel_A/MDT/Sector01/BML2A01/Chamber/A_TDC_ML1 ERROR on tdrift: ERROR on t0: • Report RED flags on TDC (or ADC) spectrum of the MDT multilayers. Tutorial for shifter - Elena Solfaroli Camillocci

  39. Barrel_C/MDT/Sector03/BML2C03/DeadStatus Multilayer 1 Layer 2 Layer 1 Click on the histogram to see the details. Layer 3 Layer 1 Layer 2 Multilayer 2 Layer 3 • Report RED flags on Dead or Low Efficient elements. Tutorial for shifter - Elena Solfaroli Camillocci

  40. Barrel_C/MDT/Sector03/BML2C03/DeadStatus/DeadTubes_ML1_L2 DeadTube: Tutorial for shifter - Elena Solfaroli Camillocci

  41. Calibration • Submit a Calibration job. • Monitor the job processing. • Check the calibration results. • Compare them with the previous calibration results.

  42. 2 3 • Open the MDT Fits menu • Click on fittables. • “Click+Ctrl” on the runs to be fitted (Default: last 20 runs in the list) and click on the button select. • Select the calibration regions for the analysis. • Start the calibration with the button on the bottom. 1 4 HOW TO CHOOSE RUNS FOR CALIBRATION #events >30M.The shifter can also decide which run is good according to the DQA. Tutorial for shifter - Elena Solfaroli Camillocci

  43. Click on fits. • Click on the set of runs to see the operation details. • Check the status of each calibration region • FITTING = calibration is running, • FAILED = calibration failed  alert the expert if failures are >10%, • DONE = calibration completed. • You can download the file on your pc. • Click on status to see the job view and click on the job status to see the log file. Tutorial for shifter - Elena Solfaroli Camillocci

  44. Click on calibdb observer Tutorial for shifter - Elena Solfaroli Camillocci

  45. Choose the database **ROME_NEW** and click on the white arrow; • Check that there is an entry for the last calibrated run; • Click on t0 and rt. Tutorial for shifter - Elena Solfaroli Camillocci

  46. Check the t0 results  alert if large regions failed. Tutorial for shifter - Elena Solfaroli Camillocci

  47. Check the rt results and count the failed regions. Tutorial for shifter - Elena Solfaroli Camillocci

  48. Template for report NEW Tutorial for shifter - Elena Solfaroli Camillocci

  49. Check-list for FIT NEW • Check the t0 and tdrift distributions and report mean and RMS of the differences between last and reference calibrations. • Find t0-jump. • Report the max RT variation with respect to the reference calibration. Tutorial for shifter - Elena Solfaroli Camillocci

  50. NEW • In the Calibration DB menu • Click on “check last calibration” button; • Wait 3-4 minutes; • A dialogue menu and a list of histograms will appear. parameters • Check Last Calibration: a tool to see the results of the last calibration done, comparing it with previous results. You can: • modify the parameters and re-submit the script using “Change”; • re-submit the script with the same parameters in case the DB is being updated using “Refresh” Tutorial for shifter - Elena Solfaroli Camillocci

More Related