180 likes | 299 Views
CSC Online and Offline DQA Status. Ken Johns, Venkat Kaushik, Xiaowen Lei (U. Arizona). CSC Online DQA (GNAM). CSC GNAM Successfully used (briefly) during Sept. combined run Histograms complete pending feedback from significant CSC running CoCa archiving to Castor completed CSC OHP
E N D
CSC Online and Offline DQA Status Ken Johns, Venkat Kaushik, Xiaowen Lei (U. Arizona)
CSC Online DQA (GNAM) • CSC GNAM • Successfully used (briefly) during Sept. combined run • Histograms complete pending feedback from significant CSC running • CoCa archiving to Castor completed • CSC OHP • Successfully used (briefly) during Sept. combined run • Overview tabs created for shifter convenience
CSC Online DQA (GNAM) • DQMF configuration • Successfully tested using standalone partition • Recently migrated to more sophisticated version and will be tested using CSC standalone this week • COOL database • CSC DQAgent in principle will write to COOL DB • Needs to be tested when CSC’s are in the combined run
CSC Online DQA (GNAM) • CSC Cool database • CSCCoolOutput algorithm written • Still need to setup the final folders in CSCCOOL • Lower priority since it’s unclear how the DQ/CSC community will use this information
CSC Online Monitoring (Express Stream) • Aside, came as somewhat of a surprise to us that Express Stream will be used instead of GNAM for online DQA? • Based on Tier0 monitoring • Tier0 monitoring is tested and working for CSCs • But Express Stream monitoring does not contain the functionality we need for CSC DQA (e.g. making profiles of 2D histograms at other than end of run time)
CSC Online Monitoring (Express Stream) • Express Stream histograms • Complete • Recently added several 1D hists to take the place of 2D profiles • Express Stream display • Complete (from our side) • Histogram names for monitoring were sent to Jahred Adelman for inclusion in online DQA monitoring
CSC Online Monitoring (Express Stream) • Express Stream DQMF • In our initial discussions with Jahred Adelman and Anadi Canepa this did not come up • We can implement this quickly if we have a template and write access to the appropriate directories • We already have DQMF algorithms for GNAM and Tier0
CSC Offline Monitoring (Tier0) • CSC reco/monitoring • Turned on with 15.5.X after extensive (re)validation work • Histograms for Tier0 monitoring complete pending feedback from significant CSC running • CSC DQMF/han display • Complete and tested but needs to be included in global han configuration • CSC specific DQ algorithms tested but need inclusion in DQ_utils
CSC Offline Monitoring (Tier0) • Offline DQ flags for COOL and CSC COOL • DQ algorithms exist for auto writing to COOL database but needs testing @ Tier0 • Machinery for writing to CSC COOL successfully tested • Documentation • CSC GNAM DQA now in Operations Twiki • CSC Tier0 DQA exists offline and will be migrated to Operations Twiki this week
CSC Offline DQA Documentation • CSCOfflineMonitoringPlots has updated documentation for shifters • Reference and description of histogram • Normal / Abnormal scenarios and action required by shifter • Reference histograms for cosmics_run.config (using run 125032 )
Conclusions • CSC DQA with GNAM in excellent shape • CSC Tier0 DQA in very good shape • Well-tested in standalone but some pieces (DQMF and han) are being migrated to global this week • CSC Express Stream DQA well along • We need guidance and permissions for DQMF flags • We are (and have been) ready for CSC’s in ATLAS running • But we lack operational experience of the other muon subsystems
CSC DQA OHP OHP - Performance 12
CSC DQA OHP OHP – Overview ROD strips 13
CSC DQA OHP OHP – Overview ROD Clusters 14
CSC Offline DQMF Display • Run 131041
CSC Offline DQMF Display • Run 125032
DQMF Display/DQ Flags storage DQM assessment after post processing Example of writing into SQLite folder Example of reading from SQLite folder
CSC Offline DQA Testing Monitoring ROOT output @ Tier0 CSC post processing WEB Display for Tier0 monitoring Extract layer and chamber DQ values_ Make SQLITE folders and fill extracted values CSC COOL DB • Configuration files for DQMF updated • CscDQFlags package does post-processing • Extraction of DQ flags done. Have to merge with DataQualityUtils • Reference histograms for cosmics_run.config (using run 125032 )