JetMET DQM Status

1. JetMET DQM Status Kenichi Hatakeyama, Anwar Bhatti, Frank Chlebana, Jared Sturdy DQM Meeting November 4th, 2008

2. JetMET POG Monitoring Plots From CRAFT data https://cmsweb.cern.ch/dqm/tier-0/ JetMET POG DQM is already run routinely DQM Meeting

3. JetMET DQM Shift Instruction https://twiki.cern.ch/twiki/bin/view/CMS/DQMShiftOfflineJetMET DQM Meeting

4. Data Certification for “Jets” • For jets we are looking at • Several different algorithms (IterativeCone, SISCone, PFlow, JPT) • Regions in the detector (Barrel, EndCap, Forward) • High and low jet pt triggers • Quality test compares current histogram with a reference histogram • Chi2 or KS test • Several distributions are tested • (Pt, eta, phi, constituents, HOverE) DQM Meeting

5. Determining the Quality Flags for “Jets” • Quality flags for the different jet algorithms determined by comparing histogram to reference • JetMET_Jet_AAA (AAA = IterativeCone, SISCone, PFlow, JPT) • if ( (JetMET_Jet_AAA_Pt_Low_Val > 950 ) && (JetMET_Jet_AAA_Pt_High_Val > 950 ) && (JetMET_Jet_AAA_Eta_Low_Val > 950 ) && (JetMET_Jet_AAA_Eta_High_Val > 950 ) && (JetMET_Jet_AAA_Phi_Low_Val > 950 ) && (JetMET_Jet_AAA_Phi_High_Val > 950 ) && (JetMET_Jet_AAA_Constituents_Low_Val > 950 ) && (JetMET_Jet_AAA_Constituents_High_Val > 950 ) && (JetMET_Jet_AAA_HOverE_Low_Val > 950 ) && (JetMET_Jet_AAA_HOverE_High_Val > 950 ) ) JetMET_Jet_AAA = 1 DQM Meeting

6. Data Certificaiton for “MET” • For MET, we are looking at • met (MET from Barrel+Endcap+HF), and • metNoHF (MET from Barrel+Endcap only). • Data Certification for MET: • Currently fit MEx & MEy distributions to double Gaussians and check Chi2 and the peak. • Chi2 of double Gaussian fits: reduced chi2 <20 for lum section or 200 for entire run (Need to adjust the criteria based on the statistics) • Mean of the fitted Gaussian form: within +/-10 GeV • Looking into METPhi, MET, METsignificance also • For these, need to compare with reference histograms (Chi2 or KS test) • Performed for the entire run and also per lumi section. • Currently we use “monitoring variable versus lumi section” 2D histograms, but a long run can exceed the axis range… (see later slides) DQM Meeting

7. Data Certification Outputs DBS information is organized in three layers Able to select subcomponent (HB,HO, HE, HF) Layer 1 Layer 2 Layer 3 JetMET_Global JetMET_Jet_ICone JetMET_Jet_ICone_Barrel JetMET_Jet_SISCone JetMET_Jet_ICone_EndCap JetMET_Jet_PFlow JetMET_Jet_ICone_Forward JetMET_Jet_JPT JetMET_Jet_SISCone_Barrel ... JetMET_MET JetMET_MET_All JetMET_MET_NoHF Currently have histograms for ICone, SISCone, and PFlow… DQM Meeting

8. Data Certification runs as a standalone cmsRun job Next step: move this into the harvesting job Using a root Chi2 or KS test to compare current histogram against a reference Reference histograms need to be accessible Looking into the qtest code… Results are saved in a “Data Certification” folder in the DQM root file Data Certification Algorithm Implementation DQM Meeting

9. DCS Queries • DCS queries which return HV/LV settings for the HCAL • takes several minutes (~3 min) to complete • Example from run 67124 • Many channels are stableHBM_HV1_2_08/M1   CH1   HB     -1    2   10     1 10/22/08 14:36:12        7516 HBM_HV1_2_08/M1   CH1   HB     -1    2    1     1 10/22/08 14:36:12        7516 HBM_HV1_2_08/M1   CH1   HB     -1    2   11     1 10/22/08 14:36:12        7516 • Some channels are changingHBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:37:28        1332 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:37:34         680 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:37:40         380 … • HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:38:19          32 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:38:25          20 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:38:31          12 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 14:38:50           4 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:41:39         452 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:41:45         952 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:41:51        1468 … • HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:42:55        6588 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:43:02        7108 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:43:08        7132 HBP_HV2_1_10/M2   CH1   HB      1   15    5     1 10/22/08 15:43:27        7120 HV starts out low, is lowered, then raised DQM Meeting

10. Data Certification • The JetMET Data Certification is determined entirely from the results saved in the DQM root file… • Jet Data Certification is reported for the entire run • MET Data Certification is reported for the entire run and also per lumi section • Will use DCS information to identify Luminosity Sections with bad data… • Should be folded into the DPG (HCAL, ECAL) Data Certification results… DQM Meeting

11. MET DQM in CRAFT data(in following slides…) DQM Meeting

12. Run 66594 With HF Lumi Section Number of events Barrel+Endcap Only Lumi Section Number of events METPhi (rad) MEx (GeV) MEy (GeV) First few lumi sections appear to be problematic. DQM Meeting

13. Zoom-in view Problem only in a first few lumi sections On a lumi section based method, can keep the majority of events Run 66594 cont’d DQM Meeting

14. Data certification Looking at Chi2 of double Gaussian fits: reduced chi2 <20 (lum section) or 200 (entire run) (Need to adjust the criteria based on the statistics) Mean of the fitted Gaussian form: within +-10 GeV Run 66594 cont’d DQM Meeting

15. Run 66714 With HF Lumi Section Number of events Barrel+Endcap Only Lumi Section Number of events MEy (GeV) METPhi (rad) MEx (GeV) No major problem. DQM Meeting

16. Run 66714 cont’d • Data certification output Good run DQM Meeting

17. Run 66746 With HF Lumi Section Noise in HF at phi~0.8 Number of events Barrel+Endcap Only Lumi Section Number of events METPhi (rad) MEx (GeV) MEy (GeV) Check of the mean MEx or MEy will detecot this problem. DQM Meeting

18. Run 66746 cont’d • Data certification output MET without HF mostly OK DQM Meeting

19. Run 67124 With HF Lumi Section Number of events Barrel+Endcap Only Lumi Section Number of events METPhi (rad) MEx (GeV) MEy (GeV) met with/withtou HF seem to suffer from hot tower(s) DQM Meeting

20. Run 67124 cont’d • Data certification outputs Bad Run DQM Meeting

21. Run 68021 With HF Lumi Section Number of events Barrel+Endcap Only Lumi Section Number of events METPhi (rad) MEx (GeV) MEy (GeV) No major problem. DQM Meeting

22. Run 68021 cont’d • Data certification outputs DQM Meeting

23. Summary from MET DQM Plot Scanning DQM Meeting

24. Summary • Data certification results from the current rather crude algorithm are already interesting! • Need to run updated version of JetMET DQM code • This has additional histograms needed for DC • Need to wait until CMSSW_2_2_X • Move Data Certification into the “harvesting step” • Results will be written to DQM root file… • Need to designate area for reference histograms • Used to determine Data Quality flags • Continue algorithm development on DQM output • Need easy access to DQM root files… DQM Meeting

25. Backups DQM Meeting

26. Physics Analysis • People doing an analysis using jets will initially restrict themselves to the central (barrel) well understood region and require a minimum set of working detector components…. • Example query to construct dataset: RunStart, RunStop HB, EB JetMET_Jet_ICone_Barrel Trigger, Tracker, Luminosity • Quality flags should have the required granularity DQM Meeting