Task T - CMS at LHC

1. Task T - CMS at LHC • Personnel: • Professors: D. Carlsmith, S. Dasu, M. Herndon, D. Reeder, W. Smith • Senior Scientist: R. Loveless ( New) ( Retiring) • Senior Electronics Engineer: T. Gorski • Associate Scientist: P. Chumney, Assistant Scientists: M. Grothe, A. Lanaro • Postdoc: Y. Baek • Engineers: D. Bradley, A. Golyash, M. Jaworski, A. Mohapatra, S. Rader • Graduate Students: M. Anderson, K. Grogg, J. Klukas, K. Lazaridis, J. Leonard, M. Weinberg • Technician: R. Fobes • PSL Engineers: F. Feyzi, J. Hoffman, P. Robl, D. Wahl, D. Wenman • PSL Draft/Tech: B. Dana, G. Gregerson, D. Grim, J. Johnson, D. Northacker, J. Pippin, R. Smith • Outline/ Activities: • Overview & Trigger Activity -- this talk • Computing & Software & Physics Activity -- Sridhara Dasu • Common & Muon & Tracking Activity -- Dick Loveless • Endcap Muon Alignment Activity -- Duncan Carlsmith

2. Wisconsin Senior Personnel Official Responsibilities • D. Reeder • CMS Muon Institutional Board Chair • Founding US CMS Collaboration Board Chair • W. Smith • CMS Trigger Project Manager • CMS Steering Committee & Management Board • CMS Electronics Board, Steering Committee & Review Team • US CMS Trigger Level 2 Manager • US CMS Steering Committee, Project Management Group • S. Dasu • CMS Detector-PRS (Physics Reconstruction & Software) Online Selection Group Co-Convenor • US CMS Calorimeter Trigger Level 3 Manager • US CMS Advisory Software & Computing Board Chair • R. Loveless • US CMS Muon Level 2 Construction Project Manager • US CMS Common Projects Level 2 Manager • CMS Endcap Muon System Tech. Coord., CMS Technical Board • US CMS Steering Committee, Project Management Group • CMS Tracker Integration Facility Project Manager • CMS Tracker Construction Board • A. Lanaro • US CMS Muon Installation Level 3 Manager

3. Calorimeter Trigger Personnelexperienced team • Physicists: • Faculty: Wesley Smith (CMS Trigger Project Manager)Sridhara Dasu (US CMS Cal. Trigger L3 Manager) • Associate Scientist: Pamela Chumney • 6 yrs on CMS Cal Trig, former HERMES Trig. Coor. • Assistant Scientist Monika Grothe • 3 yrs on CMS Cal Trig, 2 years ATLAS higher level trig., 3.5 yrs Babar,SVT Commissioner/Run-Coordinator • Engineers: • Tom Gorski -- Lead Engineer & Designer • 3.5 yrs on CMS Cal Trig, worked at PSL on SDC & Zeus Cal. Triggers • Replaced J. Lackey, who retired but is available for consulting • Matt Jaworski -- Design support, Testing • Worked on Zeus Calorimeter Trigger • Phil Robl -- Copper Link Test/Development • Lead PSL Engineer, Worked on Zeus Trigger, SDC, CMS EMU • Technician: Robert Fobes(Worked on Zeus Trigger) • Students: Mike Anderson,Kira Grogg, Kristos Lazaridis, Jessica Leonard,Marc Weinberg(Trig emulator, Rate Calc.)

4. Endcap Muon Personnel • Physicists (DOE base program support): • Dick Loveless (EMU level 2 manager) • Armando Lanaro (L3 manager for installation) • Yongwook Baek (cabling, low voltage, installation) • A. Lanaro & Y. Baek based at CERN; responsible for day-to-day work on integration and installation • Duncan Carlsmith (Alignment) • Jim Bellinger, CDF Scientist • Jeff Klukas, Grad Student • Engineers(US CMS project support): • Farshid Feyzi, Dan Wenman (UW Physical Sciences Lab) • Techs(US CMS project -- paid as needed): • Bart Dana, Mauro Giardoni, Jay Johnson, Dave Northacker, Ron Smith (UW -PSL) • Tracker & Common Projects (Endc. Disks): • Dick Loveless • PSL Personnel paid by US CMS Project L to R: F. Feyzi, D. Wenman, A. Lanaro J. Johnson, M. Giardoni, “Regis”, Y. Baek

5. Computing & Software Personnel • Physicists (DOE base program): • Sridhara Dasu • Wisconsin Tier-2 Manager - DISUN • Technical Coordinator, Grid Laboratory of Wisconsin (GLOW) • Chair, USCMS Software Advisory Computing Board • System Manager (DOE base program): • Steve Rader • Software Engineers (NSF-ITR & Computing Project): • Dan Bradley • Ajit Mohapatra & Will Maier • Collaboration with U. Wisconsin Computer Sciences Dept. & Condor Group • Prof. Miron Livny • Director of Condor Project • Leadership role in Grid Projects: PPDG, GriPhyN, iVDGL • PI, GLOW

6. Detector Frontend Level-1 Trigger Readout Systems Event Run Builder Networks Manager Control Filter Systems Computing Services CMS Trigger & DAQ Systems • Level-1 Trigger Requirements: • Input: 109 events/sec at 40 MHz at full L = 1034 • Output: 100 kHz (50 kHz for initial running) • Latency: 3 sec for collection, decision, propagation • Output direct to computer filter farm (no physical level-2)

7. CMS Level-1 TriggerW. Smith, Project Manager • Wisconsinfullyresponsible • US CMS Trigger • US CMSfully responsible • US CMS partially responsible • UNIQUE:All system present trigger objects w/location, ET,quality -- topological triggers possible

8. Wisconsin CMS Task Support(over past decade) • UW 95-96 Support of Personnel • J. Lackey, S. Dasu, PSL Engineering • UW Equipment Support • Teleconference Equipment • Video Room Remodeling • CAD Printer • UW CAD support • Purchase of Visula PCB Suite, incl. high speed router • New version of software used for Zeus trigger • UW Computing Support • > $ 700K • 5 New Servers, 2 TB Disk, 1 GB/s network, Grad. Student RA • 70 CPU system for simulation with Condor + network upgrade • Two new Computer Rooms with power & AC • Matching for “GLOW” shared computing facility

9. 160 MHz point to point backplane 18 Clock&Control ,126 Electron ID & Receiver Cards -- all validated18 Jet/Summary Cards -- all cards operate @ 160 MHz Use 5 Custom Gate-Array 160 MHz GaAs Vitesse Digital ASICs Phase, Adder, Boundary Scan, Electron Isolation, Sort Spares not included* Calorimeter Trigger Crate • Data from calorimeter FE on Cu links@ 1.2 Gbaud • Into 126* rearReceiverCards

10. Receiver Mezz. Card Bar Code EISO SORT ASICs (w/heat sinks) Input BSCAN ASICs EISO Regional Cal. Trigger Complete- U. Wisconsin Rest waiting here Five full crates at CERN • Receiver Card: Electron Isolation & Clock: Jet/Summary: fraction tested (needed) Front EISO Adder 154/154 Tested (126) mezz link cards Front DC-DC 158/164 tested (126) 23/25 tested (18) Back Phase ASIC Oscillator Bar Code Clock Back 23/25 tested (18) PHASE ASICs (27/28 Custom Backpl Tested) (18) Clock Input Clock delay adjust BSCAN ASICs BSCAN ASICs Sort ASICs MLUs DC-DC Converters

11. 5 RCT Full Crates Operating at CERN- U. Wisconsin • Rear of Full RCT crate fully cabled to HCAL trigger primitive logic • Front of Full RCT crate with Jet Capture Card that continuously samples output, checks on the fly for errors and provides readout of 256 crossings • Used for integration tests & board checkout after shipment

12. New: Jet Capture Card-- Tom Gorski • Receives 14 Reg. Sums, 8 HF ET’s, 8 e/g, and t and  bits on 6 SCSI type cables • Captures output from Jet Summary Card going to Global Calorimeter Trigger • Being used in final validation of RCT crates, all cards will go through an extended full crate test with the JCC • Software developed by Pam Chumney & Tom Gorski • Provides calorimeter trigger for CMS Magnet Test & Cosmic Challenge • Provides temporary trigger to Global Trigger while Global Calorimeter Trigger is being prepared Signals Out FPGAs Translators JSC Inputs CCC Signals In Delays

13. Trigger Commissioning • Operate fully functional trigger electronics at CERN • Employed in myriad tests & preparation activities • Tests in Electronics Integration Center • Labs & row of racks for all electronicssubsystems • Test interfaces & integration as much as possible before move to USC55 • MTCC in SX5 • Test multiple triggercomponents with multipledetector components duringthe magnet test. • Verify trigger functions &interfaces w/detectors onsurface • Installation in Underground CountingRoom (USC55) • Started Mid-July ‘06 -- “ready for crates” • Racks & Infrastructure installed, cooling operational • RCT crates, power, infrastructure fully installed (next slide) • Passed CERN Safety Review • Card installation next USC55 UndergroundCounting Room

14. Regional Calorimeter Trigger • Crates, Fans, Power Supplies, Monitoring, Controls and other infrastructure installed, validated and passed safety check in July • Ready for card installation

15. Electronics work in 2006-7 • Finish & Test Master Clock Crate • Develop detailed timing test system • Use 4-crate test-bed in Madison to produce exact procedures • Validate Clock Fanout Cards • Multiple crate tests • Check for datasynchronization • Repair & Analysis ofBoard Failures • Spare Parts Inventories • Install, • Commission & • Operate • Final System • in USC55 Tech’n. R. Fobes (l.) & Eng’r. T. Gorski (r.):

16. Cal Trigger Tasks at CERN - P. Klabbers, M. Grothe & students • Retest RCT Crates arriving at CERN • Comprehensive long term tests with Jet Capture Card performed in RCT lab in electronics integration center • Install RCT Crates in Underground Counting Room • Connect & test 1000+ E,HCAL cables • Connect & test to Global Cal. Trigger • Install & Test Master Clock system • Synchronize all within 4 ns to centraltiming system • Diagnostic & Online Software • Downloading detailed test patterns • Trigger Emulator • Bit-level match to actual electronics • Integration with Trigger Supervisor • Online Monitoring & Control • Configuration of Memory Lookups • Reprogramming • Function Validation Assoc. Scientist P. Klabbers (l.) & Asst. Scientist M. Grothe (r.): (both resident at CERN)

17. Trigger Lab Setup at CERN • Staging area - Prevessin 904 • Receive boards, crates, cables from Wisconsin • Inspect and log in using barcodes and database • Assemble crates for Integration/USC55 • Power up and run system tests • Operate in water-cooled rack for extended tests • Integration tests • Racks with cooling on a raised floor nearby • Storage and Repair • Spare Crates and cards also available for use in testing and replacement of suspect cards • Soldering station, scope, and tool storage • Spare component storage • Responsible: P. Chumney & M. Grothe • When collisions start need added personnel so group members can actively pursue physics analysis (task B redirection).

18. ECAL RCT GCT GT/GMT TTC DTTF HCAL CSCTF Trigger Integration Progressin Electronics Integration Center (Pr. 904) • Large scale successful integration tests in central racks using common TTC infrastructure involving trigger primitives, regional & global processing: • Calorimeter Trigger • Muon Trigger • Global Trigger

19. RCT HCAL HTR ECAL TCC ECAL/HCAL/RCT Integration Tests Successful! • HCAL HTR to RCT  • Used JCC to verify data • 6 cables used - all in sync • Latency measurements w/PMTas source of HCAL TPG • ECAL TCC to RCT • Valid link established • Channel number sent as data • 2 channels on 20 m cablessent in sync to RCT • HCAL HTR & ECAL TCC to RCT  • 28 cables to RCT from 9 TCC & 18 HCAL HTR outputs • Common clocking: LTC, TTCci • 28 channels in sync - links stable for >10 hours error free running • “Hydra” link cable checked as an option for two SLB’s to one RCT RMC • ECAL - HCAL Pattern tests • RCT can “lookup” incoming data • LUTs can be programmed to duplicate incoming data • Have ORCA emulation to help predict outputs

20. RCT Integration Tests Successful! • RCT to Local Timing Controller (for MTCC) Tests  • Receive 56 HCAL links (448 towers) in Green Barracks • Send trigger out with RCT Jet Capture Card • OR of towers in each half using Quality Bit • Validated connection with LTC/GT • GT ANDs top & bottom - reduces rate • RCT Jet Capture Card to GT Tests  • Backup Global Calorimeter Trigger • JCC in spare VME slot of RCT Crate • Currently sends up to 4 trigger bits • Threshold ET, e/ candidate, MIP • Tests using RCT pattern successful! • ECAL TCC patterns yield JCC output • Synchronized to Bunch crossing 0 • RCT- GCT Source Card • First test with new GCT • Completed successfully in July

21. Calorimeter Trigger inCosmic Challenge • RCT: • Crate fully operational in Green Barracks at Point 5 • Cable connections made to HCAL • Full modules above and below connected • Allows for top-bottom coincidence RCT output trigger RCT input from HCAL HCAL crate to RCT

22. Physicist Trigger M&O Tasks(all from base program) • Change trigger as beam conditions change • Study new trigger configurations • Test runs, Monte Carlo studies, data studies • Trigger Physics Analysis • Understand detailed impact of trigger on physics • Preparation for luminosity increases • Monte Carlo studies of new conditions, validate with present data • Respond to changing apparatus • Changes in material, configuration, etc.  changes in simulation • Operations - 24x7 support during running • Write, test & maintain electronics test programs • Maintain & update bad channel list & run daily checking programs • Run Control maintenance • Trigger data validation and calibration • Online & Offline analysis of rates & efficiencies • Monte Carlo & data trigger simulation maintenance • Continuous validation of trigger using simulation & readout data • Will need to augment UW personnel to perform tasks & do physics • Propose to redirect personnel from Task B (ZEUS)

23. The Future - SLHC • Luminosity upgrade x10 – SLHC : L = 1035cm-2s-1 • Extends LHC mass reach by ~ 20-30% • Modest changes to machine • Detector upgrades needed -- especially the trigger & tracker • Time scale ~ 2015 • Trigger: higher luminosity & tracking data • Double operational frequency from 40 MHz to 80 MHz • Design for much higher rejection power for pileup to retain output rate of 100 kHz -- more sophistication • Correlation of muon & cal triggers with new tracking trigger • Started in FY04 • Workshops: US CMS in Madison Feb ‘04, CMS at CERN Feb ‘04 & Imperial College Jul ‘04. • CMS SLHC Level-1 Trigger and Tracker project started. W. Smith & G. Hall (Imperial) chosen to lead effort. • Workshop at CERN July ‘05 (last week) proposes plan & roadmap • As project ramps up, needs additional personnel • Use redirection of Task B effort

24. UW CMS Trigger Concerns • Additional scientific staff to permit physics analysis • Present staff will be saturated w/trigger maintenance & operations • Will need additional staff to permit physics analysis, use of Wisconsin computing resources. • Propose to redirect Task B (ZEUS) staff to meet shortfall • Project support of Lead Designer/ Expert Engineer: T. Gorski • Vital for commissioning and operations • US CMS project support for M&O supervised by base program • Estimated technical support project needs for M&O: • Based on Zeus Cal. Trigger M&O 1992-2001 • Technician • Operates, repairs, maintains test facility • Repairs boards & infrastructure under physicist guidance • Total required = 0.5 FTE • Expert Engineer • ~ 5 trips/year for 2-3 weeks to make difficult repairs • Complicated/Subtle problems, Modifications to trigger electronics • Designer - available for consultation • ~ 2 trips/year for 2-3 weeks for review & design issues

25. Trigger Summary • Calorimeter Trigger • Production is finished, production testing past halfway point. • Integration tests w/ECAL,HCAL, Global Calorimeter Trigger are underway with successful results. • Very good progress, but… • Major work from now on: • Production Testing, Shipping, Retesting of > 1500 Boards • Software Development • Setup of full testing facility/lab at CERN EIC • More Integration Tests • Installation and Commissioning • Operations! • Physics!

26. Task T Endcap Muon Activities(Talk by R. Loveless) • Project Management: Dick Loveless • Construction, test, integration, installation & commissioning of 496 CSCs, electronics & infrastructure (have to lower all this in 2006!) • Chamber Install., Cabling & Test • Wisconsin responsibility -- led by UW scientist A. Lanaro, assisted by UW postdocY. Baek • Low Voltage System • Wisconsin responsibility for all chambers & crates -- R. Loveless & UW Eng. A. Golyash • Radiation & high magnetic field -- working with commercial vendors • Endcap Alignment • Wisconsin responsibility -- Design & procurement complete • System installation -- A. Lanaro & Y, Baek • Alignment Reconstruction & Corrections -- D. Carlsmith, assisted by J. Bellinger • leverage CDF expertise

27. CMS Tracker Management(reorganized this year, approved last week) The Project Management Board is chaired by: Peter Sharp Project Manager and Chairman Geoff Hall Deputy Project Manager – Construction Project • The Tracker Construction Board is: • Task Manager Deputy • TIB Guido Tonelli Ettore Focardi • TOB Joe Incandela Duccio Abbaneo • TEC Didier Contardo Stefan Schael • Pixels Roland Horisberger Bruno Gobbi • Module Production Gian-Mario Bilei Francois Vasey • Tracker Integration Nicola Bacchetta aaa • Electronic Integration Sandro Marchioro Patrice Siegrist • Software Integration Ian Tomalin Fabrizio Palla • Integration Facility Dick Loveless Patrice Siegrist

28. kHz Integrated QCD rate for events with at least two jets Integrated QCD rate for events with at least two jets and which satisfy the ‘loose’ Roman Pots condition Task T Physics Activities(Talk by S. Dasu) • Preparation for CMS Physics TDR (2006) & early data analysis • New energy regime  rapid discoveries • Need to start with well understood trigger, reconstruction & analysis software • Wide-ranging physics interest & expertise in the group • Analysis efforts to forefront as detector work finishes • Ensure trigger systems start at full performance • UW is the leading contributor to PTDR trigger chapter • Simulated Higgs, SUSY, SM EW and QCD datasets • Designed trigger systems that capture all the important physics efficiently while satisfying DAQ bandwidth requirements • Design triggers for physics channels that are new to CMS +Full simulation and analysis for low mass Higgs • Diffractive Higgs (Hbb), presented at HERA-LHC workshop • Vector boson fusion Higgs (Hbb, Htt, HWW*), in preparation • New efforts starting up • Lepton measurement and vector boson self-couplings • Accumulate large physics samples  our computing effort UW Scientist Monika Grothe & student Creighton Hogg on diffractive higgs trigger 1-4 jet rates 2 x 1033 cm-2 s-1 luminosity threshold values correspond to 95% efficiency UW Students Creighton Hogg & Jessica Leonard on trigger rate calculations

29. UW Computing Activities(talk by S. Dasu) • Bradley [NSF-ITR] and Rader [DOE Base] Support • A CMS Tier-2 computer center from FY2005 • Data-Intensive Science University Network (DISUN) • Simulation production using local UW resources • The single largest institute producing CMS events 2002-2005 • OSG and Grid3 participation • Develop tools and provide cycles • Local physics analysis support • Special simulation production • e.g., Produced 10 M events in 2 weeks for muon trigger studies* • ~ 25 world-wide CMS physicists using UW facilities and data • Help desk for using campus grid resources • GLOW - Grid Laboratory of Wisconsin • Backbone of UW campus grid in collaboration with Ice Cube, Computer Sci., Biology, Chemical Eng., Medical Phys., etc. • Leader in development and implementation • Helped ATLAS group produce 10 M events fully simulated 200 Intel Xeon 2.4-2.8 GHz CPUs50 TB Apple XServe RAID Storage x4 by 2007 for CMS Physics Analysis * Ten million events in 2 weeks

30. Wisconsin Concerns • DOE Base Program Manpower at Wisconsin • Major effort on trigger software required • Tasks: board testing, monitoring/controls, diagnostics, configuration downloads & documentation, modeling, physics simulation, etc. • In US CMS Plan as base program manpower • Major effort on testing, installation, integration tests & commissioning • Planned as activity of base program manpower • For Trigger, Computing, Muon Projects (and now Tracker) • Project-supported personnel need base-program supported supervision • Wisconsin responsibilities are growing with time! • Long term trigger M&O + Physics Analysis + SLHC • Increase in personnel needed • Needs continued support & eventual growth • Provide growth from Task B redirection