1 / 49

401-04-04 Calorimeter Trigger

This document presents the upgrade plans for the Trigger Calorimeter components as part of the US CMS upgrade, with a focus on the Calorimeter Trigger Processor (CTP) and its associated hardware, firmware, and software. It includes details on the Calorimeter Trigger Concentrator (CTC), Optical Serial Link Boards (oSLB), and the Crosspoint IO Card (CIOX).

jtravis
Download Presentation

401-04-04 Calorimeter Trigger

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. 401-04-04 Calorimeter Trigger Sridhara Dasu, University of Wisconsin DOE CD1 Review 26 August 2013 DOE CD1 Review - US CMS Upgrade - Trigger

  2. Calorimeter Trigger WBS Detail ← Muon Trigger M&S paid byCMS-France DOE CD1 Review - US CMS Upgrade - Trigger

  3. Calorimeter Trigger Components DOE CD1 Review - US CMS Upgrade - Trigger

  4. HCAL & ECAL Trigger Primitives • Upgraded HCAL Readout & Trigger Electronics (μHTR) is after split that sends data to old electronics (HTR) • μHTR supplies TP to upgrade trigger, HTR continues to send to present trigger • ECAL Trigger Concentrator Cards (TCC) are not upgraded, instead their mezzanines with trigger serial links are replaced (Lisbon): • Optical Serial Link Board oSLB replaces single copper link to current Regional Calorimeter Trigger (RCT – U. Wisc.) with two optical links (WBS 401.04.04.06) • One optical link to optical Receiver Module (oRM) on RCT (WBS 401.04.04.05) • Replaces copper Receiver Module • One optical link to input of Upgraded Calorimeter Trigger: CTP7 Card • 574 oSLB’s & oRM’s with Fibers installed in 2014 • French Contribution to Calorimeter Trigger (no US Upgrade Funds) • Presently oSLB & oRM in final prototype stage • oSLB: oRM: OSLB Output / oRM Input: 4x channels @ 1.2 Gbps  4.8 Gbps DOE CD1 Review - US CMS Upgrade - Trigger

  5. 401.04.04.02: CTP Card Concept • Main processor card • Virtex-7 690T for processing • ZYNQ for TCP/IP + linux • 60 10G optical Input links • 36 10G opticalOutput links • Function: Find ET clusters & transmit to Layer-2 • Card Count = 46 • 36 total + 8 spares + 2 test setups 1V 30A Supply 3.3V Supply 1.5V Supply CXP Module 12Tx + 12 Rx 2.5V Supply CXP Module 12Tx + 12 Rx Virtex-7 VX690T FPGA 12X Rx ZYNQ XC7Z030 EPP 12X Rx CXP Module 12Tx + 12Rx (CTP-6 BG View) DOE CD1 Review - US CMS Upgrade - Trigger

  6. CTP: Virtex-6 Prototype Exists JTAG/USB Console Interface Mezzanine Power Modules MMC Circuitry Back End FPGA XC6VHX250T/ XC6VHX380T 4X Avago AFBR-820B Rx Module 12x Multi Gig Backplane Connections Front End FPGA XC6VHX250T/ XC6VHX380T Dual SDRAM for dedicated DAQ and TCP/IP buffering Avago AFBR-810B Tx Module DOE CD1 Review - US CMS Upgrade - Trigger

  7. CTP-6 Intraboard link eyepattern • Validation of signal integrity on CTP6 DOE CD1 Review - US CMS Upgrade - Trigger

  8. HCAL TPG to CTP Integration Test • 12-links tested at 6.4 Gbps – no errors DOE CD1 Review - US CMS Upgrade - Trigger

  9. Running Linux on CTP6 FPGA – PetaLinux • Startup screen via USB console • Root login, pinging controller PC at 192.168.1.2 • Running on CTP-6 back end FPGA (`VHX250T) • Important step towards CTP-7 ZYNQ-based Linux DOE CD1 Review - US CMS Upgrade - Trigger

  10. Advantage of Linux System on Chip • Physicists can contribute to CTP6 software • Familiar, reliable environment • Faster development cycles • Use of IPBus and uHAL over TCP/IP (CMS standards) • Coupled with AMC13 (Boston), DAQ can be implemented more easily • No needfor customfirmware orkernel softwarefor monitoring and control • Postdocs arealready usingPetalinux DOE CD1 Review - US CMS Upgrade - Trigger

  11. CTP: Basis of Estimate - Hardware • CTP7 is simpler than CTP6 prototype • Engineering effort for in-house design based on CTP6 work • Procurement of PCBs is based on recent CTP6 purchase • Good estimate of cost and schedule from prototype manufacture • Quotes available for all parts • Virtex-7 690T is the major cost driver – with recent quote • 3 690Ts donated by Xilinx • 5 690Ts purchased from Xilinx • Total of 8 FPGAs in-hand for prototypes • Optical modules based on recent purchase • Miscellaneous parts also have quotes or estimated from prototype purchases (power modules) DOE CD1 Review - US CMS Upgrade - Trigger

  12. CTP: Basis of Estimate - Effort • Firmware and software efforts estimated from prototype testing + prior RCT experience • Firmware algorithms for testing provide the basis for the core firmware, which is the most complicated • Tom Gorski and Mathias Blake • Trigger algorithm firmware work is based on prior experience managing GCT project (UK) • Wesley Smith was L1 project manager overseeing GCT • Software effort is based on current RCT • Sophistication of embedded Linux / TCP and shorter timeline for implementation requires professional software effort • JesTikalsky • Bulk of testing software from post-doc and graduate student • Pam Klabbers, Evan Friisand graduate students will develop software • Board and Firmware/Software done by the same group (Wisconsin) results in efficiencies DOE CD1 Review - US CMS Upgrade - Trigger

  13. 401.04.04.03: Crosspoint IO Card– U. Wisconsin (2/crate x 3 crates = 6 + spares) • Function: For inter-board connections • Input/Output: 48x 4.8-6.4 Gbps • Prototype exists • Fully tested • Firmware is minimal and exists • CIOX cost well known • Ready for production Controller (MMC and link mgmt) 4X Avago AFBR-79EQDZ QSFP+ Module Positions Backplane Rx/TxRedriver ICs (top and bottom sides) 4x4 Lane Bidirectional Multi Gig Backplane Connections DOE CD1 Review - US CMS Upgrade - Trigger

  14. 401.04.04.04: CTP Infrastructure:Vadatech VT894 Crate Test Setup (Final system: 3 crates w/ 12 CTP7 ea. + 2 test setups + spare = 6) TTC Downlink U. Wisconsin designed backplane with dense card interconnects manufactured & installed in commercial Vadatech VT892 Crate available in Vadatech Catalog BU AMC13 UW CTP-6 UW CTP-6 UW Aux Vadatech MCH DOE CD1 Review - US CMS Upgrade - Trigger

  15. CTP: Risk and Mitigation Strategy • The dominant risks are: • Availability of ALL trigger primitive inputs from ECAL, HCAL in optical format • Validation of large optical link plant in limited time • Fully validated trigger algorithms in firmware • Control and operations software • Risk mitigation strategy: • Continue to provide fully operational current trigger system in parallel with upgrade commissioning • Partial operation of the upgrade systems provide tangible benefits from 2015 onwards DOE CD1 Review - US CMS Upgrade - Trigger

  16. Calorimeter Trigger Risk Mitigation oRSC Function: Conversion to optical oRSC Input: RCT egt and jet clusters 80 MHz Parallel ECL oRSC Output: 6x copies at 6.4 Gbps optical • Goal (Original): • Provide readout of original RCT descopedduring construction project • Present readout through GCT input buffer not workable with trigger evolution • Uses connection to a single CTP6 prototype or CTP7 card for DAQ readout • optical Receiver Summary Card (oRSC) paid by DOE Nuclear • VME Slave Interface Card • Fits in current RCT Crates (1 per crate) • 18 Cards in 2015 System • Receives RCT Jet Sum Card Outputto GCTon Copper “SCSI” Data Cables • Provides direct optical input to GCT • Bypassing old optical conversion cards • Planned use for Heavy Ion Triggers • Prototype under test  • Multiple optical outputs provide: • Inputs for upgrade calorimeter trigger &parallel operation of old & new trigger wherever ECAL & HCAL electronics notavailable in 2015 DOE CD1 Review - US CMS Upgrade - Trigger

  17. oRSC Card Status • 4 Boards manufactured and tested • 12 layer board, with IsolaiSpeedLaminate for high-speed SERDES • Kintex-7 355T-2 as the RCT parallel-to-optical-Tx interface device • Spartan-6 for VME Slave Interface and I2C/general device controller • Two AvagominiPOD 12-lane transmitters for optical outputs per card • One card per RCT crate, capturing the output from the Jet Summary Card, and receiving clock/control signals from the RCT Crate Clock Card • Card is functional: • Tested oRSC to CTP6 optical rx/tx at 6.4 Gbps (23 links) • oRSC integration test with MP7 (UK) planned for July • 2 oRSCs can be used to fully emulate the 18-crate RCT output • Will be used for developing RCT readout validation in 2013 DOE CD1 Review - US CMS Upgrade - Trigger

  18. oRSC-CTP6 Monitoring and Validation Zero bit errors 10^-14 BER! DOE CD1 Review - US CMS Upgrade - Trigger

  19. oRSC-CTP6 Monitoring and Validation • Two Virtex6 FPGAs on CTP6 • Both have Microblaze embedded processor • Enables straight forward development in C++ • Read out captured transmitter data via IPBus protocol from remote server • Back End FPGA embedded processor running Linux • serves IPBus over TCP/IP • Forward IPBus packets over serial protocol to FPGA2 • Able to readout arbitrary memory locations from both FPGAs • Receive upgrade commands for writing FPGA configuration images and additional Linux executables to onboard flash memory • Front End FPGA embedded processor running standalone app • Able to accept and decode IPBus Packets • Control or report status of all 48 fiber links • Read capture RAMs for all or selected fibers DOE CD1 Review - US CMS Upgrade - Trigger

  20. oRSC-CTP6 Monitoring and Validation CTP6 DOE CD1 Review - US CMS Upgrade - Trigger

  21. Software status and control Real Time monitor link status Real time fiber link receiver control Read out from selected link Capture RAMs oRSC-CTP6 Monitoring and Validation DOE CD1 Review - US CMS Upgrade - Trigger

  22. Six links connected from oRSC to CTP6 during integration test Displays real time fiber connection status for each of 48 CTP6 fiber inputs Overflow, Underflow, Loss of Sync, Data Error Detect, and PLL Lock All six fiber links locked and error free oRSC-CTP6 Monitoring & Validation DOE CD1 Review - US CMS Upgrade - Trigger

  23. Fiber Capture RAM readout SW controllable capture Sync character to start capture Length of Capture Links to readout Capture RAM auto clears on each capture All six links capture expected pattern from oRSC Captured data automatically checked by host oRSC-CTP6 Monitoring & Validation DOE CD1 Review - US CMS Upgrade - Trigger

  24. oRSC to MP7 Link Validation Extraordinary margin available in bathtub curve Superb eye opening measured at MP7 receiver Zero Bit errors with overnight iBERT PRBS testing Data validation: oRSC pattern RAM to MP7 capture RAM Bathtub Curve Eye Diagram DOE CD1 Review - US CMS Upgrade - Trigger

  25. Demonstrators & Critical Integration Tests • mHTR to CTP6 integration test at Madison (done) • Wisconsin/Minnesota : 12 links operated successfully • oRSCto CTP6 demonstrator at Madison (done) • Test 2-3 oRSCs and interface before shipment to CERN • oRSC to CTP6 platform at Prevessin(done) • 2 oRSCs emulate RCT + 1 CTP6 for RCT readout and algorithm tests • Full platform for system operations and control software development • oRSC- MP7 Integration test at Prevessin(done) • Wisconsin/Imperial July 2013 Milestone • CTP6 - oRSC-oRM/RCT - oSLB/TCC Integration Test at Prevessin • Wisconsin/Lisbon/LLR October 2013 Milestone • CTP6 - oRSC-oRM/RCT - oSLB/TCC -uHTR Integration Test at 904 • Wisconsin/Lisbon/LLR/Minnesota November 2013 Milestone • CTP7 - MP7 Integration test at Prevessin • Wisconsin/Imperial March 2014 Milestone DOE CD1 Review - US CMS Upgrade - Trigger

  26. Adiabatic Upgrade Timeline • 2013 • M&O + R&D Activity : oRSC construction, installation • Firmware development for RCT readout and testing using CTP6 • Lisbon / France : oSLB and oRM construction, installation • Minnesota / Wisconsin : mHTR to CTP6 testing • 2014 • Ensure fully working legacy RCT system with oRSC + CTP6 RO • CTP7, CIOX, … construction, validation • Firmware development for CTP7 testing and 2015 operation • 2015 • Commission and operate Stage-1 system • Firmware development and integration of Stage-2 system • 2016 • Commission and operate Stage-2 system DOE CD1 Review - US CMS Upgrade - Trigger

  27. CTP: Production, Installation, etc • Launch Production (Buy parts, fabricate PCBs): 1QFY2014 • Deliver Stage-1 Calorimeter Trigger (4 CTP boards + 1 crate + oRSCs): 4QFY2014 • Initial operation at CERN (Firmware for Stage-1 + HF clusters): 2QFY2015 • Deliver Stage-2 Calorimeter Trigger(All CTPs, CIOx, 3 crates): 2QFY2015 • Test High Luminosity Operation of Calorimeter Trigger (All Firmware for Stage-2): 4QFY2016 DOE CD1 Review - US CMS Upgrade - Trigger

  28. Backup Slides for Q&A DOE CD1 Review - US CMS Upgrade - Trigger

  29. ECAL energy Global Calo Trigger Regional Calo Trigger HCAL energy Evolution: Partial Upgrade in 2015 Uses reprogrammed RCT clusters with improved algorithms in Layer-2 Also, brings in all the power of finer grain HF using “Slice Test” of Layer-1 & 2 Improved PU subtraction, Isolation Calculation (e/γ/τ/μ) & Half-tower Position Resolution Add to bring in finer grain EM clusters US Items: oRSCs, oSLB/oRMcommissioning CTP Layer 1 Processors RCT RO+Testing CTP UK Items: MP7 Layer 2 Processors 36 mHTRs HF energy 2 CTP7s 9 CTP7s Layer 1 Processors oRSC oRM ECAL & HF Clusters Half-tower position oSLB RCT RO + Testing 2 CTP7s 4x4 E+H Clusters 2x1 E+H Clusters 2-bit region ID Spare Layer 2 Calo Trigger Layer 2 Calo Trigger Heavy Ion Muon 4 MP7s Jets & Sums eGammaTau GCT fallback and Minimal Stage-1 fallback remains available Layer 2 Processors With just a fraction of final cards or even prototypes, derive many benefitsof fullupgrade, incl. muon isolation DOE CD1 Review - US CMS Upgrade - Trigger

  30. Fully Pipelined Calorimeter Trigger Time Multiplexed Calorimeter Trigger US: Layer 1:CTP7 Cards UK: Layer 2: MP7 Cards Demux Calorimeter Trigger Upgrade Options • Two modes of connectivity required • Layer 1: • Pipelined: formsvarious cal. clustersto send to L2 nodesfor different triggers • TMT: distributes allcal. Info. in eventto one multiplexedL2 node for all triggers • Layer 2: • Finds different triggerobjects using clustersorscanning (TMT)all cal. info. & thendemultiplexing • Keep new trigger flexible to adapt to needs of evolving CMS physics program • Both architectures have two processing layers • Layer 1 optimized for backplane connectivity, Layer 2 for optical • TMT architecture chosen as initial baseline • Stage-1 must use pipelined traditional architecture Layer 1 Layer 2 DOE CD1 Review - US CMS Upgrade - Trigger

  31. Pipelined Calorimeter Trigger (Stage-1) Each Layer 2 processor calculates suite of trigger paths (Default plan till all ECAL & HCAL TPs are available in optical format.) To GT To GT Trig Path 1 (MP7) Trig Path 2 (MP7) Trig Path 3 (MP7) Trig Path 4 (MP7) Trig Path 5 (MP7) Trig Path 6 (MP7)  Crate G Crate G Up to 12 Trigger Path Modules Each Trigger Path MP7 rcvs 48 total 1st-Level fibers @ 9.6 Gbps (2/region) Fiber patch panel Layer 1 and RCT send dedicated clusters to Layer 2 Each 1st-Level CTP7 Drives 2 fibers out to 6-12 Trigger Paths @ 9.6 Gbps Calorimeter Trigger Processor (CTP) Card oRSC () () () () CTP () () () () () () () () () CTP () () () () () Current RCT Crate A Crate C HF ECAL HBHE HF DOE CD1 Review - US CMS Upgrade - Trigger

  32. Pipelined Calorimeter Trigger (Stage-1) Each Layer 2 processor calculates suite of trigger paths (Default plan till all ECAL & HCAL TPs are available in optical format.) To GT To GT Trig Path 1 (MP7) Trig Path 2 (MP7) Trig Path 3 (MP7) Trig Path 4 (MP7) Trig Path 5 (MP7) Trig Path 6 (MP7)  Crate G Crate G Up to 12 Trigger Path Modules Each Trigger Path MP7 rcvs 48 total 1st-Level fibers @ 9.6 Gbps (2/region) Fiber patch panel Layer 1 sends dedicated clusters to Layer 2 6 x 8-fiber ribbons for Lateral Network (@ 4.8 Gbps) Each 1st-Level CTP7 Drives 2 fibers out to 6-12 Trigger Paths @ 9.6 Gbps Calorimeter Trigger Processor (CTP) Card Crosspoint I/O (CIO) Card CIO-L CTP () CTP () CTP () CTP () CIO-U CIO-L CTP () CTP () CTP () CTP () CIO-U CIO-L CTP () CTP () CTP () CTP () CIO-U Current RCT Crate A Crate B Crate C HF ECAL ECAL ECAL HF HF HBHE DOE CD1 Review - US CMS Upgrade - Trigger

  33. Pipelined Calorimeter Trigger Upgrade Each Layer 2 processor calculates suite of trigger paths (Default plan till all ECAL & HCAL TPs are available in optical format.) To GT To GT Trig Path 1 (MP7) Trig Path 2 (MP7) Trig Path 3 (MP7) Trig Path 4 (MP7) Trig Path 5 (MP7) Trig Path 6 (MP7)  Crate G Crate G Up to 12 Trigger Path Modules Each Trigger Path MP7 rcvs 48 total 1st-Level fibers @ 9.6 Gbps (2/region) 2x288-fiber patch panel (2x24×12-fiber optical ribbons in & out) Layer 1 sends dedicated clusters to Layer 2 6 x 8-fiber ribbons for Lateral Network (@ 4.8 Gbps) Each 1st-Level CTP7 Drives 2 fibers out to 6-12 Trigger Paths @ 9.6 Gbps Calorimeter Trigger Processor (CTP) Card Crosspoint I/O (CIO) Card CIO-L CTP CTP CTP CTP CTP CTP CTP CTP CIO-U CIO-L CTP CTP CTP CTP CTP CTP CTP CTP CIO-U CIO-L CTP CTP CTP CTP CTP CTP CTP CTP CIO-U Crate A Crate B Crate C ECAL HCAL ECAL HCAL ECAL HCAL DOE CD1 Review - US CMS Upgrade - Trigger

  34. TMT Calorimeter Trigger Upgrade Time-multiplexed architecture, calo data from an entire event processed by a single processor DOE CD1 Review - US CMS Upgrade - Trigger

  35. e / g / tPosition Resolution DOE CD1 Review - US CMS Upgrade - Trigger • Significantly improved position resolution • Further enhanced with optional Stage-1

  36. Electron / Photon Trigger Improved control on isolation even at Stage-1 • Factor of 2-3 reduction in rate with small loss in efficiency DOE CD1 Review - US CMS Upgrade - Trigger

  37. Tau Trigger Big improvement in efficiency with ~10X rate reduction! Current tau trigger has large and negative PU dependence DOE CD1 Review - US CMS Upgrade - Trigger

  38. Jet Triggers Single jet thresholds similar to current • Multi-jet trigger thresholds better in upgrade (PU sub.) • Small improvement in efficiency turn-on HT = SPTJets Single jet Quad jet DOE CD1 Review - US CMS Upgrade - Trigger

  39. Physics Performance Summary Average Improvement: 17% (Low Lumi) & 40% (High Lumi) DOE CD1 Review - US CMS Upgrade - Trigger

  40. Expected performance • Shown examples of improved object performance • Taken in isolation these do not show we can deliver the CMS physics programme: how do triggers fit together? what about overlaps? Can we fit everything in 100 kHz limit? • Develop simplified L1 trigger menus to illustrate thresholds attainable within an overall fixed rate • 1.1x1034 cm-2 s-1 with 50ns BX and 50 pile-up • 2.2x1034 cm-2 s-1 with 25ns BX and 50 pile-up • Menus contain: • Single lepton triggers • Isolated single lepton triggers • Dilepton triggers • Lepton cross-triggers (lepton and jets or MET) • Hadronic triggers • Captures about 80% of the rate in 2012 L1 trigger menu • Does not include calibration triggers, prescaled trigger for efficiencies etc. DOE CD1 Review - US CMS Upgrade - Trigger

  41. L=1.1x1034 cm-2s-1with 50ns BX and 50 pile-up ⎬ Single e/μ Multijet DOE CD1 Review - US CMS Upgrade - Trigger

  42. L=2.2x1034 cm-2s-1 with 25ns BX and 50 pile-up ⎬ Single e/μ Multijet DOE CD1 Review - US CMS Upgrade - Trigger

  43. Physics studies • Physics priorities: • Measure all Higgs BR as precisely as possible to confirm Standard Model or not, so retaining or improving current trigger capability is critical • Want to be able to answer the question of naturalness - whether or not there is new physics stabilising the Higgs mass or not • SUSY remains a leading candidate, but if it is so, must have light stops • Also must be able to trigger on and search for all variants (e.g. RPV with all hadronic final states) to draw a firm conclusion • Consider a set of benchmark physics channels • Look at the performance of these channels in 2012 analyses with and without L1 trigger upgrade at different luminosities using toy menus • Benchmark the signal efficiencies in each case DOE CD1 Review - US CMS Upgrade - Trigger

  44. Physics performance Benchmark channels considered to highlight improvements • Higgs • WH: H➔bb (single lepton triggers) • H ➔ ττ (new tau algorithm, single lepton triggers) • H➔WW (single and dilepton triggers) • SUSY • Direct stop squark production (single lepton, jets and MET triggers) • RPV SUSY decays (hadronic triggers e.g. multijet) • Heavy Ion • pT asymmetry in b jets (underlying event subtraction in jet trigger) • Ratio of 3 to 2 jets (underlying event subtraction in jet trigger) DOE CD1 Review - US CMS Upgrade - Trigger

  45. Higgs summary DOE CD1 Review - US CMS Upgrade - Trigger

  46. SUSY summary DOE CD1 Review - US CMS Upgrade - Trigger

  47. Higgs summary ⎬ Single e/μ ⎬ Tau ID & Single e/μ DOE CD1 Review - US CMS Upgrade - Trigger

  48. SUSY summary Multijet DOE CD1 Review - US CMS Upgrade - Trigger

  49. Readout rate is limited by data volume to 3 kHz Need reduction to 5% of current jet trigger rate to reduce bandwidth Pile-up subtraction in upgraded trigger achieves goal Heavy Ion performance Investigation of flavour dependence in jet quenching ➔ jet asymmetry in doubly b-tagged events DOE CD1 Review - US CMS Upgrade - Trigger

More Related