350 likes | 487 Views
Trigger Upgrade. Wesley H. Smith University of Wisconsin Darin Acosta University of Florida Sergo Jindariani Fermilab US CMS PMG, January 16, 2013. Performance and Schedule of the LHC. Need to handle PU~50, and L 2E34 @ 13-14 TeV
E N D
Trigger Upgrade • Wesley H. Smith • University of Wisconsin • Darin Acosta • University of Florida • SergoJindariani • Fermilab US CMS PMG, January 16, 2013
Performance and Schedule of the LHC Need to handle PU~50, and L2E34 @ 13-14 TeV Effectively a factor of ~6 (or larger) increase in current L1 rates M.Lamont, CMS Week, also shown to Council, Dec.2012
Motivation: Trigger Rate Projections • Trigger rate studies from special 8 TeV high-PU runs • NB: Total L1 Trigger Rate < 100 kHz Trig. > Thr.(GeV) 1 e/γ > 22 1 μ > 14 1 Jet > 128 Sum(Jets) > 150 2 e/γ > 22 Linear with PU and lumi, but rates growing large !
Goals for CSC Trig. Upgrade- U. Florida, Rice, Texas A&M • Remove limit of 3 segments per Muon Port Card • Each Muon Port Card covers one sector • Particularly problematic for collimated multi-muons w/rising occupancy • Increase bandwidth in trigger links • Occupancy of segments from chambers will exceed optical link bandwidth to CSC Track-Finder Sector Processors • Dropped segments will degrade performance: lose momentum precision (higher rate) and/or tracks (inefficiency). • Improve momentum resolution • Make full use of all track information to approach best precision achievable for standalone muon reconstruction • Steeper rate vs. pT threshold curve increases safety margin to high luminosity and high pile-up • Deliver higher precision on output track quantities to Global Trigger upgrade, & more μ candidates • η✕ϕ = 0.05 ✕ 2.5° → 0.0125 ✕ 0.015° • Accommodate new algorithms like those in Higher Level Trigger • invariant mass cuts, jet-lepton matching, … • Possible seeding of future inner tracking trigger • Requires new high bandwidth (optical) links to Global Trigger
EMU Trigger Upgrade Cavern Counting Room μTCA: Advanced Mezzanine Cards from Telecommunications Computing Architecture (commercial telco, see backup slide)
Muon Port Card Upgrade • Use the existing MPC main board • Backplane interface to TMB remains unchanged • 3 original optical links are still available • New mezzanine card with new FPGA and new links x 60 +20 spares
EMU Track-Finder Upgrade “Sector Processor” x 12 “BackplaneConnector” Connection to VT892 standard backplane
EMU CSCTF Chassis Not US* *Processing the resulting tracks with RPC or CSC hits is a US responsibility
Muon Trigger M&S • TOTAL: $701K • Muon Port Cards: 80 x $1480 = $126,400 • Optical Fibers & installation: $51,600 • New estimate 4x as much under investigation • CSC Track-Finder: $523,246 • Module Preproduction (3): $63,630 • Module Production (18): $357,480 • uTCA chassis, optical parts, COTS: $102,136
Upgrade Cal. Trig. Algos.- U. Wisconsin HCAL ΔηxΔφ=0.087x0.087 η • Particle Cluster Finder • Applies tower thresholds to Calorimeter • Creates overlapped 2x2 clusters • Cluster Overlap Filter • Removes overlap between clusters • Identifies local maxima • Prunes low energy clusters • Cluster Isolation and Particle ID • Applied to local maxima • Calculates isolation deposits around 2x2,2x3 clusters • Identifies particles • Jet reconstruction • Applied on filtered clusters • Groups clusters to jets • Particle Sorter • Sorts particles & outputs the most energetic ones • MET,HT,MHT Calculation • Calculates Et Sums, Missing Et from clusters • New Technologies (μTCA, Links) enable the above • All coded in Firmware & Tested (latency/resources) ECAL φ e/γ HCAL η ECAL φ τ HCAL η ECAL φ jet
Upgrade Cal. Trig. Performance • Simulation work on stage-1 calorimeter trigger by FNAL, UI-Chicago, UC Davis, UC San Diego, U Wisconsin, MIT, Ohio State U. (subset of stage 2) Also exploring muon isolation
Regional Calo Trigger Global Calo Trigger HCAL energy ECAL energy HF energy HCAL energy Current L1 Trigger System Upgrade L1 Trigger System Layer 1 Calo Trigger oSLB EM candidates Region energies oRM Layer 2 Calo Trigger Calo Trigger Upgrade in Parallel: Split inputs from ECAL & HCAL • Install optical SLB and optical RM mezzanines during LS1 • Install HCAL passive optical splitters during LS1 or YETS • Install HCAL backend μHTRcards for input to new trigger • Install HCAL frontend electronics after LS2 (finer segmentation)
Calorimeter Trigger Evolution 3 new calorimeter trigger μTCA crates 601 + spares Optical Receiver Modules
Calorimeter Trigger ProcessorVirtex-6 Prototype Board (CTP-6) JTAG/USB Console Interface Mezzanine Power Modules MMC Circuitry Back End FPGA XC6VHX250T/ XC6VHX380T 4X Avago AFBR-820B Rx Module 12x Multi Gig Backplane Connections Front End FPGA XC6VHX250T/ XC6VHX380T Dual SDRAM for dedicated DAQ and TCP/IP buffering Avago AFBR-810B Tx Module
Calorimeter Trigger Processor Virtex-7 (CTP-7) • Replace 2 Virtex-6s with a Virtex 7 for processing+ZYNQ for embedded TCP/IP endpoint • 30A, 1V power module for FPGA logic core • 3x CXP Pluggable modules for 36 Tx + 36 Rx 10G optical links • 2x AFBR-820 modules for 24 Rx 10G optical links • Simpler design to execute than the CTP-6 • 36 Total + spares 3.3V Supply 1.5V Supply 1V 30A Supply CXP Module 12Tx + 12 Rx 2.5V Supply CXP Module 12Tx + 12 Rx Virtex-7 VX690T FPGA 12X Rx ZYNQ XC7Z030 EPP (optional) 12X Rx CXP Module 12Tx + 12Rx (CTP-6 CAD View)
CIO-X: crate interconnections(2/crate x 3 crates = 6 + spares) Controller (MMC and link mgmt) 4x4 Lane Bidirectional Multi Gig Backplane Connections 4X Avago AFBR-79EQDZ QSFP+ Module Positions Backplane Rx/TxRedriver ICs (top and bottom sides)
VT894 Crate Test Setup(Final system: 3 crates w/ 12 CTP7 ea.) TTC Downlink BU AMC13 UW CTP-6 UW CTP-6 UW Aux Vadatech MCH
Fully Pipelined Calorimeter Trigger Time Multiplexed Calorimeter Trigger Layer 1 Layer 2 Demux Final Calo Trigger Upgrade(“Stage 2”) • Two modes of connectivity required • Keep new trigger flexible in order to adapt to the needs of the evolving CMS physics program • Both architectures have two processing layers • Layer 1 optimized for backplane connectivity, Layer 2 for optical • TMT architecture chosen as baseline
Calorimeter Trigger M&S • TOTAL: 1,149 K$ • 42 CTP7s @ 17.5K$ each (36 needed plus 6 spares): 735 K$ • FPGA: 12 K$ • Optical: 3 K$ • Board, Fabrication, Assembly, other 2.5 K$ • 6 CTP7 prototypes @ 17.5 K$ each: 105 K$ • 9 CIOx @ 2K$ each (6 needed plus 3 spares): 18 K$ • Optical: 1.2 K$ • Board, Fab Assembly, other 0.8 K$ • 3 CIOx prototypes @ 2K$ each: 6 K$ • 4 VadatechμTCA crates : 40 K$ • incl. MCH & PS (3 needed plus spare) @ 10 K$ • 4 AMC13 Modules (3 needed plus spare) @ 5 K$: 15 K$ • Optical Cables & Patch Panel between Layers 1 & 2: 20 K$ • oRM’s: 700 (601 plus spares) @ 300 $: 210 K$.
Trigger Labor & Travel(non-physicist) • Total Labor: $2.07M • Muon Trigger Labor over 4 years: $ 840K • MPC Electronic & Firmware Engineering: $160K • CSCTF Electronic & Firmware Engineering: $480K • Software Engineering: $200K • Calorimeter Trigger Labor over 4 years: $ 1,230K • Electronic Engineering: $ 380K • Firmware Engineering: $ 530K • Technician: $160K • Software Engineering: $160K • Travel over 4 years: $130K • Muon: $70K • Calorimeter: $60K • NB: Resource Loading is not complete
Trigger WBS High Level • Notes: • Starts Nov. 1, 2013 • Prototyping complete • Not included • Dictionary structure only • Next: Schedule integration & Resources • Needs alignment with CMS Structure • Underway • All WBS US only
Schedule & Completion • Trigger Schedule: • Installation of components to provide parallel upgrade trigger installation/commissioning/operation during LS1. • Installation/Commissioning of upgrade trigger system during 2015. • Parallel Operation of Upgrade Trigger System at beginning of run in 2016 with old trigger system. • Full sole operation of Upgrade Trigger System in 2017. • Trigger Completion KPP: • Demonstration of 99.9% (99.99% objective) agreement btw. upgrade trigger electronics & software emulation through test patterns • Demonstration of reduction of trigger rates for electrons, photons, muons and taus for a reduction of less than 15% in efficiency • Incorporation of unganged ME1/1a data into the endcap muon trigger logic.
Risks • MPC installation incomplete by end LS1 • Consequence: unable to provide full inputs to upgrade CTCTF • Mitigation: installation of remaining MPC mezzanines during 2015-2016 YETS. • oSLB-oRM installation not complete by end LS1 • Consequence: full parallel operation of final calorimeter trigger not possible until 2018 • Mitigation: use parallel operation involving stage-1 calorimeter trigger hardware or use slice for validation • Full HCAL μHTR system not commissioned by end 2016 • Consequence: operation of final calorimeter trigger not possible during 2016 • Mitigation: Continue to use stage-1 upgrade calorimeter trigger hardware which incorporates much stage-2 hardware.
Existing CMS Trigger & DAQ • Overall Trigger & DAQ Architecture: 2 Levels: • Level-1 Trigger: • 25 ns input • 3.2 s latency UXC Calorimeters: Muon Systems: US Upg. USC • Design: Interaction rate: 1 GHz • Bunch Crossing rate: 40 MHz • 40 MHz x 25 PU = 1 GHz • Level 1 Output: 100 kHz • Output to Storage: 300-400 Hz • Average Event Size: 0.5 MB • Data production 1 TB/day US Upg.
Motivation: Projected L1 Rates @ 2E34 • Single e/γtrigger • Black - 14 TeV MC (50 PU) • Red - 8 TeV data (66 PU) Rates shown for Linst=2×1034cm-2s-1 Rate in kHz ! • HT(ET sum of jets) • Black - 8 TeV data (66 PU) • Red - 8 TeV data (45 PU) 100 100 • Single muon trigger • Black - 14 TeV MC (50 PU) • Red - 8 TeV data (66 PU) 100 Jet trigger rates are strongly dependent on PU Lepton triggers scale by ~2 for increased center of mass energy. Muons have poor control of rates at high thresholds
Tools for upgrades: ATCA • Advanced TelecommunicationsComputing Architecture ATCA • Example: ATLAS Upgrade Calorimeter Trigger TopologicalProcessor Card • 12-chan. ribbon fiber optic modules • Backpl. opt. ribbon fiber connector • Example: μTCA derived from AMC std. used by CMS HCAL, Trig. • Advanced Mezzanine Card • Up to 12 AMC slots • Processing modules • 6 standard 10Gb/s point-to -point links from eachslot to hub slots (more available) • Redundant power, controls,clocks • Each AMC can have in principle (20) 10 Gb/sec ports • Backplane customization is routine & inexpensive
Calorimeter Trigger PrimitivesPresent Connections HCAL HTR Cards Existing Copper Cables To DAQ Regional Calorimeter Trigger Via HCAL DCC2 To DAQ Via GCT Existing Copper Cables ECAL TCCs To DAQ Via ECAL DCC
Calorimeter Trigger PrimitivesConnection Evolution HCAL HTR Cards Existing Copper Cables To DAQ Regional Calorimeter Trigger Via HCAL DCC2 To DAQ Via GCT ORMs Optical Splitter Upstream of HCAL HTR/uHRT ECALIndiv. Fibers (LC) HCAL uHTR Cards Trigger Primitive Optical Patch Panel Optical Ribbons To DAQ Via BU “AMC13” ECAL Opti. Ribbons SLHC Cal Trigger Processor Cards HCAL Opti. Ribbons To DAQ Optical Ribbons ECAL TCCs Via BU “AMC13” To DAQ OSLBs Via ECAL DCC
Calorimeter Trigger PrimitivesFinal Situation HCAL uHTR Cards Trigger Primitive Optical Patch Panel Optical Ribbons To DAQ Via BU “AMC13” ECAL Opti. Ribbons SLHC Cal Trigger Processor Cards HCAL Opti. Ribbons To DAQ Optical Ribbons ECAL TCCs Via BU “AMC13” To DAQ OSLBs Via ECAL DCC