170 likes | 289 Views
Overview / motivation Upgrade phase one and the c urrent system JEM/CPM-to-CMM datapath The Backplane test module Considerations and requirements A few technical details and BERT setup Some words on the additional circuitry Outlook. The backplane test module.
E N D
Overview/motivation • Upgrade phaseone and the currentsystem • JEM/CPM-to-CMMdatapath • The Backplane test module • Considerations and requirements • A fewtechnicaldetails and BERT setup • Somewords on the additional circuitry • Outlook The backplane test module Christian Schröder Mainz University Level-1 CalorimeterTrigger Joint Meeting November 5th, 2008
Upgrade phaseoneWhat will happen in phaseone? LHC/beam: Trigger: Level-1 trigger rate can‘t increase (output rate still < 100 kHz) Have to be more selective Acceptance should still be as high as possible Simply raising the thresholds is no solution! (pile-up effects?) • Luminosity will increase by a factor of two: from 1034 cm-2 s-1 to 2.3·1034cm-2 s-1 • Interaction rate will approximately double • Number of events per bunch crossing will increase from about 20 to about 40 • have to improvethetriggeralgorithm • Buthow and where?
Overview of thecurrent level-1 calorimetertriggersystem • 4 crates à 14 CPMs + 2CMMs: • carry out the e/γ and τ algorithm(Δφ x Δη = 0.1 x 0.1) • 16 thresholds (8 for e/γ and 8 for e/γ/τ) and 16 RoIs per module • 25 links to each CMM @ 40 MHz At that point wehaveonlyinformation of multiplicities and no topologicalinformation. • 2 crates à 16 JEMs + 2 CMMs: • Carry out jet and sumalgorithm (Δφ x Δη = 0.2 x 0.2) • 8 thresholds and 8 RoIs per module • 25 links to each CMM @ 40 MHz
What additional datacouldweuse? • MaybetheRoIs • 8 RoIs per JEM, 2 locationbits per RoI, 8 threshholdbits per RoI • 8 x (2 + 8) bits = 80 bitsfortheRoIs per JEM • Maybe ET, Ex and Eywithfull 12 bitprecision (and notthescaled 6 bit) • 3 x 12 bits = 36 bits per fortheenergy sums per JEM • Total data per JEM: • 80 + 36 bits= 116 bitshave to besent per JEM each 25 ns With 50 links on the backplane to theCMMs data rate needed: 4 x 40 Mbps = 160 Mbps 12bit to 8bit scaling Need to understand wich data is useful (Monte-Carlo simulations?)
Bandwidth on the backplane Each CPM or JEM is sourcing a total of 50 lines into two mergers total capacity per module into both mergers is : 50 bit @ 40 Mb/s (25 bit of jet data) 100 bit @ 80 Mb/s (75 bit of jet data) * 200 bit @ 160 Mb/s (175 bit of jet data) * 400 bit @ 320 Mb/s (375 bit of jet data) * * On the JEMs, if we do not need to increase energy sum data volume, any increase on both backplane links can be used for jet data, if the increase in latency on the jet-to-sum processor path is acceptable (requires re-work of current jet processor DAQ interface)
backplane signals Series terminated: Scopeshots of JEM signalsoverthelongest backplane trackswithnoise on CMM and VME lines: Parallel terminated: 160 Mbits, CMOS 2.5V 320 Mbits, CMOS 2.5V For rates ≥ 160 Mbits we need termination at the sink
Rate tests • The rate limit on the backplane is about 160-320 Mb/s on JEMs • We need to understand what the required bandwidth will be on CP and JEP • Understand which data we want to use • We will need to do bit error rate tests on backplane data with a module able to • terminate the signals for data rates ≥ 160Mb/s • deskew each signal line individually • Not possible with current CMMs • Build backplane tester based on recent FPGA family providing both termination and deskew
General considerationsforthe backplane test module • datafrom JEMs/CPMs: 400 lines (at themoment 2.5V CMOS, sourceterminated) • Parallel termination at the sink isrequired • externalto ½ VCCO • internalby DCI • 1.5 V CMOS shouldbepossibleas well • variable VCCO • Regional clocks for source synchronous transmission (clock forwarding) • fine tunable per pindeskew • VME––bus(3.3 V, about 49 lines) • TTC clock jittercleaner • PCB iscomparatively expensive • useit also totestsomehigh-speedoptical links • high-speed links upto 6.25 Gbps • SNAP12 upto 75 Gbpseach • route theremaining parallel links on a headerforgeneralusage Xilinx Virtex-5 FX70T FPGA
Schematicoverview Backplane Reduced VME CPLD VME buffer JTAG buffer JTAG header VME 40MHz clock JTAG chain config CF-card Full VME-- System ACE from CPM/JEM FPGA 400 Additional circuitry (opto) Ring ofdiscreteterminators Parrallel links TTC signal High-speed links Clockmuxandfanout 16 pairs Recovered clock Cleaned clock config Power converters 160 MHz crystalclock JitterCleaner SPI flashmemory
Power dissipation Externalterminationat sink DCI-/internal-terminationat sink VCCO = 2.5 V R = 60 Ohm • VTT = ½ VCCO = 1.25 V • Z0 = 60 Ohm • P = (½ VCCO)2 / Z0 ≈ 26 mW • Ptotal = 400 * 26 mW ≈ 10.4 W a lot of power dissipation (challenging for cooling) changing the signal standard to 1.5 V CMOS, i.e. VCCO = 1.5 V • Ptotal = 400 * 9 mW = ~ 3.8 W But: only possible for the JEMs not for the CPMs
Overview of the BERT setup Backplane Eachmodule: 1 forwardedclock 24 datalines 1.5V-2.5V CMOS 40-320Mbits • JEMs/CPMscanbemixed (butinbetween has to beoneslotleftempty) • theJEMs/CPMssimplygenerate a test pattern • data (test pattern) issentoverthe backplane • 1 link out of 25 isusedforclockforwarding • the backplane test modulereceives and comparesthedata to expectedpatter • thebiterrorsarecalculated and an errorcountercanberead out via VME • Phase correction of clock and datalines also via VME CPU CPU Backplane Tester JEM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM/CPM JEM Backplane Tester TCM
Somewords on the additional circuitry we‘dlike to test someoptical links: • Snap12 optical link module: • upto 75 Gbps (12 x 6.25 Gbps) • up to 300 m lengthover OM3 ribbonfiber • board-edgeormid-boardmounted • low power consumption: ~ 2.5 W TX, ~ 1 W RX per channel • 850nm VCSEL laserarray, MTP/MTO opticalconnector • electrical interface: 12 x 6.25 Gbps CML (compatible with Xilinx GTXs Transceiver) • Rocket I/O GTX Transceiver • cheaplyavailable in manyXilinx Virtex-5 FPGAs • upto 6.5 Gbps per link • up to 48 Transceiver per FPGA (16 in FX70T) • Requires a low-jitterclock
High speeddatapath and clockpath FPGA input signals inputs 6.25 Gbps GTX GTX logic/ patterngenerator GTX data GTX GTX TTC signal GTX Snap12 (RX) GTX 12 x 6.25 Gbps electrical 12 x 6.25 Gbps optical GTX Jitter Cleaner Clockrecovery clock GTX GTX GTX GTX low jitter clock
High speed clock and data path FPGA input signals inputs 6.25 Gbps GTX GTX logic/ patterngenerator GTX data GTX GTX TTC signal GTX Snap12 (RX) • Peak-peakjitter: ~ 7 ps • RMS jitter: ~ 700 fs • Phase drift 50°C – 80°C: < 50 ps • Shouldbesufficientfor 6.5 Gbps GTX 12 x 6.25 Gbps electrical 12 x 6.25 Gbps optical GTX Jitter Cleaner Clockrecovery clock GTX GTX GTX GTX low jitter clock
Outlook • We have already started • FPGA will be delivered in about 5 weeks • PCB layout will be finished in about 5 weeks • Firmware will be programmed in parallel • maybe the board will be fully assembled in about 2 months then we‘ll be ready for first tests
Total data rates: • 14 CPMs/16 JEMs per crate • CPMs/JEMs aremergedtoleftandright CMM • 24 + 24 datachanels (+ 2 forwardedclocks) per CPM/JEM • 160 Mhz (4x): • 3.84 Gbps to each CMM per JEM • 61.44 Gbps to each CMM altogether • total data transfered: • 122.88 Gbps • 240 Mhz (6x): • 5.76 Gbps to each CMM per JEM • 92.16 Gbps to each CMM altogether • total data transfered: • 184.32 Gbps • 320 Mhz (8x): • 7.68 Gbps to each CMM per JEM • 122.88 Gbps to each CMM altogether • total data transfered: • 245.76 Gbps