110 likes | 122 Views
CSC Electronics Problem Report CSCE I&C. Fred Borcherding. Activities. Over the past months two activities have been ongoing 1 Peripheral Crate + Chamber testing has been in process for –Z 2 The minus end Slice Test has been in process
E N D
CSC Electronics Problem ReportCSCE I&C Fred Borcherding ME I&C -- PC Electronics
Activities • Over the past months two activities have been ongoing • 1 Peripheral Crate + Chamber testing has been in process for –Z • 2 The minus end Slice Test has been in process • Both processes have identified problem PCrate electronics boards • The next slide lists these problems • The following third and forth slides list earlier problems ME I&C -- PC Electronics
List of Problem PCrates & Boards • Date of Entered Location status ID action taken • Action by Location • 1 8-Feb-07 Misha VME-2/3 detector removed DMB0104 We couldn't download the firmware. • 2 22-Feb-07 Misha VME-2/1 detector removed DMB0506 ground potential for CFEB 1,2,4 read >0.25V • 3 5-Mar-07 Misha VME-3/6 detector removed EMUPC0038 1 pin bent, 1 pin in wrong position, slot #20 RAT side • 4 18-Apr-07 Misha VME-1/6 detector removed DMB0490 DMB tests 4,8,9 failed • 5 3-May-07 Misha VME-1/6 detector removed TMB5532 gave CREBrx: 2,6,6,7,7 > wrong • 6 14-May-07 Misha VME-1/4 detector removed DMB0067 didn't enable +3.3V,5V,6V for CFEB#3 • 7 16-May-07 Misha VME-1/2 detector removed DMB0321 Couldn't download the firmware • 8 21-May-07 Misha VME-1/2 detector removed EMUPC0034 couldn't download ALCT firmware through slot #2 • 9 21-May-07 Misha VME-1/2 detector removed MPC0048 the winner bit test failed in all TMB slots • 10 22-May-07 Misha VME-1/3 detector removed TMB5096 STEP not able to read ALCT data through slot #2 • 11 31-May-07 Misha VME-1/1 detector removed DMB0067 didn't enable +3.3V,5V,6V for all CFEBs • 12 4-Jun-07 Misha VME-1/1 detector removed CCB0072 hangs up the system talking to DMB modules in slot #19 • 13 2-May-07 Greg VME-3/3 detector removed DMB0074 ELOG:1939 - Not acting correctly since latest DMB firmware update • 20-May-07 Jianhui B904 Fixed DMB0074 ELOG:2098 - Reload PROM at B904 >> fixed, OK board • 14 2-May-07 Greg VME-2/1 detector removed DMB0400 ELOG:1939 - Not acting correctly since latest DMB firmware update • 20-May-07 Jianhui B904 NOT Fix DMB0400 ELOG:2098 - looks like problem PROM >> board bad ME I&C -- PC Electronics
Earlier Problems - 1 Note: Date shown here is when entered, not when tested • Entry Date of Action Location status Serial N/O A (mfg) comment • 2723 08-Feb-07 ISR problem DMB0016 mechanical problem • 2717 08-Feb-07 ISR problem DMB0053 set aside during ISR testing • 2702 08-Feb-07 ISR problem DMB0057 set aside during ISR testing • 2722 08-Feb-07 ISR problem DMB0128 mechanical problem • 2716 08-Feb-07 ISR problem DMB0209 set aside during ISR testing • 2713 08-Feb-07 ISR problem DMB0221 set aside during ISR testing • 2721 08-Feb-07 ISR problem DMB0229 set aside during ISR testing • 2712 08-Feb-07 ISR problem DMB0259 set aside during ISR testing • 2710 08-Feb-07 ISR problem DMB0276 set aside during ISR testing • 2719 08-Feb-07 ISR problem DMB0303 set aside during ISR testing • 75 30-May-05 B904 problem DMB0304 The front pannel is upside down • 2714 08-Feb-07 ISR problem DMB0325 set aside during ISR testing • 2704 08-Feb-07 ISR problem DMB0332 set aside during ISR testing • 2708 08-Feb-07 ISR problem DMB0337 set aside during ISR testing • 2709 08-Feb-07 ISR problem DMB0338 set aside during ISR testing • 2705 08-Feb-07 ISR problem DMB0340 set aside during ISR testing • 2706 08-Feb-07 ISR problem DMB0343 set aside during ISR testing • 2707 08-Feb-07 ISR problem DMB0355 set aside during ISR testing • 2715 08-Feb-07 ISR problem DMB0363 set aside during ISR testing • 2718 08-Feb-07 ISR problem DMB0427 set aside during ISR testing • 2711 08-Feb-07 ISR problem DMB0438 set aside during ISR testing • 2720 08-Feb-07 ISR problem DMB0524 set aside during ISR testing • 2703 08-Feb-07 ISR problem DMB0531 set aside during ISR testing ME I&C -- PC Electronics
Earlier Problems 2 • Entry ID Date of Action Location status Serial N/O A (mfg) comment • 2726 07-Feb-07 ISR problem EMUPC0021 2 broken connectors on BP • 2689 08-Feb-07 ISR problem EMUPC0021 2 broken connectors on BP back side bottom RAT slots 7 & 8 • 2956 30-Mar-07 X3S41d20 problem RAT5438 replaced RAT in slice test • 813 07-Jun-06 ISR problem TMB5058 fails "CCB Out" Test • 814 07-Jun-06 ISR problem TMB5177 misaligned to backplane • 822 07-Jun-06 ISR problem TMB5465 problem with RAT cards • 824 08-Jun-06 ISR problem VCC0012 fails to download DMB firmware • 827 08-Jun-06 ISR problem VCC0015 fails to download DMB firmware to far DMB • 831 08-Jun-06 ISR problem VCC0021 fails to download DMB firmware • 835 08-Jun-06 ISR problem VCC0025 hangs during TMB/MPC chain test • 834 08-Jun-06 ISR problem VCC0026 fails to download DMB firmware to far DMB • 2701 08-Feb-07 ISR problem CRB0017 failed startup test - • 2700 08-Feb-07 ISR problem CRB0071 broken LV connector - dropped Note: Date shown here is when entered, not when tested ME I&C -- PC Electronics
Summary of Recent Problems • A total of 14 problems were encountered in –Z testing and minus slice test • DMB -> 8 problems • TMB -> 2 problems • MPC -> 1 problems • CCB -> 1 problems • Crate -> 2 problems • These have come from a detailed testing series over 16 pcrates ME I&C -- PC Electronics
Plan • Setting up dedicated board test area @ B904 lab • Multiple PCrates in place • Computer in place • Updating testing software on computer • Ready from 12-June-07 • Single test chamber in place • Procedure at B904 • Re-test each board in known environment • All those listed in all 3 tables above • Give experts a test facility to look at problem boards in detail • Averaging close to 1 problem per crate • Need to determine seriousness of each of these problems • Can we find ways to prevent or to fix these in place in the future ME I&C -- PC Electronics
Backup Slides • Backup slides >> • elog problem entries ME I&C -- PC Electronics
Message ID: 2097 Entry time: Sat May 19 12:50:42 2007 Author:ignatenko, ignatenk@physics.ucla.edu • Type:PC commissioning Subject:Problem with VME-1_2 crate Dear all, last Friday we met a problem that related to peripheral crate itself. We weren't able to "talk" to ALCT on ME-1/1/03 CSC, which were connected to the slots 2 and 3. But we were able to download the ALCT firmware to the chamber and read back all necessary information (like status ALCT) through the slot #4. We tried to talk to ALCT on ME-1/1/04 CSC (this CSC normaly connected to the slot #4) through slot #2 and we failed again. Moreover, whichever TMB or RAT board were inserted into slot #2 they showed the same type of problem. The bottom line - something wrong with PC backplane (most probable something wrong with the connector between the TMB and the RAT boards). We are going to swap VME-1/3 and VME-1/2 crates in the peripheral rack and go on testing trigger sector -1/2. Once we get approval for crate replacement we will replace the PC. ME I&C -- PC Electronics
Wed May 2 11:20:12 2007, Greg Rakness, Gregory.Rakness@cern.ch, Electronics, swapped DMB ME-2/1/8 and ME-3/1/10 Sun May 20 14:44:40 2007, Jianhui Gu, gujh@mps.ohio-state.edu, Electronics, swapped DMB ME-2/1/8 and ME-3/1/10 • Message ID: 1939 Entry time: Wed May 2 11:20:12 2007 Reply to this: 2098Author:Greg Rakness, Gregory.Rakness@cern.ch • Type:Electronics Subject:swapped DMB ME-2/1/8 and ME-3/1/10 Swapped out boards which are not acting correctly since the DMB firmware update... https://cmsdaq.cern.ch/elog/CSC/1936 ME-2/1/8: removed DMB074, replaced with DMB180 ME-3/1/10: removed DMB400, replaced with DMB300 ME I&C -- PC Electronics
Wed May 2 11:20:12 2007, Greg Rakness, Gregory.Rakness@cern.ch, Electronics, swapped DMB ME-2/1/8 and ME-3/1/10 • Sun May 20 14:44:40 2007, Jianhui Gu, gujh@mps.ohio-state.edu, Electronics, swapped DMB ME-2/1/8 and ME-3/1/10 Message ID: 2098 • Entry time: Sun May 20 14:44:40 2007 In reply to: 1939 Author:Jianhui Gu, gujh@mps.ohio-state.edu • Type:Electronics Subject:swapped DMB ME-2/1/8 and ME-3/1/10 Check these two DMBs in Building 904: DMB#400: The Controller FPGA was not programmed. Reload the PROM, the FPGA is programmed. Tried different ways (single, or broadcast), all worked. So, this is a good board. DMB#074: The controller FPGA was not loaded. Reload the PROM, the FPGA still can NOT be programmed. Load older version of firmware, still can NOT be programmed. The PROM was re-soldered after initial assembly. It looks to me that there was problem with this PROM. So, this is a bad board. Suggestion: replace the PROM. (could be connection?) ME I&C -- PC Electronics