150 likes | 252 Views
CSC Shift Training and Operation + B904 Status. Fred Borcherding Fermi. Training Changes to date Training is now being conducted at Pt5 Training is focused on LHC operations cDCS changes Run Registry changes Differences for Operation and Procedures cDCS Run Registry & DQM B904 Status
E N D
CSC Shift Training and Operation+ B904 Status Fred Borcherding Fermi CSC Training/Operation & B904 by Fred B.
Training Changes to date Training is now being conducted at Pt5 Training is focused on LHC operations cDCS changes Run Registry changes Differences for Operation and Procedures cDCS Run Registry & DQM B904 Status Cosmic Ray Runs Taken Being used for hardware & firmware testing Overview CSC Training/Operation & B904 by Fred B.
New Main Shift Station • Main station now has 4 monitors • UL > EMU Page 1 • UR > DCS • LL > Run Registry • LR > DQM / Run Evaluation CSC Training/Operation & B904 by Fred B.
Moved training to Pt5 Classroom training in meeting room With laptop project slides and/or real-time views of shifter pages Point where training could be improved Assistance with language Often with training in English for non-native speakers question go unasked and misunderstanding is too common Set requirements on 1st time shifters and returning shifters More formal shifter certification? Now training is required Require minimum of training and hands on shift training for shift to count Sit as 2nd shifter for part of a shift to complete certification Who certifies? Now> Me, Richard Need someone to conduct training who is based at CERN Changes to Shifter Training CSC Training/Operation & B904 by Fred B.
Moved CSC Shifter DCS to cDCS Moved DCS procedures out of CSCOperations and Into CSCOperationsDCS for cDCS Moving DCS procedures to pdf file Hypertext linked file – quick navigation In pdf format – fixed and changeable only by experts See version 1.0 Status so far cDCS has control since Thursday All alarms addressed at cDCS station cDCS shifter AND CSC shifter together address alarms and problems When is DCS Back to CSC? CEO and Experts fixing problems, calibrations and other special operations Shift Changes – c(entral)DCS CSC Training/Operation & B904 by Fred B.
Top Level of CSC DCS UI Key Login Panel CSC End View * CSC * PCrates • Who to Contact • CSC Shifter - shifter address problem • CSC CEO – shifter contact CEO CSC Shifter Communication Status CSC Shifter Subsystem Panel Value Monitor CSC CEO HV, LV, FEDS CSC CEO Majority Logic CSC Training/Operation & B904 by Fred B. CSC CEO >>16 1972
Subsystem Panel Alarm <RED> indicates problem in all or one end of CSC Contact CEO 16 1972 Check if cDCS has infrastructure alarms Majority Logic Alarm <RED> indicates that a significant percentage of CSC devices are in alarm Contact CEO 16 1972 HV, LV, FEDS Alarm <RED> indicates that a major component of the HV, LV or FEDS is in alarm Contact CEO 16 1972 Do NOT turn these back on – ONLY expert should correct End View Multiple chambers or crates in Alarm <RED> – indicates there may be a major problem – check bottom of the display – Contact CEO 16 1972 Single chamber or crate in Alarm <RED> indicates chamber or crate has a single device in error – CSC Shifter follow detailed procedure Communication Status Alarm <RED> monitor, if it does not clear itself after 5 minutes contact CEO 16 1972 NOTE: Question marks ‘?’ will also appear on End View Value Monitor This is a diagnostic panel Shifter hourly cycle through displays and follow detailed procedures Top Level Procedures for CSC DCS CEO Level Alarms Shifter Level Alarms CSC Training/Operation & B904 by Fred B.
Run Registry Same tool as used by Central DQM shifters Version for CSC Divides CSC into several parts Authored by Valdas Local DQM display has added features Known problem list and comparison Filtering of severity of errors Reference run comparison Status - Shifters have been putting runs into RR Shifters have been grading runs in RR NEED expert(s) to review and sign off each run Run Registry CSC Training/Operation & B904 by Fred B.
Top panel of the CSC version of the Run Registry http://pccmsdqm04.cern.ch/runregistry/ - Workspace > CSC Each run is graded by CSC > Overall CSCTF > Track Finder DDUs > DDU operation Rings > by each station/ring CSC Run Registry CSC Training/Operation & B904 by Fred B.
CSC >> Overall grade for this run BAD > tbd CSC TF >> Grade and details for TF tbd DDUs >> Grade and details for DDU BAD > 2 or more CRITICAL (including known) Rings >> BAD > 2 or more CRITICAL or DEAD (including known) Insert details for each CRITICAL and list DEAD Categories CSC Training/Operation & B904 by Fred B.
New DQM Features • NOTE – The light grey are filtered out errors • The blue are the same as for the reference run • The Hot Pink are KNOWN PROBLEMS • The DQM display has new features • Compare to run > REAPEATING_PROBLEMS > when current has same problem • KNOWN_PROBLEM > compares to a list of known problems • Filtering > FILTERS > only shows the severity of interest CSC Training/Operation & B904 by Fred B.
Action • NOTE – The example ME-2/1/02 is BLUE because it has the exact same problems as for the reference run. Since the display is filtered we see only the CRITICAL chambers • These ‘CRITICAL’ CSC problems are not a ‘Known Problem’ • Enter the problem’s messages into the RR CSC Training/Operation & B904 by Fred B.
Action (cont.) • These ‘CRITICAL’ CSC problems are the same as for the reference run • Do not enter into the ELOG • If these CRITICAL problems were new for this run it should be entered into the ELOG CSC Training/Operation & B904 by Fred B.
CTS changes Can run CR HV connected to CAEN supply Duplicate HV source possible Computers and base crates connected to wall power Duplicate power available DSS system has been upgraded Future Set up for LVDB diagnosis / repair? Dedicated 2nd chamber? UPS for computers? Remove chiller from rack DSS interlock? Train more people to operate the DSS rack interface? B904 CSC Training/Operation & B904 by Fred B.
Summary • Shift training is more formal • New documentation has been put in place for cDCS and Run Registry • Is there enough documentation for shifters? • NO, need to push experts to provide operation manuals. • What is the progress on validation by shifters? • CSC RR is being used by shifters to grade CSC for runs • Are the main goals of shifts being achieved? • Yes, CSC is running well. The safety of the detector has been assured. CSC Training/Operation & B904 by Fred B.