1 / 69

Shifter Instructions

Shifter Instructions. Instructions for the SCT ACR Shifter. Version 0.1 – November 09. Contents. Part I – Shifter Duties Part II – ACR environment Part III – Run Control & DAQ Part IV – Beam Part V – DCS Part VI – Data Quality Monitoring Part VII – Problems. SCT Shifter Manual.

donniel
Download Presentation

Shifter Instructions

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Shifter Instructions Instructions for the SCT ACR Shifter Version 0.1 – November 09

  2. Contents Part I – Shifter Duties Part II – ACR environment Part III – Run Control & DAQ Part IV – Beam Part V – DCS Part VI – Data Quality Monitoring Part VII – Problems SCT Shifter Manual

  3. Shifter Duties Part I - Instructions for the SCT ACR Shifter

  4. Before your shift • Makesure your training is up to date : courses Level 1, Level 2, Level 3 and Level 4A andSCT Shifter Qualification • Your access rights should be valid (ATL_CR) and SCT:shifterrights. • Read documentation on Twiki page : http://pcatdwww.cern.ch/twiki/bin/view/Main/AtlasOperation and go to shiftermanual. SCT Shifter Manual

  5. Beginning of your shift • Cometo the ACR at least 15 minutes before your shift and consult with the previous shifter and check: • Current ATLAS conditions • Particular item under watch? • Where we stand respect to run plan? • LHC status and plan for the coming shift • Your access privileges will be granted automatically 2 hours before the beginning your shift • Check the run plan • http://pcatdwww.cern.ch/atlas-point1/wmi/current/Run%20Status_wmi/AtlasRunCom.html • Read previous shifter e-log and start your new entry • Log in to the DCS, FSM Alarms and Run Com (Check-List Utility) SCT Shifter Manual

  6. During your shift Do the checks requested in the Check-List Monitor DCS alarms on the DCS Alarm Panel Look for ERROR and FATAL messages at the DAQ coming from the SCT Check Monitoring Histograms and DQM status flags Check beam conditions are stable Monitor Cooling status and alarms Document in the e-log (SCT and IDGen) problems and happenings In case of problems contact relevant experts and/or Run Coordinator SCT Shifter Manual

  7. End of shift Submit e-log entries SCT and IDGen (log out of the e-log) Inform the next shifter on the current situation of the running and about any special conditions or plans. Log out of the Check-List, DCS and FSM Alarms Do not leave if following shifter did not arrive (after 30 minutes call Run Coordinator if shifter has not arrived). SCT Shifter Manual

  8. ACR environment Part II - Instructions for the SCT ACR Shifter

  9. ACR Layout SCT Shift Desk ACR, CERN, Meyrin Shift Leader Desk ACR, CERN, Meyrin SCT Shifter Manual

  10. ACR Desktop Desks have 4 Screens to be used by the shifter Get familiar with the environment Some useful Utilities can be found in the General tab Example of ScreenShot of the ACR Desktop DCS and Alarm Screens TDAQ Screen DQM Screen SCT Shifter Manual

  11. RunCom In the General tab find RunCom Look for the SCT tab and log yourself in Log out of the Check-List and FSM Read the checks and comments, some of the requirements have an information page DQ checks will appear every hour This tool may change in future SCT Shifter Manual

  12. ATLAS e-log e-log can be found under the tab General To be able to submit entries you have to login with your P1 login/password Make entries if problems occur do not wait until the end of your shift Do a Shift Summary (and select ID-Gen and SCT) for every shift Remember to select all options and attach plots (if any) before submitting SCT Shifter Manual

  13. ATLAS e-log Sample Short summary….. ******************************************* 15.00: start of shift 15.04: Recovered module Crate 22 Ch 4 which showed a trip error. 17.03: end of run 139303 17:05 Expert takes over DAQ to investigate XXX 18:30 DAQ tests concluded. The result is that blah blah blah... and more blah, blah, blah… Changes have been applied, blah, blah, blah… 18.40: SCT on stand-by 19.17: Start of Physics run 139334 19.30: SCT on during LB 6. 20.00: Monitoring the number of errors, stable and around 20-30,see separate report from MON shifter. … 21.12: Run 139336. Try a short cosmics run again (8 bins, 1000 triggers, timeout 60s) Result status -> no fail, but quite a few problematic modules? … SCT Shifter Manual

  14. Atlas Operation • Information for shifters will be posted in the Operations page. • From outside P1 : http://pcatdwww.cern.ch/twiki/bin/view/Main/AtlasOperation General Information SCT Links SCT Shifter Manual

  15. SCT WhiteBoard • Special announces, SCT DAQ Panel Configuration and SCT Phones • From outside P1 : http://pcatdwww.cern.ch/twiki/bin/view/Main/SCTDetectorWhiteBoard • From P1 : ID Menu SCTWhiteBoard Phones Important Announcements SCT Shifter Manual

  16. SCT Shifter Manual • Information for your shift • From outside P1 : http://pcatdwww.cern.ch/twiki/bin/view/Main/SctShifterManual • From P1 : Link from the Atlas Operation Twiki SCT Shifter Manual

  17. pplications DAQ Panel go to TDAQ tab FSM Alarms and DCS go to IDSCT tab RunCom go to General tab e-log go to General tab konqueror go to General tab ksnapshot go to General tab SCT Shifter Manual

  18. Run Control & DAQ Part III - Instructions for the SCT ACR Shifter

  19. Applications Options Log Window DAQ Panel SCT Shifter Manual

  20. 1 2 3 4 Select the setup script(/det/tdaq/scripts/setup_TDAQ.sh will always point to the production release) Select the partition db file(i.e., /atlas/oks/tdaq-02-00-03/combined/partitions/ATLAS.data.xml) Get the partition(s) described in db (the Part Name list will be automatically filled) Tell the DAQPanel to acquire the information DAQ Panel SCT Shifter Manual

  21. DAQ Panel : Main Monitor Partition: Use it to Spy on the ATLAS Partition status Log Manager: Browse the log messages produced by the applications MRS: It starts a viewer of the MRS (Message Reporting System) messages flowing through the system Busy: It starts the Busy Presenter. Use it to understand whether/why the system is in a busy state SCT Shifter Manual

  22. Monitor Partition GUI RootController Commands Tab Panels Run Information & Settings MRS Log Window SCT Shifter Manual

  23. Message format Clone table Change subscription MRS Start from DAQPanel – Main tab – MRS button SCT Shifter Manual

  24. Busy Monitor • No data flowing through the system? • The system may be in a BUSY state • Start the Busy Presenter from the DAQPanel: Main tab, BUSY • RED: the corresponding subsystem is busy • PINK: the corresponding subsystem is busy but out of the PARTITION • GREY: the corresponding subsystem is not part of the run • If SCT is Busy and do not know what to do CALL DAQ EXPERT (162034) for instructions SCT Shifter Manual

  25. SCT Gui • DAQPanel in the SCT Desk has an additional tab called SCT • Use the button to launch the SctGui. Use the GUI to: • Run Mode Physics scans • Alternatively check DCS conditions • Probe and check modules : if OUT of ATLAS running and you have been instructed to do it SCT Shifter Manual

  26. SCT Gui : Short Tour Datashowsdifferentoptionsdepending on the kindof display selected (ModuleConfiguration in this case) Differentmodulegroups Views: Geometry and ROD crates Eachof the squaresis a module Listof: Barrels/Wheels or Crates in the configuration SCT Shifter Manual

  27. SCT Gui : Short Tour Coordinates of the module under the mouse 0– No Data 1– Bad Data 2– CLK/2 a –Corrupt Data A – ABCD Error code C–ConfigReadback mode E –Returningevents J– Junk Data O –Other Example: SCT View SIDE SCT Shifter Manual

  28. SCT Gui : Short Tour You can access to the different menus using the toolbar or with a right click on the empty part of the screen • Module Configuration: Change modules in the configuration • Probe Data: Check for modules with errors and recover them. Using this display you can perform actions like Power Cycle, Reset, Configure… • Data Manager: Allows you to access to results and plots from a test • Test Results: Show test results for all the modules • DCS Conditions: Several of the DCS parameters related with the modules are available through the SctGui (Temperature, LV, HV,...) SCT Shifter Manual

  29. SCT Gui : Short Tour • How to check the ROD which is BUSY? • Right Click at the TIM Module and select TTC Status TTC Status • If Right Click on any of the Crates a menu will show three possibilities: • Clear Latch • Mask ROD Busy • Raise ROD error (manual stop-less removal) : Use this one if a busy appears and is not picked up by the automatic removal • Only do this if DAQ EXPERT (162034) ask you to do it

  30. Physics Mode Scan Physics Mode • In SctGui : Tools Menu  Physics Mode Scan • Need to be in Physics mode (standalone) or in ATLAS partition • Uses triggers to acquire events, number of events and crates can be selected • Results are displayed in the SctGui – Test Results • Do not start close to the end of the run • or if advised that run will end soon

  31. Remember… • Important to be specially vigilant at the beginning of the run. Problem most likely will happen at the point. Look for: • FATAL / ERRORS from the SCT appearing in the MRS • Check BUSY status (and TTC Status). If no triggers are coming through one of the systems could be busy • Stop-less removal could happen at this stage. If more than 1 ROD gets disabled ask for a restart of the run • Always write Information on SctGui Run comment window (pop-ups at the start and end of the run) • Run a Physics Mode Scan and check for errors • During the run : • Keep checking on disabled RODs • Run Physics Mode Scans and check ROS Monitoring every hour. Look for errors and anomalous values in the results • Continue to check for errors in MRS • Document everything SCT Shifter Manual

  32. Beam Part IV - Instructions for the SCT ACR Shifter

  33. Also available on the WEB @ http://pcatdwww.cern.ch/atlas-point1/operRef.php?subs=dcs/dcs/process.php?page=ATL_LHC Beam Intensity From LHC (P4) <#protons> / bunch Beam Intensity From Beam Pick Up <#protons> / bunch SCT Shifter Manual

  34. ATLAS Stand-by Mode • ATLAS should ALWAYS be in stand-by mode except when: • STABLE BEAMS have been declared Physics Mode • Beam is not possible due to LHC conditions LHC NO BEAM Mode • In ALL OTHER situations ATLAS MUST be in stand-by mode • "Stand-by Mode" is state of ATLAS hardware • it is decorrelatedfrom the data aquisition state • it is possible to take data (not physics quality) with ATLAS in stand-by • SCT in Stand-by : LV ON and HV at 20 V SCT Shifter Manual

  35. Fill Pattern

  36. Acronyms ARC= ATLAS Run Coordinator. SRC= Sub system Run Coordinator SL = Shift Leader Operation Flow-Chart 1) SL notifies ARC and shifters in the ACR 2) Shifters inform their SRC if instructed to 3) SRC requests to ARC to override STABLE BEAM flag 4) ARC checks LHC plan, gives permission for STABLE BEAM flag override 5) SRC can override STABLE BEAM flag and notifies SL NO BEAM Long Interruption NO BEAM Short Interruption STABLE BEAM RAMP/SQUEEZE/.. INJECTION SL Removes Injection Permit STABLE BEAM=False STABLE BEAM=False STABLE BEAM=False STABLE BEAM=True STABLE BEAM=False LHC Page 1: Beam <2hours PROTECTION ACTIVE PROTECTION ACTIVE PROTECTION ACTIVE PROTECTION ACTIVE PROTECTION OFF INJECTION PERMIT=True INJECTION PERMIT=FALSE INJECTION PERMIT=True INJECTION PERMIT=False INJECTION PERMIT=FALSE 1) SL notifies ARC 2) Remove STABLE BEAM override YES Injection handshake warning LHC Page 1 announces NO BEAM for > 8hours 1) SL notifies ARC 2) Remove STABLE BEAM override 3) SL goes through Injection handshake NO Injection handshake warning Inject and dump cycle or lose the beam (no dump) SL goes through Injection Handshake & brings ATLAS to STDBY, gives Injection Permit Beam dump Beam dump

  37. ATLAS in Beam Mode INJECTION PERMIT= is Injection into LHC Allowed? • If INJECTION PERMIT is FALSE: • Beam cannot be injected • Ongoing injection is STOPPED or PAUSED • But Beam is NOT dumped

  38. Beam Injection: I • ATLAS Shift Leader receive LHC INJECTION WARNING via the LHC handshake panel. Big Sound coming from the DCS Desk! • ATLAS shift leader replies ATLAS INJECTION = PREPARE, within few seconds, otherwise phone call from CCC • ATLAS shift leader asks the shifters to prepare for for INJECTION: • Make sure that SCT is in Standby and Beam Protection is ACTIVE • Check the INJECTION PERMIT mask. SCT should NOT be MASKED

  39. LHC Page Link to the LHC Handshake page How to see if SCT is in STANDBY? Masks

  40. SCT Beam Page Link to the LHC Handshake page SCT Status : Injection Permit and HV Beam Protection OFF / ON

  41. SCT Beam Page SCT Status : Injection Permit and HV Beam Flag Protection OFF / ON LHC Status

  42. Beam Injection : II ATLAS Shift Leader turns the Injection Key Shift Leader uses hand-shake page and declares ATLAS INJECTION READY LHC will inject Pilot bunch...

  43. During Injection • Monitor carefullybeamlosses (Backgrounds) • ATLAS BCM and BLM readings • LHC BLMs • Monitor Beamparameters, position, ... • BCM, LUCID, MBTS, L1Calo rates, Tileintegratedcurrents • Inform Shift Leader if someproblemisfound. • Instructions and limitswillbe set soon

  44. ATLAS in Beam Mode • Only with STABLE BEAM • All systems should have Low Voltages (Front end powered, system can be read out) • All systems should have High Voltages / Bias Voltages, systems are providing signals from particles • SCT ON only with STABLE BEAM and GOOD BEAM Conditions (TBD)

  45. Stable Running • When STABLE BEAM Flag becomes TRUE. Shift Leader will ask systems to go ON • Check STABLE BEAM Flag AND Beam BACKGROUNDS : • Inform SCT Run Coordinator and ask for approval • HV can go ON • Inform Shift Leader that system is ON • Keep Checking Beam Conditions at ALL TIMES during your shift.

  46. Removal of Permit • If the Beam Mode= STABLE BEAMS, Injection Permit will be removed AUTOMATICALLY. • If a Beam Dump is requested anywhere around the LHC, our BCM receives a post mortem request which removes the ATLAS Injection Permit. • Without beam: If the LHC Page 1 indicates that the beam will be absent from LHC for a period of a few hours “Quite Time”. • SCT will be informed that some “Quiet Time” is available. SCT Run Coordinator should be informed by shifter and/or ATLAS Run Coordinator.

  47. Beam Dump • Planned Dump : • LHC send an ADJUST/ DUMP warning via the hand-shake • SCT will go to Standby automatically when BEAM DUMP state goes to INMINENT • Shift leader ask shifters PIX, SCT, MUO, LArg to put their systems in safe state. Send SCT to Standby if not already • Non planned Dump : • Send system to Standby if not already • Ask Shift Leader for an explanation and post in the e-log as much information as you can gather. Do not wait up to the end of your shift to post it! • Inform Run Coordinator and DAQ On-call expert (162034) • If qualified perform the calibrations for a Non planned dump, if not wait for the On-call expert

  48. Remember... • In NON SAFE situations SCT must be in Standby : • Single or Double beam operation during the commissioning phase • During beam injection and while STABLE BEAMS = False • During fills even if there is no beam in the machine • Standby : LV ON and HV 20 V • Special Configuration applies for Beam Commissioning : • Splash Configuration : LV ON, EndCaps at 20 V and Barrel at 5 V (OUT of the data taking) • This is the SAFE configuration up to further notice • Only SCT Run Coordinator or someone designated by the Run Coordinator is allowed to give you permission to switch ON or change running conditions (Commissioning Configuration  Standby Configuration) • ON Configuration : LV ON and HV 150 V

  49. DCS Part V - Instructions for the SCT ACR Shifter

More Related