1 / 43

Online System

Online System. Overview Description Current Status Commissioning Plans. Overview. The DØ DAQ system is divided into two components: Trigger system Level 1 hardware trigger components Level 2 specialized processors Level 3 crate readout and software trigger components

thaddeus-cortez
Download Presentation

Online System

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Online System Overview Description Current Status Commissioning Plans

  2. Overview • The DØ DAQ system is divided into two components: • Trigger system • Level 1 hardware trigger components • Level 2 specialized processors • Level 3 crate readout and software trigger components • This will be the focus of 3 other presentations • Online or Host system • Detector controls • Data Logging • Monitoring • Control room applications • This is the focus of this presentation

  3. Overview • DAQ Architecture • Event data rate and operational redundancy achieved by a high degree of parallelism • Level 3 • Host • Capability for multi-user, multi-stream operation • With central resource configuration manager • Network-centric Host design

  4. Event Data Path Detector Readout Crate Readout Crate Readout Crate Readout Crate Data Cable Data Cable 0 - 7 L3 VRC L3 VRC Fiber Channel Loop L3 SB 0 - 3 L3 SB Data Cable Data Cable L3 Filter L3 Filter L3 Filter L3 Filter Ethernet Ethernet Collector / Router Collector / Router Data Logger Data Logger A,B,C Disk Disk RIP RIP Ethernet FCC

  5. Hardware Description • Online Hardware Components • Systems (now/total) • (2/3) Compaq/Digital AlphaServers • Clustered / redundant • Gb Ethernet interfaces • (500/500 GB) shared ‘operations’ and ‘database’ disks • (150/500+ GB) local ‘data buffer’ disks • (4/6-8) Linux monitoring nodes • (2/6-8) PC control room nodes • (5/40) Control system embedded 68Ks and PowerPCs • Network (all here, being installed) • Cisco 6509 Gb Ethernet switch for all FCH nodes • Satellite 100 Mb switches in MCH • Local connectivity on FCH2, installed 100 Mb network for FCH1 (control room), 100 Mb fibers to MCH, Gb fiber to FCC

  6. Online Network 3COM 3300 Host A Host B Host C Cisco 6509 Data VLAN RIP VLAN Interactive VLAN L2 VLAN L3 Linux Ctrl Rm L2 FCH L3 Linux Ctrl Rm 3COM 3300 48x 24x 24x MCH L2 Nodes L3 Linux Ctrl Rm FCC MCH Control Nodes Gb Fiber 100 Mb Fiber 100 Mb Copper

  7. Software Description • Software Component Dictionary • Infrastructure • Databases (ORACLE) • Task-to-task communication (ITC) • Configuration Management and Run Control • Coordination (COOR) • User interface (TAKER) • Download manager (COMICS) • Primary event path • Daq State Manager (DSM) • Collector / Router (CR) • Data Logger (DL) • Event metadata manager (SAM) • Event data manager (enstore) • Secondary event path • Secondary DAQ Supervisor (SDAQsuper) • Data Merger (DM)

  8. Software … • Software Component Dictionary • Event monitoring • Data Distributor (DD) • Analysis applications (EXAMINE) • Controls • Built upon EPICS control system • A ‘standard’ toolkit upon which we’ve built DØ extensions • Lots of supplied nifty tools! • ORACLE Hardware Database • Web-based and batch interfaces • Extract EPICS db from ORACLE • Low Voltage, High Voltage, etc dedicated GUI applications • Downloading (registers, pedestals, etc) • Significant event (alarm) system (SES) • Interface to Cryo control system…

  9. Software … • Software Component Dictionary • DAQ Monitoring • Client/Server access to DAQ flow statistics, trigger rates, etc • Detector Monitoring • Front End active & parasitic monitors • Calibration • Client/Server interface to database • Accelerator interface • ACNET to EPICS interface • Give Main Control Room direct access to DØparameters • Following slides give more detail on software architecture for various Online functions…

  10. DAQ Components Detector Trigger and Readout Controls NT Level 3 Control Room PCs Linux PCs UNIX Servers FCC

  11. Event Data Path Disk Detector Trigger and Readout Readout Crate L1, L2 TCC Data Cable L3 VRC L3 Supervisor Data Cable L3 Filter NT Level 3 Ethernet Collector / Router Data Logger RIP UNIX Servers Ethernet FCC

  12. Configuration & Run Control Disk 1553 Detector Vertical Interconnect Controls Trigger and Readout Controls Crate Readout Crate L1, L2 TCC Data Cable L3 VRC L3 Supervisor Data Cable Control Room PCs L3 Filter Run Control Client NT Level 3 Ethernet Collector / Router COOR Data Logger Comics Data Distributor EXAMINE DSM RIP UNIX Servers Linux PCs Ethernet FCC

  13. SDAQ Data Flow EXAMINE Linux PCs UNIX Server Detector VMEBus 1553Bus Detector DAQ EPICS ITC Ethernet Controls/Readout Crates Ethernet CA Client Data Merge Collector / Router Collector / Router Monitor GUI Data Logger Examine GUI Data Logger Data Distributor Disk Disk RIP RIP Control Room PCs UNIX Server Ethernet FCC

  14. SDAQ Run Control Detector VMEBus 1553Bus Detector DAQ Run Services RUN SYNCH Stringout EPICS CA SERVER Controls/Readout Crates CA Protocol UNIX Server EPICS CA CLIENT Collector / Router Data Logger SDAQsuper ITC CONFIGDATABASE Disk COOR ITC RIP TAKER UNIX Server

  15. SDAQ IOC Channel Distributions VME Bus Data Control Run Serv ITC Link CA Link Run Synch EPICS CA Server Stringout To All Processes Data Collector Calibration Client Monitor Client Data Server Data Interrupt

  16. Control & Monitoring EPICS DB Generator ORACLE Hardware Database 1553 Detector Vertical Interconnect Controls Trigger and Readout Controls Crate Readout Crate Ethernet EPICS Clients: Low Voltage High Voltage Rack Monitor 1553 Devices SMT Monitor FT Monitor etc Control Room PCs UNIX Servers

  17. Event Monitoring Disk Detector Trigger and Readout Readout Crate L1, L2 TCC Data Cable L3 VRC L3 Supervisor Data Cable L3 Filter NT Level 3 Ethernet ROOT Client Collector / Router EXAMINE Data Logger Data Distributor Express Line ROOT Client Control Room PCs UNIX Servers Linux PCs

  18. DAQ Monitoring Disk Trigger and Readout Readout Crate L1, L2 TCC Data Cable L3 VRC L3 Supervisor Data Cable Control Room PCs L3 Filter DAQ Monitor GUI NT Level 3 Ethernet Collector / Router Data Logger DAQ Monitor Data Distributor RIP UNIX Servers

  19. Calibration Detector Trigger and Readout Readout Crate L1, L2 TCC Data Cable L3 VRC L3 Supervisor Data Cable L3 Filter NT Level 3 Ethernet Calibration Tool Calibration Client Calibration Manager Database Control Room PCs UNIX Servers

  20. Current Status • Integrated Functionality • Event Path • We have demonstrated the Secondary DAQ path, under COOR control, with a TAKER user interface allowing one to select a configuration, begin a run, readout a single muon crate, log the data, and simultaneously analyze the data in an EXAMINE • A similar demonstration for the Primary DAQ path is forthcoming • Controls • EPICS system is operational: • ORACLE database operational • Low and High Voltage applications working • Several low-level expert interfaces are available

  21. Current Status • Component Functionality • Will show several existing user interfaces as examples of progress • Will quickly go through these…

  22. EPICS Examples • MEDM (Motif Editor and Display Manager) example screen: • Can interactively and easily build sophisticated displays • Very useful for quick prototyping

  23. EPICS Examples • ALH (Alarm Handler) example screen: • Can drill down into successive layers, then spawn control apps (eg MEDM) from within • Useful for static alarm screens; we’re developing a more general version

  24. Low Voltage PS

  25. High Voltage Control • Example HV Control page:

  26. High Voltage Display • Example HV Display pages:

  27. Rack Monitor Display • Example 1553-based device display: • Rack monitor is DØ standard device • Many other 1553-based devices in use • DØ has complete 1553 EPICS interface

  28. Control Database • Web interface to ORACLE:

  29. Control Database • Web interface to ORACLE:

  30. EXAMINE Interface • EXAMINE is the real-time event data analysis framework

  31. EXAMINE Plots • Uses ROOT to view and manipulate continuously updating plots:

  32. DAQ Monitoring Display

  33. System Monitoring Web page monitor:

  34. System Monitoring Can drill down for details:

  35. People • Management • Fuess Fermilab • Slattery Rochester • Hardware acquisition and operations • Fuess Fermilab • Fitzmaurice Fermilab • Controls • Bartlett Fermilab • Gilmartin Florida State • Jonckheere Fermilab • Krzywdzinski Fermilab • Savage Fermilab • Simmons (contract) • Zhang Fermilab • (identified new hire) Fermilab

  36. People • Configuration and Run Control • Snyder Brookhaven • Event Data Path • Genser Fermilab (CD) • Guglielmo Fermilab (CD) • Litmaath Fermilab (CD) • Moore Fermilab (CD) • Event Data Monitoring • Yu Fermilab (CD) • Detector group members • Calibration • Yasuda Fermilab • Bertram Lancaster • Detector group members • DAQ Monitoring • Yasuda Fermilab

  37. People • Accelerator Interface • Begel Rochester • … and much interaction with the Trigger group • Bottom line • The Online group is sufficiently staffed, and is committed to commissioning efforts

  38. Commissioning Plans • Commissioning the Online • Version 1 pieces of all the Online components in place now • Upcoming efforts to provide more complex functionality • Multi-user and multi-stream operation • Distributed parallel event flow • Full rate operations • Commissioning the Detector • With Online expert help, ready now to control, monitor, and read out arriving detector components • Efforts in next few months to making this a routine operation • Relevant milestones • Will note those from the Commissioning schedule which are related to Online…

  39. Milestones • Feb 2, 2000 • Silicon front-end installed and commissioned • Mar 1, 2000 • User mode operation of DAQ system • Mar 15, 2000 • Dual / multi-crate central muon PDT reaout • Ship data through Online / DAQ / Farm chain, run reconstruction • First exercise of Online event display • Shifts in place, DAQ Expert training begun

  40. Milestones • Apr 15, 2000 • Begin multi-crate readout of full central muon system • Begin full multi-task commissioning of Online • July 15, 2000 • Half of FT, CPS commissioned • Aug 15, 2000 • Forward muon A/B layer MDTs / pixels installed • Sep 1, 2000 • Integrate event display for 3 sub-detectors

  41. Milestones • Sep 20, 2000 • 4 quadrants available for CC readout • Oct 1, 2000 • Forward muon C-layer MDTs / pixels installed / commissioned • Nov 1, 2000 • Run reconstruction on multiple sub-detectors • Link tracks in CAL, FT, CPS, Central muon • Full Online event displays • Add SMT to readout chain • Dec 15, 2000 • Full detector in steady state cosmic ray commissioning

  42. ‘Commissioning’ Run • There’s one other activity which has yet to be mentioned – • During the beam ‘Commissioning’ run which will occur late summer 2000, DØ expects to insert the Run I Level 0 scintillation counters into the beam line. These have an interface to the control system with numerous rate meters and scalers to measure luminosity and beam losses. • We plan to use this as an opportunity to implement the mechanism by which DØ exchanges information with the accelerator control systemand also to ‘teach’ the MCR to use DØ to monitor the beam conditions!

  43. Summary • Many Online components operational, suitable for commissioning duties • Staffing appears to be sufficient • Group will be intimately involved in daily commissioning activities

More Related