1 / 18

DAQ for Test&Commissioning at Point 2

DAQ for Test&Commissioning at Point 2. Klaus Schossmaier CERN PH-AID ALICE TPC Collaboration Meeting Heidelberg, Germany 12-13 February 2004. Planning Parameters. System: DAQ system for Test&Commissioning (= LHCC milestone) Size: 12 DDLs for TPC 8 DDLs for others

laszlo
Download Presentation

DAQ for Test&Commissioning at Point 2

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DAQ for Test&Commissioningat Point 2 Klaus Schossmaier CERN PH-AID ALICE TPC Collaboration Meeting Heidelberg, Germany 12-13 February 2004

  2. Planning Parameters • System: DAQ system for Test&Commissioning (= LHCC milestone) • Size: 12 DDLs for TPC 8 DDLs for others • Place: LHC Point 2 • Date: Q1 2005 • People: ALICE DAQ team TPC Collaboration meeting, 12-13 Feb 2004

  3. DAQ Installation at Point 2 SR Hall SX Hall SXL Hall (ALICE sub-detector assembly) (Networking) ACR WR1 WR2 DDL PX24/CR1 (DAQ) LAN LAN PX24/CR2 (HLT) Access Shaft PX24/CR3 (DCS) PX24/CR4 (Misc.) UX25 (Experimental Area) TPC Collaboration meeting, 12-13 Feb 2004

  4. PX24/CR2 1 DSS (DAQ Server Services): rackmount PCU4 heighthot-swap SCSI disks RunControl, Logger  On-line Monitoring HLT (HighLevel Trigger) 1 KVM switch DDL patch panels PDS (Permanent Data Storage) CERN computer center 20 DDLs GE switches 1 FC switch 10 LDCs (Local Data Concentrator): rackmount PCsU1, U2, U4 heightequipped with 20 D-RORC cards DDL readout, sub-event building  HLT interface 4 GDCs (Gobal Data Collector): rackmount PCsU1 height equipped with FC cards full-event building 1 TDS (Transient Data Storage): rackmount disk arrayU2 heightIDE of FC disks event buffering Installation at PX24/CR1 TPC Collaboration meeting, 12-13 Feb 2004

  5. Installation Issues • Hardware/Mechanical issues: • Equipment: rackmount PCs, switches, disk array, … • Rack assembly, DDL installation, cabling, … • Infrastructure: power supply, networking, cooling, … • Software/Testing issues: • Operating System: Linux + customizations • DAQ Software: DATE + configuration • Standalone tests • Integration tests • Reference System in our AID lab: • small, complete DAQ system with 6 DDLs • to spot problems in advance • to tackle problems during operation TPC Collaboration meeting, 12-13 Feb 2004

  6. Reference Setup – Front L3 rack DDLs: - to the DDL lab 4x LDCs: - 1U, 2U, 4U height- dual Xeon- 6x D-RORC cards DDL 2x GB Ethernet switch: 3COM SuperStack 3 KVM switch: Raritan Paragon UMT2161 2x GDCs: - 1U height- dual Xeon- Qlogic QLA2310F cards Fibre Channel switch: Broacade SilkWorm 3800 2x disk arrays: - Infortrend IFT-6330 - DotHill SANnet II- Fibre Channel DSS: - 4U height- quad Xeon- 3x 36GB SCSI disks TPC Collaboration meeting, 12-13 Feb 2004

  7. Reference Setup - Rear L3 rack Cat5 cables: - Ethernet- KVM- RJ45 connectors Mounting rails (!) Power distributor Fiber Channel cable: - 2 Gbit/s multimode - LC-LC connectors TPC Collaboration meeting, 12-13 Feb 2004

  8. DDL link card DDL patch panel with D-RORC • Uniform half-CMC card for both SIU (= Source Interface Unit) and DIU (= Destination Interface Unit) • 2.125 Gbit/s components (Agilent) for 200 MB/s bandwidth • bridge up to 200 meters • Two D-RORC types: 1 DDL link card plugged in, 2 integrated DDL channels • PCI 64 bit, 66 MHz • ALTERA FPGA, IP core from PLDA • 200 MB/s throughput with DATE DDL & D-RORC TPC Collaboration meeting, 12-13 Feb 2004

  9. Rackmount PCs TPC Collaboration meeting, 12-13 Feb 2004

  10. Disk Array Systems • Infortrend IFT-6330-12F2D: • 12x 300 GB IDE-based disks • dual 2 Gbit/s Fibre Channel ports • Embedded manager via front panel, RS232C, or IP • 2x logical volumes: each one has 1.1 TB, RAID5, with 5 disks • DotHill SANnet II 200: • 12x 36.7 GB FC-based disks • dual 2 Gbit/s Fibre Channel ports • RAID configurations via RS232C front view (IFT-6330) rear view (IFT-6330) TPC Collaboration meeting, 12-13 Feb 2004

  11. DAQ Software: DATE • DATE (= Data Acquisition and Test Environment)is the software framework of the ALICE DAQ. • Runs on Linux platforms (e.g. Red Hat 7.3) • Released (latest is version 4.7) and documented • DATE evolves with requirements and technology • Features/Packages: • Dataflow: DDL readout, event building • System configuration and Run control • Monitoring: on-line performance, on/off-line data quality • Utilities: message logger, control/configure front-end electronics, … TPC Collaboration meeting, 12-13 Feb 2004

  12. Readout with DATE • Step 0: Hardware is in place • Step 1: Run Linux with the physmem and the rorc driver • Step 2: Install DATE with a general configuration for the LDC • Step 3: Set up configuration file to enter parameters like D-RORC serial number, channel number, page size, checks, etc. • Step 4: Start/Stop the acquisition • Step 5: Analyse the raw data files, e.g. /tmp/run123.000, /tmp/run123.001, … TPC RCU 3 with SIU  FEC DDL D-RORC with DIU  LDC TPC Collaboration meeting, 12-13 Feb 2004

  13. DATE Run Control TPC Collaboration meeting, 12-13 Feb 2004

  14. FEE Configuration/Control • Step 0: Hardware is in place • Step 1: Run Linux with the the rorc driver on the LDC • Step 2: Write a script (ASCII file) for the FeC2 interpreter • Step 3: Run this script, e.g. typeFeC2 123 example.fec2 TPC RCU 3 with SIU  FEC DDL S/N of D-RORC # send command, 19 bit information write_command 0x10f # read status, 19 bit address, 19 bit reply read_and_print 0x100 “Register XYZ: 0x%x” # download data block, 19 bit address, file write_block 0x600 pedestal.hex “%x” # verify data block, 19 bit address, file read_and_check_block 0x600 pedestal.hex “%x” stop_if_failed -1 D-RORC with DIU  LDC TPC Collaboration meeting, 12-13 Feb 2004

  15. On-line Monitoring • MOOD Framework: • DATE + ROOT environment • Interfaces to detector code • MOOD Applications: • Visualization, e.g. TPC sector test data (Hall 167) • Data integrity • Detector performance • Execution: • DSS machine TPC Collaboration meeting, 12-13 Feb 2004

  16. DAQ Performance • ALICE Computing Data Challenge: • 1750 MB/s event building without recording, 5 days • 280 MB/s event building and recording to CASTOR, 7 days • D-RORC readout of one DDL channel with DATE: 206 MB/s readout only 118 MB/s readout with event building TPC Collaboration meeting, 12-13 Feb 2004

  17. DAQ Installations §Given that the RCU 3 is fully functional in time, see Joachim’s presentation. TPC Collaboration meeting, 12-13 Feb 2004

  18. Summary + Future Work • Objective: • DAQ system for Test&Commissioning at Point 2 • Surface tests of ALICE sub-detectors (e.g. TPC sector) • Operational in Q1 2005 • Installation Layout: • 20 DDL links between the PX24/CR1 counting room and the SXL mounting hall • L3 racks: DDL patch panels, 15 rackmount PCs, 1 disk array, switches for Gigabit Ethernet, Fiber Channel and KVM • DAQ Reference System in the AID lab • Future work concerning TPC and DAQ: • Bergen: Development of RCU 3 firmware for the DDL interface • Luciano’s lab: Integration test of RCU 3 with the DDL • TPC sector test at T10§: DAQ chain with RCU 3 + DDL + DATE TPC Collaboration meeting, 12-13 Feb 2004

More Related