The on-shore DAQ system for a deep-sea neutrino telescope

1. The on-shore DAQ system for a deep-sea neutrino telescope A.Belias NOA-NESTOR A. Belias

2. IN-SEA ON-SHORE Control Center Power station Shore DAQ GRID FrontEndUnit Electro/Optical BaseUnit Electro/Optical MEOC JunctionBox Electro/Optical Interlink cables A. Belias

3. Shore DAQ Tasks • Receive all data from telescope (PMTs / Controls/ Earth & Sea-science) •  ALL DATA TO SHORE • Process data to extract events & calibration constants •  ON-LINE SELECTION OF WHOLE TELESCOPE • Archive events and operational conditions •  EVENTS, RAW DATA, METADATA, DETECTOR STATUS • Control and monitoring components, in-sea & on-shore •  MISSION CRITICAL AND SUB-CRITICAL UNITS • Update local Data Bases & export to remote facilities •  VALIDITY CONTEXTS AND CACHE COHERENCE A. Belias

4. On-shore DAQ Readout Scheme ALL data are sent to shore Expected rate of 100-300Gb/s cannot be just stored Concentrate all data in temporary buffers Aggregate a time-slice of data of whole telescope Process in parallel sequences of time-slices Perform time-position correlations of photomultiplier hits Correlations in real-time for the whole telescope Data reduction factor: ~10000 Archive event data, raw data, calibration data A. Belias

5. DAQ Architecture Scheme Optical Modules Front End Electronics In-sea Time Stamping Acquisition Node  Concentrator On-shore Data Router  Buffer S/w Trigger  Processor Data Storage Data Base Clock System Control & Monitoring A. Belias

6. DAQ Architecture Option Optical Modules In-sea Front End Electronics Time Stamping On-shore Acquisition Node  Concentrator Data Router  Buffer S/w Trigger  Processor Data Storage Data Base Clock System Control & Monitoring A. Belias

7. Shore Station Option A 18 lines 1Gbit Ethernet x 5 80 colors 1Gbit each 80 1Gbit LVDS Xilinx Virtex 6 FPGA Up to 36 11Gbit Transceivers 10Gbit Switch O/E 1 Gbit Ethernet MEOC Optical Demux 10Gbit Ethernet Back Bone 1 10Gbit Ethernet 10Gbit Ethernet Data Base Run Control & Monitor Server BUFFER SYSTEM 10Gbit Ethernet 10Gbit Ethernet 10Gbit Ethernet Back Bone 2 Archive GRID Computer Cluster Node 1 Node 2 Node 3 Node N A. Belias

8. Shore Station Option B 18 lines 1Gbit Ethernet x 5 80 colors 10Gbit each 80 10Gbit LVDS Xilinx Virtex 6 FPGA Up to 36 11Gbit Transceivers 10Gbit Switch O/E 1 Gbit Ethernet MEOC Optical Demux 10Gbit Ethernet Back Bone 1 Gbit Ethernet 1 Gbit Ethernet Data Base Run Control & Monitor Server Archive GRID 1 Gbit Ethernet Computer Cluster Buffer Buffer Buffer Buffer Node 1 Node 2 Node 3 Node N A. Belias

9. Full Readout Chain O/E Xilinx ML605 Virtex 6 (36 11Gbit Tranceivers) Optical Demux Fiber 1Gbit Ethernet 10Gbit Switch Fabric Computer Farm 8 core processor , 64threads /core 64GB RAM 2.4TB storage Fujitsu XG2600 26 10Gbit ports On Line Monitor Data Buffer SUN STORAGETEK 2510 ARRAY A. Belias Sun SPARC Enterprise T5220 Server

10. Studies • Study attainable performance of a whole readout chain. • Investigate consequences of overlapping time-slices and triggers. • Queue modeling for data path to determine buffer requirements. A. Belias

11. Summary • Regardless of the FrontEnd Electronics of the underwater neutrino telescope, the DAQ concept on-shore has the flexibility to adapt and the modularity to scale. • The use of FPGA systems allows for flexibility in hardware. • The use of mass market, industrial, systems allows long term (10+ years) maintainability. • Due to ease of access on-shore, active components in the sea should migrate to the on-shore DAQ system. A. Belias