190 likes | 204 Views
Control and Data Systems (WBS 1.6) Gunther Haller. Scope Control and Data Systems Architecture Control System Data System Team/Organization WBS Cost and Schedule Summary. Scope – WBS 1.6 Control & Data Systems. FEH Hutch 2: Coherent X-Ray Imaging Instrument (WBS 1.3).
E N D
Control and Data Systems (WBS 1.6)Gunther Haller • Scope • Control and Data Systems Architecture • Control System • Data System • Team/Organization • WBS • Cost and Schedule • Summary
Scope – WBS 1.6 Control & Data Systems FEH Hutch 2: Coherent X-Ray Imaging Instrument (WBS 1.3) Far Experimental Hall (FEH) FEH: Hutch 1: X-Ray Photon Correlation Spectroscopy Instrument (WBS 1.4) NEH Hutch 3: X-ray Pump-probe Instrument (WBS 1.2) Tunnel X-Ray Beam Direction Separate WBS 1.6 to combine all LUSI control & data needs due to commonality in requirements, design, implementation, and integration Near Experimental Hall (NEH)
Scope • LUSI Scope is Control and Data Systems for • XPP instrument • CXI instrument • XCS instrument • Common Controls and Data Systems for LCLS and LUSI • G. Haller is manager for LUSI as well as for LCLS • Benefit from common hardware and software solution
System Block-Diagram Pulse-by-pulse info exchange High peak rate/ large volume Data Archiving/Retrieval Offline Analysis/Rendering Timing & Triggering
Software EPICS Firmware programming Hardware Cabling, racks, trays Controllers for Pumps Gauges, sensors Motors Signal processing Electrical Image Data acquisition and storage Workstations Data servers, storage arrays Network hardware Control & Data Systems Endstation Controls & Data Systems 2-D Detector Local Storage Pumps Computers Stages, Motors Controllers Intensity Monitor
Control Sub-System Based on EPICS, LCLS design Eng GUI App GUI Application Framework Display Manager Device Program Layer 1-Gb/s Network (LUSI Subnet) Remote Access Server VME-based IO Controllers VME PPC CPU’s Terminal Servers Network Configuration Database Pump/Gauge Motors Spectrometer Sensors Diffractometer Remote Access
Main Controls Devices • Valves • Ion pumps • Turbo pumps • Vacuum gauges • Motors • Encoders • Limit switches • Pneumatic actuators • RF phase shifters • Spectrum analyzers • Cameras • Waveform sampling devices • Pulse-height sampling devices • Power supplies • Laser diagnostics devices • Temperature control
Data Acquisition and Processing • Acquire 120-Hz Images • Without beam (dedicated calibration runs or in-between ~8-ms spaced beams) • Images to be used to calculate calibration constants • With beam • Images which need to be corrected • Event-building with 120-Hz accelerator timing & beam-quality data information • Filtering of images (e.g. vetoing) • Realtime pixel correction using calibration constants • Processing of corrected images • Example: Coherent imaging of single molecules • Combine 10 5 to 10 7 images into 3-D data-set • Learn/pattern recognition/classify/sort images, e.g. 1,000 bins • Average bins • Alignment • Reconstruction • ~ 5-Hz real-time display of images
Data Management and Scientific Computing • Data Management • Make LUSI data accessible for science • Appropriate format(s) • Appropriate storage/retrieval hardware and software • Scientific Computing for LUSI Science • Opportunities and needs being evaluated • Very dependent on the detailed nature of the science • Unprecedented size (for photon science) of data sets to be analyzed • Unprecedented computational needs (for photon science) • Comparable in scale to a major high-energy physics experiment • Greater need for flexibility than for a major high-energy physics experiment
Data Sub-System Difference to conventional experiments: High peak rate & large volume comparable to high-energy physics experiments such as BaBar @ SLAC • Challenge is to perform data-correction and image processing while keeping up with continuous incoming data-stream • Tradeoff between tasks implemented online versus offline • Important to produce science output without piling up more and more raw images
Data Acquisition/Mgmt Architecture SCCS LUSI Volume Rendering Cluster Quick View Rendering Node Volume Rendering Node Detector Control Node 10–G Ethernet 10–G Ethernet 2D Detector SLAC LCLS DAQ Box ADC FPGA Data Server 4 x 2.5 Gbit/s fiber Data Servers Detector-Specific Front-End Electronics Online Processors Tape Drives/ Robots Disk Arrays/ Controller Accelerator 120-Hz Data Exchange & Timing Interface Offline Online • Data system must be able to handle peak rate as well as sustain 120-Hz throughput (corrections, filtering) • SLAC LCLS DAQ Box being developed by Particle Physics and Astrophysics Electronics Group (G. Haller) • Highly scalable • Very high CPU-memory bandwidth (8 Gbytes/sec)
SLAC LCLS DAQ Box • DAQ box contains custom SLAC Cluster-Element (CE) board • Virtex-4 FPGA • 2 PowerPC processors IP cores • 512 Mbyte RLDRAM • 8 Gbytes/sec cpu-data memory interface • 10-G Ethernet science data interface • 1-G Ethernet control interface • EVG machine timing fiber interface • 120-Hz machine beam-data interface • RTEMS operating system • EPICS • Option: up to 512 Gbyte of FLASH memory • Easily scalable • If several CE boards are used • Packaged in ATCA crate with network card • Network card based on • 24-port 10-G Ethernet Fulcrum switch ASIC • Crate holds up to 14 CE boards • Option to have up to 7 Tbyte integrated with high-speed memory access • Network card interconnects multiple CE boards • Network card interconnects multiple crates CE development board 10-G switch development board
Core Control & Data Systems Team • 1.6. CAM: G. Haller • Main personnel • A. Perazzo, Online (PPA) • D. Nelson, Control (PPA ) • S. Peng, Control Software (Controls Division) • R. Rodriquez, Infrastructure (PPA) • C. O’Grady, DAQ (PPA) • Steffen Luitz, Data Management (SCCS) • Richard Mount (Director, Sci. Computing & Computing Services) • Niels van Bakel (Detector Physicist, LUSI) CAM: Control Account Manager PPA : Particle Physics and Astro Physics Division
WBS 1.6 – Control & Data Systems • Cost estimate at level 3 by fiscal year –
Control & Data Systems Milestones CD-1 Aug 01, 07 Controls & Data PRD Aug 27, 07 Phase 1 Conceptual Design Complete Sep 27, 07 CD-2a Dec 03, 07 Controls & Data Final Design Review Apr 25, 08 CD-3a Jul 21, 08 Complete Controls & Data Apr 16, 09 Ready for Installation May 18, 09 Phase I Installation Complete Aug 07, 09 CD-4a Feb 08, 10
Summary • Control subsystem is based on EPICS • Controllers will be common to LCLS systems • Motion, vacuum, cameras, power supplies, etc • Peak data rate/volume requirements are comparable to HEP experiments, requiring dedicated data acquisition and management systems • Data subsystem concept & architecture is being developed • Use standard interface to all detectors • Use data systems that have high bandwidth and are scalable • Is leveraging significant expertise at SLAC in data acquisition and management • Ready to proceed with baseline cost and schedule development