1 / 11

CWG13 : Ideas and discussion about the online part of the prototype

CWG13 : Ideas and discussion about the online part of the prototype. P. Hristov , 11/04/2014. DAQ lab machines. 8 machines Sandy Bridge-EP, dual E5-2690 0 @ 2.90GHz, 64GB RAM 2x8 hw cores, 32 threads  Network 4x with 40G Ethernet 4x with 10G Ethernet. Naive test (with ZeroMQ ?). FLP1

gannon
Download Presentation

CWG13 : Ideas and discussion about the online part of the prototype

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CWG13: Ideas and discussion about the online part of the prototype P. Hristov, 11/04/2014

  2. DAQ lab machines • 8 machines • Sandy Bridge-EP, dual E5-2690 0 @ 2.90GHz, 64GB RAM • 2x8 hw cores, 32 threads •  Network • 4x with 40G Ethernet • 4x with 10G Ethernet

  3. Naive test (with ZeroMQ?) FLP1 Data source (DDL sim) Buffering Data reductionsim. Data “sender” EPN1 Data “receiver” Time frame builder Algorithm simulator Storage simulator FLP2 Data source (DDL sim) Buffering Data reductionsim. Data “sender” EPN2 Data “receiver” Time frame builder Algorithm simulator FLP3 Data source (DDL sim) Buffering Data reductionsim. Data “sender” EPN3 Data “receiver” Time frame builder Algorithm simulator DQM simulator

  4. Goals for a naïve test • Get experience with the ALFA software (currently in FairRoot), ZeroMQ, etc. • Become familiar with the online computing (especially for the offline people) • Perform some initial measurements, i.e. networking throughput, latency, performance with different size of the messages,… • Provide “sandbox” for development of the online components • logging system • control system • Test the access patterns, the distribution of produced/requested information, i.e. calibration, geometry, etc.

  5. Some questions • Base (i.e. for components) • Common • Buffer • Networking/messaging (Pub/Sub, client/server, push/pull…) • FLP • Data Reduction Components • Clusterization • Tracklet finders • Calibration0 Components • EPN • Data aggregation component • Data reduction/reconstruction components • Vertex finding (?) • Global tracking • Rejection of non-associated clusters/cluster reformatting • Huffman encoding • Calibration1 Components • Control/logging • Which parts of the DAQ and HLT software can be reused in the test? • Is there any example in the FairRoot repository? • example/Tutorial3? • How do we organize the software in the repository? i.e.

  6. Proposed actions for the next 2 weeks • JIRA project, Git workflow (Peter) • Creation of MC points for ITS and TPC (Charis, Mohammad, Andrei) • Description of the Run3 raw data structures (Andrei, Peter) • Discussion with CWG3: 16/04/14 • Installation of FairRoot/ALFA on the test nodes (Mohammad, Peter) • Detailed presentation on ALFA (Mohammad, Anar): 25/04/14 • Ideas about the condition data base in Run3 (Raffaele): 05/14 • Presentation on the ITS & TPC reconstruction components for Run3: cluster finder, fast tracker, track fit (Sergey, Ruben): 05/14 • Next meeting 25/04/2014

  7. Backup

  8. O2 Prototype: Complementary approaches “Offline” “Online” • Simulation (ITS + TPC) in FairRoot environment • Creation of hits (MC points) • Use of Geant4 w/wo multithreading, comparison (CWG8) • Digitization in time frames • Use of (0MQ) multiprocessing • Creation of raw data in Run3 format (CWG4) • Simulated from digits • Emulated from existing raw • Setup of test nodes (CWG1, CWG12) • Hardware and software data generation • See the “offline” part • Control, configuration and monitoring (CWG10) • ALFA components + control software

  9. O2 Prototype: Complementary approaches “Offline” “Online” • Use of CWG5 + CWG7 demonstrators to process (reconstruct) the raw data • Add more detectors (i.e. the ones in triggered mode) in the simulation • GOTO digitization, creation of raw data, reconstruction • Put some calibration algorithms in the processing (CWG6) • Data transport and fan-in, event-building (CWG3) • Use of generated raw data • Data access for processing, monitoring, QA (CWG9) • Data storage

  10. Collaboration with the other CWGs • CWG 1 - Architecture • CWG 2 - Tools and Procedures • CWG 3 - Dataflow and Condition Data • CWG 4 - Data Model • CWG 5 - Computing Platforms • CWG 6 - Calibration • CWG 7 - Reconstruction • CWG 9 - QA, DQM, Visualization • CWG 8 - Physics Simulation • CWG 10 - Control, Configuration & Monitoring • CWG 11 - Software Lifecycle • CWG 12 - Computing Hardware

More Related