1 / 18

LHCb DAQ Protocol Independent Performance Evaluator: DAQPIPE

LHCb DAQ Protocol Independent Performance Evaluator: DAQPIPE. Daniel Hugo Cámpora Pérez. LHCb DAQ workshop , 27-05-2013. What is it, anyway . DAQPIPE is an evaluation tool designed to measure the performance of a generic DAQ system. EM. Daniel Hugo Cámpora Pérez.

cheng
Download Presentation

LHCb DAQ Protocol Independent Performance Evaluator: DAQPIPE

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. LHCb DAQ Protocol Independent Performance Evaluator: DAQPIPE Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  2. What is it, anyway DAQPIPE is an evaluation tool designed to measure the performance of a generic DAQ system. EM Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  3. What we want to measure Network transfer protocols Network topologies Event-Building protocols Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  4. Network transfer protocols Preliminary tests with TCP/UDP over 40G. Preparing IB FDR tests. Testing 40G Ethernet UDP iWarp ROCE IB OpenMPI(full hardware support) IB RDMA InfiniBand? Ethernet? Upcomingones? Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  5. Network topologies (recap) Unidirectional flow Simple Current solution, scale up Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  6. Network topologies Bidirectional uniform flow Full-Duplex on core – mixed-servers. Implementation details: RUs sit on servers. Fraction of computing done in receiving nodes, offloading done to FUs. Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  7. Event-Building protocols PUSH PUSH with Barrel Shifting PULL Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  8. Push Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  9. Barrel shifting Equal-length receiving queues, asymmetric sending queues. Potential dramatic decrease of congestion in DAQ network. Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  10. Pull Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  11. Let's talk software Test suite should be Portable Flexible C-like entry point (interfaceable) Scalable Efficient! Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  12. Output • Logs & rates • Effective throughput • Maximum trigger rate • Error rate • Incomplete event rate Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  13. Preliminary tests • PTP allows for microsecond-level synchronization. • RDMA over IB CPU consumption is negligible. Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  14. Preliminary tests • 40GbE HP 59002x Mellanox Technologies MT27500 Family ConnectX-38x Chelsio Communications IncT420-CR Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  15. Thanks! Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  16. Backup Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  17. Network topologies Bidirectional mixed flow Full-Duplex on core - TOR connections. Port-density requirements for core switches significantly reduced. Server-wise identical to unidirectional solution. Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

  18. Network topologies Bidirectional uniform flow Relatively high load per mixed server (RU/BU/FU) – 4 x rate Input – RU Input / Output – BU Output - FU Daniel Hugo Cámpora Pérez LHCb DAQ workshop, 27-05-2013

More Related