70 likes | 200 Views
Architecture. DAQ. INPUT. InputPySpillGenerator. InputCppDAQOnlineData. spill N. spill N. MapPyGroup. MapPyGroup. TRANSFORM. MapPyBeamMapper. MapCppTOFDigits. MapCppSimulation. MapCppTOFSlabHits. MapCppTrackerDigitization. MapCppTOFSpacePoints. (spill N)’. (spill N)’.
E N D
Architecture DAQ INPUT InputPySpillGenerator InputCppDAQOnlineData spill N spill N MapPyGroup MapPyGroup TRANSFORM MapPyBeamMapper MapCppTOFDigits MapCppSimulation MapCppTOFSlabHits MapCppTrackerDigitization MapCppTOFSpacePoints (spill N)’ (spill N)’ In-memory cache In-memory cache In-memory cache MERGE ReducePyDoNothing ReducePyTOFPlot OUTPUT OutputPyJSON OutputPyImage
Software development DAQ Input spill N-1 spill N+1 spill N Celery Transform Transform Transform parallel transform execution (spill N-1)’ (spill N)’ (spill N+1)’ document-oriented database histogram mergers Merge web front-end Output Web front-end
Celery and RabbitMQ Celery Worker RabbitMQ Celery Worker Celery Worker
Celery workers and tasks Celery Worker RabbitMQ Transform Transform spill’ spill Celery Worker Transform spill’ Celery Proxy Transform spill spill Celery Worker spill’ Transform Go.py Transform
Celery workers and broadcasts Celery Worker RabbitMQ configuration Transform status Transform configuration Celery Worker status configuration Transform status Celery Proxy Transform configuration Celery Worker status Transform configuration Go.py Transform status