70 likes | 184 Views
PROOF on the Grid. Marco MEONI CERN - Offline Week – 28.10.2009. dPROOF. d istributed PROOF is an ongoing development A combination of PROOF and AliEn… … to achieve interactive parallel analysis on distributed clusters exploiting data locality. Grid Site C. Grid Site A.
E N D
PROOF on the Grid Marco MEONI CERN - Offline Week – 28.10.2009
dPROOF distributed PROOF is an ongoing development A combination of PROOF and AliEn…… to achieve interactive parallel analysis on distributed clusters exploiting data locality Grid Site C Grid Site A Grid Site B
A ProxyServer starts Xrootd and PROOF master • JAs are sent to the VOs and start ProxyClients • A ProxyClient starts an Xrootd server and registers to the ProxyServer • A ProxyServer keeps the list of all the partecipating nodes • A user starts a dPROOF session connecting the topMaster 1 User workspace 2 AliEn-LCG Grid 3 Grid API ROOT AliEn-LCG WMS 4 5 5 PROOFtopMaster 1 VO-box 1 VO-box n VO-box m ProxyServer Xrootdmanager PROOFlocalMaster 4 2 3 ProxyClient JA WN1 WN2 WNn Xrootd server PROOFworker WN workspace Site workspace
Participating Sites http://pcalimonitor/dproof/ • CNAF (by the end of the week) • Kosice • NIHAM 4 steps to enable dPROOF on a VObox http://cern.ch/mmeoni/dproof/
Overview ALICE is adapting PROOF to the Grid The framework is under test at 3 sites 3 sites will most likely join within the next week The multi-master PROOF architecture is under test and improvement There is room for changing/improving the policy of JA submission Workgroup meets twice a week since a month Stress test per-site works steadily for hours and keep the PROOF workers busy Test with up to 100 workers on a single site (CERN), processing rate peak 400MB/s Acknowledgement Adam, Anar, Andreas, Andrei, Axel, Bellenot, Costin, Cvetan, Jan Fiete, Latchezar, Federico, Mariella, Matevz, Pablo, Peter