140 likes | 261 Views
SA2.4 – EMI Tools 1 Year Later. Lorenzo Dini Task Leader EMI All Hands Meeting 30/05/2011, Lund. Initial Situation. Current Situation. Status and Achievements - 1. DoW : Tools and Repositories Selection, Maintenance and Integration.
E N D
SA2.4 – EMI Tools1 Year Later Lorenzo Dini Task Leader EMI All Hands Meeting 30/05/2011, Lund
Initial Situation EMI All Hands Meeting - Lund
Status and Achievements - 1 DoW: Tools and Repositories Selection, Maintenance and Integration • Single tool-chain discussed, selected, deployed, integrated and maintained • Single packaging strategy defined and implemented • EMI repository deployed and maintained • Quality Assurance tools implemented • Configuration and Integration documentation and policy EMI All Hands Meeting - Lund
Status and Achievements - 2 DoW: Tools and Repositories Selection, Maintenance and Integration • QA plugins released/fixed as planned • QA report generator started and completed • 13 ETICS service and client releases with many improvements for EMI • Build infrastructure working 24/7 • 28 EPEL WNs and 6 nightly builds a day • EMI Repository: Dwnlds 169,026/83.42 GB • Integration and configuration support to EMT, SA1 and PTs with no major issues EMI All Hands Meeting - Lund
SA2.4 in Numbers - I • Support • >140 GGUS tickets • >200 emails to EMT • EMI in ETICS • Project SLOC: • Project build size: • Project build time: • EMI Modules: • EMI Configurations: • 2.6M • >15GB (w/o deps) • ~7h (8GB,2.3Ghz,4co) • 469 • 2297 EMI All Hands Meeting - Lund
SA2.4 in Numbers - II • Builds • Project: 808 (Nightlies: 557) • Component: 6367 (Nightlies: 832 SAKET) • Platforms • Project: 606 SL5_64 101 SL5_32 • Component: 5938 SL5_64 124 SL5_32 • Tests • Project: 0 • Component: 53 EMI All Hands Meeting - Lund
Top 20 Subsystems • Builds • emi.fts 569 • emi.unicore 565 • emi.arc 537 • emi.lcgdm 483 • emi.sac 438 • emi.lcgutil 409 • emi.voms 301 • emi.argus 295 • emi.dcache 264 • emi.apel 236 • emi.lb 229 • emi.px 168 • emi.hydra 146 • emi.bdii 139 • emi.amga 112 • emi.cream-ce 111 • emi.misc 109 • emi.java-security 102 • emi.mpi 101 • emi.lbjp-common 91 • Size in components • emi.lcgdm 57 • emi.sac 33 • emi.fts 30 • emi.lcgutil 22 • emi.voms 21 • emi.lrms-utils 20 • emi.dcache 19 • emi.storm 19 • emi.misc 17 • emi.unicore 17 • emi.lb 17 • emi.wms 17 • emi.argus 16 • emi.bdii 16 • emi.cream-ce 14 • emi.arc 11 • emi.gridsite 11 • emi.lbjp-common 9 • emi.dgas 9 • emi.apel 9
SLOC EMI All Hands Meeting - Lund
SLOC (no dCache) EMI All Hands Meeting - Lund
Issues and Concerns • Year-2 Debian tool support and knowhow • Worker Nodes resources -> Triplicate • Builds tend to cluster in the same periods • Lacking of automated testing activities • QA Plugins need component configuration to produce proper metrics (src.location) EMI All Hands Meeting - Lund
Conclusions • Single tool-chain and packaging • All services running reliably • Continuous software improvement • QA tools in place • Good support to all EMI • Debian expertise • Resources optimization • QA and Testing activities EMI All Hands Meeting - Lund
Thank you EMI is partially funded by the European Commission under Grant Agreement INFSO-RI-261611 EMI All Hands Meeting - Lund