70 likes | 184 Views
WLCG Storage and Data Management Jamboree Summary. Jens Jensen OGF29, Chicago June 2010. Executive Summary. WLCG: Need for improving data management for analysis Inviting demonstrators MUST work with existing experiment Demonstrate by WLCG @ IC. Input. Strawman
E N D
WLCG Storage and Data Management Jamboree Summary • Jens Jensen • OGF29, Chicago • June 2010
Executive Summary • WLCG: Need for improving data management for analysis • Inviting demonstrators • MUST work with existing experiment • Demonstrate by WLCG @ IC
Input • Strawman • Use networks rather than tape • Networking better than MONARC • Also scales with Moore’s law • “More money for networking” • Tape as dark archive • Streaming video “solved” • But HEP is != streaming video
Data management • Make data available for analysis • Pre-distribute • Fetch when required • Transfers • Restart failed transfers
xroot • Not standardised • “Changes backward compatible” • 1.5 implementations
Metrics • Normally measure CPU • … what are the appropriate metrics?
“Outcome” • Demonstrate at WLCG at IC • … detailed look at notes