90 likes | 106 Views
Evaluating data production, simulation, analysis needs for US ATLAS, focusing on high-throughput data-intensive work. Collaboration with universities and enhancing computing systems. Timeline includes testing solid-state storage and WAF implementation.
E N D
Planning for aWestern Analysis Facility Richard P. Mount Planning for a Western Analysis Facility
Evaluating US ATLAS Needs • Data Production Tasks: • BNL Tier 1 (+Tier 2s) meet the pledged requirements • Simulation: • Could absorb all Tier 2 capacity and more. Physics impact of scaling back is not clear. • Analysis: • Computing Model allocates 20% to 50% of Tier 2s. • Is this realistic quantitatively? • Is this realistic qualitatively (data-intensive analysis)? • Could Tier 3s provide what appears to be missing? Planning for a Western Analysis Facility
US ATLAS T1 + T2 in 2010 Excluding T3s Planning for a Western Analysis Facility
BaBar and CDF BaBar Tier As in 2006 (+ simulation done mainly at universities) CDF Fermilab Site in 2008 (thanks to Rick Snider) Excluding “T3s” Planning for a Western Analysis Facility
Data-Intensive Analysis Babar (and Run II) experience demonstrated a vital role for major “Tier-A” computer centers specializing in high-throughput data-intensive work. Physics demands chaotic, apparently random access to data. This is a hardware/software/management challenge. Achieving high-availability with a complex data-intensive workload is hard! Running simulation at major data-intensive facilities fails to exploit them fully (BaBar ran most simulation on university facilities). Significant university (Tier 3) facilities have always been very important for final-stage analysis. Planning for a Western Analysis Facility
SLAC Strengths • Pushing the envelope of Data Intensive Computinge.g. Scalla/xrootd (in use at the SLAC T2) • Design and implementation of efficient and scalable computing systems (1000s of boxes) • Strongly supportive interactions with the university community (and 10 Gbits/s to Internet2). • Plus a successful ongoing computing operation: • Multi-tiered multi-petabyte storage • ~10,000 cores of CPU • Space/power/cooling continuously evolving Planning for a Western Analysis Facility
SLAC Laboratory Goals Maintain, strengthen and exploit the Core Competency in Data Intensive Computing; Collaborate with universities exploiting the complementary strengths of universities and SLAC. Planning for a Western Analysis Facility
ATLAS Western Analysis Facility Concept • Focus on data-intensive analysis on a “major-HEP-computing-center” scale; • Flexible and Nimble to meet the challenge of rapidly evolving analysis needs; • Flexible and Nimble to meet the challenge of evolving technologies: • Particular focus on the most effective role for solid state storage (together with enhancements to data-access software); • Close collaboration with US ATLAS university groups: • Make best possible use of SLAC-based and university-based facilities. • Coordinate with ATLAS Analysis Support Centers. Planning for a Western Analysis Facility
ATLAS Western Analysis Facility Possible Timeline Today: Interest from “Western” ATLAS university groups in co-locating ARRA-funded equipment at SLAC (under discussion). 2010: Tests of various types of solid-state storage in various ATLAS roles (conditions DB, TAG access, PROOF-based analysis, xrootd access to AOD …). Collaborate with BNL and ANL. 2010: Re-evaluation of ATLAS analysis needs after experience with real data. 2011 on: WAF implementation as part of overall US ATLAS strategy. Planning for a Western Analysis Facility