70 likes | 165 Views
SLAC Site Report. By Les Cottrell for UltraLight meeting, Caltech October 2005. SLAC Evolving. Increasingly multi-program: Increasing focus on photon sources SPEAR3, Linear Coherent Light Source (LCLS) and Ultra Fast Science Center Increased funding from BES
E N D
SLAC Site Report By Les Cottrell for UltraLight meeting, Caltech October 2005
SLAC Evolving • Increasingly multi-program: • Increasing focus on photon sources • SPEAR3, Linear Coherent Light Source (LCLS) and Ultra Fast Science Center • Increased funding from BES • LINAC increasingly funded by BES (all in 2009) • HEP roughly stable, BaBar stops taking data 2008 • Proposal for tier 2 W. Coast ATLAS/LHC site • Accelerator design • Astronomy: NASA (GLAST) and Large Synoptic Survey Telescope (LSST)) • Joint (Stanford / DoE / NSF) funded projects • KIPAC, UltraFast center, Guest House
Requires • New business practices • More project oriented since multiple projects so need more accountability • No longer dominated by HEP • Harder to “hide” projects like UltraLight/PingER with no sources of funding for operations. • SLAC/IEPM part of BNL Terapaths project • Recently hired post-doc Yee-Ting Li to work on this
Site Connectivity • Connected to ESnet Bay Area MAN • ESnet (production) + SDN both 10Gbits/s • 4Gbits/s disk to disk SLAC/NERSC for BAMAn Christening • Have equipment to connect up production LAN at 10Gbps to ESnet, awaiting power installations • For SC2005 built a ten node xrootD cluster of v20z dual Opterons with Chelsio and Neterion NICs, plus four v20z file servers and disk trays • Attached to ESnet for SC2005 via temporary Cisco 6509
UL Testbed 10Gbits/s • Sunnyvale space loaned from CENIC, SLAC paid for power $1K/month, stopped being invoiced July ’05 • Status of permanent residency unresolved • Cisco 6509 from UltraLight proposal • Two Sun v20z dual 1.8GHz Opterons loaned from SLAC • 10GE Neterion NICs, purchased by SLAC • Remote management • Purchased/installed terminal server to provide console access • Purchased/installed remote power management • Will get file server from Caltech? • Connect hosts to Cisco 6509, to 10Gbps UltraLight • Tie in/interconnects between ESnet, USN & UL unclear • USN has 2 circuits to UL router • ESnet (SDN) has circuit to USN • ESnet BAMAN has connectivity to SLAC • Main costs to SLAC are people costs for which there is no directed funding to support
Sunnyvale set up • V20z dual 1.8GHz opterons • Linux 2.6.9, Neterion 10GE NICs • NO uldemo account allowed 10Gbits/s UltraLight (192.84.86.x) 10Mbps management(137.164.37.x) http://137.164.37.3 power management Console CENIC A2 Power .114 A3 snv1 .115 snv2 A4 Hub A5 Terminal Server A6 Te2/2 Compute servers .3 .6 .5 Not installed .8 Te2/4 Te2/2 .7 6509 .4 Te2/1 Te11/3 .2 Te1/2 UltraLight USN ESnet BAMAN
Tools installed • Ping, traceroute (of course) • Pingroute, • http://www.slac.stanford.edu/comp/net/pingroute.pl • TCP achievable throughput: iperf, thrulay • Packet dispersion: pathchirp, pathneck • File transfer: Bbcp, GridFTP • Future: iepm-bw, OWAMP?