140 likes | 326 Views
Canada’s National Laboratory for sub-atomic physics. Steven McDonald TRIUMF Network & Computing Services steven.mcdonald@triumf.ca. Located in Vancouver, Canada (west coast) ~ 400 Full Time Staff & Physicists 2 nd furthest T1 site from CERN ~168ms RRT. TRIUMF. *. *. *. *. *. *. *.
E N D
Canada’s National Laboratory for sub-atomic physics Steven McDonald TRIUMF Network & Computing Services steven.mcdonald@triumf.ca • Located in Vancouver, Canada (west coast) • ~ 400 Full Time Staff & Physicists • 2nd furthest T1 site from CERN ~168ms RRT HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
TRIUMF * * * * * * * * * * * * Assumes all ATLAS T1 are equal HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
TRIUMF-CERN 1GbE Lightpath(s) • 1st dedicated GbE circuit • established April 18th 2005 • 2nd dedicated GbE circuit • established July 19th 2005 • TRIUMF • BCNET • CANARIE • SURFnet • CERN HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
SC3 throughput results over2 x 1G lightpaths TRIUMF 90-140 MB/s is typical HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
3rd week Sept ‘05 Amsterdam Sept 1 ‘05 End Oct ‘05 HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
CWDM & Lightpaths at TRIUMF Aug 2002 /CA*net4 TRIUMF Local loop to Gigapop & CA*net4 PoP ~ 22km 10 GbE @1550nm - CERN T0 2x 1 GbE @1530nm - Canada T2’s 2x 1 GbE @1510nm - ? T2 & T1 2x 1 GbE @1690nm - CAnet4 research HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
1610 nm 1590 nm 1570 nm 1550 nm TRIUMF WAN CWDM Equipment Single Pair Fiber MRV CWDM • 4 1GbE channels • Passport 8600 • ORAN • WESTGRID • 2x CERN BCNET 22km Potential to Add 2 more 1GbE channels 10GbE Foundry Switch -> CERN 2x GbE TDM 4 Port Optical Mux SFP HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
ATLAS Tier2 in Canada There will be two Tier 2’s Centres in Canada, one in the East and one in the West. Each centre will be a distributed across several sites, with one contact point Western Tier2 Eastern Tier2 1G 1G 10G CERN TIER 0 TRIUMF Tier 1 Tier2’s Dedicated e2e Lightpaths Can be lightpaths or on the routed 1Gbps CA*net4 research network ~ ? SARA/NIKHEF Tier 1 HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
TRIUMF Tier1 → Canada Tier2’s Participating Canadian Tier2 sites in SC3 Western Tier2’s Simon Fraser University University of Alberta University of Victoria Eastern Tier2’s University of Toronto Already linked via a $40M Distributed Computing Grid Infrastructure Plans are underway to include Victoria in an expanded grid T1-T2 network activity Aug 17 - Aug 24 : All four Tier 2 sites participating HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
Transfer results over 10GbE circuit HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
10 GbE Lightpath to CERN Summary √ √ √ √ √ √ X X Atlantic Crossing TRIUMF CERN √ HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
ATLAS Tier1 resources distribution TRIUMF ~ .6T1 original networking specification called for ~75 MB/sec per ATLAS T1 with x6 safety factor implies 3.6 Gbps For TRIUMF T1 ~2-3 Gbps Consider 10G LAN Phy/SONET mapping Transatlantic 10G link HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald
TRIUMF partitions APN and establishes cross connects with 3rd parties APNs 1G HEPnet daisy chain routed TRIUMF Tier 1 UoToronto Physics Tier 2 5G Tier 0 data UBC Physics UA Physics UoT Physics 2G Tier 1 data 1G Tier 2 East UoVictoria Physics Tier 2 CWDM 1G Tier 2 West Carleton Physics CWDM UdM Physics Toronto Amsterdam Vancouver Edmonton Ottawa Victoria CA*net 4 To other physics users at smaller universities New York Geneav Optional interfaces Note: Typical View on TRIUMF UCLP GUI Chicago FERMI Tier 1 CERN Tier 0 Brookhaven Tier 1 HEPiX, CASPUR, April 3-7, 2006 – Steve McDonald