140 likes | 239 Views
TRIUMF SITE REPORT Corrie Kost Head Scientific Computing. TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost. TRIUMF MANPOWER. TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost. WestGrid – UBC/TRIUMF Site.
E N D
TRIUMF SITE REPORTCorrie KostHead Scientific Computing TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
TRIUMF MANPOWER TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
WestGrid – UBC/TRIUMF Site TRIUMF/UBC first HEP site to install large (1008 CPU) blade cluster? • 504 dual 3.06 GHz Xeon blades • Red Hat Linux 7.3 compute nodes • PBS Scheduling with Maui • 10 TB disk storage • 24 TB tape storage • Direct Gigabit connection between sites sites • Possible 10GB in future • Subatomic physics allocation: ~1/3 of compute resources • TWIST will be a Beta user this month. TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
WestGrid – UBC/TRIUMF Site(www.westgrid.ca) • Like the summer rains – two weeks away since August! • Blade power consumption exceeded expectations • Use 12 of 14 • Replace hot swap power supplies • GPFS has some teething problems • Reduced cabling welcome – wireless would be better! • Very little infant mortality (no blades failed!) TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
14 dual-cpu blades in 7U Chassis Side view of a blade TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
Rear View of Blades Chassis TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
WestGrid –UBC/TRIUMF Site Storage 1 Rack UPS Batteries Inverters Switch Gear Blades 6 Racks TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
First look at Dual 1.6GHz Opterons SATA IDE Drives system from HardData 64 bit 1.6GHz Opterons approx. equal to 32 bit 2.8GHz P4 (Xeons) Performance details: Konstantin Olchanski (olchansk@triumf.ca) TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
Misc. Developments • 1 TB Raid 5 disks attached to Linux (TRSHARE) for Linux & Windows users (via Samba) • Mosix & PBS Clustering – Steve McDonald 11:30 Wed • Bandwidth Management – Steve McDonald – 11:40 Wed • Colubris Radius Server – Steve McDonald – 11:50 Wed • SPAM fighting at TRIUMF – Andrew Daviel – 13:50 Tue • Document Management System: Docushare • Windows 2003 Terminal Service (TNT2K3) TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
Misc. Developments • Videoconferencing • One older room with limited capability • A new room with Westgrid funded equipment • Several protocols supported: ISDN, H323, VRVS, AccessGrid • Participation in the Westgrid Collaborative/Visualization effort to improve videoconferencing quality and tools TRIUMF Site Report for HEPiX/HEPNT, Vancouver, Oct20-24/2003 – Corrie Kost
International GRID Testbed First Transatlantic Native 10 Gigabit Ethernet Connection Catalin Meirosu CERN and “Politehnica” University of Bucuresti On behalf of the International GRID Testbed
HP Itanium-2 International 10GE LAN PHY 10GE WAN PHY OC192c Intel Itanium-2 HP Itanium-2 Intel Xeon Ixia 400T GRID Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Force10E 600 Force10 E 600 Ixia 400T Geneva Ottawa Toronto Chicago Amsterdam Testbed The First Transatlantic 10 GE WAN PHY over an OC-192c circuit using lightpaths provided by SURFnet and CANARIE 9.24 Gbps using traffic generators 6 Gbps using UDP on PCs 5.5 Gbps using TCP on PCs ITU Telecom World 2003 12
HP Itanium-2 International 10GE LAN PHY 10GE WAN PHY OC192c Intel Itanium-2 HP Itanium-2 Intel Xeon Ixia 400T GRID Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Cisco ONS 15454 Force10E 600 Force10 E 600 Ixia 400T Geneva Ottawa Toronto Chicago Amsterdam Testbed ESTA, IST-2001-33182 The First Transatlantic 10 GE ITU Telecom World 2003 13