170 likes | 247 Views
Summary of the ScotGRID Project. Phase2 of the ScotGRID Project. Phase1 of the ScotGRID Project. Introduction: ScotGRID Goals. ScotGRID:The Scottish LHC Computing Centre. 2000: JREI Bid. The LHC Computing Challenge for Scotland. ScotGRID: The Spirit of the Project.
E N D
Summary of the ScotGRID Project Phase2 of the ScotGRID Project Phase1 of the ScotGRID Project Introduction: ScotGRID Goals ScotGRID:The Scottish LHC Computing Centre
2000: JREI Bid The LHC Computing Challenge for Scotland ScotGRID: The Spirit of the Project The JREI funds will make possible to commission and fully exercise a prototype LHC computing centre in Scotland The Centre would provide: Technical service based for the grid services DataStore to handle samples of data Analysis Significant simulation production capability Excellent network connection RAL / Regional sites Support grid middle devel. with CERN/RAL Support core software devel. within LHCb/ATLAS Support user applications in other scientific areas • This will enable us to answer: • Grid viable solution for LHC computing challenge,TDR • Can a two-site Tier-2 centre be setup and operate effectively • How can network topology between Ed,GL, RAL & CERN http://www.scotgrid.ac.uk/
Time-Line for a Production Tier-2 & beyond Completed: Phase1 Phase2 Links to other applications… Future Upgrades ? Production Tier-2 Site Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 2003 2004 2005 2001 2002 Start of GridPP-II Prototype To Production End of JREI funding Start of ScotGRID-II Delivery of more Kit…
ScotGRID Processing nodes at Glasgow • 59 IBM X Series 330 dual 1 GHz Pentium III with 2GB memory • 2 IBM X Series 340 dual 1 GHz Pentium III with 2GB memory • 3 IBM X Series 340 dual 1 GHz Pentium III with 2GB memory • 1TB disk • LTO/Ultrium Tape Library • Cisco ethernet switches ScotGRID Storage at Edinburgh • IBM X Series 370 PIII Xeon • 70 x 73.4 GB IBM FC Hot-Swap HDD Hardware Middleware Applications
Documentation Accumulated CPU Use http://www.scotgrid.ac.uk/ Instantaneous CPU Use Tier-2 Web-Based Monitoring Total Disk Use ScotGrid reached ~ 580,000th processing hour
ScotGrid accumulated stats Significant non-LHC application use Q3 Q1 Q2
ScotGrid JREI project includes a mid-term hardware upgrade. • As part of GridPP planning, we need to upgrade from Prototype to Production Tier 2 status by 2004. • JREI funding left to be spent by June 2003: • Edinburgh £220k • Glasgow £30k £250k ScotGRID Phase-2 : Just Started
Summary of ScotGRID Upgrade Upgrade Database Server in Edinburgh xSerier 440 (8 Way 1.9GHz Intel Xeon, 1MB L3 Cache, 32GB Memory, 36GB Internal Disk) 16 – 20 TB of Disk Storage in Edinburgh FAStT700 or FAStT900 (see next slide) • 5 TB of Disk Storage in Glasgow • Agreed to relocate existing FAStT500 from Edinburgh to Glasgow Edge Servers for Edinburgh EDG SE:1 from Glasgow (x340) LCFG, CE: 2* x205, 1 x 1.8 GHz, 256MB, 40GB New Kit for Glasgow CDF & eDIRT Kit
Storage System 20TB vs. 18TB
IBM@server: xSeries 440 8* Xeon (1.9GHz) 32 GB, Scalable configuration Dual FastT900 + 24 TB ScotGRID-Edinburgh: Schematic x205 P4/1.8 GHz /256 MB RH7.3 x340 dual PIII/1 GHz /2 Gbyte RH7.3 CE LCFG Storage Nodes x205 P4/1.8 GHz /256 MB RH7.3 Gbps Fibre connection
The CDF kit has • 1 rack with only UPS • 1 rack with • 10 Dell dual Xeon 2.4 • GHz 4GB, • 7.5 TB disk, UPS • 1 rack with • IBM x370 8 of 700 MHz • Pentium III with 8GB, • 1 TB via FAStT500, UPS • 1 tape library ScotGRID-Glasgow: CDF Kit IBM: http://www.xcat.org/ CDF: http://www.scali.com/
The eDIKT kit has: http://www.edikt.org/ • 4th rack on the right and has • 6 IBM x335 (1U high) dual Xeon 2.4 GHz • and 1.5 GB memory • 2 IBM BladeCentres (7U high) each with • 14 Blades x335 dual Xeon 2.4 GHz and • 1.5 GB memory ScotGRID-Glasgow: eDIKT Kit
GIIS control connection Virtual GIIS data connection Org. Catalog Storage Globus Element Replica (GridFTP) Catalog Tier2 GateWay (Broker) Cluster Worker Globus gatekeeper A nodes EDG Job Grid + job manager u Manager t GridFTP h Front-end PBS GIIS Globus GRIS GIIS Working Directories Information Providers: /session1 queues, jobs, users /session2 Cluster ... Cluster Possible ScotGRID Config
Summary of Tier-2 ScotGRID Project • Have Successfully completed Phase-1 • ScotGRID had been upgraded – Phase-2 • eDIRT Kit, CDF Kit • HPS + Larger DataStore • ScotGRID: will concentrate on commissioning the new hardware during the next few month. before going to EDG2.0 • There will be an ad. for ScotGRID Technical Coordinator • We will have to start to think about restructing the ScotGRID team for production running – early next year • In the New Year plan to integrate the Durham CPU Farm
ScotGRID-Glasgow: Schematic x340 dual PIII/1 GHz/0.5 Gbyte x340 dual PIII/1 GHz /2 Gbyte x340 dual PIII/1 GHz /2 Gbyte Masternode Storage Nodes Head Nodes Campus Backbone Internet VLAN 10.0.0.0 VLAN 100 Mbps 1000 Mbps Compute Nodes 59 x330 dual PIII 1GHz/2 Gbyte
Disk Arrays(Total 4.6 Tb) SRIF Network FastT 500 Storage Controller Server (4*Pentium Xeon, 16Gb RAM) ScotGRID-Edinburgh: Schematic