1 / 11

Portuguese Grid Infrastruture(s) Gonçalo Borges Jornadas LIP 2010 Braga, Janeiro 2010

Portuguese Grid Infrastruture(s) Gonçalo Borges Jornadas LIP 2010 Braga, Janeiro 2010. Portuguese EGEE Infrastructure. 8 Sites LIP-Lisboa, LIP-Coimbra NCG-INGRID-PT UPorto (3 clusters) UMINHO-CP, DI-UMINHO IEETA CFP-IST Resources 2500 job slots

tracyrivera
Download Presentation

Portuguese Grid Infrastruture(s) Gonçalo Borges Jornadas LIP 2010 Braga, Janeiro 2010

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Portuguese Grid Infrastruture(s) Gonçalo Borges Jornadas LIP 2010 Braga, Janeiro 2010

  2. Portuguese EGEE Infrastructure 8 Sites LIP-Lisboa, LIP-Coimbra NCG-INGRID-PT UPorto (3 clusters) UMINHO-CP, DI-UMINHO IEETA CFP-IST Resources 2500 job slots Hundrends of Terabytes for Storage space Support for more than 20 VOs WLCG,EGEE, EELA INGRID, IBERGRID 2

  3. RCTS • 10 Gbps link between Lisbon and Porto • ~ 1 Gbps to other important regions • Important improvements are foreseen • Better International high speed connectivity • New links through Spain are (almost) operational • Minho and Galicia • Spanish Estremadura •  5 Gbps • Better Geant connectivity • Better redundancy • Ring between both countries 5 Gpbs 5 Gpbs

  4. INGRID overview INGRID:Iniciativa National GRID Push for resource sharing in Portugal Follows the path of EGI Helps to fulfill the Portuguese responsibilities in the framework of present European Projects EGEE, WLCG, IBERGRID... INGRID Management Commitee: FCT, UMIC and LIP (technical coordination) Steps towards INGRID deployment... Selection of 13 pilot applications HEP, Weather Forecast, Civil Protection, ... Deploy a dedicated data centre to host resources Located in Lisbon @ LNEC Works as the INGRID seed / core infrastructure 4

  5. Facilities @ INGRID main node Computer room area 370m2 85 cm raised floor Electrical power: 1st step:1000 kVA 2nd step 2000 kVA Protected power 5x UPS 200kVA Diesel generator Chilled water cooling: Chillers with free-cooling (2x375kW) Close-control units (6x150kW+47kW) Fire detection Very Early Warning Smoke Detection Fire extinction being installed 5

  6. Different VLANs: Scalability, Security, Easier Management Inbound/Outbound traffic to the grid local farm via 2 linux boxes FW/NAT servers connected to the central switch at 10 Gbps. Network @ INGRID main node Vlan Grid Cluster Vlan Routers Vlan Support Services FW/NAT 1 Vlan ISCSI Arrays Vlan Site Services FW/NAT 2 Central 10 Gigabit Ethernet switch Vlan Core Services Vlan User Services FW 10 Gbps LIP-Lisbon + LIP-Coimbra Internet 3.5 Gbps 6

  7. Topology @ INGRID main node Computing Blade Centres SGE cluster ... Firewall Core 10gigabit Ethernet switch Support Services Blade Centres net ... Storage = Lustre + StoRM 7

  8. Core Services Fault Tolerance Redundant services distributed between 2 blade centres Solution based on Xen Virtual machines Xen images available Storage accessible via Internet SCSI (iSCSI) Controlled by OCFS2 shared cluster file system... guaranties full data coherence and data integrity in simultaneous data accesses from multiply hosts ISCSI ARRAY 1 12 x 1TB SATA disks Raids 10, 6 LUNS 2 x 512 MB iSCSI controllers Blade centre ... OCFS2 Filesystem Xen Images Repository ISCSI ARRAY 6 12 x 1TB SATA disks Raids 10, 6 LUNS Blade centre 2 x 512 MB iSCSI controllers Central 10 Gigabit Ethernet switch 8

  9. Computing Resources @ INGRID main node Core services (failures have a critical impact on the infrastructure availability) 2 different blade centres with server direct attached storage Redudant power suplies, management and network connectivity IBM blades running SL5 x86_64 Xen Dom0 Kernels: 24 LS22 IBM blades (2 quad-core AMD opteron 2356 processors @ 2.3 GHz) 2 Gigabit Ethernet interfaces; Intelligent Platform Management Interface (version 2.0) 146 GB of local storage under 2 SAS disks in Raid mirror 192 cores, 3 GB of RAM per core (24GB RAM / blade) High Throughput Computing Servers Bladecentres hosting 12 / 14 blades running SL5 x86_64: 100 LS22/HS21 IBM blades (2 quad-core AMD opteron 2356 processors @ 2.3 GHz) 42 Proliant BL460 G6 HP blades (2 quad-core Intel Xeon X5550 @ 2.67GHz) 1136 cores, 3 GB of RAM per core (24GB RAM / blade) High Performance Computing Servers IBM bladecentre H with infiniband switch running SL5 x86_64: 14 LS22 IBM Blades (2 quad-core AMD opteron 2356 processors @ 2.3 GHz) 20 Gbps Double Data Rate Host Channel Adaptors 112 cores, 4 GB of RAM per core (32GB RAM / blade) 9

  10. Storage Resources @ INGRID main node Storage servers and expansion boxes 13 IBM X3650 servers running SL5 x86_64 2 quad-core Intel(R) Xeon(R) L5420 CPUs @ 2.50 GHz 2 SAS disks (74GB) deployed in Raid mirror Each server has associated 40 TB of effective storage 2 LSI Mega Raid Controllers (linking to the expansion boxes) Expansion boxes in Raid 5 Volumes with 1 TB SATA-II disks Total of ~ 620 TB of online grid storage space Storage Network interfaces Two builtin 10/100/1000 BASE-T Broadcom Gigabit Ethernet One NetXen 10 Gigabit Ethernet PCIe interface 2 HP DL380 G6 running SL5 x86_64 Expansion boxes with 4 x 12 SAS disks 450GB 15K RPM disks 10 Gigabit Ethernet, 2 NetXen 10 Gigabit Ethernet PCIe interface 2 HP DL360 G5 dedicated servers to run gridftp services Grid access enabled via the StoRM SRM interface Sun Microsystems’ Lustre cluster shared file system 10

  11. Computing Resources @ INGRID main node HP bladecenter C7000 IBM Blade Center E HP Proliant BL380 G6 IBM System X3650 Server 4x12TBexpansions IBM Blade Center E Core services HP Proliant BL460C G6 iSCSI (SAN) 11

More Related