110 likes | 256 Views
KOLKATA TIER-2 Site Name :- IN-DAE-VECC-01 and 02 VO :- ALICE Country :- INDIA System Administrator (1): Tapas Samanta email : tsamanta@veccal.ernet.in System Administrator (2): Vikas Singhal email : vikas@veccal.ernet.in. New Procurement. 3 BLADE enclosure with 40 Blades. Each Blade has
E N D
KOLKATA TIER-2Site Name :- IN-DAE-VECC-01 and 02VO :- ALICECountry :- INDIASystem Administrator (1): Tapas Samantaemail : tsamanta@veccal.ernet.inSystem Administrator (2): Vikas Singhalemail : vikas@veccal.ernet.in Vikas Singhal, VECC, INDIA
New Procurement 3 BLADE enclosure with 40 Blades Each Blade has 2 * 3.0GHz Dual Core Xeon Processors 4MB L2 Cache per processor 8GB RAM 2 * 72GB HDD for Redundancy 2 * Gigabit Network Card for Redundancy iLO Port for Remote management Each Enclosure has 6 Hot Swappable High speed Fans 6 Hot Swappable power supply 2 redundant layer-II switch Vikas Singhal, VECC, INDIA
New Procurement of Storage 2 Fully Loaded HP EVA6100 Racks 2 redundant EVA Controller in each Rack 2 * (100 * 500GB) + 8*1TB raw disks. Total Usable Space 75 TB After Hot spare and RAID5 configuration Vikas Singhal, VECC, INDIA
Full Picture of New Procurement after Complete installation Two HP EVA6100 Storage Racks Computing Element Rack Vikas Singhal, VECC, INDIA
Logical Diagram of New Procurrement Pure XROOTD Grid Network Line (100Mbps) Gridce02 (CE + BDII) Grid01 (VOBOX) Dcache-server Dcache-pool Dcache-client Switch SAN switch 192.168.2.120 SAN switch 192.168.2.119 39 HP BL160G5 Blade Server Cluster 192.168.1.44-83 HP 50 TB Raw EVA 6100 HP 58 TB Raw EVA 6100 Grid-bkp-server 192.168.1.16 Tape Loader Vikas Singhal, VECC, INDIA
Middleware installation on new hardware 1.Installed SLC 4.6 (x86_64) operating system on x86_64 Machine. 2. Installed following middleware packages on x86_64 machine. glite-VOBOX CREAM-CE (32bit) glite-BDII Pure XROOTD Storage Element glite-MON glite-WN (64bit) grid01.tier2-kol.res.in gridce02.tier2-kol.res.in dcache-server.tier2-kol.res.in For 39 Worker Nodes (156 core) wn045-wn083.internal.tier2-kol.res.in Vikas Singhal, VECC, INDIA
Full TIER-2@Kolkata centre for ALICE Grid Internet 100Mbps Router Management Nodes Management Nodes 144.16.112.xx/27 Switch grid01 dcache-server grid gridce01 gridse001 gridce02 Usable 75 TB Storage wn001 wn045 Switch-1 wn002 Switch-2 Switch-1 wn046 Switch-2 Wipro Netpower Dual CPU Xeon 3.0 GHz HP DL160c Blade Server with 2 * Dual Core Xeon 3.0 GHz Giga-bit Switch Computing Nodes Computing Nodes 192.168.x.x (Stand by) 192.168.x.x (Stand by) wn012 wn082 wn013 wn083 IN-DAE-VECC-02 Site with 64 bit machine IN-DAE-VECC-01 Site with 32 bit machine Vikas Singhal, VECC, INDIA
IN-DAE-VECC-01 site 32 Bit Machines Vikas Singhal, VECC, INDIA
Installation of CREAM-CE at Kolkata • First we have cleaned full machine, removed all packages related to lcg, glite, TORQUE, pbs etc. • Update with yum. • Followed general procedure for installing CREAM-CE. • If required installed TORQUE and pbs packages by hand. Batch server packages (TORQUE packages all 64 bit) [root@gridce02 ~]# rpm -qa \*torque\* torque-server-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-debuginfo-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-pam-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-drmaa-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-drmaa-docs-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-devel-2.3.0-snap.200801151629.2cri.slc4.x86_64 glite-yaim-torque-server-4.0.1-5.noarch torque-docs-2.3.0-snap.200801151629.2cri.slc4.x86_64 torque-client-2.3.0-snap.200801151629.2cri.slc4.x86_64 glite-yaim-torque-utils-4.0.2-2.noarch torque-mom-2.3.0-snap.200801151629.2cri.slc4.x86_64 Cream CE packages (all 32 bit) [root@gridce02 ~]# rpm -qa \*cream\* glite-ce-cream-1.8.4-1.noarch glite-yaim-cream-ce-4.0.5-0.noarch [root@gridce02 ~]# Vikas Singhal, VECC, INDIA
Installation of Pure XrootD at KOLKATA Site • Installing pure-xrootd is really simple and easy. • We have to modify only one system.cnf file and all is done. • One special variable for ALICE. • export OFSLIB=TokenAuthzOfs • Run the xrootd service through xrd.sh and all is configured. • Thanks to Fabrizio Furano who helped a lot for installation at Kolkata. • Similar procedure for xrootd server and pool servers All is properly documented at the link http://alien.cern.ch/twiki/bin/view/AliEn/HowToInstallXrootdNew Vikas Singhal, VECC, INDIA