60 likes | 175 Views
WH Wide. WH Wide. Silver Wide. WH Wide. WH Wide. Silver Wide. WH Wide. WH Wide. HiPPI Switch. WH Wide. WH Wide. Silver Wide. WH Thin. WH Thin. WH Thin. WH Thin. Silver Wide. WH Thin. WH Thin. WH Thin. WH Thin. Silver Wide. WH Thin. WH Thin. WH Thin. WH Thin.
E N D
WH Wide WH Wide Silver Wide WH Wide WH Wide Silver Wide WH Wide WH Wide HiPPI Switch WH Wide WH Wide Silver Wide WH Thin WH Thin WH Thin WH Thin Silver Wide WH Thin WH Thin WH Thin WH Thin Silver Wide WH Thin WH Thin WH Thin WH Thin Silver Wide WH Thin WH Thin Silver Wide Silver Wide Gig-E Switch 8 STK 9840 Tape Drives 8 STK 9840 Tape Drives 8 STK 9840 Tape Drives 8 STK 9840 Tape Drives High Performance Gateway Node (HPGN) SP Switch ATM Switch RAID RAID 8 IBM 3590 Tape Drives 8 IBM 3590 Tape Drives SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID Mass Storage (HPSS) Configuration 6 TB SSA Disk StorageTek Tape Libraries 100Mb Network To Terascale Computer 830 GB MaxStrat Disk Array
HPSS Configuration • SP system with 20 nodes; 8 silver wides, 4 Winterhawk wides, and 8 Winterhawk thins • Direct network connectivity through 100Mb ether, GB ether, and HiPPI. ATM via HPGN. • Close to 7 TB of disk as SSA raid or MaxStrat raid • 48 tape drives; 16 IBM 3590 and 32 STK 9840 • Striping essential to required performance
HPSS WH Node HPSS WH Node HPSS WH Node HPSS WH Node NH Node “Router” NH Node “Router” NH Node “Router” NH Node “Router” 8 way striped data transfers to HPSS Terascale SP2 HPSS Gig-E Switch 9840 Tape Drives SP Switch
Striped Data Transfers to HPSS • Machines are logically sub-netted at the router • Terascale machine organized in 4 network ‘quadrants’ • HPSS servers divided across 2 networks • “Router” nodes do network I/O to hpss on behalf of remaining nodes in a quadrant. • Striping is dependent on GPFS
NH Node “RVSD” NH Node “RVSD” RIO “RVSD” RIO “RVSD” RIO “RVSD” RIO “RVSD” SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID SSA RAID 12 RVSD servers (6 redundant pairs) A B A B A B A B A B A B A B A B A B A B 60 Drawers of [ 3 x (4+p) raid + HS ] = 960 x 36GB disks
RVSD Server Configuration • 12 RVSD servers in the system in 6 redundant pairs • Each server drives 5 drawers of disk as primary with 5 additional during failover • One drawer per loop configured as three 4+p arrays with a hot spare disk • Total of 60 drawers of 36GB disks (960 disks)