110 likes | 221 Views
Visible Human. Networking Update Thomas Hacker June 3, 2000. Outline. Latest News U-M Network Connectivity Existing CPC Network Topology Proposed CPC Network Topology Performance Improvement Program NPACI Storage Resource Broker Performance Goals. Network Status. In the works …
E N D
Visible Human Networking Update Thomas Hacker June 3, 2000
Outline • Latest News • U-M Network Connectivity • Existing CPC Network Topology • Proposed CPC Network Topology • Performance Improvement Program • NPACI Storage Resource Broker Performance • Goals
Network Status • In the works … • CPC Upgrade from OC-3 155Mbps to OC-12 622Mbps • CPC Router Purchase • OC-12 line installed from Media Union to Arbor Lakes, needs some tuning to improve performance
University of Michigan Network Topology VBNS/Abilene Research Commercial/Net X Cleveland POP GW Quin VBNS Abilene NSI Mich NET DOE MERIT BIN Mich Giga PoP DREN OCR UM BIN FDDI 300-450m 17m OC-12 1000Mb/sec gigabit ethernet OC-12 FW FW Firewalls ITD FDDI CAEN MCIT OC-12 CPC 1 2 3 4 5 X
4 Processor 2 GB Multi-Resident/ Resident AFS Mass Storage Server IBM F-50 Existing CPC High Performance Network Topology 5/2000 144 GB Local Disk FWD SCSI Existing ADSM Mass Storage Server 1 Processor 1 GB Mem New ADSM/Tivoli Robotic Tape Controller IBM F-50 DIFF SCSI IBM 3995 288 GB CD-R Juke Box FWD SCSI Existing ADSM Robotic Tape Controller 1 Processor 512 Mb Mem CPC IBM SP2 Complex STK Timberwolf 9710 41 TB Switched 10 BaseT SP2 Control Workstation (48) 66 MHz Nodes Switchless (Training Nodes) 48 Switched 10 BaseT Lines 100 Mb/sec FDDI SGI Powerchallenge 4 GB, 16 Processors 100 Mb/sec FDDI 100 Mb/sec FDDI Switched 10 BaseT SP2 Build/ Submit Node CISCO CDDI/FDDI Concentrator (48) 166 MHz Nodes (Production 1 GB Mem Nodes) IBM NPACI Globus Research Server 100 Mb/sec FDDI 100 Mb/sec FDDI UMMU-CIS7513.9 48 Switched 100 BaseT Lines 100 Mb/sec FDDI CPC-CISCO 5500 mr CPC CISCO 5500 Ethernet Switch OC-3 ATM 155 Mb/Sec Switched 100 BaseT (64) 166 MHz Nodes (SDSC) June 2000 (16) 166 MHzNodes (SDSC) June 2000 OC-3 ATM 155 Mb/Sec Switched 100 BaseT Switched 100 BaseT Lines UMMU-CIS 1010 Media Union ATM Switch CISCO Lightstream 1010 2 Processor 2 GB Mem New Nodes SP2 Control Workstation IBM F-50 4 EtherChannel Bonded Switched 100 BaseT Lines LINUX Cluster Firewall UMMU-cis7513.9 4 EtherChannel Bonded Switched 100 BaseT Lines 2 Processor 2 GB MemNew ADSM/Tivoli Mass Storage Sever IBM F-50 NPACI AFS Storage Server IBM F-50 2 Processor 2 GB Mem New Tivoli/ADSM Backend Server + Engineering Research Host Backup IBM H-50 48 port 10BaseT Hub ATM OC-12 622 Mb/sec 32 10 BaseT Lines Chry-CIS 1010 Chrysler ATM Switch CISCO Lightstream 1010 CPC BEOWULF LINUX Cluster 4 Processor 2 GB Mem Network Performance Measurement Station IBM F-50 Dual Ppro 200 MHz 128 Mb RAM per node FWD SCSI LVD SCSI LVD SCSI 2 Ether-Channel Bonded Switched 100 BaseT Lines 2 Processor 1 GB Mem New ADSM/Tivoli Robotic Tape Controller IBM F-50 LVD SCSI 32 Switched 100BaseT Lines OC-12 To Abilene 622 Mb/sec 216 GB Dual Channel RAID 1 100 GB ADSM Data Vole 144 GB RAID 1 CISCO 2900XL 10/100 Switch SGI 12 GB, 16 Processors SGI Origin 2000 Switched 100 BaseT Line CPC Beowulf Complex 200 GB Backup/Archive
2 Processor 2 GB Mem SDSC Nodes SP2 Control Workstation IBM F-50 4 Processor 2 GB Multi-Resident/ Resident AFS Mass Storage Server IBM F-50 Proposed CPC High Performance Network Topology 216 GB Dual Channel RAID 1 LVD SCSI 100 GB ADSM Data Vol 1440 GB Sun A1000 Disk UMVH Production Prototype Compaq Cluster Storage Technology Timberwolf 9710 DLT Tape Silo 41 TB 2 Processor 2 GB Mem New Tivoli/ADSM Backend Server + Engineering Research Host Backup IBM H-50 FWD SCSI FWD SCSI LVD SCSI 200 GB Backup/Archive FWD SCSI ADSM/Tivoli Mass Storage System (42 TB) 4 Processor 2 GB NPACI AFS Server IBM F-50 ADSM/Tivoli Robotic Tape Controller 2 Processor 1 GB IBM F-50 LVD SCSI 144 GB RAID 1 • 588 DLT7000 Tape Cartridges • 6 DLT7000 Tape Drives CPC IBM SP2 Complex IBM F-50 SP2 Control Workstation Switched 10 BaseT 1000 Mb/sec Gigabit Ethernet (48) 66 MHz Nodes Switchless (Training Nodes) 1000 Mb/sec Gigabit Ethernet 1000 Mb/sec Gigabit Ethernet 1000 Mb/sec Gigabit Ethernet Switched 10 BaseT 48 Switched 10BaseT Engineering ATM Cloud - or - To ITD-Cooley ATM Switch SP2 Build/ Submit Node Arbor Lakes ATM Switch (48) 166 MHz Nodes (Production 1GB Mem Nodes) Media Union ATM Router OC-12 622 Mb/sec 1000 Mb/sec Gigabit Ethernet OC-12 622 Mb/sec OC-12 622 Mb/sec 48 Switched 100BaseT Abilene CISCO 6509 Router Switched 100 BaseT CISCO 5500 Ethernet Switch (64) 166 MHz Nodes (SDSC) June 2000 (16) 166 MHzNodes (SDSC) June 2000 4 EtherChannel Bonded 100 Mb/sec Switched Ethernet 1,000 Mb/sec Gigabit Ethernet 1,000 Mb/sec Gigabit Ethernet Switched 100BaseT Lines UMVH SGI OCTANE Webserver 2 EtherChannel Bonded 100 Mb/sec Switched Ethernet 1,000 Mb/sec Gigabit Ethernet Nodes 1000 Mb/sec Gigabit Ethernet 1,000 Mb/sec Gigabit Ethernet LINUX Cluster Firewall 4 Processor 2 GB Mem Network Performance Measurement Station IBM F-50 SGI Origin 2000 Media Union SGI Onyx2 48 port 10 baseT Hub OC-48 CPC BEOWULF LINUX Cluster SGI Power Challenge Server Dual Ppro 200 Mhz 128 Mb RAM per node OC-12 36GB AFS Disk Gigabit Ethernet CISCO 2900XL 10/100 Switch FW SCSI 32 Switched 100BaseT Lines SGI 12 GB, 16 Processors SGI Origin 2000 CPC Beowulf Complex SGI 4 GB, 16 Processors SGI Origin 2000 1000 Mb/sec Gigabit Ethernet
High Performance Networking Upgrade Program Approach Application: Training, ImBench performance testing User training & consulting to optimize application utilization of network (Matt Mathis–PSC/NLAR TCP testrig) System: Network performance testing & tuning Move from 10/100 G.E./ATM Platform Optimize facilities and operations use by performance tuning & host network adapter upgrade Network: Move from OC-3 OC-12 Upgrade physical infrastructure Current Applications That Will Immediately Benefit From Upgrade Program • NPACI Storage Resource Broker/ Reagan Moore – Data Intensive Computing Environment Thrust Area • University of Texas/University of Michigan SP2 system integration collaboration AFS file system, joint job scheduling, Engineering Materials Database sharing • Multi-resident AFS wide area mass storage file systems (AFS server that utilizes mass storage system) Applications • Job scheduling/moving large multi-gigabyte files between NPACI and National HPC sites/Grid computing infrastructure (Globus, Legion, Linux Clusters) • NPACI thrust areas: Engineering/Education, Outreach and Training/ ISR-Social Science • Visible Human/NPACI Neurology Collaboration/ • Brian Athey @ U-M; Human Cochlear Modeling, Ed Givelberg @ U-M; Mark Ellisman @ UCSD,
Application Data Transfer 1st Read File System File System Virtual Memory Dependent on File System “dirty page” Policy Write File System BW 2nd File System Read Cached File System Read B/W bcopy Memory Read B/W Disk B/W 1st File System Read Write Virtual Memory B/W Time for Application to Process Data Application Time for Application to Process Data Application Network Socket TCP/IP Measure TCP/IP Loopback Network B/W Measure TCP/IP Loopback Network B/W TCP/IP B/W Network Interface Card Network Interface Card Router Router Link Characteristics – Link B/W – Link RTT – Link Packet Loss Router Router Router Router Router • Bi-Directional B/W • Route Stability “Bi-Directional” • Latency (RTT) • Path Length (Hops) Internet Characteristics DataTransfer.ppt
Networking Goals • Get new router and tuned OC-12 connection in place • Move critical servers and HPC systems to gigabit ethernet • Develop system, network and internet performance tuning toolset and expertise to optimize use of resources