320 likes | 488 Views
SUNet the Stanford University Network. Presentation for the Internet2 Campus Networking Workshop. A brief history of SUNet. Originally a research project of EE, CS and Medical grad students Networking staff assembled in 1983 Centrally funded since 1984 Cable plant project in 1985
E N D
SUNet the Stanford University Network Presentation for the Internet2 Campus Networking Workshop
A brief history of SUNet • Originally a research project of EE, CS and Medical grad students • Networking staff assembled in 1983 • Centrally funded since 1984 • Cable plant project in 1985 • Responsible for operations since 1986
Backbone technology evolution • 3Mb ethernet from Xerox PARC ~ 1979 • Large bridged ethernet - DEC bridges 1986 • Campuswide FDDI ring 1990 • Multiple FDDI rings from Cisco 7513 1995 • Initial fiber install in 1985 - 12 MM • Latest trunks: 96 MM/48 SM
In-building wiring • Complete spectrum down to 3-pair RJ-11 • New buildings get at least 2 Cat-5 network jacks along with 2 Cat-3 phone wires • Centrally funded wiring improvement project - recently approved - requires matching departmental investment in activation
SUNet design parameters • TCP/IP only supported backbone protocol • Appletalk is tunneled with Fastpaths • Medical Center routes IPX/Appletalk • DECNET still on in several routers • Networking supports to building entrance • Local Network Administrators in buildings • Network consultants assist LNAs
Network components • 49 routers from Cisco • 3 7513, 2 7507, 6 7000, 4 7206, 5 4700 • 7 2501, 1 2514, 1 3000 • and still 9 AGS+, 10 AGS, 1 CGS • FDDI concentrators from DEC • FastEthernet switches: Catalyst 5000/5500 • ATM switches: LS1010
SUNet statistics 970914 • From NetDB, the network database • Generates DNS and BootP tables • 442 subnets defined, 342 active • 327 physical subnets • 240 main campus, 87 Medical Center • 33866 hosts, 35445 addresses • 24749 campus hosts, 9117 Medical Center
BBN Planet (and beyond….) UCnet SUNet DMZ ACE workstations ACE/AFS servers Core Cisco 7513 Student ACE AFS Engineering Med Admin servers General MedNet GSB GSB
CERAS AGS+ Res 4700 Res-West 4700 Res-South 4700 Res-Central AGS+ Sweet 7507 Jenkins AGS+ SUNet Backboneas of early 1997 Gates 1 7000 Gates 2 7000 CIS AGS+ SUNet 7000 BBN Planet DMZ 4700 Varian AGS+ DMZ FDDI AFS/DCE Servers InfoSci AGS+ Med 7206 CORE ACE Servers Med Center 7513 FDDI GSB-DMZ 4700 FDDI MedNet AGS+ FDDI FDDI GSB-DMZ 4700 NCS 7000 Encina AGS+ Quad 7206 Press 7000 Pine 7507
Next generation requirements • Migration from Mainframe to distributed computing model for Admin systems • Choice of DCE as standard platform • Higher bandwidth for image transfer, etc • Increased reliability as well as capacity
Next Generation choices • ATM seemed likely even 18 months ago • New routers were ordered with ATM • New Computer Science building provided early implementation experience for both LANE and FastEthernet VLAN trunking • Sought advice from Cisco Consulting Engineers
Proposed ATM backbones ATM switch ATM switch ATM switch ATM switch ATM switch ATM switch ATM switch ATM switch
Concerns with ATM design • Redundancy vs. Interface expense • Total throughput • Staff education on a new technology
N-dimensional mesh network • Proposed by Cisco’s Roger Beeman • Designed to have well defined expansion • Multiple paths provide aggregate capacity • Significant redundancy makes individual components less critical • Networks on corners • 2-way routers on edges or 4-way routers on faces
4-way connected routers on faces • 3-D (cube) : 8 networks, 6 routers • 4-D (hypercube): 16 networks, 24 routers • 5-D: 32 networks, 80 routers
The SUNet choice - a cube • Attracted by the combination of redundancy and expandable capacity • Have purchased 6 7513s with 4-VIP2s with 100FX port adapter each • Have purchased 4 Catalyst 5000s with 2 12x100FX boards, each will be two corners (using VLANs)
SUNet cube backbone layout and addressing Pine Forsythe Sweet Press .3 0 2 4 6 .35 .97 .98 .2 .33 .65 .99 .34 .66 .35 .1 .33 5 3 .2 .67 .51 .115 .3 .98 1 2 .114 .19 .49 .65 .97 4 .83 6 .18 .17 .81 .82 .18 .50 .113 .83 .82 .49 1 .115 3 5 7 .51 .81 .114
Connections to the cube • User routers connected to at least two corner networks • Server nets directly connected to two backbone routers using HSRP <or> • Server router directly connected to two opposite face backbone routers • Three “hotspots” - ACE servers, Admin servers and Off-campus/Internet
User router choices • Planned to serve multiple networks per router interface using VLANs and Catalysts • Now planning to use router module (RSM) in Catalyst 5500 and feed Catalyst 5000s • Have ordered several to replace remaining AGS+ routers • Will use Catalyst 3200 replacing AGS “departmental routers”
SUNet Cube Backbone User routers R Commercial Internet R Legacy routers FE FE FDDI R R Router to BBN R R FE FE R R FE FE R CalREN-2 Gigapop R FE FE R R User routers
Organization • ITSS - Information Technology Systems and Services • CCS - Computer and Communications Services • Networking Systems - centrally funded • Production Services - Operations/Systems • SUNet Operations
Responsibilities • Backbone routers • End-to-end TCP/IP protocol • Network to the building entrance • Run network servers (DNS, DHCP, etc) • Support network consultants/LNAs
Support profile • Onsite staff - 7am - 11pm Monday-Friday • Weekend - 8 hours/day • On call support 7 by 24 • Off hour trouble calls taken by Computer Operations staff who page on call person
Staffing level • Operations has 5 Network Specialists and 3 Systems Programmers • Systems has 2 SysAdmins, 2 generalists • One network specialist/one sysadmin work the late shift (3pm-11pm)
Multicast • Currently using PIM dense mode • Works in 11.0 AGS routers (if no loops) • Plan to deploy in new backbone • SCPD (SITN) Engineering classes • Library - supplement class videotapes • Conferencing with remote sites
Network monitoring • DEC MSU / Remedy Health Profiler • IBM Netview 6000 • Perl scripts • Ethermeters / RMON
Traffic/usage data • Have been using Cisco’s Netflow Export - looks very promising • Other products being examined
Challenge of Internet2 • More of a co-operative than NSFNET • Trouble ticket generation/responsibility • Service level commitment between members? • Chance to use the technology!
9/8/97 CSDCF Gates Building Network 21ea. Cisco Catalyst 5000 1000 10BaseT ports, 80 100BaseT ports, 20VLans …. Cisco 5000 …. Cisco 5000 Cisco 5000 To 7 Catalyst 5000 4ea. 100MB connected to C5000 10ea.10MB ether ports connected to C5000 To 21 Catalyst 5000 Cisco LS1010 155MB ATM BBone . . . . . . . . . . ... ... ... ... ... ... Cisco 7513 Router Cisco 5000 100MB Vlan BBone OC3 ATM Campus Backbone FDDI 100
Gates VLAN Connections 9/8/97 CSDCF G Cat-3-1 G Cat-4-1 G Cat-1-1 G Cat-2-1 G Cat-0-4 G Cat-5-1 G Cat-3-4 G Cat-4-4 G Cat-1-4 G Cat-2-4 G Cat-0-2 G Cat-3-2 G Cat-4-2 G Cat-1-2 G Cat-2-2 G Cat-0-1 G Cat-3-3 G Cat-4-3 G Cat-1-3 G Cat-2-3 G Cat-0-3 VLAN 1: 171.64.70.10 - All GCATs VLAN 41: 171.64.64.10 VLAN 3: 171.64.65.10 VLAN 4: 171.64.67.10 VLAN 5/45: 171.64.68.10 VLAN 6: 171.64.71.10 Cisco LS1010 Cisco 7513 Router
Gates VLAN Connections 9/8/97 G Cat-5-1 G Cat-3-1 G Cat-4-1 G Cat-1-1 G Cat-2-1 G Cat-0-4 G Cat-4-4 G Cat-3-4 G Cat-1-4 G Cat-2-4 G Cat-0-2 G Cat-3-2 G Cat-4-2 G Cat-1-2 G Cat-2-2 G Cat-0-1 G Cat-3-3 G Cat-4-3 G Cat-1-3 G Cat-2-3 G Cat-0-3 VLAN 7: 171.64.72.10 171.64.73.10 VLAN 8: 171.64.75.10 VLAN 9: 171.64.76.10 VLAN 11: 171.64.66.10 100MB VLAN 12: 171.64.74.10 100MB VLAN 13 171.64.77.10 100MB Cisco LS1010 Cisco 7513 Router
Gates VLAN Connections 9/8/97 G Cat-3-1 G Cat-4-1 G Cat-1-1 G Cat-2-1 G Cat-0-4 G Cat-5-1 DHCP Public VLAN VLAN 19 Experimental ATM ELAN 30 G Cat-3-4 G Cat-4-4 G Cat-1-4 G Cat-2-4 G Cat-0-2 G Cat-3-2 G Cat-4-2 G Cat-1-2 G Cat-2-2 G Cat-0-1 Vlan 16 Firewall Net(Cheriton) G Cat-3-3 G Cat-4-3 G Cat-1-3 G Cat-2-3 G Cat-0-3 VLAN 17 Mosquito Net(Baker) VLAN 13: 171.64.77.10 VLAN 14/16: 171.64.79.10 100MB VLAN 15: 171.65.XX.XX VLAN 17: 171.64.67.10 VLAN 19: 171.64.70.128 ELAN 30:: 171.64.70.128 ELAN 45: 171.64.68.10 Repeater from Med Center VLAN 15 Cisco LS1010 Cisco 7513 Router