Switch Router Design & Implementation

1. Switch Router Design & Implementation Paul C. Huang, Ph.D. ITRI / CCL / N300 pchuang@ccl.itri.org.tw

2. Teaching Staff • Lecturer • 黃肇嘉 (pchuang@ccl.itri.org.tw) • MIT Generalized Oversampled A/D Converter EECS BS / MS ‘87 • U. Tokyo Multicast Routing Algorithms EECS Ph.D. ‘94 • Bellcore Optical Switch / Optical Transceiver / High Speed Mux • CCL LAN switching • Teaching Assistant • 魏煥雲 (gis87517@cis.nctu.edu.tw) • 張政賢 (chchang@cis.nctu.edu.tw) • Guest Lecturer • 王耀宗 Switch-Router Testing Methodology • 呂國正 Verilog Implementation of Routing function

3. Course Grading • Assignment Load • 25% 3 sets of Homework assignments • 30% 2 sets of Labs • 15% Presentation • 30% Final Project • Grading Policy • Quality, not quantity • Innovativeness • Late penalty (15% daily, including weekends & holidays).

4. Course Schedule • (2/24) Course Introduction • General communications network basics • Network market reality (success / failures) • Evolution towards Switch Router: Why, Where, When, and How • (3/3) The Basic Requirements of Switch Router • IEEE / IETF overview • Current System and IC product features & specification • Current IC product architecture • (3/10) Switch-Router Architectures • Switch architecture • IEEE 802.3 (10/100/1000 Mbps MAC) • IEEE 802.3x • (3/17) Switch-Router Testing Methodology(王耀宗) • Lab I: L2 Performance / Functionality Testing

5. Course Schedule • (3/24) Traffic Management & Implementation Issues and Pitfalls • Understanding Traffic Management (RSVP, DiffServ, QoS, Buffering, Routing, Scheduling) • Buffer Mgt • (3/31) Traffic Management & Implementation Issues and Pitfalls • Queue Mgt. • Scheduler • (4/7) Routing Implementation Issues and Pitfalls • Route Forwarding Techniques • Implementation Issues at Gbps • Example Implementation • (4/14) Verilog Implementation of Routing function (呂國正) • Lab II: L3 Performance / Functionality Testing

6. Course Schedule • (4/21) Routing Algorithms • Basics of Routing • Classification of Current Routing Algorithms & Protocols (Unicast / Multicast) • (4/28) Implementing Unicast Routing Functions • Interior Routing Algorithms (RIP) • Interior Routing Algorithms (OSPF) • Exterior Routing Algorithms (BGP) • (5/5) Implementing Multicast Routing Functions • (Multicast Routing (DVMRP) • Multicast Routing (PIM) • Multicast Routing (CBT) • (5/12) Advance Routing Topics • ATM Routing Protocol (NHRP) • Policy-based / CoS / QoS Route • Final Project:

7. Course Schedule • (5/19) Project presentation • (50 min / group): Total 3 groups. • (5/26) Project presentation • (50 min / group): Total 3 groups.

8. Industry focus Market reality Standards process Product concepts Knowledge focus Networking fundamentals Testing fundamentals Actual design trade-offs Design concepts Additional benefits English comprehension Interactive (hopefully) Unfocused on … Not presentation of protocols Not theoretical Not number crunching Course Benefits Thanks for being my guinea pigs

9. Teaching Philosophy Confucius (Eastern) Socrates (Western) Knowledge Knowledge

10. Network Engineering Why are you interested ? How is it different ? Is it your cup of tea?

11. Taiwan’s Industry • IT • PC Motherboard • PC Manufacturer • Notebook • PC Peripheral • Modem / NIC • Add-on Cards (Graphics) • Scanner / Digital Camera • Monitor / LCD Monitor • DataComm • 10/100/1000 NIC • Dual Speed Hub • L2 Switch • SOHO Router • Wireless LAN • Systems Integration • Switch-Router • DSLAM • Access Switch • Software • Internet Middleware • OS • Protocol • Applications • CPE • Telephone • KTS • TeleComm • xDSL Modem • Cable Modem • Cellular Phone • DLC / HDSL • RAS • IC Design House • PC Chipset • Network Chipset • Consumer IC • Memory Foundry LCD Opto-Electronics

12. Telecommunications Scalability Reliability Data communications Compatibility Standards conformance Information Technology Manufacturing Cost Logistics Foundry Manufacturing Cost Yield Process Test Equipment Accuracy Speed Completeness Manufacturing Equipment Flexibility Reproducibility Mobile Miniaturization Low power Wireless SNR Error recovery Key Engineering Skills

13. Theoretical Mathematics / Physic Algorithmic Modeling Design Power Analog Circuit Digital Logic Software Architectural Protocol Fundamental Engineering Skills

14. Key Engineering Value • Intellectual Property • Patents, copyright, trade secrets • Service Differentiation • Functional • Management • Content • Information • Knowledge

15. The Value Chain in Networking has Changed Chips Software System Design & Integration Manufacturing Distribution Chips Software System Manufacturing Distribution • Already Happened in the PC Business • Intel makes the chips; Microsoft makes the software. • Dell and Compaq focus on manufacturing, relentless cost cutting, and distribution, not R&D • Little system-level innovation, few new system startups • Plenty of silicon innovation; plenty of silicon startups • Shift from managing scarcity to creating abundance

16. Porter’s Industry Attractiveness Model Threat of Competitor Industry Attractiveness Supplier Power Customer Power Threat of New Entrant

17. 10/100M NIC Single Chip N-Way Switch Single Chip 8/16 ports 1998 1999 2000 Dual-speed Hub Single Chip 8/12 ports Layer 3 Switch 8/16 ports 國內 Networking IC 現況 • 網路 IC 戰雲密佈, MB/NIC 卡爭鋒, 瑞昱. 旺宏. 聯傑. 威盛. 上元. 民生. 大智. 矽統及華邦等開始 10/100 Mbps 單晶片量產供貨 • 雙速集線器 IC 定位成功, 宏三乘勝推出 8 埠新產品, 耘碩. 聯傑. 上元. 凱訊. 亞信. 旺宏. 瑞昱等網路 IC 設計公司打算推出三合一集線器晶片 • 亞信於台北電腦展展出八埠 N-Way Switch 的嵌入式 DRAM 網路晶片, 此顆 IC 內含 32 位元 RISC 及 2MB SDRAM • 瑞昱量產網路交換器 IC, 首批國產四埠交換器 IC 月產能已超過一千顆 (87/12) • 上元科技推出台灣第一顆八埠交換器整合單晶片 (87/12) • 聯傑購併美商 NETio 獲得先進交換器晶片技術, 目前正研發二埠和八埠高速以太交換器晶片 (88/1)

18. Octal Port Layer 3 Switch 8 +1 Layer 3 Switch Quad Port Gigabit Layer 3 Switch IP NIC 3 in 1 NIC Hub Contr.. Single Speed Hub 3 in 1 Dual Speed Hub 3 in 1 Dual Port Switch Octal Port Switch 8 +1 Layer 2 Switch Quad Port Gigabit Switch MAC PHY Single PHY 2 in 1 Quad PHY PHY TXVR Transceiver 10Mbps 100Mbps 1000Mbps Product Line of Ethernet LAN IC

19. Network Technology Creating abundance Velocity of change

20. Technology Pace has Exploded Technology Explosion Technology Applications CPU / DSP Chips 2D / 3D Graphics Engine Memory (Rambus) LCD Displays 10 / 100 / 1000 Ethernet Multi-Layer Ethernet Switch xDSL (G.Lite, ADSL, VDSL, etc.) Cable Modem Terabit Switch-Routers Dense WDM Focus on Technology Innovation, Not Technology Invention Transistor IC Processing / Lithography Technology Analog IC Design (Spice Modeling) Technology Creation Technology Creation Technology Creation A/D Conversion Computing Technology DSP Algorithm Digitization Software Technology Networking Technology Packet / Cell Switching Optical Fiber / Laser Technology Material Science

21. Technology Creating Abundance • Chipsfor networking have twice as many gates every 18 months, thanks to Moore’s Law. • We can build network systems on a chip for minimal incremental cost or “free”. • We can pack billions of DSP ops/sec on a chip. We • We can route 10s of millions of packets/sec on a chip. • Opticsperformance doubles every 12 months. Twice as many wavelengths on the same fiber every year. Eventually, that changes everything. • Packet switching (IP)is taking over everywhere. Fundamental packet technology performance is doubling every 12 months, outpacing alternatives. outpacing alternatives.

22. $45 $40 $35 $30 $25 $20 $15 $10 End’97 Mid’98 End’98 Mid’99 L2 through L7 Managed L2 Moore’s Law Meets Network ICs • Cost is dropping to $15/port • Full L3 and L4 routing, QoS, accounting, etc. “for free” • New standards like DiffServ, RSVP, H.323, IPsec, can all be handled with the same chips at the same cost • Total Bill of Materials for 10K boxes/month Source : MMC networks

23. OC-192, 32l OC-48, 96l OC-192, 16l OC-48, 48l OC-192, 4l 135 Mbps 565 Mbps 1.7 Gbps OC-48 OC-192, 2l DWDM: A Breakthrough Technology 350 300 250 200 150 100 50 0 Doubling Each Year: 2000: OC-192, 80 l 2001: OC-192, 160 l 2002: OC-192, 320 l 1982 1983 1984 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 1997 1998 1999 System Capacity (Gbps)

24. Demand Growing Faster than Technology Basic technology Performance doubling time Moore’s Law -gates/chip 18 months; 59% / yr. Optical fiber - bps/fiber 12 months; 100% / yr. Packet switching - $/bps12 months; 100% / yr. Basic demandTraffic doubling time Internet users 12 months; 100% / yr. Data bits7.5 months; 300% / yr. Internet core4 months; 1,000% / yr.

25. The SONET Era “Free” local calls, expensive long distance Circuit/TDM model Transmission was king;efficiency was key. Service was based on multiplexing Data used existing transmission Few, legacy carriers with legacy nets Managing scarcity The WDM Era Expensive access to “free” backbone Packet model Switching is king; features are key Service is based on internetworking Data demands new transmission Thousands of new carriers with new nets Creating abundance Changing of the Era: SONET  WDM

26. Original Assumptions IP routing is based on destination address Routers can maintain only a few queues per port Fast switching must be very simple Signaling, traffic management should be done only at call setup Very fast switching requires fixed length cells Cell and frame networks are very different New Assumptions Can route on SA, DA, port, URL, DS types, etc. Routers can have tens of thousands of queues Chips can be application-aware, still run at many Gbps Its possible to do shaping, policing, WFQ, NAT, tunneling for each packet It is no harder to switch a packet than a cell In hardware, cells and frames are interchangeable. Changing of the Era: Network Processor

27. Changing of the Era: Packetization This transition is as fundamental as the shift from analog to digital

28. Telco Business Model Regulated monopolies Protected local / domestic markets High barriers to entry Pricing based on usage Smart network Stupid end devices Profits generated by managing scarcity Internet Business Model Unregulated providers Global market with global competitors Low barriers to entry Pricing based on access Stupid network Smart end devices Profits generated by creating plenty Changing of the Era: Service Networks

29. Network Service Paradigm Shift New business model

30. Biggest Driving Factor: Internet Traffic Growth assumes more real-time services including multicast Users(Millions) Usage Sizes (KB) Annual Packet Traffic (Billion Packets) 5000 100-500,000 200 4,000 - 20,000x 5,000x 40x 35 5 1000 50 25 1 1990 1995 2000e E-Mail WebHome-PageSurfing** Web,VideoInfomercialUsage*** 1990 1995 2000e * Presumes growth in PC-installed base from 1995’s 60 million to 2000’s 475 million ** 5KB/page x 10 Web pages per user** 500KB/seconds x 10 seconds Source: IDC, Zona Research, Literature Searches, Team Analysis

31. Internet’s Exponential Growth & Changes

32. The Current PSTN Model Potential Competitors Baby Bells, GTE Connectionless Signaling Network SS7 Connection-Oriented Bearer Network 4ESS, 5ESS Thin Clients Thin Clients

33. The Current Internet Model Potential Competitors 1000’s ISPs, Telcos, HiNet IP Routers Connectionless Bearer Network Thick Client Thick Client Connection-Oriented Transport Network SONET, ATM

34. A Possible Future Model Potential Competitors AT&T (@Home), WorldCom (UUNet), AOL, DirectPC Internet Connectionless Signaling Network Thick Client SS7-Aware Gateway • Connection-Oriented • Bearer Network • Application Specific • VPN Capable Future Nets Thin Clients

35. Another Possible Future Model Potential Competitors Qwest, Level 3, Delta Three, Concentric, IDT, Bigger Faster Internet Thick Client SS7-Aware Gateway Connectionless Signaling Network & Best-effort Data Delivery • Connection-Oriented Services: • IP Telephony • VPN Capability • Assured Data Delivery Thin Clients

36. Enterprise Protocol IP / IPX / SNA Enterprise Transport Ethernet ATM / FDDI / TR Conventional Voice (PBXs & phones) Analog IP / ATM Frame Relay Access: Protocol Users want choice and interoperability Access: Physical Cable xDSL / ISDN SONET / SDH Satellite / Wireless Internet provides Network Intelligence Access Applications provide the Network Services Edge Core TeleComm / Cable / Wireless provides the Access and the Transport Network Architecture

37. Network Convergence Voice Video SNA TDM RAS Core Core Wireless Voice ISDN Data EDGE Service Specific Vertical Integration from Access to Core Core • Deregulation • Technology • The Internet • Global Commerce Frame Relay FTTx HFC Data EDGE IP ATM Voice Voice Copper VPN Video Core Core Intranet Data Data Any access technology on a Common Edge/Core Architecture offers great flexibility while reducing cost

38. Content Managed Intranets Electronic Commerce VPN Services Internet Services Frame Relay, Cell Relay Leased Line Services 10% 7% 10% 3% 20% 25% 25% 30% 1997 2000 25% 45% Service & Content Revenue Trends Private Services Public Services Increasing Value Functional Differentiation Quality and Cost Relative income from basic services decreasing - value added services key to profitability

39. The new business driver . . . THE CUSTOMER IP/ATM Services Regulated Environment Standards Bodies Manufacturers Service providers Customers New Competitive World ISDN The market, not regulators decide on standards today

40. Market Success / Failures Why do some succeed & some fail ?

41. 1969 1973 1979 1981 1982 1983 1985 1986 1987 1988 1989 1990 1991 1992 1993 1994 1995 1996 Networking : A Technology Timeline Fore and NET/Adaptive, among others, announce first ATM switches; roughly $5000 per port Novell demonstrates first networked PC LAN IBM introduces 16Mbps token ring adapter Sun introduces Iava Robert Metcalfe found 3Com IBM announces 4 Mbps token ring $830 per node Frame Relay Forum founded Bay Networks established Arpanet opens; 50 kbps, 4 hosts IETF established ATM Forum established Robert Metcalfe and David Boggs build first Ethernet; 2.944Mbps over coax Cisco ships AGS router Ipsilon Networks ships IP switching Kalpana ships first Ethernet switch; $1450 per port IEEE approves 802.3 Ethernet Alteon demos first gigabit Ethernet switch and adapter Synoptic ships first Ethernet hub IEEE splits work on fast Ethernet into two groups, 100Base-T and 100VG 3Com ships first 10Mbps Ethernet adapter; $950

42. Market Tradeoffs Cost Functionality Time to Market Winner == Right Product at the Right Time at the Right Cost

43. Strategies and Corresponding Value Propositions Market Segment Vendor-Created Market-Created 1 3 Innovative Evolution Breakthrough Product 2 4 Replicative Differentiation Reposition

44. Department Division SBU Corporate Broadband Network Market Application CPE DataComm provides Network Intelligence Enterprise Networking Internet Backbone SOHO Networking CO / Cable RAS (Copper, Cable) SONET / DWDM TeleComm / Cable / Wireless provides the Access and the Transport

45. LAN vs. WAN

46. Need more Functionality (VLAN, Multicast, Routing, etc.) Ethernet Switch Bridge Router Need for Lower Cost, Higher Bandwidth Bridge vs Router • Available Approaches • Big Fast Router • Layer 3 Switch Router • IP Forwarding Switch • MPLS / IP Switch • ATM Switch • ??? “ASICs are the technology enabler. Like the introduction of the microprocessor, new chips will revolutionize the networking industry.” -- David House (Chairman, President, and CEO of Bay Networks)

47. LAN Standards IEEE 802.2 LLC Data Link Layer 802.3 CSMA /CD LAN 802.4 Token Passing Bus LAN 802.5 Token Passing Ring LAN 802.6 Dual Bus Distributed Queue Public LAN 802.11 Wireless LAN 802.12 Demand Priority LAN 802.14 Cable TV WAN ANSI FDDI I & II Campus MAC PHY

48. IP IP Ethernet Ethernet Frame Switch Frame Switch IP ATM ATM ATM ATM IP Ethernet Cell Switch Cell Switch Cell Switch Cell Switch Cell Switch Frame Cell IP Ethernet ATM Frame ATM Cell Frame Cell High Speed Networking 10 / 100 Ethernet Access Gigabit Ethernet Backbone IP Edge Hub IP Switch Backbone IFMP, GSMP, TDP ATM Edge Hub ATM Switch Backbone IPOA, LANE, MPOA CIF Edge Hub ATM Switch Backbone ATM Edge Switch ATM Switch Backbone

49. Integrated Routing 3. Multi-Layer Switching Model (Tag Switching, MPLS) 2. Integrated Model (IP Switching) Layered Routing 1. Overlay Model (MPOA) Simplified addressing, Separate routing (NA) Subnet Addressing Peer Addressing IP Switching Model

50. A Taxonomy of IP Switching Solutions IP Switching Peer Overlay Layer 3 Switch Flow Topology Flow Address Resolution Layer 4 Switch IFMP/GSMP Tag Switching MPOA Classical IP Gigabit Routers CSR/FANP ARIS LANE Terabit Routers IP Navigator NHRP QoS Router VNS MARS MPLS RFC 1483 PVC • Different environments warrant different solutions • Factors : scalability, cost, simplicity, extensibility, etc.