Internet2 End-to-End Performance Initiative

1. Internet2 End-to-End Performance Initiative Russ Hobby, Internet2, rdhobby@internet2.edu AMIA, November 10, 2002

2. Overview • Internet2 - What and Why • Applications • Engineering • End-to-End Performance Initiative

3. Internet2 Mission • Develop and deploy advanced network applications and technologies, accelerating the creation of tomorrow’s Internet.

4. Internet2 • Internet2 universities are recreating the partnerships that fostered the Internet in its infancy • Industry • Government • International

5. Internet2 Beginnings and Growth • Fall 1996 • Internet2 project is created as a collaboration among 34 leading research universities • Fall 1997 • University Corporation for Advanced Internet Development is incorporated • Spring 1998 • 123 regular University members, 30 Corporate members, and 22 Affiliate members • Today • 202 regular University members, 63 Corporate members, and 42 Affiliate members

6. Internet2 Goals • Enable new generation of applications • Re-create leading edge R&E network capability • Transfer technology and experience to the global production Internet

7. Internet2 Focus Areas • Advanced Applications • Middleware • Engineering • Advanced Network Infrastructure • Partnerships

8. Internet2 Membership: Expectations • Collaborate on advanced applications • Commit to the sustained deployment of high-performance network infrastructure on an end-to-end basis • Contribute to the advancement of research and educational uses of high-performance networking • Deploy pre-commercial infrastructure and protocols • Establishing expertise and human capital • Engage in large-scale proofs of concept • Self select

9. Internet2 Membership: Accomplishments • Advanced applications development • Development and deployment of middleware capabilities, locally and nationally • Creation and support of national high-performance networks • Implementation of advanced network services throughout national, regional and campus topologies • Strong partnerships with international networking organizations • New work in end-to-end performance • A newly organized effort in network and host security

10. Applications

11. Internet2 Applications • What are “Internet2 applications”? • They deliver qualitative and quantitative improvements in how we conduct research and engage in teaching and learning • They require advanced networks to work

12. Sciences Arts Humanities Health care Business/Law Administration … Library Classroom Clinic Office Laboratory Dorm room … Different Disciplines/Contexts

13. Interactive collaboration Real-time access to remote resources Application Attributes

14. Large-scale, multi-site computation and data mining (AKA “the Grid”) Shared virtual reality Any combination of the above Attributes, cont.

15. Approach Broad Outreach Internet2 Days, web site, application flyers Health Sciences Arts & Humanities NEES, Physics, Astronomy Applications Community Applications Community Applications Community Applications Community Applications Community Applications Community Applications Community Applications Community

16. Health Sciences Veterinary Medicine Arts & Humanities Non-trad’l Theses Arts Performance High Energy and Nuclear Physics GIS … Voice over IP Digital Video Videoconferencing ResearchChannel Network Storage … Applications Working Groups

17. The Internet2 Commons • An effort to encourage and support large-scale, distributed collaboration for the research and education community • Enabling one-to-one, one-to-group, and group-to-group collaboration • Supporting personal communications, meetings, conferences, and teaching and learning • For Internet2 members and their international counterparts

18. Other Collaborative Technologies The Internet2 Commons Data Sharing Instant Messaging Voice/IP Electronic Notebooks Peer to Peer Collaboratories Others H.323 VRVS Videoconferencing Technologies AG MPEG2 Others

19. Engineering

20. Internet2 Engineering andEnd-to-End Performance Initiative • Original Internet2 Intents and Reasons • What we have done • What we have discovered • Changes in direction based on what we have learned

21. Original Reasons for Advanced Services in Internet2 • Commercial Internet could not deliver what researchers wanted • Eliminate the network as a limitation for applications • Re-create the sharing environment to test and develop new capabilities • Transfer new technologies to the larger Internet

22. Provide Reliable Performance Across the Network • Implement Quality of Service (QoS) capabilities from Source to Destination • Create a coordinated bandwidth reservation system • Let applications determine the level they need • Allow resource control and accounting • Provide “Bandwidth Overkill” until QoS is available

23. Support efficient “one-to-many” and “few-to-few” applications • Applications • Internet2 video broadcast • Support effective video conferencing • Allow shared use of common data • The solution: Multicast

24. Create an National Network for Technology Development

25. Test New Protocols and Capabilities • New Network Equipment • New Link Technologies • Complex Routing • Measurement Techniques • IPv6

26. What We Have Tried • Creating a National Network for Development • Implementing wide-spread Multicast • Trials of QoS across the Network • Tests and Training of IPv6

27. What We Have Learned • Some ideas have worked • Some ideas are more complex than expected • Some had to go back to the drawing board • Some had a change in direction • We learned from all the experiences!

28. High Capacity Development Networks • They Enable New Applications

29. High Capacity Development Networks • Enable New Applications • Many good Demonstrations • Real Time Application can now work • Transfers of Large Datasets • Provide the Test Bed for New Technologies • Packet over Sonet • New Measurement Techniques • Allows sharing of Ideas and Results

30. Multicast • Robust Multicast Deployment Can Be Done

31. Multicast • It is hard for Operations to understand how well Multicast is running. Beacons are up now to help. • It is more difficult for Applications to use. New methods for joining Multicast Groups have been developed (SSM). • Any problem can be made harder by Multicast

32. QoS • Abilene Premium Service failed to get off the ground • It is a complex system that needs many parts before it can work. Some key part were not implemented for high speed links. • Premium Service requires all parts of the end-to-end path to participate and coordinate. This is against the current Internet operating model. • Allocation models for who gets Premium Service need a lot more work. • Trials are going on with Scavenger Service • Low Priority Best Effort Service

33. IPv6 • Set up a National Backbone • Established Hands-on Training Workshops

34. Network Security • Initial Internet Premise: • Security belongs on the end-system • Development of security capabilities has been slow. • Devices have been put into the network to try to help • Firewalls, NAT boxes, Filters • These often impede Applications. • Network devices themselves need to be protected

35. What Did Not Work • QoS was too hard to implement at this time • Even with High Bandwidth available, researchers often did not see the expected performance. WHY? • The End-to-End Performance Initiative (E2Epi) was create to figure this out.

36. End-to-End Performance Initiative (E2E pi)

37. The Wizard Gap

38. No other complaints Everything is AOK Talk to the other guys System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop A Problem Hey, this is not working right! Others are getting in ok Not our problem Applications Developer Applications Developer The computer Is working OK Looks fine All the lights are green How do you solve a problem along a path? We don’t see anything wrong The network is lightly loaded

39. True End-to-End Experience • User perception • Application • Operating system • Host IP stack • Host network card • Local Area Network • Campus backbone network • Campus link to regional network/GigaPoP • GigaPoP link to Internet2 national backbones • Internationalconnections EYEBALL APPLICATION STACK JACK NETWORK . . . . . . . . . . . .

40. Packet Loss The Performance Killer • On high-speed, long-distance connections even one lost packet can greatly affect performance. For TCP the maximum transmission rate is: MSS 0.7 Rate = * RTT P Matt Mathis MSS = Maximum Segment Size RTT = Round Trip Time P = Packet Loss

41. Top Three Problems - #1 • Ethernet Duplex Mismatch • Duplex negotiations failed • One side full duplex, one side half duplex • Works fine under light load • Heavy load, full duplex dominates

42. Top Three Problems - #2 • Computer Tuning • Buffers not set big enough, can not fill pipe • Software options not set correctly • Hardware limitations

43. Top Three Problems - #3 • Bad Media – Copper or Fiber • Usually between wall and computer • Kinked copper wire • Dirty optic fibers • Causes random errors and packet loss

44. Good Work Already Going On • Many projects and research is underway by others investigating performance on portions of the end-to-end path. • E2Epi seeks to bring these efforts together to look at the end-to-end path as a complete system.

45. Areas of E2Epi • Applications • Host/OS Tuning • Measurement Infrastructure • Performance Improvement Environment (PIE) • Operations and Human Communications • Performance Evaluation and Review Framework (PERF)

46. Applications • Work with specific application communities to help solve their performance problems. • High Energy Physics • Medical Sciences – Visible Human Project • Use a few key, general purpose applications for performance testing. • FTP • Video Conferencing

47. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Application Beacons Let’s Bounce it off a Beacon! OK you test your end Applications Developer Applications Developer Beacon How do you solve a problem along a path?

48. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Application Beacons My side tests OK Try from your end Applications Developer Applications Developer Beacon

49. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Application Beacons Oh, My end has a lot of packets lost Applications Developer Applications Developer Beacon

50. Host/OS Tuning • Web100 has a leading role • Provide Best Practices for getting the most from your computer. • Locate or build tools for Host/OS performance diagnostics. • Work with computer vendors on Internet2 Performance Packages.