End to End Performance Initiative Russ Hobby <rdhobby@internet2> NORDUnet 2002

1. p End to End Performance Initiative Russ Hobby <rdhobby@internet2.edu> NORDUnet 2002 Copenhagen, Denmark 15 April, 2002

2. Context for E2E Performance • Even with high bandwidth network links, the Internet2 community often does not see expected performance.

3. The Wizard Gap

4. True End-to-End Experience • User perception • Application • Operating system • Host IP stack • Host network card • Local Area Network • Campus backbone network • Campus link to regional network/GigaPoP • GigaPoP link to Internet2 national backbones • Internationalconnections EYEBALL APPLICATION STACK JACK NETWORK . . . . . . . . . . . .

5. No other complaints Everything is AOK Talk to the other guys System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop A Problem Hey, this is not working right! Others are getting in ok Not our problem Applications Developer Applications Developer The computer Is working OK Looks fine All the lights are green How do you solve a problem along a path? We don’t see anything wrong The network is lightly loaded

6. Good Work Already Going On • Many projects and research is underway by others investigating performance on portions of the end-to-end path. • E2Epi seeks to bring these efforts together to look at the end-to-end path as a complete system.

7. Areas of the Initiative • Applications • Host/OS Tuning • Measurement Infrastructure • Performance Improvement Environment (PIE) • Operations and Human Communications • Performance Evaluation and Review Framework (PERF)

8. Applications • Work with specific application communities to help solve their performance problems. • High Energy Physics • Medical Sciences – Visible Human Project • Use a few key, general purpose applications for performance testing. • FTP • Video Conferencing

9. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Beacons Let’s Bounce it off a Beacon! OK you test your end Applications Developer Applications Developer Beacon How do you solve a problem along a path?

10. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Beacons My side tests OK Try from your end Applications Developer Applications Developer Beacon

11. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Beacons Oh, My end has a lot of packets lost Applications Developer Applications Developer Beacon

12. Packet Reflector Local Reflector Remote Reflector Local Router Wide Area Network Routed by Faking Gateway Tunneled Traffic Normal Routing Packet Reflector enables wide-area experience when both source and destination are in a lab

13. Host/OS Tuning • Web100 has a leading role • Provide Best Practices for getting the most from your computer. • Locate or build tools for Host/OS performance diagnostics. • Work with computer vendors on Internet2 Performance Packages.

14. Measurement Infrastructure • Bring together current measurement efforts and projects in the community. • Establish an End-to-End Measurement Infrastructure from the intersection of these works. • Create diagnostic tools to determine the health of the network and locate performance problems.

15. System Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Standard Operational Info Applications Developer Applications Developer Ops Info Ops Info LAN Administrator LAN Administrator Ops Info Ops Info Ops Info Ops Info Ops Info Ops Info Information from All Parts of the Network Ops Info

16. System Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Standard Operational Info End-to-End Analyzer Applications Developer Applications Developer Ops Info Ops Info LAN Administrator LAN Administrator Ops Info Ops Info Ops Info Ops Info Ops Info Ops Info Know the Health of the Network Ops Info

17. System Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Standard Operational Info Apps Tuning End-to-End Analyzer Applications Developer Applications Developer Ops Info Ops Info LAN Administrator LAN Administrator Ops Info Ops Info Ops Info Ops Info Ops Info Ops Info Applications Adapt to the Network Ops Info

18. E2Epi Measurement Workshop • 31 January 2002, Tempe Arizona • The workshop brought together those working in the measurement field • Conclusions: • Packet Loss is the most important attribute • Need for common schema and exchange format • Global Grid Forum to lead effort • Use Internet2 Measurement WG to continue communication

19. Performance Measurement Architecture • Measurement Infrastructure • Measurement Analysis • Presentation • Tools and Support

20. Performance Measurement Architecture • Measurement Infrastructure • Measurement Attributes • Measurement Type – Packet Loss, Latency, … • Measurement Scope – Path, Link, Interface, … • Measurement Time • Measurement Location • Measurement Method – Active, Passive, … • Information Schema and Exchange Format • Measurement Information Exchange Protocol • Data Repository • Accesses Control and Security

21. Performance Measurement Architecture • Measurement Analysis • Network Status and Capabilities • Problem Location • Presentation • Common Presentation Format • Application API • Tools and Support • List of common test and analysis routines • List of presentation tools

22. Performance Improvement Environment (PIE) • Develop a dynamic environment where collaboration and information sharing will happen. • Identify, collect and disseminate appropriate information for end-to-end related information. • Include success stories,measurement statistics, reference materials, measurement tool documentation. • Include pointers to materials already developed by other communities.

23. Operations and Human Communications • Establish communications among common interest groups • System administrators • LAN administrators • Campus NOCs • GigaPoP • Application support staff • Establish communications between groups for operations and problem resolution.

24. System Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Groups of Common Interest I don’t know how to solve this problem! I do! I do! Applications Developer Applications Developer LAN Administrator LAN Administrator Let them share experiences. Provide a means of communications

25. Not a bottleneck At this point Everything is Still AOK Throughput OK System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Find a Solution? Hmm, Time to Check the PIE and Talk to others Ah ha, an Ethernet Duplex problem! It is slow for others too! Applications Developer Applications Developer Performance OK here Yup. Duplex Does not Agree! All the lights are green We don’t see anything wrong A System to Check a Specific Problem The network is still lightly loaded

26. Can You Go Direct to the Problem? • How can you tell where is the problem? • Need a tool to tell you: • Where the problem is. • The type of problem • Who to contact to get it fixed • Terry Gray, University of Washington “We Need a Finger Pointing Tool”

27. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Gray Finger Pointing Tool Finger Pointing Tool Time! Applications Developer Applications Developer Locate the Problem Gray Finger Pointing Tool Terry Gray University of Washington

28. System Administrator LAN Administrator LAN Administrator System Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop Gray Finger Pointing Tool Finger Pointing Tool Time OK, I’ll fix it Applications Developer Applications Developer You ARE the Weakest Link!

29. Performance Evaluation and Review Framework (PERF) • Establish a framework for resolving performance problems • Provide known solutions by using the PIE • Tap community knowledge by facilitating group communications • Coordinate a team of experts to solve hard problems

30. This is strange No clue here I’m stumped System Administrator System Administrator LAN Administrator LAN Administrator Campus Networking Campus Networking Backbone Gigapop Gigapop The Hard Problems Hey, Its is not working again! Others are getting in ok I don’t know Applications Developer Applications Developer I don’t know what is wrong I am Cluefully Challenged Doh! What if no one has the answer? We can’t figure it out Need a Tiger Team of Experts to Research the Problem It looks normal here

31. Partners • Campuses • Faculty and discipline communities • GigaPoPs • International partners • NSF-sponsored engineering efforts • NLANR, www.nlanr.net • Web100 Project, www.web100.org • Internet2 corporate members • Federal labs and agencies

32. Calls For Participation • Seek participants in the various work areas • Internet2 Measurement Working Group • Campus Participation in E2Epi • Internet2 Performance Packages • Seek stories and best practices • Current Call for Experiences

33. Internet2 Organization Role • Staffing • Cheryl Munn-Fremon, Initiative Director • Russ Hobby, Technical Architect • George Brett, Information Architect • Eric Boyd, Network Engineer • Lisa Wilberding, Communications Coordinator • Terri Saarinen, Program Assistant

34. For More Information • Info-E2Epi@internet2.edu • http://www.internet2.edu/e2e/

35. www.internet2.edu