Greg Cole , Associate Director National Center for Supercomputing Applications (NCSA)

1. US-Russia Science, Education and Civic Networking InitiativesPresentation to US Embassy Staff, February 28, 2002 Greg Cole, Associate Director National Center for Supercomputing Applications (NCSA) University of Illinois at Urbana-Champaign Principal Investigator, NSF Cooperative Agreement US-Russian High Performance Nauka-Net (formerly FASTnet) Network Natasha Bulashova, President US-Russia Friends & Partners Foundation Introduction

2. Presentation Overview • Nauka-Net - (formerly FASTnet) - high performance infrastructure linking our science and education communities (NSF, Russian MinIST, RAS) • CIV-Net - 4 year program strengthening local community governance through local infrastructure development (Ford Foundation) • Friends & Partners - broad community networking initiative (parent of all our other initiatives) • Nauka-Grid, CIV-Grid - US-Russian grid deployment efforts related to high performance and civic networking initiatives • The Future Introduction

3. Presentation Motivation • Educate/inform about important programs/capabilities • Introduce their risks and rewards • Discuss future developments and possibilities • Solicit help in expanding knowledge and appropriate use of new communications capabilities • Initiate discussion on minimizing risks, maximize rewards of improved communications infrastructure in context of US-Russia collaborative programs Introduction

4. Brief History • US base of activities at University of Tennessee until March, 2001 (moved to NCSA of UIUC) • Russian base of activities at Pushchino Biological Center (IBPhM) until 1998 (moved to own non-profit foundation in Moscow) Introduction

5. “Friends & Partners”: hobby gone “haywire” • Started from a single email in 1993; launched in January 1994 • Hobby effort to help introduce people in US and Russia using then-new Internet technologies • An early example of Internet-based community building • No politics, religion (and not a dating service!) • Focus on science and education collaboration Introduction

6. An early dream … …. problems … Introduction

7. A story of infrastructure development . . . • Early days: entire South Moscow region behind a single 19.2K modem • First grant (from NATO) addressed this - and over 2 year period, increased speed to 256K • Sun Microsystems donated workstation equipment to both teams • US DOS grant enabled us to hire staff, provided some operations funds, helped legitimize efforts within our home institutions Introduction

8. Anatomy of a 50M file transfer . . . • Compress file • Uuencode it • Split into 1000 uniform sized pieces • Compress the 1000 files • FTP the 1000 files • Uncompress the 1000 files • Join into 1 file • Uudecode it • Uncompress it Took all weekend With new Nauka-Net, theoretically possible in 3 seconds (in practice, 2-3 minutes) Introduction

9. Addressing the US-Russian Link for S&E Introduction

10. Nauka-Net (formerly FASTnet) Animation • S&E Traffic flowing across link between Moscow and Chicago on January 18, 2002 (24 hours) • 1 minute summary per transition • Shows extensive reach of high performance S&E network in US (Universities, NASA, DOE, NIH, NOAA, USGS, others) • Shows growing reach of S&E network in Russia • Shows different types of traffic • Illustrates use of our monitoring/analysis system Nauka-Net

11. The fastest route from Moscow to Paris (is via Chicago) STARTAP in Chicago • All US domestic “next generation” S&E Internet networks “meet” (and exchange traffic) at the NSF-funded STARTAP in Chicago • Most of the world’s international “next generation” S&E Internet networks meet at STARTAP and exchange traffic with US domestic networks and other international S&E networks Nauka-Net

12. Iceland Norway Sweden Finland Denmark Russia France Netherlands CERN Israel Who is Connected to STAR TAP? Science Technology And Research Transit Access Point Canada Japan Korea Taiwan Singapore Australia China Chile, Brazil (FAPESP) US Networks: vBNS, vBNS+, Abilene, ESnet, DREN, NREN/NISN www.startap.net Nauka-Net

13. Starlight . . . (something much better than STAR TAP coming …) Nauka-Net

14. Nauka-Net Defined • Funding / History • Partners • Users • Applications Nauka-Net

15. MIRnet (predecessor to Nauka-Net) • NSF Cooperative Agreement (ANI-9730330) to the University of Tennessee with matching funds from Russian Ministry of Science and Technology to Russian partners • A 6 Mbps IP/ATM service (provided by Teleglobe) between STAR TAP in Chicago and the M9 switch in Moscow for purpose of linking high performance science and education networks in US and Russia • A program to encourage applications of high performance networking for US-Russian scientific collaboration • Network running reliably since July, 1999 … problems … Nauka-Net

16. FASTnet / Nauka-Net • MIRnet has changed to Nauka-Net • 155 Mbps MPLS service Chicago - Frankfurt • 155 Mbps service Frankfurt - Moscow • Routing nearly all S&E networks in Russia • New partners: Kurchatov Institute, Joint Supercomputing Center, Russian Academy of Science, Ministry of Industry, Science and Technology • New US home: National Center for Supercomputing Applications, University of Illinois Nauka-Net

17. Nauka-Net / CVETnet • Contracts for new network signed October 1, 2001 • 45 Mbps began operating December 7, 2001 • Move to Starlight and upgrade to 155 Mbps: March 12, 2002 (under budget, 1.5 years ahead of schedule) • CVETnet may represent next evolutionary advance (to lightwave switching) Nauka-Net

18. Network Topology NAP in Chicago is represented with router and ATM switch connected to STAR TAP NAP in Moscow is represented with router and ATM switch connected to Internet Exchange in M9 which is managed by Russian Institute of Public Networks. Nauka-Net

19. NSF Funding $800K annually ($4.0 million total) $600K for transport (Chicago - Frankfurt) $135K operations ($65K overhead) $150K cost sharing Budget • Russian Funding • Russian Ministry of Industry, Science and Technology • Russian Academy of Science • Funds transport (Frankfurt - Moscow) • 2-1 match of US funding Nauka-Net

20. Development Review Oct ‘00 Teleglobe Sep ‘00 Demo Aug 8 ‘00 Newsletter Sep ‘00 MADAS 2 Sep ‘00 Demo Jun ‘00 Meeting Nov ‘99 Demo Feb 22 ‘00 Launch Sep ‘99 IP Down Jul ‘99 IP Up Jun’99 MADAS 1.0 Sum’99 Moscow/ MASS Nov’98 Announce Sep’98 Teleglobe Sep’98 Cooperative Agreement Jul’98 Revised Proposal Mar’98 Renegotiate Fall/Winter ‘97 Proposal Aug’97 NSF RFP Jun’97 CIVnet Jan’97 NATO Sep’95 F & P Jan’94 KORRnet Jun’94 Nauka-Net

21. Nauka-Net Defined • Funding / History • Partners • Users • Applications Nauka-Net

22. Partners • Original partners on proposal to NSF included Kurchatov Institute (Russian Institute for Public Networks), Russian Academy of Science, Russian MinSci • Proposal was likely funded based on strength/relevance of these partners (NSF had worked with them on US-Russian Internet development since 1993) • New partners appeared …(network politics fierce everywhere) • All effort (for 2+ years) focused on returning control to those who could route all S&E networks in Russia • Project managed on “the edge of failure” Nauka-Net

23. Partners / History • November, 1999 - Efforts begin to correct problem • February, 2000 - first of many video-conference events/demonstrations with Acad. E. Velikhov, Kurchatov Institute • March, 2001 - PI moves from UT to NCSA Access (in Arlington, VA) • April, 2001 - Acad. E. Velikhov signs as first international partner of the NCSA • July, 2001 - Agreement signed with Acad. Velikhov, Acad. Osipov (President of RAS), Acad. Savin (Director of JSC), Russian MinIST, NSF, NCSA establishing FASTnet • July, 2001 - Agreement signed with Teleglobe • August, 2001 - NSF grant moves from UT to NCSA • October 30, 2001 - letter written from NCSA to MSU re: changes • November 2, 2001 - MIRnet ceases operation • November, 2001 - new “Access Center” begins operating in Moscow • December 7, 2001 - new FASTnet network begins operation • December 14, 2001 - official launch ceremony; Washington, Moscow Nauka-Net

24. Kurchatov Institute Evgeny P. Velikhov Academician President, RRC Kurchatov Institute New Access Center Nauka-Net

25. Kurchatov Institute Alexey Soldatov, Director Research and Development RRC “Kurchatov Institute” President, RELCOM Developing Nauka-Grid Program Nauka-Net

26. Russian Institute for Public Networking Alexei Platonov, Exec. Director, RIPN Russian Backbone Network (RBnet) Nauka-Net

27. Joint Supercomputing CenterRussian Academy of Science Gennady P. Savin Academician Director, JSC Nauka-Net

28. Friends & Partners Foundation • Originating member of Russian MIRnet team • Worked with US staff for 8+ years on many US-Russian networking, information system and community development projects Natasha Bulashova, President, F&P Nauka-Net

29. Nauka-Net Defined • Funding / History • Partners • Users • Applications Nauka-Net

30. Nonproliferation and Arms Control Projects: US-Russia Since February, 2000, MIRnet has been used by the Oak Ridge National Laboratory to support its various collaborations with the Kurchatov Institute and other Russian research laboratories. In June, 2000, peering arrangements were put in place enabling all DOE laboratories in the US to use MIRnet. The primary applications discussed and observed related to US-RF programs are in nonproliferation and arms control. Several video-conferencing demonstrations have been held - including with senior US government leaders - to demonstrate the utility of high performance networks in supporting existing US-RF collaborative efforts. All of these demonstrations have been coordinated with Oak Ridge National Laboratory and the Kurchatov Institute. . Oak Ridge - Kurchatov Institute traffic from February, 2000. Nauka-Net

31. Weapons Disposal: Reactor Physics / Thermal hydraulics Analyses for Plutonium Disposition The US and RF are engaged in a cooperative program to dispose of weapons usable plutonium in pressurized water reactors in both countries. While plutonium fuels have been routinely used in western pressurized water reactors (PWRs) in France and Germany, such fuels have not been used in Russian reactors (VVERs). For the past four years, ORNL has been responsible for transferring technology for mixed oxide (MOX) fuel to Russia and Kurchatov Institute has been responsible for educating ORNL staff as to the design and operation of VVERs. MIRnet has supported this cooperative program through video-conferencing, ftp, use of the Centra Symposium web-based teaching package, whiteboard, and applications sharing. Academician Ponimarev-Stepnoi (seated, on screen from Moscow) of the Kurchatov Institute addresses the June 13, 2000 video-conference involving participants from Moscow, Washington, Argonne National Lab in Chicago and Oak Ridge. Included was Howard Baker, former US Senate Majority leader, heading up a Blue Ribbon Panel observing US-Russian programs. Nauka-Net

32. US-Russia Materials Protection, Control & Accountability program The objective of the lab-to-lab MPC&A Program is to enhance, through U.S.-Russian technical cooperation, the effectiveness of nuclear materials protection, control, and accounting in Russian nuclear facilities. The enhancements are implemented by Russian institutes. The U.S. laboratories provide funding for the Russian institutes through laboratory-to-laboratory contracts. The two partnering institutions, the Oak Ridge National Laboratory and the Kurchatov Institute in Moscow, have used MIRnet since February, 2000 to support a variety of applications - including video-conferencing (demonstrations, seminars, contract negotiation), large database (200+ Mbytes) transfer, radio propagation analysis, and application sharing. US participants interact with Dr. Evgenii Velikhov, President of the Moscow Kurchatov Institute, and other Russian academicians during the February 22 video-conference between Moscow, Washington, Knoxville and Oak Ridge. In addition to the video-conferencing, a demonstration was conducted of application sharing for joint control of a radio propagation analysis Nauka-Net

33. NASA-Russian Space Science Internet (RSSI) Collaboration FTP dominates as the primary application between hosts on NASA’s high performance NREN network and the Russian Space Science Internet. With daily flows occasionally reaching 500 megabytes or more, MIRnet supports a wide variety of NASA-RSSI programs and activities. Traffic from NASA hosts to RSSI hosts is shown above. The primary application is ftp which often exceeds 256 Megabytes transferred daily. Nauka-Net

34. NASA Utilization since January 1, 2002 Nauka-Net

35. NASA Utilization since January 1, 2002 Nauka-Net

36. Traffic flow to Russia from US Nauka-Net

37. Traffic flow to Russia since January 1, 2002 Nauka-Net

38. Experimental High Energy Physics High energy physicists in the Skobeltsyn Institute of Nuclear Physics at Moscow State University use MIRnet for collaborating with US partners at the Fermi National Accelerator and the Stanford Linear Accelerator. Data is shared and analyzed from experiments performed in the particle accelerators for the purpose of obtaining insight into macroworld structures. Investigation of Magnetospheric Perturbances Moscow State University and the Space Physics Research Laboratory at the University of Michigan are using MIRnet in support of a joint project involving a heavy computational component and the creation/maintenance of a shared cosmophysical information database addressing experimental and theoretical research in the area of magnetospheric and space physics. Research of on-line collaboration methods in distance learning technology development Based on the collaboration of Ural State University, Perm State University, and North Caroline State University in the framework of their 1997-2000 project “Collaboration in the field of distance learning in the area of business management” supported by the US State Dept., the project is exploring methods of remote collaboration via video- and audio- data exchange (mBONE and H.32x). US-Russia Collaboration in Plasma Astrophysics Project is multi-disciplinary, involving specialists in numerical magnetohydrodynamics, plasma physics, and astrophysics. Russian scientists work at Cornell during one-month visits, and the US scientists visit Russia on a regular basis. Collaboration on developing 2D computer codes between Keldysh Institute and Cornell. Sample Academic Partnerships Utilizing High Performance Services Nauka-Net

39. Saint Petersburg, Russia Seattle, Washington Novosibirsk, Siberia San Diego, California Sixty Four Students And a Significant Number of Physicists and Technologists US-Russian InternetPhysics Olympiad In April '00 high school students in Novosibirsk and St.-Petersburg (Russia) combined with students in Seattle and San Diego (America) to participate in an internet-based science competition. Each of eight teams were composed of four American and four Russian students. Each pair of team halves were linked with their own private chat and whiteboard connection so they could consult in solving the problems. They were presented with questions and then submitted answers through an internet-based platform which was controlled at a central site; the system delivered each team's answers to separately located panels of judges. Novosibirsk State University and Cornell University propose to use MIRnet to enhance opportunities and expand participation. Nauka-Net

40. U.S. Users (October, 2000) • Traffic to U.S. • 93% educational • 7% .gov/.mil • Traffic from U.S. • 92% educational • 8% .gov/.mil US Government agency use of MIRnet (megabytes transferred since July, 2000) Nauka-Net

41. Russian Users via MIRnet Novgorod State Univ. In: 0.4% Out: 0.2% Moscow State Univ. In: 30.4% Out: 24.8% 21 1 Yaroslavl’ Reg. Net. In: 0.7% Out: 0.6% Chernagolovka In: 24.5% Out: 6.1% 17 2 Ural State University In: 2.7% Out: 3.8% MEPHI In: 8.0% Out: 2.3% 8 3 RAS Ural Reg. Acad. Net. In: 1.4% Out: 0.6% 11 Chelyabinsk FREEnet In: 3.0% Out: 0.6% 7 Nauka-Net

42. MIRnet routed institutions in Moscow Nauka-Net

43. Nauka-Net utilization today Nauka-Net

44. International Traffic Flow to Russia #4 Finland 4% (31G) #2 Sweden 12% (99G) #7 Canada 3% (22 G) #6 U.K. 3% (24G) #5 Netherlands 3% (27G) #13 Japan 0.3% (2.8G) #1 U.S. 63% (508 G) #3 France 4% (33G) #12 China 0.4% (3G) Primary Country Providers of Traffic to Russia from July 1 - October 15, 2000 Nauka-Net

45. Nauka-Net Traffic to Russia by Country 2000 - 2002 Nauka-Net

46. Nauka-Net Traffic from Russia by Country 2000 - 2002 Nauka-Net

47. Nauka-Net Traffic from Top Russian Institutions Nauka-Net

48. Nauka-Net Traffic from Russia to US Nauka-Net

49. Nauka-Net Traffic from US to Russia Nauka-Net

50. Nauka-Net Traffic by Top Users Today Nauka-Net