Extra Dimensions of the Digital Divide

1. Extra Dimensions of the Digital Divide Harvey B. Newman California Institute of TechnologyLISHEP2004, Rio de JaneiroFebruary 18, 2004

2. ICFA and Global Networks for HENP • National and International Networks, with sufficient (rapidly increasing) capacity and seamless end-to-end capability, are essential for • The formation of worldwide collaborations • The daily conduct of collaborative work in both experiment and theory • Detector development & construction on a global scale • Grid systems supporting analysis by involving physicists in all world regions • The conception, design and implementation of next generation facilities as “global networks” • “Collaborations on this scale would never have been attempted, if they could not rely on excellent networks”

3. Extra Dimensions of the Digital Divide • It’s all about Global Collaborations, and the Key Roleof Sciences (Especially HENP) • Scientific and Technology Partnership • HENP, and the Network Community: • Increasingly Expert in Inter-Regional and Global Collaborations • Adept at Multiple Technologies, New-Generation Systems • As Co-Developers as Well as Early Adopters • Reach (both Push and Pull) for Equality • An Imperative for Long Term Stability • Broad Returns: A Rapid, Positive Impact on Society in the Region: • Extremely Rapid Initial Progress • Some Breakthroughs for the Region • “Fundamental” New Ways of Working, Sharing of Information, and Knowledge • Education and Access to Knowledge: Generally, and to Advanced Technologies • Creating a Sustainable Process of Innovation

4. Extra Dimensions of the Digital Divide • To Reach Our Goals We Need A Clear Roadmap: Where You Need to Reach; How to Get There; When • Clear and Quantitative • The Goals are a Function of Time: • While the Goals Grow Exponentially, the Enabling Technologies Also Progress ExponentiallyThere is a match • But one must Bypass Legacy Technologies and Stay with Current Techniques • Benchmarks and/or Model Cases Exist: • For Countries (ITU/DAI and WEF/NRI Indices): ~ 10 kbps/capita • For Research and Education ~ 500 kbps-Several Mbps/researcher • For Leading Edge Research ~ 10-1000 Mbps/researcher • Long Term Initiatives [and HENP] • Highly Organized and Focused • Mission-Oriented: Founded in the Scientific Mission • Appreciation for the Human Element in Global Collaborations

5. Extra Dimensions of the Digital Divide • Share Information • Status, Progress and Key Issues for Connectivity in the Region • Prices for Bandwidth in Different Ranges • Vendors: Who they are; who is flexible • Opportunities for Joint Projects • Success Examples: the Fiber (and Ethernet and Lambda) Imperative • South East Europe: Poland, Czech Republic, Slovakia; Romania • “Dark Fibers”; Cost Case Studies • Cooperation Among Neighbors; Linkng to a Favored Region • Great Example(s) for Latin America • Act Locally, Think Globally: Inter-Regional Partnership • Visits from Abroad Can Have a Major Impact, But First • Local Requests and Action: Essential to Lay the Groundwork, then Open the Way • The Key Role of Scientists, and the Need to Work with Funding Agencies and Policy Makers Abroad and in the Region • The Role of Distressed Assets (e.g. 16,000 miles of fiber in Brazil)

6. Core Capacity on Western European NRENs 2001-2003 10G                1G 100M Log Scale 15 European NRENs have made a step up to 1, 2.5 or 10 Gbps core capacity in the last 3 years

7. PROGRESS: Rays of Hope in SE Europe (Sk, Pl, Cz, Hu, …) 1660 km of Dark Fiber CWDM Links, up to 112 km. 1 to 4 Gbps (GbE) August 2002:First NREN in Europe to establish Int’l GbE Dark Fiber Link, to AustriaApril 2003 to Czech Republic. Planning 10 Gbps Backbone; dark fiber link to Poland this year.

8. 2 Years Ago: 4 Mbps was the highest bandwidth link in Slovakia

9. GLORIAD: Global Optical Ring (US-Ru-Cn) “Little Gloriad” (OC3) Launched January 12; to OC192 in 2005 Also Important for Intra-Russia Connectivity

10. Dark Fiber in Eastern EuropePoland: PIONIER Network 2650 km Fiber Connecting16 MANs; 5200 km and 21 MANs by 2005 Support • Computational GridsDomain-Specific Grids • Digital Libraries • Interactive TV • Add’l Fibers for e-Regional Initiatives

11. Romania: Future Prospect of 1 to 2.5 G Wavelength Services or Dark Fiber from RDS Romania Data System(RDS) January 2004

12. CESNET Case Study (Czech Republic):Financially Within Reach 2513 km Leased Fibers (Since 1999) Case Study ResultWavelength ServiceVs. Fiber Lease: Cost Savings of 50-70% Over 4 Yearsfor Long 2.5G or 10G Links

13. Optics and Fibres[Message to NRENs; or Nat’l Initiatives] • If there is one single technical lesson from SERENATE it is that transmission is moving from the electrical domain to optical. • The more you look at underlying costs the more you see the need for users to get access to fibre. • When there’s good competition users can still lease traditional communications services (bandwidth) on an annual basis. • But: Without enough competition prices go through the roof. • A significant “divide” exists inside Europe – with the worst countries [Macedonia, B-H, Albania, etc.] 1000s of times worse off than the best. Also many of the 10 new EU members are ~5X worse off than the 15 present members. • Our best advice has to be “if you’re in a mess, you must get access to fibre”. • Also try to lobby politicians to introduce real competition; In Serbia – still a full telecoms monopoly – the two ministers talked and the research community was given a fibre pair all around Serbia !

14. GLIF: Global Lambda Integrated Facility “GLIF is a World Scale Lambda based Lab for Application and Middleware development, where Grid applications ride on dynamically configured networks based on optical wavelengths ... GLIF will use the Lambda network to support data transport for the most demanding e-Science applications, concurrent with the normal best effort Internet for commodity traffic.” Joining GLIF as a Regional andInter-Regional Goal

15. HENP Major Links Roadmap: Bandwidth in Gbps Continuing the Trend: ~1000X Bandwidth Growth Per Decade In 2004: A DOE Science Networking Roadmap; Compatible.

16. SCIC in 2003-2004http://cern.ch/icfa-scic Three 2004 Reports; Presented to ICFA Today • Main Report: “Networking for HENP” [H. Newman et al.] • Includes Brief Updates on Monitoring, the Digital Divide and Advanced Technologies [*] • A World Network Overview (with 27 Appendices): Status and Plans for the Next Few Years of National and Regional Networks, and Optical Network Initiatives • Monitoring Working Group Report [L. Cottrell] • Digital Divide in Russia [V. Ilyin] [*] Also See the 2003 SCIC Reports of the Advanced Technologies and Digital Divide Working Groups

17. Recommendation 1:Work on the Digital Dividefrom Several Perspectives • Work on Policies and/or Pricing: pk, in, br, cn, SE Europe, … • Share Information: Comparative Performance and BW Pricing • Find Ways to work with vendors, NRENs, and/or Gov’ts • Exploit Model Cases: e.g. Poland, Slovakia, Czech Republic • Inter-Regional Projects • South America: CHEPREO (US-Brazil); EU ALICE Project • GLORIAD, Russia-China-US Optical Ring • Virtual SILK Highway Project (DESY): FSU satellite links • Help with Modernizing the Infrastructure • Design, Commissioning, Development • Provide Tools for Effective Use: Monitoring, Collaboration • Participate in Standards Development; Open Tools • Advanced TCP stacks; Grid systems • Workshops and Tutorials/Training Sessions • For Example: Rio DD and HEPGrid Workshop, February 2004 • Raise General Awareness of the Problem; Approaches to Solutions

18. Inhomogeneous Bandwidth Distributioin Latin America. CAESAR Report (6/02) Int’l Links0.071 Gbps Used 4,236 Gbps Capacity to Latin America Need to Pay Attentionto End-point connections

19. ICTP 2nd Open Round Table on Developing Countries Access to Scientific Information STATEMENT: AFFORDABLE ACCESS TO THE INTERNET FOR RESEARCH AND LEARNING “Scholars from across the world meeting at the Abdus Salam International Centre for Theoretical Physics (ICTP) in Trieste [10/2003] were concerned to learn of the barrier to education and research caused by the high cost of Internet access in many countries. The Internet enables the use of content which is vital for individuals and for institutions engaged in teaching, learning and research. In many countries use of the Internet is severely restricted by the high telecommunications cost, leading to inequality in realising the benefits of education and research. Research staff and students in countries with liberal telecommunications policies favouring educational use are gaining social and economic advantage over countries with restrictive, high-cost policies. The potential benefits of access to the Internet are not available to all. The signatories to this message invite scholars in every country to join them in expressing concern to governments and research funding agencies at the effect of high telecommunications costs upon individuals and institutions undertaking teaching, learning and research. The situation in many countries could be improved through educational discounts on normal telecommunications costs, or through the lifting of monopolies. It is for each country to determine its own telecommunications policies but the need for low-cost access to the Internet for educational purposes is a need which is common to the whole of humankind.”

20. SCIC Monitoring WG - Throughput Improvements 1995-2004 Bandwidth of TCP < MSS/(RTT*Sqrt(Loss)) (1) 60% annual improvement Factor ~100/10 yr Some Regions ~5-10 Years Behind SE Europe and Parts of Asia May be Catching Up (Slowly);India Ever-Farther Behind Progress: but Digital Divide is Mostly Maintained (1) Matthis et al., Computer Communication Review 27(3), July 1997

21. Recommendations 3 & 4: Digital Divide Workshops and World Map/Website • Project to Build HENP World Network Map; Updated and Maintained on a Web Site, Backed by Database: • Systematize and Track Needs and Status • Share Information On: • Links: Bandwidths; Pricing; Vendors; Technologies • Problems: Overloading (& Where); Quality; Peering, etc. • Requirements: Are They Being Met ? • Identify Urgent Cases; Focus on Opportunities to Help

22. NREN Core Network Size (Mbps-km):http://www.terena.nl/compendium/2002 100M Logarithmic Scale Leading Nl 10M Fi Cz Advanced Hu Es 1M Ch In Transition It Pl Gr 100k Ir Lagging 10k Ro 1k Ukr 100

23. Dai Davies SERENATE Workshop Feb. 2003 www.serenate.org Ratio to 114 If Include Turkey, Malta;Correlated with the Number of Competing Vendors

24. Relative Cost of Connectivity Compared with Number of Suppliers

25. Multipliers for Differing Circuit Speeds

26. DAI: State of the World

27. DAI: State of the World

28. Digital Access Index Top Ten +  Pakistan 0.030.54 0.41 0.2 0.01 0.24

29. ICFA Report: Networks for HENPGeneral Conclusions (2) • Reliable high End-to-end Performance of networked applications such as large file transfers and Data Grids is required. Achieving this requires: • Removing local, last mile, and nat’l and int’l bottlenecks end-to-end, whether technical or political in origin.While National and International backbones have reached 2.5 to 10 Gbps speeds in many countries, the bandwidths across borders, the countrysideor the city may be much less. This problem is very widespread in our community, with examples stretching from China to South America to the Northeastern U.S. Root causes for this vary, from lack of local infrastructure to unfavorable pricing policies. • Upgrading campus infrastructures.These are still not designed to support Gbps data transfers in most of HEP centers. One reason for the under-utilization of National and International backbones, is the lack of bandwidth to groups of end-users inside the campus. • End-to-end monitoring extending to all regions serving our community.A coherent approach to monitoring that allows physicists throughout our community to extract clear, unambiguous and inclusive information is a prerequisite for this.

30. On Recommendation 1:Work to Close the Digital Divide; Help Bring the Needed Networks to All Regions • ICFA Members should work vigorously towards this goal: Locally, Nationally and Internationally • Why ? • Physicists from all world regions have the Right to be full partners; It is the basis of our global community, and our largest projects • Involvement of students, and outreach to the community is vital to our field. In modern times, this is founded on networks. • How ?“We are the prototypical ‘global’ community” • Developments by HENP of Grids, state-of-the-art networks and systems for collaborative work on a worldwide scale represent a unique opportunity, for science and society Work with SCIC & other cognizant organizations • And If We Don’t ? • We fail as the first “global” community in science

31. Recommendation 2: Strongly Supportthe Monitoring Work • The IEPM Project: http://www-iepm.slac.stanford.edu/Led by SLAC with help from FNAL and CERN • This is Imperative, to: • Quantify and Bridge the Digital Divide • Continue to Work with ICTP and Extend the Monitoring Coverageof Developing Countries • Special Emphasis on Africa and Remote Regions • Ensure at Least 2 Hosts Monitored in Each Developing Country • REQUEST ICFA (and Other) Assistance: Find Sites and Contacts in • Latin America: Venezuela, Costa Rica, Honduras, El Salvador, Belize, Panama, Bolivia • Africa: Burkino Faso, Egypt, Ghana, Malawi, Nigeria, Senegal, Somalia, Kenya, Libya, Nigeria, Sudan • Vietnam, Belarus • Need Funding: Agency Representatives are Asked to Help/Advise • US DOE or NSF: for IEPM at SLAC • EU: for ICTP that is working with IEPM for Developing Nations

32. Role of Science in the Information Society. Work Towards Tunis 2005 • Regional Involvement is Crucial to the WSIS Process • CERN Leadership • Geneva 2003 Visitors: • Kofi Annan, UN Sec’y General • John H. Marburger, Science Adviser to US President • Ion Iliescu, President of Romania; and Dan Nica, Minister of ICT • Jean-Paul Hubert, Ambassador of Canada in Switzerland • Carlo Lamprecht, Pres. of Economic Dept. of Canton de Geneva • …

33. Pan-European Multi-Gigabit Backbone (33 Countries)January 2004 Note 10 Gbps Connections to Poland, Czech Republic, Hungary Planning Underway for “GEANT2” (GN2), Multi-Lambda Backbone, to Start In 2005

34.  

35. Romania: Inter-City Links of 2 to 6 Mbps in 2002 Improved to 34 to 155 Mbps in 2003; GEANT-Bucharest Link Improved: 155 to 622 Mbps GEANT connection Timişoara RoEduNetJanuary 2004 Planning Dark FiberInterCity Backbone

36. Study into European Research and Education Networking as Targeted by eEurope www.serenate.org SERENATE is the name of a series of strategic studies into the future of research and education networking in Europe, addressing the local (campus networks), national (national research & education networks), European and intercontinental levels. The SERENATE studies bring together the research and education networks of Europe, national governments and funding bodies, the European Commission, traditional and "alternative" network operators, equipment manufacturers, and the scientific and education community as the users of networks and services. From Summary and Conclusions by D.O. Williams, CERN 

37. SCIC Work in 2004 • Continue Digital Divide Focus; More In-Depth Information • In Europe with TERENA • In Asia with APAN and KEK • In US, with Internet2 and ESnet • On South America, with AMPATH, Internet2, RNP, et al. • Continue on Africa, with Jensen and ICTP Trieste • Set Up HENP Networks Web Site (Get Support and/or Funding) • Continue and if Possible Strengthen Monitoring Work (IEPM) • Continue Work on Specific Improvements, Case by Case: • Brazil and South America, with RNP • Russia • Pakistan (?) India (?); China (?) • Romania • Follow the World Summit on the Information Society Process • Watch Requirements; the “Lambda Grid” & “Grid Analysis” Revolutions • Encourage Creation of a New “Culture of Collaboration”

38. ICFA Report: Networks for HENPGeneral Conclusions (3) • We must Remove Firewall Bottlenecks [Another “Digital Divide”; also at some Major HEP Labs] • Firewall systems are so far behind the needs that they won’t match the data flow of Grid applications. The maximum throughput measured across available products is limited to a few X 100 Mbps ! • It is urgent to address this issue by designing new architectures that eliminate/alleviate the need for conventional firewalls. For example, Point-to-point provisioned high-speed circuits as proposed by emerging Light Path technologies could remove the bottleneck. • With endpoint authentication [as in Grid AAA systems], the point-to-point paths are private, intrusion resistant circuits, so they should be able to bypass site firewalls if the endpoints (sites) trust each other. • We should deploy high performance (TCP) toolkits in a form that is suitable for widespread use by users. We should train the community to use these tools well, and wisely.