Interconnection, Bandwidth and Datacenters

1. Interconnection, Bandwidth and Datacenters “Water, water everywhere - And not a drop to drink.” Remco van Mook, Equinix SwiNOG, May 23. 2013

2. Remcos-MacBook-Pro:~remco$ whoami

3. Topics for Today Interconnection Markets The Bandwidth Challenge Datacenters: Equinix ZH5

4. Act 1: Interconnection Markets No, not just internet exchanges

5. The Price of Bandwidth, in bulk, per Mbps Western Europe, early-mid 2011 $0.01 $0.25* $0.50 $1 $2 $15 $50 $180 $11,400 $483,840 $834,000 $3,127,500 $3,338,496 $210,000,000 $1,166,400,000 A EUR80 fiber cross connect: Internet Exchange traffic: Backbone traffic Western Europe: Transatlantic traffic, wholesale: Internet Transit, wholesale: Internet Transit, retail Broadband Internet, consumer: National Ethernet service: 3G mobile data, national: GSM voice call, national: 3G mobile data, roaming low: 3G mobile data, roaming high: GSM voice call, roaming: SMS Text Messages: SMS Text Messages, roaming: Carrier Pigeon: $2500 (est)

6. The New Price of Bandwidth, in bulk, per Mbps Western Europe, mid 2012 (based on 10Gbps) A EUR80 fiber cross connect: Internet Exchange traffic EU: Internet Exchange traffic US: Backbone traffic Western Europe: Transatlantic traffic, wholesale: Internet Transit, wholesale: $0.01 $0.18* $0.35* $0.15 $0.50 $0.65 Pain ahead!

7. Definition time! A Healthy Interconnection market • Has sufficient critical mass to be self-perpetuating • Has at least a regional significance • Minimizes duplication of effort

8. 3 Basic Motivators Why does a network expand its footprint? • Increase Revenue • Reduce Cost • Improve Quality These decisions are made: • For different reasons, • By different people, • In different parts of an organisation.

9. No seriously, where?

10. No seriously, where? Take Frankfurt, for example:

11. No seriously, where? Or Amsterdam:

12. Why does it work? A Combination of • Density • Cost • Regulatory framework • Availability and Scalability • Consolidated effort

13. Consolidated effort You need: • Space, Power and Local Connectivity • Local/National eyeballs • Transport providers • National and International Content • Carriers • Foreign eyeballs To work TOGETHER to create a SINGLE interconnection zone

14. Act 2: The Bandwidth Challenge

15. Cisco’s VNI – All IP Traffic

16. AMS-IX Traffic over a 20 year period (2015 based on a CAGR of 40% and mid-2012 data)

17. Evolution of Networking Standards (Planned) release dates of IETF Ethernet standards

18. Hmm, that looks familiar… • Those lines look the same! • Besides, I recognise that 100,1000,10000,100000 series from somewhere… • Let’s see those charts again on a logarithmic scale!

19. AMS-IX Traffic over a 20 year period (2015 based on a CAGR of 40% and mid-2012 data)

20. Evolution of Networking Standards (Planned) release dates of IETF Ethernet standards 400000 2017!

21. As long as equipment performance keeps up… We now move to Andy Bechtolsheim, presenting at NANOG 55 “There is basically a bottleneck around I/O.” “ASIC designs are not on Moore’s Law.” “There is a big gap between the processes that are used for networking chips and the ones used for state of the art CPUs.”

22. To summarize, linear growth… Oh, snap.

23. Takeaways Traffic keeps growing exponentially Network hardware backplanes are not We need to get creative to solve this And rethink how we’re interconnecting the Internet

24. Abridged history of Internet interconnection 1980s Hey, it works! Early 1990s Buy my pipes! Late 1990s Wanna Peer? Mid 2000s Mine’s bigger than yours, go away. Late 2000s I’ll build my own, then. Mid 2010s Why am I building this network again?

25. “Why am I building this network again?” Eyeball Version “Those damn users keep eating more bandwidth.” “I’m not getting paid enough.” “Forget about peering, I’ll just buy transit” “Let’s create a walled gardencharge a premium for guaranteed access!”

26. “Why am I building this network again?” Content Version Off-net is the new hotness! For some content providers, over half of their traffic is served from inside eyeball networks, trending upwards… It helps to create walled gardens! This does not scale!

27. A short explanation of a “Walled Garden” (Adult language version)

28. This does not scale! • Instead of ~20 locations to interconnect worldwide, we’re looking at over 200 deployments close to eyeball networks • It doesn’t even work for a lot of things (interactive content, cloud) • This sets a huge barrier to entry • There is not enough physical infrastructure to support this!

29. Act 3: Equinix ZH5

30. Switzerland. The Secure Heart of Europe. ZH5. IBX ZH5 ZH5/ZH4 Dual Site Strategy • 6.5 km Dark Fiber between ZH5 and ZH4 for the price of a Cross Connect • Dual Site Strategy for CHF 120.- MRR connectivity cost Facts & Figures • IBX+ • Leed Gold Standard • ISO 9001 and ISO 27001 • 80+ carriers • 6‘680 m2 colocation area • 14 MVA power • Biggest IT Ecosystem in Switzerland • High carrier density, 80+ Carriers • Located in the economical and business center of Switzerland • Scalability - power and space wise 30

31. Equinix Switzerland – Datacenters. Facilities • Established 1998 (Telehaus -> iXEurope -> Equinix) • ISO 9001 and 27001 certified • Redundancy of equipment N+1 • Carrier-neutral 31

32. Switzerland. The Secure Heart of Europe. Questions? remco@equinix.com