190 likes | 314 Views
Internet Video: The Next Wave of Massive Disruption to the U.S. Peering Ecosystem. William B. Norton Co-Founder & Chief Technical Liaison Equinix, Inc. Clean Slate Networking Research Workshop Wednesday, March 21, 2007 13:30-14:00 Frances C. Arrillaga Alumni Center. v0.3. 1987-1994. R. R.
E N D
Internet Video: The Next Wave of Massive Disruption to the U.S. Peering Ecosystem William B. Norton Co-Founder & Chief Technical Liaison Equinix, Inc. Clean Slate Networking Research Workshop Wednesday, March 21, 2007 13:30-14:00 Frances C. Arrillaga Alumni Center v0.3
1987-1994 R R R R R R R NSFNET R R R R R R NSF funded $ Merit @ UMich – NSFNET Project Agenda Logistics Regional Techs Meetings Host Open sharing of Ops Data Then port 80 grew, NSF stopped funding…
1987-1994 1994 NSF funded $ Self-Sustaining $ R Commercial Internet R R R R R R R R R R R R NSP R R R R NAP NSP NSFNET NSFNET R R NSP R R R R R R NSP R R R R R R R Merit @ UMich – NSFNET Project North American Network Operators Group (NANOG) Agenda Regional Techs Meeting Logistics Regional Techs Meetings Host Slow transition Little sharing Weak SLAs&NDAs 1998->EQIX
Equinix • Carrier Neutral Internet Exchange • Bay Area, LA, CHI, DAL, DC, NYMetro • Singapore, Hong Kong, Tokyo, Sydney • IPO in 2001, Market Cap $2.5B today • 1200 Customers, 200 Networks • Tier 1 ISPs, Cable Cos, Content, etc. • Efficient interconnection of services Catbird seat 90% documenting Internet Ops Practices
Internet Operations White Papers • “Interconnection Strategies for ISPs” • “Internet Service Providers and Peering” • “A Business Case for Peering” • “The Art of Peering: The Peering Playbook” • “The Peering Simulation Game” • “Do ATM-based Internet Exchanges Make Sense Anymore?” • “Evolution of the U.S. Peering Ecosystem” • “The Asia Pacific Internet Peering Guidebook” • “The Great (Public vs. Private) Debate” • “The Folly of Peering Traffic Ratios?” • “Video Internet: The Next Wave….” On the Internet, Everyone if a Publisher Internet makes anyone a publisher, similar effect now emerging for video
Massive Disruption in U.S. Peering Ecosystem Short Videos • YouTube – founded 2005 • Short video clips – 50 million view per day! • 20Gbps of peering traffic Feb 2006 • $1M/month in Sept 2006! • Entering Peering Ecosystem • 30 Other competitors600Gbps peerable? • DoveTail • Video may dwarf current peered traffic • 2010 – 80-90% Internet is Video • Inculcate video guys into peering ecosystem Now, On the Internet Everyone is a Broadcaster Short video clips…Full TV shows… Source: http://digg.com/tech_news/YouTube_Gets_Bandwidth_Boost_from_Level_3 Source: http://www.nanog.org/mtg-0606/norton.html
Massive Disruption in U.S. Peering Ecosystem Full Episodes • “Desperate Housewives” – 210MB/hour • For 320x240 H.264 Video iTunes image • 10,000,000 households • 2,100,000,000 MB = 2.1 peta-Bytes • How long will that take to download? 3 days @ 64Gbps non-stop ! Just one show Try 250M*180 Channels*HDTV The Point: Massive Wave of Incremental Traffic to document….. Source: http://www.pbs.org/cringely/pulpit/pulpit20060302.html
The Research Questions How to distribute video across the Internet ? How much does it cost per video?
Transit =Metered pipe to the Internet CDN =Content Distribution Network Peering =free & reciprocal access to each others Customers P2P =PeerToPeer Small =Distribute 10 videos every 5 minutes on avg. Medium =Distribute 100 videos every 5 minutes on avg. Large =Distribute 1000 videos every 5 minutes on avg. $ per video? Modeling Varying Sized Loads Shift from Avg to more typical demand curve...
Demand Curve Modeling 95th % ω~ 4 x α α = average load ρ = peak load (6.6*α) ω=95th percentile (4*α) ρ=6.6xα α = 10 videos/5 min=400Mbps ω =1.6Gbps ρ = 2.64Gbps α = 100 videos/5 min=4,000Mbps ω =16Gbps ρ = 26.4Gbps α = 1000 videos/5 min=40,000Mbps ω =160Gbps ρ = 264Gbps
Model 1C – Large Load Commodity Transit Upstream ISPs Router4 Router2 10G Router2 8 * 10GE to upstreams each Server1 GigE Switch1 Router1 : Server24 : 10G : GigE Switch14 : : Server262 Server263 Server264 :
Summary Per Video Cost Of delivery
Observations • Internet Transit Supply ▼Price ▲ • Internet Transit Model src/dst specific • Bottlenecks • IX Power, Router Capacity, Peer’s Capacity, • Backbone Capacity, Last Mile bottleneck, 100G NIC? • Do I need to upgrade $$$$ gear to support my competitor (peer)? • Identify Players, Positions, Motivations, Behavior • Geoff Huston: “P2P has won. Telco/Cable co trying to keep its 1998 biz plan relevant.” Predictions from the Field
Content Providers: "We are sitting around this table in 2010 and we are commenting how remarkable the last few years have been, specifically that:“ 1. Video streaming volume has grown 100 fold 2. Last mile wireless replaced local loop 3. Botnets (DDOS attacks) are still an issue 4. Non-mechanical (i.e. Flash) Drives replaced internal hard drives on laptops 5. 10% of all cell phones are now video phones 6. We have cell phones that we actually like 7. The U.S. is insignificant traffic wise relative to the rest of the world 8. Most popular question discussed around the table: 'How do we operate business in China?‘ 9. No online privacy. And the gov't watches everything 10. 18-25 demographic is best reached w/ads on the Internet 11. Next Gen 3D on-line Social Networks are so successful 12. No physical network interfaces are needed 13. We will big brother ourselves (video cams 'who scraped my car?') 14. So many special purpose Internet apps - in car google maps, livetraffic updates, etc. 15. So much of our personal information is on the net 16. Video IM emerged as a dominant app 17. P2P will emerge for non-pirated videos - DRM in place and embraced 18. Voice calls are free, bundled with other things Source: May 2006 Web Content Private Forum
“ISPs: We are sitting around this table in 2010 at NANOG and we are commenting how remarkable the last few years have been, specifically that:“ 1. We have 10G network interface(s) on laptops (I assumed wired, but someone else might have been thinking wireless) 2. $5/mbps is the common/standard price of transit (other prediction was $30/mbps) 3. Internet traffic is now so heavily localized (as in 75% of telephone calls are across town type of thing but for the Internet) 4. Ad revenue will cover the cost/or subsidize significantly of DSL 5. 90% of Internet bits will be video traffic 6. VoIP traffic exceeds the PSTN traffic 7. Private networks predominantly migrate to overlays over the Internet • Wireless Internet Service Providers (WISPs) are serious competitive threat to DSL and Cable Internet • Sprint is bought by Time Warner 10. Cable companies form cabal & hookup with Sprint or Level 3 11. Government passes Net Neutrality Law of some flavor 12. Earthlink successfully reinvents themselves as Wireless Metro player in Response to ATT and Verizon 13. 40% paid or subscription as opposed to Content Click Ads. Like Cable Company channel packages, folks will flock to subscriptions for Internet Content packages. 14. RIAA proposes surcharge on network access (like Canada tax on blank CDs) 15. NetFlix conversion to Internet delivery of movies to Tivo or PC,or open source set top box 16. ISPs will be in pain 17. Last mile (fiber, wireless, .) in metro will be funded by municipal bonds 18. Death of TV ads, Death of broadcast TV, Tivo & Tivo like appliances all use the Internet with emergence of targeted ads based ondemographic profiles of viewer 19. Google in charge of 20% of ALL ads (TV, Radio, Billboards, .) 20. Ubiquitous wifi in every metro with wifi roaming agreements 21. Congestion issues drive selective customer acceptance of partial transit offerings 22. IPTV fully embraced by cable cos - VOD - no need for VDR and ala carte video services replace analog frequency 23. Near simultaneous release of movies to the theaters, DVDs for the home, PPV, and Internet download to meet needs of different demographics. Source: Discussions at NANOG 37 San Jose