1 / 39

Translight/PacificWave

Translight/PacificWave. John Silvester Executive Director of Center for Scholarly Technology Professor or Computer Engineering, USC Chair, CENIC. NSF OCI-IRNC Cooperative Agreement [#0441119]. Briefing to NSF-OISE, April 28, 2006. Translight/PacificWave (TL/PW).

stew
Download Presentation

Translight/PacificWave

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Translight/PacificWave John Silvester Executive Director of Center for Scholarly Technology Professor or Computer Engineering, USC Chair, CENIC NSF OCI-IRNC Cooperative Agreement [#0441119] Briefing to NSF-OISE, April 28, 2006

  2. Translight/PacificWave (TL/PW) • Cooperative Agreement [#0441119] under NSF IRNC Program • PI John Silvester (USC); Co-PI Ron Johnson (UW) • Other Key Partners • CENIC, Jim Dolgonas • PNWG, Jacqueline Brown • University of Hawaii, David Lassner • AARnet, George McLaughlin • Approx $1M per year for 5 years • Awarded March 1, 2005

  3. TL/PW Primary Objectives • Facilitate international R&E connections on US Pacific Coast • Assist in the termination (equipment, backhaul) of AARnet SXTransport links to Hawaii, Seattle and Los Angeles • Assist in build-out of Hawaii connectivity to Telescopes • Further develop PacificWave exchange capabilities • Assist in operation of IEEAF link Tokyo-Seattle • Assist in operation and support of other International R&E networks participating in PW • Develop and operate advanced capabilities to support optical interconnect and exchange needs of R&E networks

  4. What is Pacific Wave? • Pacific Wave is a state-of-the-art international peering facility designed to serve advanced research and education. • Primary focus is interconnectivity among US R&E networks and International R&E networks from the Pacific Rim • One of the objectives was the desire for all participants to be able to peer with each other which led to the “distributed exchange” design

  5. Context of Pacific Wave • The US States on the Pacific Coast [Alaska, Washington, Oregon, California, Hawaii] have collaborated in networking for several years. (e.g. US Pacific Consortium is an affiliate of APAN) • Seattle, Los Angeles, and Sunnyvale are “natural” places for exchange points • Many international links enter the US through Washington and California (and to a certain extent Hawaii although they tend to remain local there) • Led to the development of Pacific Wave – a collaboration between CENIC and PNWG to build out exchange capabilities on West Coast.

  6. Who Operates Pacific Wave? A joint project of CENIC and Pacific Northwest Gigapop In collaboration with University of Southern California and University of Washington

  7. Pacific Wave Layer 2 Exchange • Extensible peering exchange to allow layer 3 networks to peer easily over a layer 2 fabric • Nodes (currently) in Seattle, Sunnyvale, and Los Angeles. Connected by a 10GbE wave provisioned over National LambdaRail (2,241 kilometers) • AUP free • Supports IPv4 and IPv6; multicast enabled • Provides 24x7 NOC support. • Priced consistently from node to node • Allows participants to self-select their peering • Allows participants to connect to one-location and access participants at all Pacific Wave nodes • Supports advance applications • Welcomes any research or development network that can meet the minimum network configuration requirements (connect with a router; support BGP; support jumbo-frames)

  8. International Participation

  9. “Layer 3” R&E Networks and Pacific Wave CA*NET4 AARNET GEMNET GLORIAD IEEAF KREONET MIMOS (Malaysia) QATAR SINET SINGAREN TANET/TWAREN TRANSPAC2 Pacific Wave ABILENE (Internet2) CALREN (HPR) DREN ESNET NASA NLR-Packetnet PNWG CLARA CUDI

  10. PacificWave Seattle 1 Gigabit 10 Gigabit NLR Lambda to STARLIGHT NLR-Packetnet AARNet Abilene ATTBI/Comcast TANET2/TWAREN CA*NET4 SingAREN DREN PNWGP Seattle Westin CISCO 6509 ESnet Microsoft GEMnet KREONet2 WIDE/TLEX (IEEAF) NLR Lambda to LAX (via Sunnyvale) Does not show “lightpath” connections

  11. 1 Gigabit 10 Gigabit Pacific Wave - Sunnyvale NLR TO SEATTLE PWAVE ESNET PAIX CENIC SVL HPR L3 SVL 6509 NLR TO LA PWAVE Does not show “lightpath” connections

  12. 1 Gigabit 10 Gigabit Pacific Wave - Los Angeles 10 GE NLR Lambda To Seattle PWave (via Sunnyvale) Mimos Berhad (Malaysia) Abilene Qatar Foundation 1 Wilshire 6509 600 W 7th 6509 818 W 7th 6509 TWAREN Los Nettos (3) Singaren NII/SINET AARNet CalREN-HPR TRANSPAC2 Cinegrid NLR Packetnet Does not show “lightpath” connections

  13. Network Topology

  14. The VLAN Architecture

  15. CA*Net4 POP PW-Seattle TλEX Tokyo PW-LA Oahu IEEAF Link CLARA, CUDI POPs (Tijuana) Hawaii AARnet-SX Transport AARnet POP Sydney IRNC TL/PW Pacific Connections

  16. TL-PW – West Coast Detail NLR link PW-Seattle SEA Hillsboro(OR) Portland (OR) (NLR) AARNet-SX(N) To Kahe Point (HI) Pacific Wave N-S link SNV (CalREN-XD) Los Osos (CA) SLO (CA) AARNet-SX(S) To Spencer Beach (HI) Santa Barbara (CA) Optics to carry new lambda over CalREN-XD from SLO to LA LAX PW-Los Angeles

  17. TL/PW – Hawaii Detail SCCN OC-192 Kahe Point (Oahu) AARNet-SX(N) To Portland Hawaii Gigapop (Oahu) AARNet-SX(S) To Sydney Spencer Beach (Big Island) AARNet-SX(S) To Los Osos SCCN OC-192 AARNet-SX(S) To Sydney Waimea Hilo Mauna Kea MKOCN (Summit)

  18. JCMT UKIRT IRTF CFHT Keck VLBA CSO Gemini UH-2.2 UH-0.6 SMA Subaru 56kb Verizon Summit UH-Managed Shared Network for All Observatories Hilo Base Facilities VLBA JAC Waimea Base Facilities DS3 Keck Verizon Humuula CSO Verizon Hilo CFHT Verizon Waimea Gemini UH Hilo Campus Leased Private Links SMA Carrier Infrastructurefor leased shared & private links UH IfA Hilo Leased DS3 (shared) UH managed fiber links Subaru Proposed New GbE Mauna Kea Observatories Communication Network

  19. Status of TL/PW as of April 2006 • Engineering and technical support through PNWG and CENIC for all International connections into Pacific Wave • Northern AARnet Link • Operational and in use • Southern AARnet Link • Backhaul from Los Osos through San Luis Obispo to PW-LA over CALREN as OC-192 in place • ETE equipment for HI and LA on order (arriving as we speak). • Local connectivity in Hawaii – in process • Expected operation (test mode) end of May

  20. Changing Requirements for Exchanges • The Exchange points need to provide a wider array of services: • Layer 3 Interconnect (routed) • Layer 3 Interconnect (over layer 2 switch) • Layer 2 Interconnect (Ethernet switching) • Layer 1 Interconnect (wave switching) • Layer 0 Interconnect (fiber interconnect) • PacificWave is moving in this direction to allow us to continue to participate in the world of Global R&E networking

  21. Pacific Wave Lightpath Interconnect • Primary focus has been on Layer 3 interconnect • There is a lot of interest in Layer 2 (“lightpaths”) and Layer 1 (“waves” and “lambdas”) interconnect. [GLIF, etc] • SXTransport(S) will be configured as 8x1GE • PW is deploying additional OC192 from LA to SEA configured as 8x1GE to allow interconnect for AARnet and other nets as demand grows. • Also plans in place to extend PW connectivity to Starlight (Chicago) to further enhance layer 3 and lightpath interconnect capability

  22. Pacific Wave Lightpath Exchange To Canarie NLR To Chicago and Starlight IEEAF to TλEX SEA HOPI SNY HOPI LA AARnet to AU, via HI NLR To Phoenix San Diego

  23. Lightpath Networks and PW CA*NET4 NLR Waves NLR (Layer 2) CALREN-XD HOPI (Internet2) PNWG Pacific Wave TRANSPAC (?) AARNET (S) (to TλEX) IEEAF Others in the planning stages

  24. CENIC 15808 CENIC 15808 CENIC 15808 to SLO to SNY, SEA AARNet S Path PW Lightpath Interconnect PW-L2X (8x1G) LAX-SNY-SEA PW 15454 6509 AARnet Router PW-L3X:10G LAX-SNY NLR Packetnet 6509 818 CalREN Router Abilene 6509 Singaren Twaren PW-L3X-LA to SD

  25. Some Current Projects

  26. Activities • Basically all International R&E traffic to Pacific Rim flows through PW • Recent Highlights • iGRID • SC’05 • PRAGMA • APAN • INTERNET2 meetings

  27. Examples • January 2005: Huygens Titan probe data transfer: 3Tbytes of satellite data distributed and collated for analysis to locations in Amsterdam and Australia • January 2005: Tele-microscopy demo between University of Hawaii and UCSD (Lariat network) • January 2005: PTC Honolulu 270Mbps interactive HD video conferencing with Australia and Seattle • January 2005: Seattle—Tokyo, uncompressed HDTV 1.5 Gbps Smarr HD lecture between Seattle and JGN meeting • June 2005: Chicago-Seattle-UCSD OptiPuter HD permanent interactive uncompressed HDTV video-conference link

  28. Examples – iGRID05 • 4k interactive HD between Tokyo & SD • Concurrent n-way real-time low-latency uncompressed 1080 line (ie >1gb/s per stream) HDTV teleconferencing between Australia, Japan, Korea, Ann Arbor, Seattle and San Diego • 100 megapixel remote viz. Illinois-SD • Real-time flat-panel stereo, remotely rendered • Clusters in Chicago & Amsterdam loosely coupled compute demo: performance = to single machine room alternative!! • Neptune/‘Looking’ real-time HDTV from 2km below the surface showing volcanic vents in the northeast pacific

  29. Examples • November 14-17, 2005: SC05 Seattle. About 50 10gb/s waves, petabytes of storage, leading edge visualization systems and teraflops of computing assembled for a week computational sciences etc conference for this. • ‘Persistent’ OptIPuter • Wide Area Storage GRIDs • The Next Disaster Recovery Architectures that really work!? • Neptune Canada ‘in the water’

  30. “Neptune” Ocean Observatories ‘Dry’ Headend – Nodes & Access points

  31. Recent Stereo Video • I2 Spring MM from Stanford Medical School (Margaret Krebs, Testbed Mgr, Stanford University Medical Media and Information Technologies) ran a stereo video program test with CSIRO in Sydney on March 30th via  Abilene and SX.  • They ran about a 90Mbps stream for the  test.  No problems through AARnet N and across AARnet.

  32. iGrid 2005, San Diego Sept. 2005 • iGrid 2005, Over 10 Gbps bidirectional traffic coexisted with production exchange traffic without detriment • 4k line interactive Super-HD between Keio University and UCSD • Live HD from the sea floor 100 miles off the Pacific Coast • N-way uncompressed multicast HD video conferencing

  33. ResearchChannel N-Way HD Multicast Video Conferencing

  34. Does it Really Perform in Practice? …Yes! • 7.5 Gbps of unicast HDTV over IP traffic (10 750 Mbps flows) • 3 Gbps of multicast replicated in Seattle switch node using PIM snooping • Traffic test performed in Cisco POC lab before the event

  35. An Amazing Feat at SC05

  36. 47 10 Gbps Lambdas to be Exact

  37. HDTV Conferencing Spanning Two Oceans Enabled by Pacific Wave

  38. Traffic Flows at Supercomputing • Among other things, 5-way multicast replication of 3 Gbps, over 12 Gbps total traffic across the switch backplanes

  39. Thank you John Silvester, silvester@usc.edu

More Related