210 likes | 401 Views
Pacific Wave, Pacific Light Rail, And National Light Rail. Jacqueline Brown University of Washington, Seattle CANS2002, Shanghai, 22 August 2002. Pacific Wave. Pacific Wave is a service of the Pacific Northwest Gigapop. High speed peering point for regional and international networks
E N D
Pacific Wave, Pacific Light Rail, And National Light Rail Jacqueline Brown University of Washington, Seattle CANS2002, Shanghai, 22 August 2002
Pacific Wave Pacific Wave is a service of the Pacific Northwest Gigapop. • High speed peering point for regional and international networks • Complement of Abilene and CA*net3 International Transit Network services • Open peering point for participant-managed bilateral peerings
Features of Pacific Wave • Close to major Pacific cable landing sites • Located in incumbent telecommunications carrier grade hotel • easy access to collocation services • easy access to fiber-meet-me-room • easy access to full U.S West Coast fiber grid • Gigabit Ethernet is high speed, low cost, low maintenance • No PNWGP staff involvement required to setup your peerings; no ATM PVC’s or mandated routing policy • Switches implement PIM-SM snooping for increased multicast efficiency
Features of Pacific Wave (cont.) • 24 x 7 Network Operations Center • Redundant environmentals (DC, HVAC) • PNWGP Commodity Internet Services • Engineered and delivered via four diverse tier-one vendors • Vendors chosen after exhaustive review of capacity, support, peering, etc. • Diverse geographic connectivity for commodity services • 1.45Gbps throughput (under expansion)
Networks at Pacific Wave: Spring 2002 • AARNet – Australian Academic & Research Network • Abilene Network/Internet2 • ATT Broadband Internet • CA*net3/CANARIE • DREN – Defense Research and Engineering Network • ESNet – Energy Sciences Network • Microsoft Corporation • Pacific Northwest Gigapop • Siemens Medical – Pointshare • TANET2 – Taiwan Research Network • TransPAC – Asia Pacific Academic Networks (APAN)
Note: Aubrey Bush’s slide RESEARCH = Network research testbeds EXPERIMENTAL = Experimental network infrastructure OPERATIONAL = 24/7 operational high performance networks Chicago 5/DEC/01 Grand Challenges in e-Science Grand Challenges in e-Science
R&E Network Tiers NETWORK DISCONTINUITIES LEADERS NETWORK TYPE CAPABILITIES/USERS Research Academic Research, papers, lab. Experiments, spools of fiber In labs & sparse testbeds Computer Science & Net. Researchers CS, Comp. Science & ‘Grid’ researchers, + major experiments (eg DTF) & net. experimenters + leading edge labs and centers, optics sys.& net. Industry R&D groups + I-WIRE PACIFIC LIGHTRAIL + Internet-2 wave projects; Bleeding-edge e2e services & facilities for key experiments, programs, projects, researchers & for next gen. tech., architectures, Grids, content, apparatus, etc. ‘Things that haven’t been done before; with, to, on or over networks’. ’s, P2p fiber, & >=10g ip … Experimental & Developmental Networks I2-Abilene, GigaPoPs; Fed. ‘NGI’ Nets. Leading-Edge ipServices for demanding apps . & middleware Operational High Performance Research Support Networks Internet-2, GigaPoPs I2-K20 Common Denominator, Advanced Services Research & Education Network Advanced Services for R&E users ISP’s, hosting .com’s etc. Business,.Gov. & General Public Commodity Internet 12/05/01
N A T I O N A L L I G H T R A I L An Extraordinary Opportunity for a Research & Education Community Owned & Lit, Fiber-Based, National-Scale Experimental & Research, & Production ‘.edu’ Network Infrastructure Revised 8-15-02 rj
Optical Fiber Options:Creative Approaches to Extraordinary (but perishable) Opportunities(to make Bandwidth a Resource instead of a Constraint!)
Keep the Experimental Networks tier from sliding down the network development ‘Spiral’ And, Long Term Privatization Commercialization Today’s Internet Research Nets ‘NGI’ efforts Research and Development Partnerships Source: Ivan Moura Campos
A Real Partnership & Project:N A T I O N A L L I G H T R A I L • Partners = CENIC & Pacific Wave (aka the ‘Pacific LightRail partners) + Distributed Terascale Facility (DTF-ETF) & I-Wire folks + UCAID + NCAR + a few others • Rooted in a lightweight, but coordinated, and opportunistic collaboration of the NLR partners to acquire, provision and ‘operate’ optical networking assets • Now seeking to establish national scale: • owned & lit fiber infrastructure cost-effectively providing many waves – bulletproof dedicated, waves for separate services, projects, experiments • optical infrastructure substrate for e-science projects (proposing to a diverse array of funding agencies) • provide appropriate hooks and support for advanced network measurement and academic research • provide waves for various other R&E metro, regional and national ‘operational’ network etc services • A viable long term option (but full-costed 5 yr amortization for start) • ‘AUP free’! • MetaPoPs & strategic pop’s
Optical Network Landscape • Temporarily open windows of opportunities wrt: • Optronics kit manufacturers (some will do LAN PHY for us). • Fiber Owners Long haul & Metro – great deals available now • PoPs Co-Lo facilities – available & affordable • [But Not Wave Vendors (Instead we are seeing recent rising prices/lessened competition, and unwillingness to: generalize occasional good pricing; to create believable/bulletproof long term price and availability protections; to provide techs like LAN PHY )] • Existing metro, regional (&linked!) & now inter-regional/national efforts to deploy cost-effective, reasonably enduring, i.e. owned & lit fiber based multi R&E infrastructure: • Leveraging state & regional K-20 + higher ed transport activities • Leveraging ‘production’ networks (on dedicated waves) • Research & Experimental network capabilities • To/among major research sites including NSF, DoE, and university facilities and end users
Optical network project differentiation/evolution Derived from Steve Corbato, Internet2 Feb. ‘02
ADDRESSING NETWORK DISCONTINUITIES P A C I F I C L I G H T R A I L • LONG LINES: • Lit fiber plus waves • Options for more @ discount • Could buy fiber (nationally) • METRO: • Owned Fiber Rings/Segs. in • SEA, SF BAY, LA, SD & SAC • PROVISIONABLE DEDICATED p2p WAVES • MetaPoPs! • ESTABLISHING KEY PIECES • FOR FLEXIBLE LONG TERM LOW COST PROVISIONING! P/NWGP-Fairbanks U. Alaska ARSC etc Abilene? R P/NWGP SEA R Peerings? S UW OHSU/OGI? PDX R SAC CENIC ONI Tier 1 & 2 R UCD Peerings UCB & LBL SNY EMV R R UCSF Stanford SLAC SLO or R UCSB Caltech SB R Peerings DEN R LA CHI R NCAR?! UCLA ISI USC I-WIRE !!! ANH NY R LANL?? UCI R NM DC SD 10 gig waves R SDSC UCSD draft 12/4/01
National LightRail: cost-effective owned lit R&E fiber fabric Initial footprint 3/03 Leading-Edge e2e services & experimental network facilitiesvia MetaPoPs and inter-gigapop linksfor research & next gen. tech., arch., grids, DTF expansion, content, sensors, apparatus … Up to 40 dedicated 10 gigabit waves with up to hundreds of dedicated gigabit links system-wide. Canarie fabric SEA 10 gbs Tycom IEEAF donation BOS CLV? CHI 10 gbs Tycom IEEAF Donation NY SUN PIT DC DEN Raleigh? LA ATL MetaPoPs & Core Nodes ADM sites Desired Expansion PoPs/ADM National LightRail” (NLR) International Broadband Metro/WAN owned Fiber ‘Rings’connecting strategic R&E endpoints. 8/14/02
CalREN DC HPR Teragrid NLR HPR & DC NLR 10 gig Lambdas (startup NLR plus some CENIC & DTF-ETF waves on same glass) Seattle • Optical Amps are configured for 40 10 gigabit waves, which sub-dividable into hundreds of one gigabit dedicated paths plus 10 gigs • 4 10 gigabit waves at startup with one subdivided into 8 one gigabit paths. • Inexpensive addition of waves though-out or locally • Easily geographically extensible Portland Davis Via Metro Sacramento Oakland Sunnyvale Solidad Chicago Denver San Luis Obispo Los Angeles Santa Barbara Pittsburgh Tustin San Diego D.C. 8/14/02
Initial Configuration: • At least 4 express 10 gig waves on each DWDM span (in some cases there are as many as 8) • 8 wdm systems/spans in the initial footprint • Capacity up to 20 express waves and 20 add/drop waves per span • 1 wave terminated in NLR router for a common shared IP service (with the exception of SAN) • 1 wave terminated on NLR switches • 1 10GE client facing port on routers • 8 1GE client facing ports on switches for allocatable experimental 1 gig dedicated/private net services • Client router/switch ports and extra waves connect directly at colo and/or across metro WDM – uses of other 10 gig waves under active discussion
Lit National NLR Core Fabric Fiber A. Starting footprint - operational by March 2003. 5,207 miles A. B. Multi-Loop core for owned fiber R&E net - June 2004? B. 11,000 miles Dashed lines for regional not costed 7-28-02 ronj
NLR Achieves: • National & Extensible Core system of Lit Fiber with Dedicated Waves and/or bandwidth for Experimental Production and Research networks, • Initially providing no fewer than 4 Ten Gigabit Waves Nationwide; • One of which will be subdivided into dedicated 1 gigabit circuits/facilities; • Optical Amplifiers are configured from start with 40 10gps waves; • Very low cost for bringing up each additional 10 gigabit wave (each can be done point to point, e2e, or system-wide), or subdividing a wave; • Max. capacity of 40 separate 10 gigabit waves (400 gb/s total), each of which is easily subdividable into at least 8 1 gigabit dedicated circuits (or > 300 total if system-wide, or many more if point to point in smaller geographies). • Interoperates with, leverages and further enables DTF-ETF & other research & experimental network Endeavors • Easy and Inexpensive Extension to the other critical mass geographies • Establishes an enduring and highly flexible platform for enabling network based e-Science and for enabling NSF and other agency research & experimental net. activities. • MetaPoP & strategic physical PoP infrastructure!
Thank you! Jbrown@cac.washington.edu CANS2002, Shanghai, 22 August 2002