260 likes | 268 Views
Presentation to MAX membership on the latest updates, new participants, and MAX production network services. Also includes information on MAX's background, history, and strong carrier partnerships.
E N D
What’s MAX Been Up to Lately?Presentation to MAX membership Dan Magorian Director of Engineering & Operations November 30, 2005
Welcome New MAX Participants! • Since April, 3 new participants joined for total of 38: • USDA, Beltsville Agriculture Research Ctr • Library of Congress • Northrop Grumman • Folks who are near term: • Health & Human Services (parent agency of NIH) • Lab for Telecom Science (LTS) • Venter Institute • And folks that are in process: • Johns Hopkins APL campus • Inter-American Development Bank • DC networks (welcome back Chris Peabody) • Sun Microsystems Compute Grid @ 10G • Max will likely be at 44 connectors by early 06 • Forecast is for continued growth!!
Higher Education (18) Baltimore Education & Research Network (BERnet) Catholic University Georgetown University George Washington University Johns Hopkins University Montgomery College National Consortium for Supercomputing Applications / ACCESS Network Virginia (aggregating the State of Virginia) Smithsonian Institution Southern Universities Research Association (SURA) University of California, D.C. campus University Consortium for Advanced Internet Development (UCAID / Internet2) University of Maryland, College Park University of Maryland, Baltimore University of Maryland, Baltimore Co. Univ. System of Maryland Network (aggregating 11 campuses) University of Southern California, Information Sciences Institute / East Washington Research Library Consortium rev. 10/27 Federal Labs and Agencies (14) Library of Congress NASA / GSFC National Archives and Records Administration (NARA) National Science Foundation (NSF) National Institutes of Health (NIH) Nat’l Institutes of Standards and Tech. (NIST) National Library of Medicine (NLM) National Oceanic and Atmospheric Administration (NOAA) Naval Research Lab & ATDnet U.S. Census USDA, Beltsville Agriculture Research Ctr U.S. Department of State (through GWU) U.S. Geological Survey U.S. Holocaust Memorial Museum Corporate and Non-profit (6) Howard Hughes Med. Institute Fujitsu Labs of America Northrop Grumman The Institute for Genomic Research Windber Professional Services, Inc World Bank Participant Consortium of 38 Participants Directly Connected Higher Education, Federal Agency, and Non-Profit Institutions
Introducing new MAX production engineers • Dave Diller, Senior Network Engineer • Chris Tsonis, Services Engineer • And most people know: • Quang Bach, Senior Network Engineer • We’re very happy to have them, and we have more DRAGON and MAX production openings to fill soon!
MAX is More than Production IP Networking MAX Activities Production Net Activities ResearchActivities Layer 3 IP Network Services Layer 1 Optical Services Internet2 HOPI Test Bed support DRAGON Experimental Networking NGIX/East FedNet peer point Related Strategic Activities AtlanticWave, Quilt, ATDNet-V2 Research Technologies Additional Funded Research
For new folks:A Brief Background & History • Founding consortium: Georgetown U., George Washington U., U. of Maryland, & Virginia Tech. • UMD hosts MAX’s administration. • 1997: 155 mb atm network to vBNS connecting 4 univs. • 2000: Built regional dark fiber network lit by dwdm lambdas connected to Abilene/Internet2 at 2.5 gb . • Evolved into a rapidly-growing group of universities, federal agencies, and commercial and non-profit institutions emphasizing advanced networking. • Currently operating optical OC-48 network in the DC, suburban MD, N Va, Baltimore metro areas. • Doubled network size in 2-3 years
MAX Production Network Services • IPv4 unicast, IPv4 multicast, and native IPv6 unicast. • Internet2 (Abilene network) regional aggregation • ISP resale (Qwest DIA, just added Cogent) • NGIX/East FedNet peer point operation • National Lambda Rail (NLR) aggregation and fanout • Lambda transport on MAX dwdm optical network • MPLS tunnel transport in MAX IP network • Participant Colocation at UMD, Qwest, & Level3 pops • Network monitoring and uptime/usage reporting
Strong Carrier Partnerships • With 6 (soon 7) MAX pop locations around region, participants can connect at one or more locations via dark fiber or lit services via aggressive low-cost carriers, as well as traditional telcos. • 80% & growing of participant circuits ethernet. • Strong partnerships with carriers (11 & growing!) • Qwest, Level 3, Fibergate, Starpower/RCN, Yipes, Allied Telecom, AboveNet, Looking Glass Nets, Verizon, MCI, ATT.
Mid-Atlantic Crossroads DREN vBNS GEANT ESnet Abilene DRAGON NREN Cogent Qwest ISP NISN MAX Regional Infrastructure National/International Peering Networks Regional Network Participants NGIX-East ATDnet Univ System Md Network Virginia Institutional Connectors
MAX upstream network peerings • Abilene (diverse: 2.5 gb primary /1 gb backup, 10 gb) • vBNS network (1 gb) • Defense Research & Exp Net (DREN) (1 gb) • Energy Sciences net (ESnet) (1 gb, becoming 10 gb) • NASA’s NISN and NREN (1 gb ea) • USGS DOI net (1gb) • Qwest DIA ISP service offering (1 gb, adding 2nd 1 gb) • National Lambda Rail (lambdas, no peerings “yet”) • GEANT, “European Abilene”, (10 gb, spring 06) • Atlantic Wave distributed peer fabric, (summer 06)
MAX Commodity Internet Services • 3rd year of Qwest DIA service, resold to any participant for primary or secondary ISP. • ISP routes kept separate from I2 routes via RFC 2547 MPLS vpns (Separate routing tables, separate peerings) • 13 participants, 650 mb aggregated and growing, added Census, NOAA, and raised JHU during 2004-5, up from 11 participants at 405 Mb. HHS coming onboard shortly with additional 400 mb. • Dropped cost from $70 mb/m to $55 mb/m in year 3 (start Oct) • Talked Qwest into 2nd redundant burstable peering for minimum incremental cost, prototype for Quilt offering. Online shortly. • Provided emergency outbound ISP to NOAA for Katrina relief. • Just added Cogent as very-low-cost ISP via resale through GWU. Peering established, just waiting completion of MOU.
National Association of GigaPoPs • MAX is a member of TheQuilt, a national association of GigaPoPs • Provides collaboration on projects to benefit the individual GigaPoPs • E.g., Leverages multi-state buying power • ISP services with pricing based on aggregated national bandwidth tiers • national pricing for commodity ISP services
BALT Baltimore M40e Router NGIX T640 Router OC48c POS CLPK College Park OADM Aggregation Switch M160 Router Washington D.C. DCGW DCNE OC48c POS Abilene Northern Virginia Qwest OC48c POS ARLG M160 Router Where we were Spring 05
MAX is in the middle of a huge expansion • Upgrade and consolidation of layer 3 routers • Removed 3 Juniper M160s (EOLed) • Installed 2 Juniper T640s, cutting all customers over. • Router changeover essentially complete! • Expansion of layer 1 core optical network • Backhaul with redundancy of switches at pops • Top-tier customer optical backhaul from any pop • Integrating second optical dwdm system (Movaz) • Optical backhaul of Abilene and Qwest ISP • Expansion to new Level 3 pop (NLR) – already filled! • Easily 5x more complex than original network installation, esp logistics to preserve service uptime. • It went well, other than some Qwest provisioning nightmares.
R&E Nets NLR Abilene Cogent Qwest Where we are Fall 05 State of MD pop, Baltimore 1. Original Zhone dwdm over Qwest fiber M40E 2. Movaz dwdm over State Md fiber OC48c w/ OC3 backup Level3 pop, Mclean VA NGIX Ring 2 T640 MCLN CLPK T640 UMD pop, College Park MD CLPK Ring 1 DCGW DCNE ARLG GWU & Qwest DC pops, ISI/E Arlington VA pop
What’s in Progress Now? • More optical rings ahead! • Large expansion of Movaz dwdm CLPK-LVL3 from 2 chassis to 8 • Upgrade to REII chassis, allowing protected lambdas • Changeout of 8 operating lambdas to new transceiver types • Ringout of path via strong partnership with NWMd (2nd MOU) • New pop location at Equinix in Ashburn VA thanks to HHMI contribution! • AboveNet dwdm ring from Level3 Mclean to Equinix • Pick up second 1 gb Qwest ISP connection for protection/expansion • New dwdm ring College Park to Baltimore replacing OC48, thanks to USM • Will be able to offer protected lambdas to Baltimore participants • Will offer protection to MAX backbone from fiber cuts etc. • Upgrade to 10G-capable Force10 ethernet switch in Baltimore • Next phase Q1 06 will upgrade MAX backbone from OC48 to 10G, including Abilene connection. Already have added new top-tier OC48-10G participant bandwidth pricing ($200k/yr). • High uptake on MAX lambda offering for NLR fanout, already 6+ 10Gs in planning for ESnet, GEANT, NOAA, NASA, etc • Atlantic Wave distributed peerings to NYC and Miami for NGIX customers
Qwest Cogent R&E Nets Abilene NLR Qwest Where we’ll be by Spring 06 State of MD pop, Baltimore 1. Original Zhone dwdm over Qwest fiber BALT M40E 2. Movaz dwdm over State Md fiber 3. HHMI dwdm over Abovenet fiber Ring 4 4. USM dwdm over State Md fiber Level3 pop, Mclean VA CLPK NGIX Ring 2 T640 MCLN CLPK T640 UMD pop, College Park MD CLPK MCLN Ring 1 Ring 3 DCGW DCNE ASHB ARLG Equinix pop, Ashburn VA GWU & Qwest DC pops, ISI/E Arlington VA pop
NGIX MAN LAN ATL MIA Atlantic Wave Distributed Peering Topology Initial East Coast NLR 10G A-Wave Backbone Future backbone Extensions within NA & EU To South America To Europe & Canada, Miami, FL Atlanta, GA Washington, DC New York City, NY 10G ethernet via NLR Ethernet fanout
We want to encourage Redundant Peerings for participant protection (high-9’s) LVL3 T640 Movaz dwdm Already doing with USM and NetWorkVa, works well. NLM is in progress with theirs. Approach is to have 2 of your routers peer with 2 MAX routers over diverse fiber paths. MAX can provision lambdas to help accomplish this. CLPK T640 Movaz dwdm USM NLM NetWVa
Offsite backup, the next “killer application” • Some MAX participants already have procured off-site backup of critical services. This can be quite expensive through commercial offerings. Many other MAX folks are in process of figuring out options now. Offsite backup was one of biggest service requests spring MM. • MAX already runs colo at UMD and Level3 (NOAA, HOPI, NASA). This has worked out well. • Because of already being out of space in new Level3 suite, we’re intending to build a much larger expansion space nearby for our own and other’s racks. Northrop Grumman, right next to Level3 in Mclean VA, is a strong possibility for lots of racks/cages/cabinets and power. • We would like to be able to offer rack/cage space to participants at low rates, using same simple “do-it-yourself” model with some “smart hands” help. Could provision lambdas back to your institutions to make racks become part of your networks w/o MAX L3 in middle. • Beyond regional backup, potential for backup across NLR to remote areas of country. Those gigapops would probably be thrilled to do this.
MAX networking efforts are directed toward extending the services & performance of the national high performance backbones into the region and to leverage the resources of MAX for the good of all participants.