1 / 15

ESnet Planning for the LHC T0-T1 Networking

This article discusses the planning and infrastructure of ESnet, the high-speed networking system for the Large Hadron Collider (LHC). It covers the IP core and Science Data Network (SDN) of ESnet, as well as its connections to international partners and major research facilities. The article also outlines the proposed upgrade schedule for ESnet.

bensonm
Download Presentation

ESnet Planning for the LHC T0-T1 Networking

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ESnet Planning for theLHC T0-T1 Networking William E. Johnston ESnet Manager and Senior Scientist Lawrence Berkeley National Laboratory

  2. ESnet High-Speed Physical Connectivity toDOE Facilities and Collaborators (Summer 2005) SINet (Japan) Japan – Russia (BINP) SINet, AARnet Australia CA*net4 Taiwan (TANet2) Singaren CERN (LHCnet – partDOE funded) CA*net4 France GLORIAD Kreonet2 MREN Netherlands StarTap TANet2 Taiwan (ASCC) GEANT - Germany, France, Italy, UK, etc PNNL PNWGPoP NERSC SLAC ANL BNL MIT LIGO INEEL LLNL LBNL MAN LANAbilene SNLL JGI TWC Starlight GTN&NNSA 4xLAB-DC INEEL-DC ORAU-DC LLNL/LANL-DC Chi NAP FNAL AMES PPPL JLAB ORNL SRS SNV SDN HUB SNV SDN HUB SNLA LANL DOE-ALB PANTEX NOAA ORAU OSTI ARM YUCCA MT BECHTEL-NV GA Abilene Abilene Abilene Abilene MAXGPoP KCP Allied Signal SDSC HUB ALB HUB ELP HUB DC HUB NYC HUB CHI HUB ATL HUB SoXGPoP NREL ESnet Science Data Network (SDN) core SEA HUB ESnet IP core CHI-SL HUB QWEST ATM MAE-E SNV HUB Equinix PAIX-PA Equinix, etc. 42 end user sites Office Of Science Sponsored (22) NNSA Sponsored (12) International (high speed) 10 Gb/s SDN core 10G/s IP core 2.5 Gb/s IP core MAN rings (≥ 10 G/s) OC12 ATM (622 Mb/s) OC12 / GigEthernet OC3 (155 Mb/s) 45 Mb/s and less Joint Sponsored (3) Other Sponsored (NSF LIGO, NOAA) ESnet IP core: Packet over SONET Optical Ring and Hubs Laboratory Sponsored (6) peering points SND core hubs IP core hubs SNV HUB high-speed peering points

  3. ESnet • The IP core is primarily a layer 3 infrastructure • However, supports layer 2 via MPLS • Directly connects sites • Provides global peering for sites • The SDN core is primarily a layer 2 infrastructure • Targeted at providing virtual circuit services • Site connectivity is evolving to be Metro Area Network rings • Goal is two independent core rings that are interconnected at various locations with metro area rings

  4. ESnet Target Architecture: IP Core+Science Data Network Core+Metro Area Rings CERN Asia-Pacific GEANT (Europe) Science Data Network Core (SDN) (NLR circuits) Seattle Chicago Australia New York Sunnyvale Washington, DC IP Core Atlanta LA Aus. Albuquerque San Diego El Paso MetropolitanArea Rings IP core hubs 10-50 Gb/s circuits Production IP core Science Data Network core Metropolitan Area Networks Lab supplied International connections SDN/NLR hubs Primary DOE Labs New hubs

  5. Evolution of ESnet – Step One:SF Bay Area MAN and West Coast SDN CERN Asia-Pacific GEANT (Europe) Science Data Network Core (SDN) (NLR circuits) Seattle Chicago Australia New York Sunnyvale Washington, DC IP Core (Qwest) Atlanta Aus. LA San Diego Albuquerque El Paso MetropolitanArea Rings IP core hubs Production IP core Science Data Network core Metropolitan Area Networks Lab supplied International connections SDN/NLR hubs Primary DOE Labs In service by Sept., 2005 planned New hubs

  6. LHC Requirements • 10G “light paths” from FNAL and BNL to CERN • CERN/LHCnet will provide10G circuit to Starlight and likely another to 32 AoA • BNL must communicate with TRIUMF (Vancouver) • Data rates? • Backup paths must be provided • 10G Starlight to MAN LAN • Others • Access to T2 sites • What characteristics? • At least 1G guaranteed

  7. ESnet Approach for LHC Requirements LHC FNAL GEANT MAN LAN ESnet ESnet SDN SDN SDN IP IP IP FNAL FNAL LHC SL CANARIE Triumf CERN CERN 32 AoA BNL Starlight 60 Hudson(or 32 AoA) QwestChicago FNAL ESnet SDN core All paths are 10 Gb/s Sunnyvale ESnet IP core

  8. ESnet Goal – 2007/2008 Major DOE Office of Science Sites AsiaPac • 10 Gbps enterprise IP traffic • 40-60 Gbps circuit based transport SEA Europe CERN CERN Aus. Europe ESnet Science Data Network (2nd Core – 30-50 Gbps,National Lambda Rail) Japan Japan CHI SNV Europe NYC DEN DC MetropolitanAreaRings Aus. ESnet IP Core (≥10 Gbps) ALB ATL SDG ESnet hubs New ESnet hubs ELP Metropolitan Area Rings High-speed cross connects with Internet2/Abilene 10Gb/s 10Gb/s 30Gb/s40Gb/s Production IP ESnet core Science Data Network core Lab supplied Major international

  9. Proposed ESnet Upgrade Schedule • Fiscal Year 2005 • FNAL-ANL-Chicago Metropolitan Area Network • Fiscal Year 2006 • BNL MAN • Fiscal Year 2007 • Extend Science Data Network (SDN) from Seattle=>New York/Washington, DC at 10G. Jefferson Lab MAN. • Fiscal Year 2008 • Science Data Network (SDN) loop around the country at10G. ORNL MAN. • Fiscal Year 2009 • Double main Science Data Network (SDN) links to 20 Gigabits. • Fiscal Year 2010 • Increase main Science Data Network (SDN) links to 30 Gigabits per sec. PPNL MAN.

  10. ESnet Lambda InfrastructureBased on National Lambda Rail(incremental install 2005-2008) Seattle Boise Clev Chicago New York Denver Sunnyvale KC Pitts Wash DC Raleigh Tulsa LA Albuq. Phoenix San Diego Atlanta Dallas Jacksonville El Paso - Las Cruces Pensacola Baton Rouge Houston San Ant. NLR regeneration / OADM sites NLR wavegear sites

  11. ESnet Near-Term Planning for FNAL (mid-late 2005) T320 T320 T320 CERN ORNL OC192 NRL,UltraScienceNet, etc. ESnet IP core ESnet SDN core Starlight sw IWire Qwest hub (NBC Bld.) Starlight Notes FNAL Qwest FNAL FNAL Shared w/ IWire ESnet • All circuits are 10Gb/s • ESnet fiber (single lambda) ESnet Switch/RTR FNAL ESnet site gateway router ESnet/Qwest site equip.

  12. ESnet Planning for BNL and Long Island MAN Ring T320 M320 CERN LI MAN – Diverse dual core connection Starlight Chicago(Qwest hub) Europe BrookhavenNational Lab, Upton, NY AbileneNYSERNetSINet (Japan) CANARIE (Canada) HEANet (Ireland)Qatar GEANT 10GE circuit ESnet demarc Cisco 6509 MAN LAN LI MAN DWDM ESnet IP core 10GE circuit 1 GE or 10 GE 32 AoA, NYC ESnet SDNcore router 60 Hudson, NYC BNL IP gateway 2.5G NLR OADM ESnet IP core(Qwest) 10 Gb/s circuits International LHCnet circuits (proposed)production IP core SDN/provisioned virtual circuits Washington ESnet SDNcore(NLR circuits) Chicago(Syracuse – Cleveland – Chicago) Washington (Qwest hub) Engineering Study for LI MAN

  13. ESnet Planning for BNL and Long Island MAN Ring T320 M320 CERN LI MAN – Diverse dual core connection Starlight Chicago(Qwest hub) Europe BrookhavenNational Lab, Upton, NY AbileneNYSERNetSINet (Japan) CANARIE (Canada) HEANet (Ireland)Qatar GEANT 2 1 10GE circuit ESnet demarc Cisco 6509 MAN LAN LI MAN DWDM ESnet IP core 4 10GE circuit 1 GE or 10 GE 3 32 AoA, NYC ESnet SDNcore router 60 Hudson, NYC 7 BNL IP gateway 6 2.5G NLR OADM ESnet IP core(Qwest) 5 10 Gb/s circuits International LHCnet circuits (proposed)production IP core SDN/provisioned virtual circuits Washington ESnet SDNcore(NLR circuits) Chicago(Syracuse – Cleveland – Chicago) Washington (Qwest hub) Engineering Study for LI MAN

  14. ESnet Planning for BNL and Long Island MAN Ring T320 M320 CERN LI MAN – Non-diverse dual core connection Starlight Chicago(Qwest hub) Europe BrookhavenNational Lab, Upton, NY AbileneNYSERNetSINet (Japan) CANARIE (Canada) HEANet (Ireland)Qatar GEANT 10GE circuit ESnet demarc Cisco 6509 MAN LAN LI MAN DWDM ESnetIP core 10GE circuit 1 GE or 10 GE 32 AoA, NYC ESnet SDNcore router BNL IP gateway 2.5G ESnet IP core(Qwest) 10 Gb/s circuits International LHCnet circuits (proposed)production IP core SDN/provisioned virtual circuits ESnet SDNcore(NLR circuits) Chicago(Syracuse – Cleveland – Chicago) Washington Washington (Qwest hub) Engineering Study for LI MAN

  15. ESnet Planning for BNL and Long Island MAN Ring LI MAN – ring detail MAN LANCERN (?)NLRESnetGEANT, etc. Other connections BNL internal Other connections Engineering Study for LI MAN **CONFIDENTIAL**

More Related