1 / 39

Deutsches Forschungsnetz

Deutsches Forschungsnetz. Roll-out of a National Research Network - a Field Report. Spring Internet2 Member Meeting Martin Wilhelm German National Research Network DFN wilhelm@dfn.de. Why a new network for DFN ?.

lilly
Download Presentation

Deutsches Forschungsnetz

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Deutsches Forschungsnetz

  2. Roll-out of a National Research Network -a Field Report Spring Internet2 Member Meeting Martin Wilhelm German National Research Network DFN wilhelm@dfn.de

  3. Why a new network for DFN ? • Contract with operator (TSI, subsidiary of Deutsche Telekom) ended at the end of 2005 • Market situation had changed significantly (availability of dark fiber, lower prices) • Requirements of users had changed a lot. In particular increased demand for • high capacities between relatively few sites • improved reliability and availability • more capacity for same / lower price

  4. The „Old“ Network G-WiN

  5. Pre-Tender: Market Survey • Market Survey started in early 2004 • Constraint: No budget for investments, so: • asking for offers of DWDM-services (no purchase of equipment) • asking for offers of rental of DF (no IRUs with upfront payment) • Results of Survey: • there is a market for DF in Germany (not the case when tendering for the „old“ Network) • a number of competitors can offer DWDM services at reasonable prices

  6. Preparing Call for Tender • The top 60 sites (by volume) were defined as potential end points for dark fiber (DF) as well as for Managed Wave Lengths (MWL), resulting in a 60 x 60 matrix • Bidders were asked to offer options for DF and / or MWL between any of two sites • In another lot bidders were asked to offer DWDM-services on DF provided by DFN • In a 4th lot offers for network supervision were solicited (24 * 7 * 365)

  7. Results of Tender (1) • DFs were offered between a significant number of DFN sites at reasonable prices • Comparing prices for MWL and cost for DF plus DWDM-services showed in many cases economic benefits for DF-solution from 2nd wavelength on (surprise, surprise ...) • For a few areas there was either no offer for DF or offers were economically not reasonable (the German DF badlands ;-))

  8. Results of Tender (2) • As a nice side effect, offers of DF could be arranged to build a number of rings. In total X-WiN now spans across approx. 5,500 fiber kilometers (approx. 3440 miles) • These rings then were complemented by a number of MWLs • Increased number of nodes  reduced number of access lines  cost savings

  9. X-WiN-Topology(Fibers and Managed Wavelengths) KOP KIE GRE ROS HAM AWI Fiber GL Fiber GC EWE DES Fiber DFN FFO Fiber KPN BRE TUB POT ENS Managed WL HAN HUB BIE ADH ZIB BRA MUE MAG DUI GOE KAS LEI DRE FZJ MAR JEN AAC BIR CHE GIE ILM FRA BAY GSI • 46 Core Sites (+ 3 CBF) • 31 connected by Fiber • 10 connected by Managed WL • 9 connected by fiber and MWL ESF WUE ERL HEI SAA REG FZK STU STB KEH GAR AUG Richtung Basel As of 18.01.2006 BAS

  10. Another topological view 132 AWI ROS W 115.00 AO AN HAM 249.00 FFO DES BRE 196.00 10.00 I HUB H 138.00 156.9 27 380.11 HAN ADH AM J AA 139.35 KIE G BIE K 39 Z 76.88 TUB 145.0 Y 16 AD L MUE 69.7 F 141.6 M BRA 107.0 ZIB X DUI AC POT 32 268.8 N 230.4 AL 168.5 E AAC MAG DRE 104.3 265.58 O AK D1 144.9 55.00 THU CHE 120.20 AJ D2 158.30 FZJ 102.2 LEI AI BAY AF JEN AG P ERL 138.10 179.70 62.68 ILM C 79.71 BIR AE 300.24 AH Q ESFL-S1 188.98 A FRA 121.73 R B REG 69.3 132.30 S V GSI U operational T 91.00 GAR 274.42 155,20 60.50 102 FZK HEI STU Under construction Kehl-S2 154.00 AP BAS

  11. DWDM Equipment • Contract (provision of DWDM-services) awarded to Huawei • Includes installation, operation and maintenance of DWDM equipment (carrier grade DWDM) as well as amplification (OLA) • Contract defines SLAs (and penalties) and obligation for pro-active 24*7 monitoring • Access to performance data (read-only) via open non-proprietary interface is part of contract

  12. Wavelength Planning • Task 1: Substitute G-WiN by X-WiN as hassle-free as possible (minimize reconfigu-ration and relocation of existing routers) • done by (almost) 1:1 copy of existing SDH-links to wavelengths (STM-16, STM-64) • Task 2: Integrate new DFN sites • this required a number of new routers. Some reconfiguration could not be avoided • Task 3: Optimise wavelength plan after the dust has settled (current work)

  13. Roll Out Stage 1 • Co-ordination of providers (DF and DWDM) • exchange of fiber info (lengths of fibre spans, attenuation of spans, location and access regulations of amplifier huts, contact details as phone, fax, e-mail of hotlines, ...) • Preparation of DFN-sites • creating space for additional equipment (DWDM) at „old“ sites • preparing grounds (sometimes from scratch) in „new“ sites: installation of cabinets, power, UPS, A/C, patch fields, out-of-band access, ...

  14. Roll Out Stage 2 • Verification of WL routing • Optimal WL routes proposed by Huawei experts • Cross-checked by DFN and verified against IP routing • Building of the (in)famous last mile • Almost all DFN-sites are on university / research lab campuses. All (but two) sites have dual connections. Cross-check that all fiber routes are built with full redundancy (sometimes difficult because of unadequate infrastructure or stubborn administrations)

  15. Roll Out Stage 3 • Installation of Optical Line Amplifiers (OLA) • Early installation was possible, because all long distance spans of fibers as well as amplifier huts were already in place • Installation of DWDM equipment at DFN sites

  16. Some Installation Impressions

  17. More Impressions

  18. Even more Impressions

  19. Roll Out Stage 4 • Link Commissioning • five teams working in parallel to set up basic interworking between adjacent DWDM locations. Since in most cases OLAs were required, this was done step by step: DWDM A -> OLA1 -> OLA2 -> DWDM B -> OLA3 -> DWDM C, then back to set up the other direction. • Detailed planning was necessary to minimize travel time between sites (problem of traveling sales man ;-)). • Average fuel consumption per working day: approx. 70 l per team

  20. Roll Out Stage 5 • Service Commissioning • again five teams in parallel working to set up end-to-end wavelengths including the digital interfaces (STM-64, STM-16, 10 GE, 1 GE), fine tuning of lasers etc. • again quite a bit of travel was involved, although remote set up and calibration was possible at this stage

  21. Roll Out Stage 6 • Switch over from „old“ G-WiN SDH-links to „new“ X-WiN wavelengths • The first approx. 10 links could be set up in parallel to existing SDH-links. This worked well. Good for building confidence ;-) • Since interfaces at all of our routers could not simply be doubled, most of the core links had to be „hot swopped“ (no old links in parallel standby). Some nervosity could be noticed ...

  22. Timeframe was a bit tight ... • The only thing we were sure of was the cut off date for G-WiN: 31 December 2005 ... • Fortunately, remarkably few things went wrong: • 4 or 5 wrong patches, a few faulty patch cables, three faulty boards, one weak laser etc etc • Last G-WiN link switched off on 29/12/05 • A German proverb says: „Luck is with the competent“ :-) • The following slides show how time went by

  23. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (15/09/05) ESF WUE ERL HEI REG SAA FZK AUG STU GAR KEH BAS

  24. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (26/09/05) ESF WUE ERL HEI REG SAA FZK AUG STU GAR KEH BAS

  25. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (29/09/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  26. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (02/10/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  27. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (13/10/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  28. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (31/10/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  29. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (07/11/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR KOP

  30. KOP DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (18/11/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  31. KOP DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR CHE GIE ILM FRA BAY GSI Roll out X-WiN (21/11/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  32. DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (30/11/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR KOP

  33. KOP DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR CHE GIE ILM FRA BAY GSI Roll out X-WiN (05/12/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  34. KOP DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR CHE GIE ILM FRA BAY GSI Roll out X-WiN (14/12/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  35. KOP DFN-Site KIE GRE Site infrastructure ready ROS AWI HAM DWDM installed DF ordered DES EWE DF delivered FFO BRE TUB MWL ordered POT HUB HAN MWL delivered BIE ADH MUE ZIB BRA MAG DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI Roll out X-WiN (19/12/05) ESF WUE ERL HEI REG SAA FZK AUG KEH STU BAS GAR

  36. Today: • Everything now on X-WiN • First links of old network were cut off on 2 January 2006 • No operational issues so far ...

  37. Cross Border Fibers CPH GRE KIE ROS AWI HAM DES EWE FFO BRE PSNC TUB POT HAN HUB BIE MUE (PL) MAG ADH ZIB BRA (NL) DUI GOE KAS LEI DRE FZJ MAR JEN BIR AAC CHE GIE ILM FRA BAY GSI ESF WUE ERL HEI REG SAA FZK Renater AUG KEH STU GAR (FR) Switch/GARR Surfnet CBF DFN PoP Dark fibre Wavelength

  38. The Idea behind CBFs • Connectivity between NRENs usually via GÉANT • Cross Border Fibers complement existing GÉANT infrastructure and can add resilience • CBFs have a big potential for savings • Will be part of European infrastructure - not a testbed ! • Challenge: Operational issues. Requires definition of technical, operational, organisational and financial framework

  39. Questions ...? ? ? ?

More Related