Janet Update Martin Dunmore

1. Janet UpdateMartin Dunmore Multi-Service Networks 2012 Cosener’s House, Abingdon, 12th July 2012

2. Topics • Intro to Janet • Janet6 • Support for Network Research

3. Introduction to Janet

4. Adult LA / Schools HE/FE Relative sizes of sectors: from funding body statistics on staff & student numbers Use of Janet Users Connections 18 million possible users of JANET.

5. Network Figures • Circuits/fibres: • ~1,500 circuits make up JANET • non-trivial task to monitor • ~80% of total outage time Routing equipment: ~100 routers in the core of JANET ~300 regional area routers ~520 end organisation routers

6. The SuperJanet5 Network • Six core points of presence. • A core across the UK of 20Gbit/s, 80Gbit/s and 100Gbit/s. • 19 regional distribution areas. • Multiple connections for resilience. • ~900 organisations connected. • Point to point “light path” connections for research. • ~400Gbit/s external connectivity.

7. The Network Glasgow Global Transit#3 Telecity Manchester Leeds Warrington Global Transit#2 Global Transit#1 Telecity HX Telehouse Reading London 10G Bristol 40G 100G

8. Major Peerings

9. Regularly Hitting > 100Gb/s of Traffic Typical week in May… From JanetTo Janet Mean 18.5 Gb/s 58.6 Gb/s Max 29.7 Gb/s 115 Gb/s Min 5.72 Gb/s 9.57 Gb/s

10. Total Janet Traffic Prediction

11. Janet6

12. Janet6: Backbone Resilience • Similar topology to SJ5. • Two north-south paths • New east-west path from Birmingham to Nottingham • Erdington to Lowdham • No backbone PoP at Reading • Still have a regional PoP • New PoP in Acton, West London

13. Limits of SuperJANET5 • Contractual • Favourable: Mandated 40Gbit/s in 2006 contract • Favourable: Worked with Verizon for deployment of 100GE • Less Favourable: Maximum bandwidth available for use on each link • Increasing those needed technical and legal negotiations • Engineering • Legacy of layered optical systems • Provide 40G SDH and 100GE over system not designed for it • Large “guard bands” of wasted bandwidth

14. Removing SJ5’s limits • Manage the optical layer directly • For more detail see Networkshop presentation • ROADM • Flexible optical platform • DWDM • Theoretically 80 channels • 100Gbit/s per lambda from day 1 • Plans for 400Gbit/s and 1Tbit/s with better spectral density • “Data DelugeBonanza” • Big Science • LHC, SKA, Bioinformatics, ITER, Radio Astronomy, Climate Data • Day-to-day usage

15. Janet6 IP Platform • Original 2006 T-640 chassis still in service • 40Gbit/s per slot, 32 10Gbit/s ports per chassis • Most upgraded to T-1600 • Same chassis, new switching fabric and PSUs • 100Gbit/s per slot • T-4000 • Same chassis, new switching fabric and PSUs • 240Gbit/s per slot, 192 10Gbit/s ports per chassis • Two power supplied for resilience • Each one takes 6, 60A, 48VDC feeds – 17kVA! • Migration • Janet6 will be in new PoPs • Can’t move all the connections overnight • New routers and hand back the old

16. Janet6 Lightpath Network • Investigated provisioning over optical platform • Not enough competitive offers for smaller chassis • Investigated merging Lightpath and IP platforms • IP platforms are already short on chassis space, some locations would require additional chassis • Keep on current MX960 platforms • Upgrade interconnects to 100GE • Move 10GE lightpaths from lambdas to EoMPLS circuits • Scope for point to point circuits without committed bandwidth • Shared with Janet IP access

17. Janet6 Procurement Strategy Options appraisal • Procure dark fibre infrastructure • Procure optical transmission equipment • Management in-house by the Janet NOC Why? Agility • Janet NOC will have a view from the fibre up the stack to the routers • Fewer contract/administrative boundaries or chains to cross • Directly translate the community’s requirements into engineering Why? Different contractual vehicles for fibre and equipment • Fibre: long-term, little need to change • Optical equipment: rapidly evolving, highly competitive competitive dialogue procedure

18. Janet6 Procurement Timeline

19. Procurement Update – Fibre Progress to date • Procurement kicked off October 2011 • Dialogue with 6 bidders during first half of 2012 • Bids received from 2 suppliers

20. Procurement Update – Fibre Current Status • SSET selected as preferred supplier • Design optimisation • Finalising contract & schedules • Signature by end July 2012

21. Procurement Update – Equipment Progress to date • Procurement kicked off November 2011 • Dialogue with 6 bidders during first half of 2012

22. Procurement Update – Equipment Current Status • Bids received from all 6 suppliers • Evaluation underway • Selection by end July 2012 • Signature by mid September 2012

23. Rollout & Transition • Fibre delivery by end March 2013 • Equipment delivery by end April 2013 • Commissioning • Migration by end July 2013

24. Support for Network Research

25. Stuff we can help with Router configs Network diagrams Access to Netsight (SNMP data) • Be careful what you wish for! Netflow data • SBR exporters (1:10 to 1:50) • Some BAR exporters • Regional routers as and when we can TVN, Eastern • Subject to agreement data is non-anonymised • We don’t have much disk space to store it – 100GB!

26. UK Testbed for Loc / ID Research Loc / ID – Decoupling Location and Identity from the IP address • LISP, HIP, ILNP, SHIM6, others Stimulate synergy between UK researchers in this area Janet wants to get a handle on the operational pros/cons Call for proposals should go out later this year • Has been ready for a while but we need to resource internally Modest funding: max 30k 12 months but testbed would stay up after that

27. SDN / OpenFlowTestbed? Start off small scale • 3x OF switches in Core PoPs • 10G inter-switch • 1G switch to user ‘Usual Suspects’ • 1 or 2 controllers Scale up organically Who manages the • HW ? • Service ?