1 / 28

Network Architecture and IPv6 Deployment at CERN

Network Architecture and IPv6 Deployment at CERN. CHEP Oct 2013 David.Gutierrez@cern.ch Co-authors: Edoardo.Martelli@cern.ch , Carles.Kishimoto@cern.ch IT/Communication Systems. Agenda. Network Infrastructures LCG Architecture Management IPv6 Deployment Status.

kare
Download Presentation

Network Architecture and IPv6 Deployment at CERN

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Network Architecture and IPv6 Deployment at CERN CHEP Oct 2013 David.Gutierrez@cern.ch Co-authors: Edoardo.Martelli@cern.ch, Carles.Kishimoto@cern.ch IT/Communication Systems

  2. Agenda • Network Infrastructures • LCG Architecture • Management • IPv6 Deployment Status

  3. 1. Network Infrastructure

  4. CORE Network • Interconnects all infrastructures • Extends between Geneva-Wigner • Non-blocking 1Tbps • IPv6 Ready • OSPF backbone • Security policies • Problem isolation General Purpose External Technical CORE LHC Computing Grid Experiments

  5. Technical Network • Technical services • Safety, electricity, cooling,… • LHC Operation • Cryogenics, vacuum,… • Industrial systems General Purpose External Technical CORE LHC Computing Grid Experiments

  6. Experiments • IT/CS provides • Detector Control Network • ALICE • ATLAS • CMS • Data Recording to T0 • 20Gbps, up to 50Gbps • 25 PB/year General Purpose External Technical CORE LHC Computing Grid Experiments

  7. LHC Computing Grid • High Performance Network • 5.28 TbpsNon-blocking Switching Fabric • WLCG Tier0 • Long-term storage • Distribution WLCG • 1.5 PB/day General Purpose External Technical CORE LHC Computing Grid Experiments

  8. External Network • Public general purpose connections • Full BGP Internet routing table • Geant, CIXP, ISPs • Private WLCG • LHCOPN • 70Gbps peaks to T1 • LHCONE General Purpose External Technical CORE LHC Computing Grid Experiments

  9. General Purpose Network • Desktop computing • Wired and wireless • Central Services • AFS, www, mail, databases General Purpose External Technical CORE LHC Computing Grid Experiments

  10. 2. LCG Network Architecture CORE Internet GENEVA WIGNER

  11. Building block: Service • Network Access modeled as Service • A Service is a broadcast domain • Providing access to end systems • IPv6/IPv4 Dual Stack • Features are defined by a Service Type • Jumbo, LACP, tagged, loop protect, access-list protect, OSPF, VRRP, … • A ToR Switch provides a Service • A Router interconnects multiple Services

  12. Service Bandwidth • Service capacity depends on Service purpose • Blocking Factor: 2 for CPUs, 5 for Storage Storage rack CPUs rack Distribution Router n x 10 Gbps m x 10 Gbps x 1Gbps 10 Gbps x

  13. Scaling the Data Center Rows of Racks Distribution Routers Backbone Routers 100 Gbps links 100s of 10 Gbps 100s of 10 Gbps 100s of 10 Gbps

  14. Worldwide LCG LCG Border Routers 100 Gbps links ∑ 140 Gbps ∑ 20 Gbps Internet ∑ 12 Gbps Distribution Racks Backbone ∑ 60 Gbps CORE Network External Network

  15. Extending the Tier0 to Wigner CORE Network Distribution Racks Internet ∑ 240 Gbps Backbone

  16. WLCG Tier0 Backbone Routers CORE MPLS Internet Distribution Racks Racks Distribution Backbone Backbone GENEVA WIGNER

  17. 3. Network Management Configuration Manager SOAP Admin Web Public Web Monitoring

  18. Dyn-A4 three columns example of a distribution router configuration Racks Distribution I think I can fix it!

  19. Network Database • Buildings and cabling infrastructure • IPv4/IPv6 addressing schemas • Services and service features • Devices (Servers, VMs, desktops, smartphones, …) • Switches • Routers/Firewalls • Security for the Infrastructure (firewall rules)

  20. Interfaces to the Network Database Configuration Manager SOAP Admin Web Public Web Monitoring Users Sys Admins Net Admins First Line Tech Admins

  21. Software-based Network configuration Configuration Manager Net Admins First Line Automatic Updates General Purpose External Technical CORE • Network Services • DNS • DHCP • RADIUS LHC Computing Grid Experiments

  22. 4. IPv6 Deployment Status

  23. Network Database: Schema and Data IPv6 Ready Admin Web: IPv6 integrated 2012 Configuration Manager supports IPv6 routing Gradual deployment on the routing infrastructure starts The Data Center is Dual-Stack NTPv6 and DNSv6 2013 • Infrastructure is Dual-Stack • Firewallv6 automated configuration • User Web and SOAP integrate IPv6 • Automatic DNS AAAA configuration DHCPv6 Today

  24. IPv4 / IPv6 same portfolio • Identical performance, common tools and services • Dual Stack, dual routing • OSPFv2/OSPFv3 • BGP ipv4 and ipv6 peers • Service managers decide when ready for IPv6 • Devices must be registered • SLAACdisabled • RAs: Default Gateway + IPv6 prefixes no-autoconfig • DHCPv6 • MAC addresses as DUIDs: painful without RFC6939 • ISC has helped a lot (βcode implementing classes for ipv6) • DHCPv6 clients might not work ‘out of the box’

  25. Conclusions • The Network is ready to accommodate the new demands after Long Shutdown 1 • Before Eo2013, IPv6 will be fully deployed and available to the CERN community

  26. Thank you!

  27. Extra Slides

More Related