270 likes | 291 Views
Explore the upgrade of CERN's data center network infrastructure to support 40GbE, 100GbE and more while ensuring high availability and reliability. Discussing options like optical fiber quality, connector types, cabling organization, and more.
E N D
Network infrastructure forCERN DataCenter Eric.Sallaz@cern.ch HEPiX Fall 2015
Agenda Needs Situation Options Implementation Questions
Needs Support 40GbE, 100GbE and more Still available for 10GbE Also for low bandwidth (PDU, Management) High availability and reliability
Needs Supporting 40G, 100G and more imply At least OM3 optical infrastructure At least MPO connectors
Needs 10GbE compatible imply : • LC connectors • Convert MPO to LC • Copper (Cat6A …)
Needs Low bandwidth for management and PDU Copper is enough
Needs High availability and reliability Respect of installation methods
Needs High availability and reliability • Respect of installation methods • Cabling organization
Needs High availability and reliability • Respect of installation methods • Cabling organization • Operation methods “Inspect before you connect !”
Situation • Old infrastructure • Copper from 1995 • OM2 • Racks • Extension of the DC locally but also in Wigner site
Options Copper • Which use ? • Management and PDU • May come the need for 10G uplink
Options Optical fiber quality OM3 allow 100GbE over 100m OM4 allow 100GbE over 150m
Options Connector MPO, LC, … ? MPO-12 or MPO-24 ? What about MTP ?
Options • Optical cabling type • A, B, C, …? • key up, key down ?
Options Type A
Options Type B
Options Type C
Options Module type • 1 MPO to 12 LC ? • 2 MPO to 24 LC ? • How many fiber per trunk and per chassis ?
Options Cable type A same MPO to LC module but different patches
Options Cable type B same patches but different MPO to LC module
Options No type C if you want more than 10GbE !
Options Manufacturer dependent solution Same patches and same MPO to LC module Patented solution
Implementation • Aggregation and ToRswitches for Management • ToR Data switches
Implementation • Infrastructure every 3 or 5 racks • New copper in new rooms • Old copper cabling reused for management and PDU
Implementation OM4 72 fibers with MTP-12 Type B