Shelf Management & IPMI SRS related activities

1. Shelf Management & IPMI www.samwayelectronic.com Shelf Management & IPMI SRS related activities Mihai Savu Samway Electronic Bucharest -ROMANIA mihai.savu@samwayelectronic.com

2. Shelf Management & IPMI PICMG and VITA Standards CPCI ATCA MicroTCA CPCI-S VME VPX

3. Shelf Management & IPMI Evolution of PICMG Standards DATA RATE 40 Gb/s MTCA.0 R1.0 Micro TCA PICMG 3.0 AdvancedTCA CPCI S.0 CompactPCI Serial 10 Gb/s 1 Gb/s PICMG 2.16 Packet Switching PICMG 2.0 CompactPCI 528 Mb/s TIME 1999 2003 2001 2011 2006

4. Shelf Management & IPMI Evolution challenges Together with data rate have increased also: • Power consumption • Cooling requirements • Component density => The system monitoring and control becomes more important and more sophisticated 4

5. Shelf Management & IPMI System monitoring Traditional system monitoring: • Monitor temperatures inside the system • Controls fans speed based on temperatures • Monitor power supply output voltages and currents • Remote reset or shutdown • Trigger alarms in case of failures (LEDs, buzzers) Limitations: • No information about the boards present and their healthy • Temperature on boards are not used for thermal management • The boards may run hot even the temperatures inside the system are fine The limit comes from the fact that was no standard protocol to communicate with the cards

6. Shelf Management & IPMI System monitor example Example: System monitor used in VME crates on Linac4 project at CERN Was developed custom software to monitor CERN's own boards over I2C

7. Shelf Management & IPMI Evolution of management specifications VITA 46.11 System Management on VPX SAMWAY 2000 2003 2006 System Management based on IPMI 2015 2014 2005 PICMG 2.9 CompactPCI System Management CPCI S.0 CompactPCI Serial System Management PICMG 3.0 AdvancedTCA VME64X MTCA.0 R1.0 Micro TCA CPCI S.0 CompactPCI Serial VPX VITA 46 PICMG 2.16 Packet Switching VME PICMG 2.0 CompactPCI TIME 1997 1999 2001 2003 2007 2009 1994 2006 2011

8. Shelf Management & IPMI Management on IPMI To overcome the system monitoring limitations PICMG has adopted a standard protocol (IPMI) for system management and monitoring IPMI (Intelligent Platform Management Interface) • The protocol was initially developed by Intel, Hewlett-Packard, NEC and DELL for server management • It is as a software protocol, a language, transported over I2C inside the chassis • First implemented in CPCI and further developed for ATCA and MTCA • With IPMI the cards could be discovered and the sensors they support are read • There is no need to know in advance what sensors are implemented on a card, they will be discovered • This requires every component (Card, PSU, Fan tray) to have a management controller capable of “speaking” IPMI • An additional module, the shelf manager, centralizes the information it collects from cards and present it to the external System Management Software

9. Shelf Management & IPMI Management and Monitoring System Monitor Provides information about chassis health by reading temperatures, voltages, fan speeds, I/Os Shelf Manager Provides information about chassis and the cards present 9

10. Shelf Management & IPMI Shelf Manager Shelf Manager • Designed for multiple architectures: ATCA, AXIe, CPCI, CPCI-S and VPX • Monitors/controls cards supporting IPMI • Monitors the chassis by reading: voltages, temperatures, currents and fans status • Provides configurable digital I/Os • 10/100Mbps Ethernet interface supporting RMCP, HTTP (graphical WEP page), Telnet, SNMP v3, DHCP, TFTP and Serial Over Lan • Extended temperature range: -40..85 deg C • Mounted as a mezzanine module on a card or on dedicated carrier board • Dimensions 68mmx95mm

11. 8 Analog 6 Thermistors RS232 12 Fan TACH 3 Fan PWM IPMB 16 Digital Inputs 16 Digital Outputs I2C_2 Shelf Management & IPMI Shelf Manager features Shelf Manager RTC I2C MUX

12. Shelf Management & IPMI System monitor example Integrated WEB Server • Provides a simple and intuitive interface for reading management information • Based on XML • No additional software needed- just a WEB browser (could be accessed from a mobile phone or tablet) • Information about a board is obtained with just a mouse click

13. Shelf Management & IPMI MCH In MicroTCA the MicroTCA Carrier Hub (MCH) is responsible for management and monitoring of the boards. Beside this it has also the switching functionality Features: • Support for up to 12 AMCs, 12uRTMs, 2 CUs and 4 PMs • MTCA.4 Compliant • 16 ports Gigabit Ethernet Switch • PCIe Gen 3 switch, x4 links to each AMC • PCIe clock distribution • Front panel 16x PCIe optical link.

14. Shelf Management & IPMI IPMI software for cards IPMI Software for ATCA/MTCA cards (IPMC/MMC) • Delivered on pre-programmed microcontrollers • Fast development, low cost and minimum risk • Reference schematic provided • Graphical tools for configuring the sensors and board information (manufacturer name, part number, supported interfaces...)

15. SRS related activities

16. Optical mezzanine board Features Optical mezzanine board – collaboration with IFIN-HH in Romania Mezzanine board for ATCA SRS Two Virtex7 FPGAs 6 TX and 6 RX MicroPod Avago optical modules (12 fibers each) Flexible clock distribution Management Controller (IPMI)

17. Optical mezzanine board Block diagram

18. FEC v6 assembly Status FEC v6 assembly status -SMD assembly for first batch done - Follows edge connector plus through hole components - Software for functional test under development

19. Shelf Management & IPMI www.samwayelectronic.com Thank You!