1 / 94

FAS/V31X0 Hardware TOI

FAS/V31X0 Hardware TOI. April 30 th , 2008 Mark Insley 408-822-6261 mwi@netapp.com. FAS3140/FAS3170 The New Kid on the Block…. New “two in a box” mid-range platform Two “controllers” in a single chassis Controller is what we used to call a “motherboard” Chassis 6U 6 Fan FRUs

chaman
Download Presentation

FAS/V31X0 Hardware TOI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. FAS/V31X0 Hardware TOI April 30th, 2008 Mark Insley 408-822-6261 mwi@netapp.com

  2. FAS3140/FAS3170The New Kid on the Block… • New “two in a box” mid-range platform • Two “controllers” in a single chassis • Controller is what we used to call a “motherboard” • Chassis • 6U • 6 Fan FRUs • 2 Power Supply Units (PSUs) • 1 mid-plane • Two primary configurations • “High” - 3170 • “Low” - 3140

  3. From the Front

  4. From the Front Fan “A2” Fan “A1” Fan “A3” Fan “B2” Fan “B1” Fan “B3”

  5. From the Rear…

  6. From the Rear… Controller “A” PSU “A” PSU “B” Controller “B”

  7. IO e0a e0b 0a 0c 0d 0b ConsolePort management 9600 8/N/1 Serial Ethernet Fibre Chanel

  8. NMI Button NMI

  9. The Controller • Dual core Opteron processors • “high” uses two 2.6GHz (2218) processors • “low” uses one 2.4GHz (2216) processor • Memory configuration based on model: • “high” comes with 16G per controller • “low” comes with 4G per controller • Remote access via RLM • RLMs are included in all systems • Four PCIe slots • 3 PCIe x8, all full height, full length • 1 PCIe x4, full height, ¾ length

  10. The Controller • Embedded Fibre Channel • Four 1/2/4 Gb ports • Embedded Ethernet • Two 10/100/1000 ports • FAS30x0 had four, but you get an extra PCI slot to better tailor the setup

  11. NVRAM7 • NVRAM embedded in controller • We call it NVRAM7, but it’s really just like NVRAM6 • Minor improvements to the battery charging hardware • Basic SW architecture the same as NVRAM6 • Based on Mellanox “Arbel” • Dual 4x InfiniBand routed via backplane to second controller • NVRAM Memory options: • “high” configured with 2GB (single DIMM) • “low” configured with 512M (also single DIMM)

  12. Some other details… • NVRAM battery and DIMM are FRUs • One or two controllers per system • Single controller systems have controller in “A” (top) position • Single controller systems upgradeable to two controllers • Upgrade (handled via quotetool) comes with second controller and three additional fans • Consult “Adding second controller to dual-controller system” flyer

  13. How is FAS31x0 Different Than FAS30x0? • Obviously, moving to “two in a box” for FAS31x0 is mechanically a lot different than Dr. Who… • Single 6U chassis • Shared PSUs • Improved Fan FRUs • However, at the controller level, the two systems are architecturally very similar… • AMD based design • Broadcom support chips • PCIe expansion • Similar embedded IO

  14. FAS31x0 vs. FAS30x0 OpteronDual Core1.8GHz (265) 3.2GB/s 3.2GB/s OpteronDual Core1.8GHz (265) 2G DDR-400 DIMM HT x168GB/s 2G DDR-400 DIMM 2G DDR-400 DIMM 2G DDR-400 DIMM 3.2GB/s 3.2GB/s HT x168GB/s HT x168GB/s FAS30x0 HT-2000 HT-2000 Two 10/100/1000Ethernet Ports Two 10/100/1000Ethernet Ports Two PCI-EExpansion Slots PCI-Ex82.5GB/s PCI-Ex82.5GB/s HT x81.6GB/s HT-1000 PCI-Ex8 PCI-Ex8 PCI-Ex4 PCI-Ex4 PCI-Ex410GB/s BIOSFlash LPC XBus Two PCI-EExpansion Slots PCI-Ex41.25GB/s PCI-Ex41.25GB/s Console Port ISP-2432 ISP-2432 SIO IIC SRAM SRAM Two 1/2/4 Gb/sFC Ports Two 1/2/4 Gb/sFC Ports

  15. FAS31x0 vs. Dr Who – Round 1The processing core OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s HT-2100 HT-2100 • Still AMD/Broadcom based core • New generation of AMD processors • Faster 2.6GHz vs. 1.8GHz • Socket F vs. Socket 904 • Updated System I/O Controller • HT-2100 vs. HT-2000 • Faster memory • DDR2-667 vs. DDR-400 • Can de-pop one processor and still have all our IO • 8 DIMM sockets • Support 1/2/4GB DIMMs • Wide range of memory configurations possible

  16. FAS31x0 vs. Dr Who – Round 2Embedded IO OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s HT-2100 HT-2100 10/100/1000 BCM5715 10/100/1000 PCI-Ex41.25GB/s • Embedded IO mostly the same • Still 4 fibre channel ports (same controller as Dr. Who) • Memory size the same as Dr. Who: 2MB/channel • Two Gig-E ports instead of 4 PCI-Ex42.5GB/s ISP-2432 ISP-2432 SRAM SRAM Four 1/2/4 Gb/sFC Ports

  17. FAS31x0 vs. Dr Who – Round 3Expansion IO OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s HT-2100 HT-2100 10/100/1000 BCM5715 10/100/1000 PCI-Ex41.25GB/s PCI-Ex82.5GB/s PCI-Ex8 PCI-Ex8 • Similar Expansion IO • Still four PCI-e slots • Three x8 slots vs. two on Dr. Who PCI-Ex8 PCI-Ex42.5GB/s PCI-Ex4 ISP-2432 ISP-2432 SRAM Four PCI-EExpansion Slots SRAM PCI-Ex41.25GB/s Four 1/2/4 Gb/sFC Ports

  18. FAS31x0 vs. Dr Who – Round 4Embedded NVRAM OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s HT-2100 HT-2100 10/100/1000 BCM5715 10/100/1000 PCI-Ex41.25GB/s PCI-Ex82.5GB/s • Calling it NVRAM7 • But it’s really just a better NVRAM6 • Cross connected to partner via backplane (No cables!) • Don’t burn a PCI slot PCI-Ex8 PCI-Ex8 PCI-Ex8 PCI-Ex42.5GB/s NVRAM7 PCI-Ex4 ISP-2432 ISP-2432 SRAM Four PCI-EExpansion Slots SRAM PCI-Ex41.25GB/s DIMMDDR-333 Four 1/2/4 Gb/sFC Ports Dual IB x4 linksto partner

  19. FAS31x0 vs. Dr Who – Round 5Management and other goop OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s 10/100 via backplaneto partner PCI-X66Mhz HT-2100 HT-2100 10/100/1000 Switch BCM5703 10/100 BCM5715 10/100/1000 PCI-Ex41.25GB/s 10/100 HT x81.6GB/s HT-1000 SMBus RLM IIC • Same HT-1000 south bridge • Additional Ethernet controller to facilitate RLM failover detect mechanism • SIO/BIOS/RLM/Agent basically the same Agent BIOSFlash LPC PCI-Ex42.5GB/s XBus RS-232 SIO IIC ISP-2432 ISP-2432 Console Port SRAM SRAM To PSUs Four 1/2/4 Gb/sFC Ports

  20. FAS31x0 – The Winner! OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s PCI-X66Mhz HT-2100 HT-2100 10/100 10/100/1000 Switch BCM5703 10/100 BCM5715 10/100/1000 PCI-Ex41.25GB/s 10/100 PCI-Ex82.5GB/s HT x81.6GB/s HT-1000 SMBus RLM IIC PCI-Ex8 Agent PCI-Ex8 BIOSFlash LPC PCI-Ex8 PCI-Ex42.5GB/s RS-232 NVRAM7 SIO IIC PCI-Ex4 ISP-2432 ISP-2432 Console Port SRAM Four PCI-EExpansion Slots SRAM PCI-Ex41.25GB/s To PSUs DIMMDDR-333 Four 1/2/4 Gb/sFC Ports Dual IB x4 linksto partner

  21. FAS31x0 – High vs. Low OpteronDual Core2.6GHz(2218) 5.3GB/s 5.3GB/s OpteronDual Core2.4GHz(2216) OpteronDual Core2.6GHz (2218) DDR2-667 DIMM HT x168GB/s DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR2-667 DIMM DDR-667 DIMM DDR2-667 DIMM DDR-667 DIMM 5.3GB/s 5.3GB/s HT x168GB/s HT x168GB/s PCI-X66Mhz HT-2100 HT-2100 10/100 10/100/1000 Switch BCM5703 10/100 BCM5715 “High” 10/100/1000 PCI-Ex41.25GB/s 10/100 PCI-Ex82.5GB/s HT x81.6GB/s HT-1000 SMBus RLM IIC PCI-Ex8 Agent PCI-Ex8 BIOSFlash LPC PCI-Ex8 PCI-Ex42.5GB/s RS-232 NVRAM7 SIO IIC PCI-Ex4 ISP-2432 ISP-2432 Console Port SRAM Four PCI-EExpansion Slots SRAM PCI-Ex41.25GB/s To PSUs DIMMDDR-333 Four 1/2/4 Gb/sFC Ports Dual IB x4 linksto partner

  22. FAS31x0 – High vs. Low OpteronDual Core2.6GHz(2218) 5.3GB/s OpteronDual Core2.4GHz(2216) DDR2-667 DIMM DDR2-667 DIMM 5.3GB/s HT x168GB/s HT x168GB/s PCI-X66Mhz HT-2100 HT-2100 10/100 10/100/1000 Switch BCM5703 10/100 BCM5715 “Low” 10/100/1000 PCI-Ex41.25GB/s 10/100 PCI-Ex82.5GB/s HT x81.6GB/s HT-1000 SMBus RLM IIC PCI-Ex8 Agent PCI-Ex8 BIOSFlash LPC PCI-Ex8 PCI-Ex42.5GB/s RS-232 NVRAM7 SIO IIC PCI-Ex4 ISP-2432 ISP-2432 Console Port SRAM Four PCI-EExpansion Slots SRAM PCI-Ex41.25GB/s To PSUs DIMMDDR-333 Four 1/2/4 Gb/sFC Ports Dual IB x4 linksto partner

  23. Tour of the Controller

  24. Tour of the Controller Firstprocessor

  25. Tour of the Controller DIMMs forfirstprocessor

  26. Tour of the Controller Secondprocessor

  27. Tour of the Controller DIMMs forsecondprocessor

  28. Tour of the Controller HT-2100s

  29. Tour of the Controller HT-1000

  30. Tour of the Controller Dual Gig-EBCM5715

  31. Tour of the Controller ISP-2432s(fibre channel)

  32. Tour of the Controller FC Memory2MB/Channel

  33. Tour of the Controller NVRAM7controller

  34. Tour of the Controller NVRAM7DIMM

  35. Tour of the Controller FC Memory2MB/Channel NVRAM7DIMM ISP-2432s(fibre channel) NVRAM7controller HT-2100s HT-1000 Dual Gig-EBCM5715 Firstprocessor DIMMs forsecondprocessor DIMMs forsecondprocessor Secondprocessor

  36. Tour of the Riser

  37. Tour of the Riser Slot 1

  38. Tour of the Riser Slot 1 Slot 2

  39. Tour of the Riser Slot 1 Slot 2 Slot 3

  40. Tour of the Riser Slot 1 Slot 4 Slot 2 Slot 3

  41. The rumors are true, there is an Ethernet switch on the controller… why? • Management port provides access to both the RLM and the e0M port • Management traffic is all 10/100 • Link light on management port indicates link to switch, *not* to RLM or e0M • Switch configures itself to allow traffic to flow in appropriate directions at power up “management” port RJ-45 RLM Switch Enet Agent SIO ONTAP e0a port Gig-E 10/100 Enet Gig-E e0b port e0M port

  42. RLM assisted CFO Backplane RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  43. RLM assisted CFO Backplane RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  44. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  45. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  46. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  47. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  48. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  49. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

  50. RLM assisted CFO Backplane RLM to theRescue! RJ-45 RJ-45 RLM Enet RLM Switch Switch Enet Agent Agent Your disksare mine! SIO SIO ONTAP ONTAP Gig-E Gig-E 10/100 Enet 10/100 Enet Gig-E Gig-E

More Related