1 / 60

DS4243 Shelf SE Training Presentation

DS4243 Shelf SE Training Presentation. Haripriya Technical Marketing Engineer Core Systems Product Group. Agenda. Introduction Quick Looks Supported Configurations Value Proposition When to Sell DS4243 vs. DS14-Class Shelves System Configurations with DS4243 Shelves References

adair
Download Presentation

DS4243 Shelf SE Training Presentation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. DS4243 Shelf SE Training Presentation Haripriya Technical Marketing Engineer Core Systems Product Group

  2. Agenda • Introduction • Quick Looks • Supported Configurations • Value Proposition • When to Sell DS4243 vs. DS14-Class Shelves • System Configurations with DS4243 Shelves • References • Backup Slides: Technical Details

  3. What’s In a Name?Introducing the NetApp DS4243 Disk Shelf • DSxxxx – Disk Shelf • DS4xxx – 4U • DSx24x – 24 drives • DSxxx3 – 3Gbps SAS backbone

  4. Launch and Availability Announcement Date: August Planned Availability: • Limited availability in September Quote Tool • FAS/V3170/6040 newly configured systems only, no cabinet support (cabinets planned for October Quote Tool) • Full availability in December Quote Tool for all supported systems • All currently shipping newly configured FAS, V-Series, and SA systems except 2020 (all of which will require PCIe SAS HBA or embedded SAS port to connect to DS4243) • Add-on storage for capable systems (PCIe slot for HBA or embedded SAS port) DOT Release Vehicle: • Initial support on 7.3.2 • 8.0.x (7 and Cluster-Mode) support planned

  5. DS4243 Shelf—Front View

  6. DS4243 Shelf—Front View, Bay Numbering Bay 0 Bay 1 Bay 2 Bay 3 Bay 20 Bay 21 Bay 22 Bay 23

  7. DS4243 Shelf—Rear View

  8. DS4243 Shelf—Rear View Details IO Module (IOM3) 4U SAS Ports Alternate Control Path (ACP) Ports Power Supply/ Fan Assemblies • Dual, redundant IOM3 modules are standard and support multipath HA (MPHA) configuration. Note: MPHA not supported on FAS2040. • Each IOM3 contains two ACP ports and two SAS ports. • Shelf configurations with 15k rpm SAS drives require 4 power supplies. • Shelf configurations with 7.2k rpm SATA drives use 2 power supplies.

  9. Supported Configurations • Software Support • Initial support on Data ONTAP® 7.3.2 • Data ONTAP 8.0 support targeted for GA release (Dec. 2009) • Controller Support • FAS/V6000 series & SA600 (with 4-port SAS adapter card) • FAS/V3100 series (with 4-port SAS adapter card) • FAS/V3070 & 3040 & SA300 (with 4-port SAS adapter card) • FAS2050 & SA200 (with 2-port SAS adapter card) • FAS2040 (using single SAS port per controller) • Supported Disk Drives • SAS: 15,000 rpm 300GB and 450GB • SATA: 7200 rpm 500GB and 1TB

  10. Supported Configurations (2) • One drive type per shelf, i.e., SAS or SATA, not both • Standard configurations with one drive model, e.g., 300GB SAS • Fully loaded = 24 drives • Half loaded = 12 drives • Dual shelf I/O modules (IOM3) configurations only • Dual or multipath HA configuration required • Provides path redundancy and I/O bandwidth • Exception: FAS2040 (only one port per controller) • All systems, except FAS2040 and FAS2050, support up to 10 shelves per “stack” • A stack is a group of shelves connected via shared I/O paths • Nearly 3x the drives per path versus DS14 shelves • FAS2040 and FAS2050: up to four shelves per stack

  11. Supported Configurations (3) • Mixed stack of SAS and SATA shelves • SAS drive shelves and SATA drive shelves are supported within the same stack • There should be no more than one mixed stack in a new system • This is a best practice, but systems grown over time may have more • Like disk-type shelves, should be adjacent in the mixed stack, i.e., only one transition from a SAS shelf to a SATA shelf in the stack • Systems with both DS4243 and DS14-class shelves • Systems configured with DS4243 and DS14mk2 or mk4 and DS14mk2 AT shelves are supported • All shelves should be dual-path or multipath HA connected • This could consume several PCIe slots, making it undesirable • Obviously, DS4243 and DS14 shelves don’t share I/O paths • New cabinet rails required for DS4243 (backwards compatible)

  12. Unsupported Configurations Nonsupported platforms (no PCIe slots) FAS2020 FAS/V3020 FAS/V3050 FAS/GF 900 series, FAS/GF 270, R200 Drives are not interchangeable with DS14 or FAS20xx Mechanical and electronic interfaces are different FAS20x0 cannot be converted into an expansion shelf No Stretch or Fabric MetroCluster support SAS specification limits connection distances SAS-FC bridge module in plan to enable MetroCluster use No VTL support at shelf FCS; future support planned No DC power supply support 12

  13. RAID Group Configuration Best PracticesExamples • Fully populated DS4243 • Single-shelf configuration • 2 RAID-DP® groups with maximum group size = 12 • RG 0: 10 data + 2 parity • RG 1: 9 data + 2 parity • 1 hot spare • For two or more shelves: • RAID-DP maximum group size = 16 • Half-populated DS4243 • Single 1 RAID-DP group • 9 data + 2 parity • 1 spare

  14. System Disk Drive and Capacity Limits System-level maximum disk drive and capacity limits are unchanged when using DS4243 • System limits are independent of shelf type • Limits do not increase when using DS4243 System-level disk drive count limits may not divide neatly into whole numbers of fully populated DS4243 • Limits for most systems are based on even numbers of full loops of DS14-class shelves Future new system limits will be based on DS4243 14

  15. Shelf Topology Comparison FAS Controller FC Port (on-board or HBA) FC Port (on-board or HBA) SAS Port (quad-port HBA) FC Connect 2 (dual/multipath) ports per loop per controller SAS Connect Dual/Multipath only 2 ports per controller per stack No interconnectivity between FC and SAS FC loop FC loop SAS stack DS14mk4 DS14mk2 AT DS4243 ESH4 (2x) AT-FCX (2x) IOM3 (2x) 14X HDD 14X HDD SAS/SATA HDD SAS/SATA HDD SAS/SATA HDD FC HDD FC HDD FC HDD SATA HDD SATA HDD SATA HDD 24X HDD 6 shelf (84 spindle) limit per loop 10 shelf (240 spindle) limit per stack 6 shelf (84 spindle) limit per loop • Note that SAS/SATA drives cannot be mixed in the same shelf DS14 Family DS4243 15 15

  16. DS4243 Value Proposition High Resiliency Architecture Disk Drive Density per Adapter Port and RU Configuration Flexibility Efficient Power Consumption

  17. Value PropositionHigh Resiliency Architecture SAS is a point-to-point architecture • Inherently better fault isolation and recovery than FC-AL, including FC-AL with switched hubs (e.g., ESH) • Result is a more resilient storage subsystem that enhances overall storage system availability Alternate Control Path (ACP) • ACP is secure out-of-band management interface, separate from the data path of disk drives • It allows control of the storage subsystem if a SAS connection becomes unresponsive • Adds frame array–class subsystem manageability • Single daisy-chained Ethernet connection per controller used Multiple redundant components design and nondisruptive firmware and software upgrade capability

  18. Value PropositionDisk Drive Density Density per Adapter Port • Up to 240 disk drives (10 shelves) per port pair (i.e., via dual path or multipath HA connection) • Nearly 3x higher per adapter density than DS14 shelves • More efficient PCIe slot utilization in combination with the 4-port SAS adapter Density per Rack Unit (RU) Height • 22% better rack space efficiency (based on 168 drives in 28U vs. 36U with DS14 shelves) • Higher rack density helps reduce data center costs (e.g., co-lo)

  19. Value PropositionConfiguration Flexibility/Power Consumption Configuration Flexibility • Same shelf chassis and I/O module used for both SAS and SATA drives • Common FRUs and shelf management • 12- and 24-drive standard configurations • HW and FW will be highly leveraged in future shelf offerings Power Consumption Efficiency • Per drive power consumption is 10–20% less in DS4243 compared to DS14-class shelves • Power consumption advantage will be less when compared to soon-to-be released higher-efficiency DS14 power supplies

  20. When to Sell DS4243 vs. DS14 Shelves Sell the DS4243 for: • New or installed FAS/V6000 systems • New or installed FAS/V3100 systems • Installed FAS/V3040 & 3070 systems • New FAS2040 & FAS2050 systems • New SA systems Note: Assumes a PCIe slot is available for SAS adapter, except FAS2040 Sell the DS14 for: • FAS/V6000, 3100, 3070, & 3040 systems when no PCIe slot is available • FAS2020 systems using expansion storage • MetroCluster systems • Systems where controller-to-shelf or shelf-to-shelf distances exceed 5m • DC-powered systems

  21. References • Enterprise Disk Storage Subsystem Directions white paper

  22. Technical Details

  23. Technical Details Content SAS Adapters and Cables Serial Attached SCSI (SAS) Alternate Control Path SAS and ACP Connections and Configuration Storage Bridge Bay (SBB) Troubleshooting

  24. SAS Adapters • Quad-port PCIe SAS Adapter • Used with FAS/V6000, 3100, 3070, & 3040; SA600 & 300 • Dual-port PCIe Mini-SAS Adapter • Used with FAS2050 & SA200 only

  25. Cable Requirements

  26. Cables QSFP-QSFP cable Ethernet cable QSFP-mini-SAS cable

  27. Physical SAS Connections Storage Controller with SAS Adapter Expander Expander Disk Subsystem

  28. SAS SAS is the future—FC HDDs are declining 3.0Gb SAS interface • More capability • 4-lane-wide SAS port connectivity to FAS controller • 12Gb composite bandwidth, 24Gb in the future • Greater HBA connectivity • 10 shelves per “stack” = more HDDs per port even with MPHA • More resilient • Point to point vs. loop • Simple cross-bar matrix • HW routing of data with little to no FW involvement 28

  29. SAS Point-to-point paths established between end-point devices. Enterprise SAS architectures use expanders—end-points directly attached to expander ports (vs. each end-point being part of the loop in FC-AL). Expanders are path switchers and arbiters. Expanders are central managers and “traffic cops.” Management efforts can coexist with “normal” traffic— different protocols, device isolation.

  30. SAS versus FC-AL

  31. Alternate Control Path Overview • NetApp first to offer this frame-array-class resiliency feature in a modular enclosure • Full control plane for resolving data-plane problems • Reset/power-cycle capabilities that are • Built in • Automatic • Real time • Road map for future functionality improvements

  32. Alternate Control Path • Provides new options for nondisruptive recovery of shelf modules • SAS expander reset • SAS expander power cycle • ACP components • ACP Processor (ACPP) • e.g., HW/FW on a shelf controller • ACP Administrator (ACPA) • e.g., SW in Data ONTAP® • ACP Subnet • Private Ethernet Network • Connects ACPAs to ACPPs • First implementation in the DS4243 shelf

  33. ACP is NOT… • …a point of failure for the data path • Data path continues to function even if ACP is not connected or operational • … a way to do enclosure services • … a replacement for in-band features • NOT intended for management servers • (e.g., CIM, SMASH)

  34. ACP Features at DS4243 Release • New Recovery Mechanisms • Reset SAS Expander Complex on I/O Module • Power Cycle SAS Expander Complex • Retrieve Shelf Module POST Data • ACPP Firmware Update • Nondisruptive to I/O • Downloaded over the Ethernet link • Image delivery • Packaged in Data ONTAP® • Available on NOW™ (NetApp on the Web) site for download

  35. Connecting the ACP • “ACP Subnet” is a private Ethernet network • User configures one Ethernet port on each node • Future platforms will have a dedicated port • IP addresses automatically assigned by Data ONTAP® • "Daisy-chain" topology • Pros: • Simplicity, cost • Cons: • Single points of failure for ACP • Not for Data ONTAP • FRU isolation requires diagnosis

  36. ACP • ACP (Shelf) Alternate Control Path • Independent of the data path • Data path ("in-band”): SAS cables • ACP: Ethernet cables ACP (Ethernet) Data Paths (SAS)

  37. ACP Network Robustness • ACP operation does not affect data path • Still functions if connected to a nonprivate network • Uses proprietary ports • NOT the supported configuration • Still functions if cross-connected with other ACP networks • Both ACP subsystems can continue to operate • ACPA only talks to ACPPs that it sees on the data path • ACP uses encrypted communication (SSL) • After the initial IP address negotiation

  38. Changing the ACP Configuration • A user can disable ACPA by either • Rescinding the ACP Ethernet port designation • Disconnecting the Ethernet connection from the storage node • User can also change the ACP Ethernet configuration on the fly • Nondisruptive to I/O

  39. SAS and ACP Connectivity • IOM A SAS (circle) daisy chains to next IOM A (square) • IOM A ACP (circle) daisy chains to next IOM A (square) • IOM B SAS (circle) daisy chains to next IOM B (square) • IOM B ACP (circle) daisy chains to next IOM B (square) • *Bottom* IOM A ACP (circle) connects to *Top* IOM B (square)

  40. SAS and ACP Connectivity

  41. Storage Bridge Bay (SBB) Overview • The Storage Bridge Bay Working Group, Inc., is a nonprofit corporation formed by industry members to develop and distribute specifications standardizing portions of storage enclosures (www.sbbwg.org). • Members include NetApp, EMC, IBM, Sun, Dell, Emulex, LSI, Seagate, Intel, and AMD. • The SBB specification defines mechanical, electrical, and internal interfaces between a storage enclosure and the electronics cards that give the subsystem its personality or function.

  42. New and Updated Commands • Updated Commands • sysconfig • storage show disk • environment shelf • New Commands • storage show acp • storage download acp • acpadmin list_all • acpadmin expander_reset • acpadmin expander_power_cycle • acpadmin post_data • acpadmin voltage_status

  43. Updated Command: “sysconfig” NetApp Release 7.3.1: Fri May 15 18:32:02 PDT 2009 System ID: 0118058768 (avarice); partner ID: 0118059346 (bowmore) System Serial Number: 30004785 (avarice) System Rev: D3 System Storage Configuration: Multi-Path HA System ACP Connectivity: Full Connectivity slot 0: System Board Processors: 4 Memory Size: 8192 MB Memory Attributes: Node Interleaving Bank Interleaving Hoisting Chipkill ECC ) • Storage connectivity is monitored and EMS events generated when transitions occur. • ACP connectivity is monitored and EMS events generated when transitions occur.

  44. Updated Command: “storage show disk” Disk: 1d.00.0 Shelf: 0 Bay: 0 Serial: 3QP0YEAH00009926FKQF Vendor: NETAPP Model: X287_S15K6288A15 Rev: NA00 RPM: 15000 WWN: 5:000:c5000f:6f7330 UID: 000C500:0F6F7333:00000000:00000000:00000000:00000000:00000000:00000000: 00000000:00000000 Downrev: no Pri Port: B Sec Name: 1a.00.0 Sec Port: A Power-on Hours: N/A Blocks read: 0 Blocks written: 0 Time interval: 00:00:00 Glist count: 0 Scrub last done: 00:00:00 Scrub count: 0 LIP count: 0 Dynamically qualified: No Power cycle count: 0 Power cycle on error: 0 Current owner: 4294967295 Home owner: 4294967295 Reservation owner: 0 • Disk-naming convention is SAS focused. • Zero shelf ID values are valid. • Software-based ownership is required—keeping tabs on it is more important.

  45. Environment for channel 7c Number of shelves monitored: 2 enabled: yes Environmental failure on shelves on this channel? yes Channel: 7c Shelf: 0 ... ACP installed element list: 1, 2; with error: none ACP information by element: [1] MAC address: 00:50:CC:62:61:DA [2] MAC address: 00:50:CC:62:61:4E Updated Command: “environment shelf”

  46. New Command: “storage show acp” • Primary tool for diagnosing ACP connectivity issues • Summarizes a controller’s view of the ACP network • Sample output: Alternate Control Path: enabled Ethernet Interface: e0b ACP Status: Active ACP IP address: 198.15.1.212 ACP domain: 198.15.1.0 ACP netmask: 255.255.255.0 ACP Connectivity Status: Full Connectivity Shelf Module Reset Cnt IP address FW Version Status --------------------------------------------------------------------- 7a.001.A 002 198.15.1.145 0.6 active 7a.001.B 003 198.15.1.146 0.6 active 7c.002.A 000 198.15.1.206 0.6 active 7c.002.B 001 198.15.1.204 0.6 active

  47. New Command: “storage show acp” – Header Alternate Control Path: enabled Ethernet Interface: e0b ACP Status: Active ACP IP address: 198.15.1.212 ACP domain: 198.15.1.0 ACP netmask: 255.255.255.0 ACP Connectivity Status: Full Connectivity Shelf Module Reset Cnt IP address FW Version Status --------------------------------------------------------------------- 7a.001.A 002 198.15.1.145 0.6 active … • Alternate Control Path: “enabled” or “DISABLED” • Ethernet Interface: port assigned to this ACPA • ACP status: ”Active” or “Inactive” • ACP Connectivity Status • ”No Connectivity” – no ACPP connected • ”Full Connectivity” – data path matches control path • ”Partial Connectivity” – some IOMs seen only on data path (not ACP) • ”Additional Connectivity” – some IOMs seen only on ACP (not on data path) • "NA” – ACP state is Inactive

  48. New Command: “storage show acp” – ACPP summary … ACP Connectivity Status: Full Connectivity Shelf Module Reset Cnt IP address FW Version Status --------------------------------------------------------------------- 7a.001.A 002 198.15.1.145 0.6 active 7a.001.B 003 198.15.1.146 0.6 active 7c.002.A 000 198.15.1.206 0.6 active 7c.002.B 001 198.15.1.204 0.6 active • Status: • [0x5] “active” • [0x1] “inactive (initializing)” • [0x2] “inactive (not ready)” • [0x3] “inactive (waiting for in-band information)” • [0x4] “inactive (no in-band connectivity)” • [0x6] “not-responding (last contact at: "Sat Jan 31 21:40:58 GMT 2009”) • [0x7] “inactive (upgrading firmware)” • [0x8] “not-responding (last contact at: "Sat Jan 31 21:40:58 GMT 2009") • connection error encountered on this module.

  49. New Command: “storage show acp -a” Alternate Control Path: enabled Ethernet Interface: e0b ACP Status: Active ACP IP address: 198.15.1.212 ACP domain: 198.15.1.0 ACP netmask: 255.255.255.0 ACP Connectivity Status: Partial Connectivity Shelf Module Reset Cnt IP address FW Version Status --------------------------------------------------------------------- 7c.001.A 000 198.15.1.204 0.7 active 7c.001.B 000 198.15.1.205 0.7 not-responding (last contact at: Sat Jan 31 21:40:58 GMT 2009) 7c.002.A NA NA NA NA 7c.002.B NA NA NA NA • “-a” includes SAS shelf modules that are NOT connected to ACP • (Data path, but no control path) • Example:

  50. New Command: “storage download acp” storage download acp {<adapter_name>.<shelf_id>.<module_number> | all} [-F <file_name>] • Downloads firmware to the ACPP • Picks image from /etc/acpp_fw/ with highest version number • Unless file name specified with “-F” • Will NOT download firmware if: • ACPP is not in active state • A firmware upgrade is already pending on this ACPP • If “-F” is not given and firmware is already up to date • (compared to images in “/etc/acpp_fw”) bovard*> acpadmin download_firmware 7c.000.A -F ACP-IOM3-01.00.tgz bovard*> Wed Apr 22 08:19:48 GMT [acp.command.sent:info]: sent firmware download (image: ACP-IOM3-01.00.tgz) command to 198.15.1.218. Wed Apr 22 08:20:17 GMT [acp.command.response:info]: Command firmware download to 198.15.1.218 was successful.

More Related