270 likes | 479 Views
Intelligent Storage Systems. Module 1.4. Module Objectives. After completing this module, you will be able to: Describe components of intelligent storage system List benefits of intelligent storage system Explain intelligent cache algorithms and protection
E N D
Intelligent Storage Systems Module 1.4
Module Objectives After completing this module, you will be able to: • Describe components of intelligent storage system • List benefits of intelligent storage system • Explain intelligent cache algorithms and protection • Describe intelligent storage array implementation • High-end storage array • Mid-range storage array Intelligent Storage System
What is an Intelligent Storage System Intelligent Storage Systems are RAID arrays that are: • Highly optimized for I/O processing • Have large amounts of cache for improving I/O performance • Have operating environments that provide: • Intelligence for managing cache • Array resource allocation • Connectivity for heterogeneous hosts • Advanced array based local and remote replication options Intelligent Storage System
Benefits of an Intelligent Storage System Intelligent storage system provides several benefits over a collection of disks in an array (JBOD) or even a RAID arrays: • Increased capacity • Improved performance • Easier data management • Improved data availability and protection • Enhanced Business Continuity support • Improved security and access control Intelligent Storage System
Intelligent Storage System Front End Back End Physical Disks Cache FC SAN Components of an Intelligent Storage System Host Connectivity Intelligent Storage System
FC SAN Intelligent Storage System: Front End Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Ports Controllers Intelligent Storage System
Front End Command Queuing A D C B A D C B A D C I/O Requests I/O Processing B Order Front-End Cylinders Controller Without Optimization (FIFO) A D C B A D B C A D C I/O Requests I/O Processing B Order Front-End Cylinders Controller With command queuing Intelligent Storage System
FC SAN Intelligent Storage System: Cache Intelligent Storage System Front End Back End Physical Disks Host Cache Connectivity Intelligent Storage System
Write Operation with Cache Write-through Cache Cache WriteRequest Acknowledgement Write-back Cache WriteRequest Acknowledgement Acknowledgement Intelligent Storage System
Read Operation with Cache: ‘Hits’ and ‘Misses’ Data found in cache = ‘Hit’ Cache ReadRequest No data found = ‘Miss’ Cache ReadRequest Intelligent Storage System
Cache Management: Algorithms • Least Recently Used (LRU) • Discards least recently used data • Most Recently Used (MRU) • Discards most recently used data New Data Oldest Data Intelligent Storage System
Cache Management: Watermarking • Manage peak I/O requests “bursts” through flushing/de-staging • Idle flushing, High Watermark flushing and Forced flushing • For maximum performance: • Provide headroom in write cache for I/O bursts 100 % HWM LWM Idle flushing High watermark flushing Forced flushing Intelligent Storage System
Cache Data Protection • Protecting cache data against failure: • Cache mirroring • Each write to the cache is held in two different memory locations on two independent memory cards • Cache vaulting • Cache is exposed to the risk of uncommitted data loss due to power failure Intelligent Storage System
FC SAN Intelligent Storage System: Back End Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Controllers Ports Intelligent Storage System
FC SAN Intelligent Storage System: Physical Disks Intelligent Storage System Host Front End Back End Physical Disks Cache Connectivity Intelligent Storage System
LUN 0 LUN 0 LUN 1 LUN 1 What the Host Sees – RAID Sets and LUNs Host 1 Intelligent Storage System Front End Back End Physical Disks Cache Connectivity FC SAN Host 2 Intelligent Storage System
LUN Masking • LUN masking is access control mechanism • Process of masking LUNs from unauthorized access • Implemented on storage arrays • Storage group logical entity that contains one or more LUNs and one host Intelligent Storage System
Also referred as Active-active arrays I/O’s are serviced through all the available path Following are high-end array capabilities: Large storage capacity Huge cache to service host I/Os Fault tolerance architecture Multiple front-end ports and support to interface protocols High scalability Ability to handle large amounts of concurrent I/Os Designed for large enterprises Controller Controller A B LUN Port Port ISS Implementation: High-end Storage Systems Active-Active Configuration Active Active Host Storage Array Intelligent Storage System
Controller Controller A B LUN Port Port Midrange Storage Systems • Also referred as Active-passive arrays • Host can perform I/Os to LUNs only through active paths • Other paths remain passive till active path fails • Midrange array have two controllers, each with cache, RAID controllers and disks drive interfaces • Designed for small and medium enterprises • Less scalable as compared to high-end array Active-Passive Configuration Active Passive Host Storage Array Intelligent Storage System
Module Summary Key points covered in this module: • Intelligent Storage Systems features • Components of Intelligent Storage Systems • Cache management algorithms • Intelligent Storage System implementation • High-end storage array • Mid range storage array Intelligent Storage System
Concept in Practice: EMC CLARiiON • Support for UltraFlex technology • Scalable from up to 960 disks • Supports flash drives • Supports different types and sizes of drives, and RAID types (0, 1, 1+0, 3, 5, 6) • Supports up to 16 GB of available cache memory per controller (Storage Processor) • Enhances availability with non disruptive upgrade and failover • Ensures data protection through mirrored write cache and cache vaulting • Supports storage-based local and remote data replication • Through SnapView and MirrorView software Intelligent Storage System
Storage Processor Storage Processor Multi-Core Processors Multi-Core Processors 4 Gb/s Fibre Channel Front-End CPU CPU CPU CPU CPU CPU CPU CPU FC Module FC Module CPU CPU CPU CPU CLARiiON Messaging Interface (CMI) CPU CPU CPU CPU FC Module FC Module Multi-Lane PCI-Express Bridge Link FC Module FC Module FC Module FC Module Power Supply SPS Memory Memory iSCSI Module iSCSI Module Fan Fan Fan Fan iSCSI Module iSCSI Module SPS Power Supply CPU Module CPU Module I/O Complex I/O Complex 4 Gb/s Fibre 4 Gb/s Fibre 4 Gb/s LCC 4 Gb/s LCC Channel Back-End Channel Back-End 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC 4 Gb/s LCC CLARiiON CX-4 Architecture Intelligent Storage System
EMC Symmetrix • Incrementally scalable to 2,400 disks • Supports Flash-based solid-state drives • Dynamic global cache memory (16 GB–512 GB) • Advanced processing power (up to 130 PowerPC) • Direct matrix Architecture • High data processing bandwidth (up to 128 GB/s) • Data protection with RAID 1, 1+0 (also known as 10 for mainframe), 5, and 6 • Storage-based local and remote replication • Through TimeFinder and SRDF software Intelligent Storage System
ESCONhost attach Fibre Channelhost attach FICON, GigE, iSCSIhost attach FICON, GigE, iSCSIhost attach FICON, GigE, iSCSIhost attach FICON, GigE, iSCSIhost attach Fibre Channelhost attach ESCONhost attach ESCON Director FC Director Multi-Protocol CD Multi-Protocol CD Multi-Protocol CD Multi-Protocol CD FC Director ESCON Director Cntl Cntl Cntl Cntl Cntl Cntl Cntl Cntl Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Control and communications Signals Environmental control and status signals Environmental control and status signals 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory 64 GB Memory Control and communications Signals FC (Back-End) FC (Back-End) FC (BE or FE) FC (BE or FE) FC (BE or FE) FC (BE or FE) FC (Back-End) FC (Back-End) Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Direct Matrix Cntl Cntl Cntl Cntl Cntl Cntl Cntl Cntl A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B A B Symmetrix Fibre Channel disk devices Symmetrix Fibre Channel disk devices Fibre Channel back-end director * Fibre Channel back-end director * Fibre Channel back-end director * Fibre Channel back-end director * Symmetrix Fibre Channel disk devices Symmetrix Fibre Channeldisk devices Battery backup Unit Modules Cooling Power supplies Service Processor Modem UPS Direct Matrix Architecture Intelligent Storage System
Check Your Knowledge • What are the parts of an Intelligent Storage System? • What are the differences between a high-end and midrange storage array? • What is the difference between a read cache hit and a read cache miss? • What is the difference between Least Recently Used and Most Recently Used algorithms? • What is the difference between Write-through and Write-back cache? Intelligent Storage System