340 likes | 645 Views
iSCSI Storage: Momentum, Deployments and Future. Suzanne Morgan Program Manager WDEG sumorgan @ microsoft.com Microsoft Corporation. Claude Lorenson, Ph.D. Senior Product Manager Windows Server clor @ microsoft.com Microsoft Corporation. Session Outline.
E N D
iSCSI Storage: Momentum, Deployments and Future Suzanne Morgan Program ManagerWDEG sumorgan @ microsoft.com Microsoft Corporation Claude Lorenson, Ph.D. Senior Product Manager Windows Serverclor @ microsoft.com Microsoft Corporation
Session Outline Part 1 iSCSI Storage Momentum • iSCSI defined • Industry trends • Emerging iSCSI-NAS technology • Platform Support and Architecture Future • Microsoft’s iSCSI Roadmap Part 2 iSCSI Deployments • Customers • iSCSI Case Study: Video • City of Everett: Exchange Consolidation • Partners • Broadcom: iSCSI boot • EqualLogic: iSCSI SAN/NAS
Session Goals • Attendees should leave this session with the following: • A better understanding iSCSI fits into the storage solution landscape • A better understanding of how iSCSI integrates into the Windows platform • A better understanding of the Windows applications that are supported on iSCSI • A better understanding of how iSCSI can benefit SMB and enterprise environments • A better understanding of customer deployments
iSCSI Defined: What Is iSCSI? • iSCSI = internet Small Computer System Interface • An interconnect protocol that: • Is designed for storage area networks (SANs) • Supports the block-based storage needs of database applications • Is TCP/IP based • Establishes and manages connections between IP-based storage devices, hosts and clients • Is based on familiar and ubiquitous open standards • Provides advanced IP routing, management, and security tools
iSCSI Defined: An Alternative to FC SAN? • A non-Fibre Channel means of deploying storage networks • Low intangible costs (management, training, deployment) • No inherent distance limitations on the protocol • Flexible topology • Easy to use with multi-vendor storage devices • Easy to scale to large number of devices NAS Network Attached Storage File storage traffic over LAN DAS Direct Attached Storage High TCO Inflexible SAN Storage Area Network Optimized for block data transmission Separation of LAN from storage traffic
Industry Trends: What’s Driving StorageNetwork Deployments? • Escalating capacity needs • Federal regulations • Growing email databases • File storage requirements doubling every 1-2 years • Need for flexible storage provisioning and data sharing • Need for improved data protection Analyst predictions: Source: IDC, July 2004
Industry Trends: Factors Slowing SAN Adoption Actual SAN adoption far lower than respondents had predicted in 2002. Why? • Perceived as too costly, even in large organizations • SMBs do not have the staff or the expertise to support a SAN IDC: Networked Storage Opportunities, August 2004
Industry Trends: iSCSI Impact on SAN Purchases • Organizations are constrained by: • Limited budgets • Hiring freezes or cutbacks • Increased storage requirements • iSCSI SANs capitalize on: • Existing LAN and WAN infrastructures • Existing staff expertise • iSCSI perceptions will drive new SAN purchases • According to the IDC, most potential buyers believe: • It will be easy to learn iSCSI • Same staff can be used for network and storage • Allows buyers to use standard network equipment for storage network • iSCSI products are likely to cost less than FC over time • iSCSI products are likely to be less expensive to manage over time • iSCSI products will have the same or better performance as FC IDC: Worldwide iSCSI Forecast and Analysis, 2003-2007: Storage Networks Embrace IP , September 2003
Industry Trends: SAN Adoption - Growth Areas Users have pent-up demand for iSCSI/IP based storage • Full range of price points and brands are required torealize potential Among those involved in the purchase of SAN solutions or employed at a company using/planning to use SAN solutions (N= 332): What types of SAN technologies are currently in place at your company and what technologies is your company planning to use 12 months from now? Source: Infoworld Test Center Research Report - Storage 2004
Industry Trends: iSCSI Market Share Forecasts • iSCSI: A disruptive technology • Especially with low cost SATA disks and LAN switches • Total market for iSCSI-based disk arrays: • 2003: $216 M • 2007: $4.9 B • Total market for iSCSI-based switches: • 2003: $27.9 M • 2007: $1.15 B Source: IDC, July 2004
Industry Trends: iSCSI Awareness • Slowly increasing • 2002: 66% of IDC survey respondents heard of iSCSI • 2004: 73% • In general, awareness is higher • The larger the total installed storage capacity • When there are more than 10 servers/10 IT staff • Potential buyer interest is highest in large organizations • Buyer group: mean of 273 switch ports • Non-buyer group: mean of 67 (Source: IDC Sept 2003) • Many smaller businesses deterred by high cost disk arrays($25K-$100K) • US market currently has an estimated 8% iSCSISAN installations • Currently mid-market (30-300 installed servers) leads the installations (Source: IDC, August 2004)
Industry Trends: iSCSI SAN - Growth Areas Band 1: $1k-$4.9k Band 2: $5k-$9.9k Band 3: $10k-$14.9k Band 4: $15k-$49.9k Band 5: $50k-$149.9k Band 6: $150k-$299.9k Band 7: $300k-$500k 249% CAGR 175% CAGR 1286% CAGR WINDOWS has a high attach rate in these price bands Source: IDC Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis
Industry Trends: How Will iSCSI be Used? Storage Magazine survey (October 2004): • Large enterprises with installed Fibre Channel SANs no longer resistant to iSCSI SANs • Now looking for less complex solutions • Tiered storage solutions is now an enterprise goal • Seeing the value of multiple SANs
Industry Trends: iSCSI Application Preferences Source: IDC, August 2004
Industry Trends: Analyst View of Storage Market SAN Enterprise Mission Critical Applications ESG Storage Pyramid • Range of applications that need SAN functionality • Until iSCSI, too costly OLTP / ERPFinancial Data Business Critical Apps Email & Collaboration Departmental & Remote Databases Document Imaging & Content Mgt Lead Mgt. & Customer Databases Medical Data Management Scientific Data Collection NAS/SAN DAS Workgroup Applications Microsoft Office Apps, Dept. File Sharing
Industry Trends: Analyst View of theStorage Market (con't) Gartner Storage Pyramid • Environments will continueto grow CAGR 80% • A new storage pyramidby 2006 • 10% of the industry will be using FC-SAN • 40% IP-SAN • 50% DAS DataCenters Mission Critical FC-SAN 3TB $50K Departments IP-SAN NAS Mission Important $20K 1TB DAS Workgroups
Windows & iSCSI: Momentum • Worldwide external disk storage (terabytes sold) for iSCSI SANs IDC, Worldwide Disk Storage Systems 2004-2008 Forecast and Analysis, August 2004 In a survey of Storage Magazine readers (October 2004), Windows was the preferred host platform choice for iSCSI SANs:
Windows & iSCSI: Emerging iSCSI-NAS Devices • Adding iSCSI capabilities to NAS devices • Key advantages • Consolidated networked storage • File, print, and application storage services on a single NAS platform • Single platform to manage, expand, protect. • Leverages well-understood Ethernet technology using low-cost components • Windows Storage Server OEMs are taking advantage of the many 3rd party targets available: • HP NAS 500s, 1200s, 1500s, 2000s • Fujitsu-Siemens • FibreCAT N20i 1 TB, SATA drives • Very economical iSCSI target capabilities • Other vendors to follow soon
Windows & iSCSI: Emerging iSCSI-NASDevices (con't) • Provide best-of-breed entry-level storage consolidation • NAS traditionally for file serving to clients; application servers traditionally host storage internally (DAS) • iSCSI-NAS devices • Allow consolidatation of client and application data in a NAS storage server • Create a storage tier to serve both client and application tiers • No Fibre-Channel SAN required for block-level data
Windows & iSCSI: Application Support • Exchange, SQL, and Windows SharePoint Services are supported on iSCSI SANs • Note: hardware components, including iSCSI hardware, must be logo’d in their device category • Exchange, SQL, SharePoint Services can all be installed on an iSCSI disk • For detailed information on how to configure the Microsoft iSCSI initiator with Exchange and SQL • See the iSCSI user’s guide • For more information on iSCSI support, see: • 317173 – Exchange support with SANs • 833770 – Support for SQL Server 2000 on iSCSI technology components
Windows & iSCSI: Architecture • Complete iSCSI architecture for Microsoft platforms • Windows Server 2003 • Windows Storage Server 2003 • Windows 2000 • Windows XP • Architecture includes: • iSCSI software initiator • Responsible for moving storage data over the network • For use with standard NIC • Initiator Service • Manages all iSCSI initiators, providing uniform storage management • Provides device discovery and management capabilities • Manages security (includes iSNS client) • Initiates and terminates iSCSI sessions • Management applications • Command line interface (CLI) • Control panel application (provides most common iSCSI operations)
Windows & iSCSI: Architecture Details Applications Hardware Management Drivers iSCSICLI InitiatorService WMI SoftwareInitiator NIC Network DeviceManager MiniportDriver iSCSI HBA Perf. Monitor Bus Driver+Miniports MultifunctionCard Security Microsoft iSCSI MgmtApps iSNSClient Microsoft Windows Vendor
Windows & iSCSI: Security • Microsoft iSCSI architecture integrates security • iSCSI Software Initiator uses built-in IPsec • IPsec for encryption • Internet Key Exchange (IKE) • CHAP for authentication • Microsoft iSCSI Service provides • A common interface for all implementations • A security interface for management applications • Interface with Windows IPsec • Caching of keys • Wire-speed IPsec • Hardware supporting this should be available in 2005 • Native IPsec support • More iSCSI targets are beginning to offer this
iSCSI Logo Program for Various Targets • iSCSI target devices • Storage arrays • Bridge devices • Host Bus Adapters • Media changers • Testing Protocol • The target OS (abstracted) is tested to ensure that: • It responds correctly to SCSI an iSCSI protocol and commands • It interoperates with the Microsoft iSCSI initiator/service • iSCSI specification compatibility/compliance • CHAP • Digest • SCSI compliance • SBC, SMC, SPC-2 and SPC-3 • Note that except for control LUNs, signing drivers for iSCSI arrays/bridges is excluded from the iSCSI logo program • As of 4/2005, over 120 iSCSI hardware targets qualified
Windows & iSCSI: FutureMicrosoft’s iSCSI Roadmap Q12005 Longhorn • Microsoft iSCSI Software Initiator v2.0 • Integrate MPIO with iSCSI • Support and integration withVDS (requires VDS 1.1) • x64 support • Supportability and Deployments enhancements • Auto-discovery • Support for IPv6 • Storage Management Integration (next version) • Integration of iSCSI & iSNS withActive Directory and Radius • Winsock Kernel Support (RDMA) • Storage Explorer User Interface • Centralized Management of iSCSI & Fibre Channel targets
Windows & iSCSI: Next GenerationVersion 2.0 • Integrates the Microsoft MPIO high availability multipathing solution • Supports logo’d block storage devices • Designed to work with all SPC-2 or later compliant targets • MS MPIO DDK includes iSCSI DSM source • The iSCSI-MPIO solution enables • Multiple connections per session • Multiple load balance policies and failover policies • Persistent ISID across reboots • Portal hopping for target rediscovery • Attempt connection to alternate portals in the event of lost connection • Error Recovery Levels 1 & 2 for tapes and high availability scenarios
Windows & iSCSI: Next GenerationVersion 2.0 (Con't) • Provides x64 support • Enhances supportability and deployment • Improved event log messages • Eventlog using WMI • Event Tracing • Unattended Setup • Enhancements to iSCSICLI & iSCSI GUI • Auto discovery of iSNS server using DHCP • Enhancements to iSCSI WMI provider • IPv6
Windows & iSCSI: Longhorn Integration(Next Version) • Project Goals: • Persist iSCSI security and other configuration information • Data access • Storage device management • Provide: • A centralized management interface • The infrastructure to distribute configuration information securely • Integration with Active Directory • Infrastructure to centralize secure authentication • Integration with RADIUS • Accounting with RADIUS • iSCSI login and configuration changes • High availability • Fabric management
Community Resources • Windows Hardware & Driver Central (WHDC) • www.microsoft.com/whdc/default.mspx • Technical Communities • www.microsoft.com/communities/products/default.mspx • Non-Microsoft Community Sites • www.microsoft.com/communities/related/default.mspx • Microsoft Public Newsgroups • www.microsoft.com/communities/newsgroups • Technical Chats and Webcasts • www.microsoft.com/communities/chats/default.mspx • www.microsoft.com/webcasts • Microsoft Blogs • www.microsoft.com/communities/blogs