610 likes | 791 Views
THE ART OF STORAGE NETWORKING. 美国飞康软件公司简介. FalconStor Inc. NASDAQ 上市公司( FALC) 总部位于 Melville, New York 由 Cheyenne 软件公司的资深人员组成 成功地将 ARCserve 软件提升为企业备份首选方案 在存储、操作系统、网络方面具有丰富经验 提供 网络存储基础架构 软件 集中并虚拟化存储资源 ( SCSI, FC, iSCSI, SSA, InfiniBand..)
E N D
美国飞康软件公司简介 • FalconStor Inc. NASDAQ 上市公司(FALC) • 总部位于 Melville, New York • 由 Cheyenne 软件公司的资深人员组成 • 成功地将 ARCserve 软件提升为企业备份首选方案 • 在存储、操作系统、网络方面具有丰富经验 • 提供 网络存储基础架构 软件 • 集中并虚拟化存储资源 (SCSI, FC, iSCSI, SSA, InfiniBand..) • 通过 SAN (IP, iSCSI, FC) or NAS (NFS, CIFS) 提供存储服务 Confidential
Explosive Data Storage Growth 1,600 15¢ per MB 1,400 1,200 1,000 800 Petabytes 87% CAGR 600 400 2¢ per MB ($20,000 per TB) 200 0 1998 1999 2000 2001 2002 • Represents disk storage capacity sold annually as estimated by IDC • Storage costs as projected by Dataquest. Confidential
Fundamental Shift in IT Spending Source: IDC By 2003, Server will become peripheral to Storage – Forrester Research Confidential
Centralized Management of Storage Capacity & Storage Services. Cost of Distributed Data Management becomes Prohibitive SAN Centralized Management of Storage Capacity. Source: IDC & CIBC World Markets Confidential
With Less (TCO) Do More (ROI) Today’s Business Climate Confidential
传统存储架构面临的挑战 • 复杂的存储异构环境 • 传统 SAN 和 NAS 的争议 • 功能强大的独立存储设备各自为政 • 传统 SAN 的安全机制,令人担忧 • 存储服务(SSP) 成本高居不下 • 从传统存储迁移到SAN,工程巨大 • 异地容灾投资巨大 Confidential
我们的理念 提供企业级强大的 网络存储基础架构 软件 实现存储虚拟化、资源服务和管理 Confidential
Oracle Snapshot Agent SANergy Integration MS ExchangeSnapshot Agent Capacity On-Demand D5 D4 O.S. Integration D1 D3 D2 IP SAN FC SAN Management Block & File Access IP/iSCSI Fibre Channel Mirroring Snapshot Replication TimeMark Backup Virtualized Storage Pool NFS Service Enabler CIFS D1 D2 D4 In-Band Storage Aggregation D3 D5 ExistingLUN w/Data SCSI, FC, iSCSI, InfiniBand* Network Storage Infrastructure withEnd-to-End (O.S. - Storage) Manageability Confidential
IPStor Servers 将存储与服务器分离 CIFS Folder • I/O 接 口 灵 活 SCSI, FC, iSCSI, Infiniband* • 设 备 中 性Compaq,EMC,Fujitsu,Hitachi,IBM,NEC,SUN.. • 独 立 传 输 SAN/IPtm, iSCSI, FC IPStor NAS Clients IPStor SAN/IP Client IPStor iSCSI Client IPStor FC Client IP SAN (LAN MAN WAN) Fibre Channel SAN Java Management Console SCSI iSCSI* Disks FC Disks SCSIDisks Storage Farm TapesLibrary Confidential
Performance Security Availability Scalability Manageability Compatibility Reliability Network Storage Infrastructure • In-band Storage Virtualization • Vendor and Interface Agnostic SCSI, FC, iSCSI, Infiniband • Block[SAN] and File[NAS] Access • Protocol Agnostic FC, IP/iSCSI, CIFS, NFS • Operating System Integration • Platform Agnostic Win2K, Linux, Solaris, AIX.. • Generic Management Services • Backup, Mirroring, Snapshot, Replication, Capacity-On-Demand.. • Enterprise Integration Confidential
Server-based (Distributed)Storage Management Cost Model App Server App Server App Server Management Cost ~= (Software + Labor + Hardware) x (Total #App-Servers) + 6.7 IT Managers per 2TB of storage Confidential
Network-based (Consolidated)Storage Management Cost Model Consolidate Storage Services App Server App Server App Server Consolidate Storage Hardware IPStor Server FC, IP/iSCSI, CIFS, NFS Management Cost ~= (Software + Labor + Hardware) x (Total # IPStor Servers) + 1 IT Manager per 2 TB Storage Confidential
IPStor’s Open Architecture • Evolve from a Server-Attached model … Objectives: Server and Storage Consolidation Improve Storage Utilization/Efficiency Gain Advanced Storage Services: Virtualization, Mirroring, Snapshot, faster Backup, etc. Lower TCO, Simplify Management Servers App Servers Users Ethernet LAN SCSI or Fibre Channel JBOD, RAID, TAPE Confidential
IPStor’s Open Architecture Questions: Where to add Storage Services How to connect the storage back to the servers? • Detach the storage to form a separate Storage Farm Storage Farm Server Farm App Servers Users Ethernet LAN SCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor Servers FC Switch SCSI IPStor’s Open Architecture • Add IPStor Servers to manage the storage with intelligence • Scalable, Highly-Available, Low-Latency, Virtualized Storage Pool • Add physical storage to the pool without affecting existing logical allocation • Supports SCSI, Fibre Channel, iSCSI, and future InfiniBand Storage Farm Server Farm App Servers Users Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor’s Open Architecture • Create Virtual Drives from the available Storage Pool • Virtualize across drive, cabinet, protocol, and vendor boundaries • Just-in-time space management (Capacity On-Demand) Storage Farm Server Farm App Servers IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor’s Open Architecture • Add Storage Services such as: • Mirroring, Remote Replication, Snapshot, Zero-impact Backup… • All run on IPStor servers: no impact on App Servers Storage Farm Server Farm App Servers IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor’s Open Architecture • Provision the Virtual Drives to App Servers via Fibre Channel SAN • Key-based Authentication ensures totally secured access • Authenticated Diffie-Hellmann Algorithm Storage Farm Server Farm FC Switch FC SAN App Servers IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor’s Open Architecture • App Servers NOT conveniently connected to Fibre Channel? • Performance, Cost, Location, Platform Interoperability… ? Storage Farm Server Farm FC Switch FC SAN App ServersNot on FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IP SAN (iSCSI) Fast or Gigabit Ethernet Ethernet Switch IPStor’s Open Architecture • IPStor provides native IP-based SAN connectivity • Leverage existing Ethernet infrastructure and know-how • Ease of deployment and maintenance Storage Farm Server Farm FC Switch FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor’s Open Architecture • IPStor SAN Clients (Windows NT, W2K, Linux, Unix…) • Provides Key-based security, automated configuration, and multi-path fail-over IP SAN (iSCSI) Fast or Gigabit Ethernet Storage Farm Server Farm Ethernet Switch FC Switch FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN SCSI,iSCSI or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStor’s Open Architecture • Further consolidate File Servers with NAS (file share) support • CIFS/SMB and NFS for Windows and Unix clients • Unified SAN and NAS under a single storage infrastructure IP SAN (iSCSI) Fast or Gigabit Ethernet Storage Farm Server Farm Ethernet Switch FC Switch FC SAN IPStor Servers Users FC Switch SCSI Ethernet LAN NAS Folders SCSI, iSCSI, or Fibre Channel Based JBOD/RAID/TAPE Confidential
IPStorTM软件架构 IPStor Server Management ServicesSNMP, Java NAS Client IPStor SAN Client Application Application Storage ServicesHA, Mirror, Replicate, Snapshot.. Operating System Operating System NAS (NFS,CIFS) I/O Virtualization SCSI driver Native NetworkRedirector Client Management Host Adapter Driver SANSCSI SANSCSI SCSI driver iSCSI iSCSI Fibre Channel Target Mode Driver Fibre Channel HBA Driver SAN/IP TCP TCP SAN/IP Host AdapterDriver TCP IP IP IP SCSI iSCSI FC,SSA Infiniband… IP SAN (LAN, MAN, WAN) Tape Fibre ChannelSAN Confidential
Performance and Benchmark TM Software. That makes the difference! Confidential
Scaleable Performance • IPStor’s Zero-Memory-Copy architecture ensures optimal throughput with no cache-memory • Small footprint (4 MB Flash) • Light demand on RAM (128 MB) • 64*66 PCI, one Gigabit Ethernet NIC w/ Jumbo Frame • Sequential R/W over 110 MB/s • Small packet I/O over 12,000 IO/s • 64*66 PCI, two Gigabit Ethernet NIC w/ Jumbo Frame • Sequential R/W over 180 MB/s • Small packet I/O over 15,000 IO/s • 64*66 PCI, one 1Gb FC HBA • Sequential R/W over 90 MB/s • Small packet I/O over 8,000 IO/s • 64*66 PCI, one 2Gb FC HBA • Sequential R/W over 180 MB/s • Small packet I/O over 23,000 IO/s Confidential
数据传输延迟分析 在千兆以太网上,将 # commands 设置为 3(IOMeter 参数),IPStor 的SAN/IP 协议将产生 ~0.1ms 延迟。当I/O数据的大小超过4KB时, 这个延迟就显得微不足道了。 如果这个延迟比硬盘的巡道时间小很多的话,在并行I/O的情形下,这个延迟对应用将不会产生什么影响。 Confidential
Independent Benchmark Results ExtremeLabs, Inc. “ExtremeLabs, Inc. performed three benchmark test series on FalconStor’s IPStor SAN. The results were chilling: IPStor SANs under test conditions outperformed local subsystems, and was rarely the source of any disk I/O latency as perceived by the benchmarks. The difference in performance between server I/O using a local disk subsystem and the IPStor SAN ranged from a rare 0.6% latency to a 7.2% gain in performance over local disk I/O.” - www.extremelabs.com Confidential
IPStor Product Family • Advanced Solution Functionality • Snapshot • Disaster Tolerance • Zero-Impact backup • ……………… Base Solution Functionality • Virtualization • Connectivity • HA IPStor Full Version Capacity (735GB, 1000GB, above IPStor eLite Functionality Confidential
IPStor’s Target Market • Optimize Storage Capacity Utilization • Eliminate Vendor Lock-In and Isolation • Maximize Interoperability, Connectivity • Reclaim Locked-up Free Space • Minimize the Deployment and Sustain Cost of Storage Services • SAN & NAS Unification • Volume Management • Backup/Recovery • Data Replication • Maximize Business Continuity (Availability) • SERvivorautomatic stand-in for failed application server • DynaPathreal-time recovery from path/link failure • Active-Active Fail-Overreal-time recovery from appliance failure • Mirroringreal-time recovery from disk failure • Replicationrecovery from site failure • TimeMark/TimeViewtrack/restore disk image by time (< 3 minutes) • Zero-Impact Backup/Restorebackup/restore data at 100 GB/Hour per LTO Confidential
IPStor Solution TM Software. That makes the difference! Confidential
Availability of Storage OS/Platform Neutral: NT, Win2K, Unix, Linux, Intelx86, Sun, RISC… SAN and NAS Provisioning App Server App Server App Server … Connectivity Neutral: FC, iSCSI, IP, InfiniBand … High-Availability (Failover) FC, IP, iSCSI SAN IPStor Java Management Console Virtualized Storage Pool Protocol/Vendor Neutral Virtual Storage Pool (SCSI, iSCSI, FC, SSA, JBOD, RAID…) Confidential
Deferred investment of space 25%-100% Over Provisioning Minimal Over Provisioning $$$ Space Time Availability of Storage: High Utilization Efficiency Allocated, unused spaceUpfront investment Space Time • Non-Virtualized Model(No Dynamic Resizing) • Wasted Unusable pre-allocated Space • Upfront investment of total cost • Over-provisioning: Bad habit • Virtualized Model with Dynamic Resizing • Just-in-time allocation of needed space • Deferred investment of total cost of storage • Over-provisioning is eliminated Confidential
Before … After Frequently Used Data StaleData Stale Data Migrate FC or IP SAN Free Space Allocate from IPStor Server Availability of Storage:Capacity-On-Demand (COD) Option • Optimize storage usage based on policy • Compress stale data • Migrate stale data • Enlarge virtual disk • Eliminate system downtime caused by “out-of-storage” • Reduce backup window • Transparent to application Frequently Used Data Stale Data Compress Free Space IPStor Physical Disks Virtual Disks Confidential
Availability of Service - Active-Active Failover Eliminate Single Point Of Failure (SPOF) Clustered App Servers with optional IPStor SAN Client for Key-based Security and Discovery Clustered App Servers withIPStor SAN Client (IP/iSCSI Protocol) CIFS/NFSClients • End-to-end redundancy • Zero downtime for • HW/SW failures • Scheduled maintenance • Storage Expansion • Storage Migration • Cost of downtime • 1% Downtime is almost 4 days a year, costing $187 Million • Most business may never recover a 4 day outage Ethernet Switches IPStor Appliances in Active-Active Fail-Over mode heartbeat Fibre Channel Switches Dual Port RAID NAS NAS Mirrored Confidential
Availability of Storage:Key-based Authentication App Servers withIPStor SAN Client • Centralized Management via a Java-based Console • Precise R/W access control • Encrypted management traffic • Key-based Authentication • Shared Secret Generated with Authenticated Diffie-Hellmann • Eliminates security hole of LUN-masking • Simplifies Zoning complexity • IP SAN Compatible with IPSec, 3rd Party VPN, etc. for complete data encryption R-Only R&W VPN IP SANLAN, MAN, WAN FC SAN VPN Industry’sFirst Encrypted Mgmt Session Java Management Console IPStor Serverand Virtual Storage Pool Confidential
Stand-By Server SERvivor-Automatic recovery from Server failure Oracle DB2 Notes DynaPath -Automatic recovery from Path failure FC SAN IPStor Server IPStor Server IPStor Server Active-Active Fail-Over Automatic recovery from Appliance failure Real-Time Mirroring Automatic recovery from Diskfailure Data Center Disaster Recovery Site Business Continuity - Availability Replication over IP MAN/WAN Confidential
Backup Consolidation • LAN Free Backup: preserves your existing backup procedure • Serverless Backup: Data Mover enables data to travel directly from disk to tape. • Zero-Impact: FalconStor’s unique approach to simplify backup/restore while achieving maximum performance Industry’sFirst Confidential
Backup Consolidation: LAN-free Backup (on-site) withOff-the-Shelf Backup ApplicationsandTape Library/Drive Attached to IPStor Server LAN App. Server App. Server Backup Data Flow Backup App Backup App Virtual Disk Local Disk IP and/or FC SAN IPStor Server Virtual Disk Tape Library/Drive and RAID/JBOD attached to IPStor Server Off-the-shelf Backup Applications (e.g. Networker, ARCserve, Backup-Exec..) can perform ordinary backup/restore to/from a Tape Library/Drive attached to the IPStor Server over the IP-SAN. The Tape Library/Drives and the IPStor virtual disk appear as if there were locally attached to the App. Servers. To facilitate the sharing of Tape Library (with multiple Slots and Tape Drives) by multiple backup servers/applications on the network, vendor-specific hardware/software is needed to virtualize and partition the Tape Library. Confidential
Backup Consolidation: Server-less Backup (on-site)Off-the-Shelf Backup Application,IPStor’s “Data Mover”andTape Library/Drive Attached to IPStor Server LAN App. Server App. Server Backup Data Flow Backup App Backup App 3rd Party Copy Command Local Disk Data Mover IP and/or FC SAN IPStor Server Virtual Disk Tape Library/Drive attached to IPStor Server To expedite data transfer between the virtual disk and tape, off-the-shelf Backup Applications (e.g. ARCserve) can issue 3rd Party Copy Command to instruct the Data Mover to read the designated sectors from the Virtual Disk and write them to the tape library/drive. To facilitate the sharing of Tape Library (with multiple Slots and Tape Drives) by multiple backup servers/applications on the network, vendor-specific hardware/software is needed to virtualize and partition the Tape Library. Confidential
D: D: FC or IP SAN Step 1:Snapshot Request Step 2:Ack: Oracle inSnapshot Mode Total Time:A few seconds Step 4:Signals Oracle to resumesNormal Mode Step 3: Backup Starts; Snapshot Engaged Automatically BakBone Backup Consolidation: Zero-Impact Backup (on-site)Off-the-Shelf Linux Backup ApplicationandTape Library/Drive Attached to IPStor Server Industry’sFirst! Oracle D: virtual disk Step 5: Snapshot Backup continues at high speed while Oracle operates in normal mode. Over 100GB Per Hour Per Tape Drive verified. IPStor Server ‘DemoIPStor2’ D: Tape Library/Drive attached to IPStor Server virtual disk Confidential
With IPStor TimeMark: Restore using Last Night’s Backup … Oops! Virus attack at 5:15PM 9:00AM TimeMark 10:00AM TimeMark 5:00PM TimeMark Business Continuity - Availability • Memorize Disk Image Periodically or On-Demand based on TIME • Provides a fast ‘undo’ function for data processing • Quickly restore disk to the designated state based on TIME • Enables incremental block-level backup of Oracle/Exchange.. Without IPStor TimeMark: Mission Critical Data Instant Roll-back To 5:00PM Mission CriticalData Business Interruption = Hours & Today’s work is lost! Business Interruption = Minutes & Today’s work is intact. Confidential
R Backup Consolidation: Zero-Impact Backup (off-site)Off-the-Shelf Linux Backup ApplicationandTape Library/Drive Attached to IPStor Server LAN Backup Data Flow App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Replication over IP R Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center 1) The system administrator can replicate the data to the Disaster Recovery Center (or Vault). 2) The administrator in the DR Center can utilize off-the-shelf Linux Backup Applications (e.g. NetVault, NetBackup, etc.) on the IPStor Server to perform high-speed Snapshot (Point-In-Time Image) backup/restore of the virtual disks assigned to the application/file servers. Confidential
Duplication of Data:Real-time Mirroring via Fibre Channel LAN App. Servers FC and/or IP SAN IPStor Server IPStor Server Real-time Mirroring Fibre Channel SAN M M Data Center Disaster Recovery Center Storage Device in the Data Center and the Disaster Recovery Center can have different interface (SCSI, SSA, FC), configuration (RAID-X, JBOD) Confidential
R R R R Duplication of Data: Asynchronous Replication over IP LAN/MAN/WAN LAN Data Access Flow App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Replicate Data over IP P P Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center Storage Device in the Data Center and the Disaster Recovery Center can have different interface (SCSI, SSA, FC), configuration (RAID-X, JBOD) Confidential
P R R P Duplication of Data: IP-based Remote Disaster Recovery LAN Data Access Flow App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center If Primary system fails, the Replica can be promoted as Primary for emergency access over IP. Confidential
R R Duplication of Data: IP-based Remote Disaster Recovery LAN App. Servers IP-SAN (LAN,MAN,WAN) IPStor Server IPStor Server Linux Backup App Re-synchronize Data P P Tape Library/Drive attached to IPStor Server Data Center Disaster Recovery Center When Primary Data Center is back alive, a Reverse Replication process can re-synchronize the difference (updated data). Confidential
Duplication of Data: Distributed to Centralized Only delta (changes) are replicated to remote site. T3 Line (45 Mb/s) can sustain 10 GB/h of data transfer. IPNetworkLAN, MAN, WAN IPStor Server IPStor SAN Client IPStor SAN Client disk arrays EMC or others Local Mirroring (RAID 1 or LVM) Local Mirroring (RAID 1 or Dynamic Disk) Application level mirorr will take up CPU time. But only when data is being migrated. Corporate Data Center Remote Replication Site Enterprise Customers Confidential
Enterprise Level Management • End-to-end Performance Monitoring and Diagnostics • Cross-platform • Anytime-anywhere Administration • Usage Report • Integration with Tivoli NetView, HP Openview, CA Unicenter, etc. Confidential
SAN & NAS 统一 App Server withIPStor SAN Client App Server using NFS or CIFS • 通过CIFS 和 NFS共享企业文件 • 最大限度利用存储资源 • SAN 和 NAS 从公用得存储池中分配磁盘块 • 为SAN and NAS提供公共服务 • Mirror, Snapshot, Replication, COD, Zero-Impact Backup.. • 统一的硬件和软件的管理 IP-SAN (LAN,MAN,WAN) IPStor Server NAS Access SAN Access Common Storage Resources for NAS & SAN Confidential