660 likes | 827 Views
Extending SANs over IP Networks. Addy Lam Professional Services. Agenda. Nishan, The Company Evolution of Storage Area Network Nishan Vision Why deploy IP Storage and Why go with Nishan? SAN over IP applications Customer Profiles Nishan Products
E N D
Extending SANs over IP Networks Addy Lam Professional Services
Agenda • Nishan, The Company • Evolution of Storage Area Network • Nishan Vision • Why deploy IP Storage and Why go with Nishan? • SAN over IP applications • Customer Profiles • Nishan Products • Comparison between Nishan and Cisco Products • IP SAN reference material • Questions and Answers
Nishan, The Company Top 10 Private Storage Networking Companies 50 Companies Most Likely to Change the World
Value of Storage Area Networking SAN • Storage Consolidation • Reduce administrative overhead • Maximize storage utilization • High Availability • Server clusters accessing shared storage • Mirroring terabytes of data/common accessibility • Disaster Recovery / Metro and Campus • Remote mirroring within the SAN • Tape backup / restore
Evolution of Storage Area Networking IP SANs ● Based on mainstream TCP/IP networks ● Enables SAN over WAN ● More robust features; scalability ● Standards-based (IETF, IEEE, ANSI) Fibre Channel Switched Fabrics ● Data Center / Departmental SANs; many devices ● Dedicated Bandwidth per port vs. shared bandwidth Fibre Channel Arbitrated Loop ● Small departmental SANs; small number of devices ● Shared bandwidth VAX Clusters / IBM ESCON / SSA ● Proprietary shared storage solutions ● Superceded by Open Systems FC
Nishan Vision of SAN Evolution Departmental Servers- iSCSI NICs • Departmental servers beyond FC reach • Promotes storage consolidation of servers IP-to-FC FC-to-IP FC-to-IP FC-to-IP IP-to-FC Main Data Center IP Campus/Metro Network FC Servers Disaster Recovery FC SAN FC SAN IP SAN IP WAN Remote Data Center Services Required • Unified Management of mixed device types and mixed fabrics • Zoning • Authentication • Security • QoS • Bandwidth Management • Storage Resource Management Data Center Boundary Expands via iSCSI Regional Office- iSCSI NICs • Retail and Banking Applications • Primary application is remote backup • Cost Effective • Converged HBA • Leverage existing low-speed links A dispersed SAN would be key for business continuance planning and backup, both of which gained importance after 9/11 -- Mark Taylor, Wells Fargo
Nishan Vision of SAN Evolution FC-to-IP FC-to-IP FC-to-IP FC-to-IP FC-to-IP Standards-based FC SAN FC SAN IP SAN FC Switch Services Required • Unified Management of mixed device types and mixed fabrics • Zoning • Authentication • Security • QoS • Bandwidth Management • Storage Resource Management Multi-Protocol Data Center Boundary Expands via iSCSI Open iSNS Multiprotocol Intelligent Fabric SANvergence Manager Departmental Servers- iSCSI NICs • Departmental servers beyond FC reach • Promotes storage consolidation of servers Main Data Center IP Campus/Metro Network FC Servers Disaster Recovery IP WAN Remote Data Center Regional Office- iSCSI NICs • Retail and Banking Applications • Primary application is remote backup • Cost Effective • Converged HBA • Leverage existing low-speed links
Why IP and Nishan? • Distance Independence • Allows TRUE Disaster Recovery • Distributed storage • Scalability • Globally distributed Enterprise SANs • Large Data Center SANs • Interoperability • Performance • Distance-independent wire-speed IP Storage solutions • Nishan enhancement – Fast Write, Compression, and Jumbo Frames • Lower Total Cost of Ownership • Leverage existing infrastructure • Investment protection by gradual migration to iSCSI and newer technologies • Enhanced Functionality • Security: IPSec encryption and authentication • Quality of service (QoS) • Advanced SAN management tools
Why IP and Nishan Distance Independence
Infrastructure Alternatives for SAN Extension Campus FC SAN Consolidation Metro ? Main Data Center FC SAN Consolidation / Disaster Recovery / Mirroring • Fiber-Channel Extension • SONET/SDH, Dark Fiber, DWDM • Tunneling (FC Encapsulation) • FC-IP • Native IP • iFCP, iSCSI WAN Remote Backup
Fibre Channel SAN Issues - Extensibility FC FC FC FC Native FC can not be transported over most service providers infrastructure. Wide area networks are based on IP or Ethernet and not FC, therefore, costly point-to-point Dark Fiber or DWDM is required to connect FC SAN. • Fibre Channel Networks are designed for “intra data center” environments • Not architected with distance or latency in mind • Enforce strict reliability and performance requirements • Homogeneous FC-2 Transport FC SAN FC SAN Fibre Channel SAN island
FC-Extension over Dark Fiber or DWDM 100% % Link Utilization 80% Buffer Credits of Single Port 60% Buffer Credits of Four Ports 40% Remote Data Center Primary Data Center 20% Metro WAN 0% 0 50 100 150 200 250 300 350 400 Fibre Length (Km) • Limited credits of FC switches causes a dramatic decrease in utilization > 30km • Can increase distance by robbing FC credits from other ports • Disadvantages: • Lost switch port density • Doesn’t fix link-utilization problem (just delays it) • Still have FC scalability limits if connecting FC-switches (few as 8 switches in fabric) • Service not available in all regions • Best positioned between limited FC Targets (2) that are relatively close, and where availability and tariffs not an issue
IP Storage Extends Beyond Fibre Channel’s Reach Long Distance IP Storage Performance Results Nishan Systems Lab Testing with Delay Simulation Equipment: 3 NT Servers with FC HBAs, 24 Disk Drives 120 Throughput, in Megabytes per Second IP Storage Switches Extend Fibre Channel’s Reach to Greater Distances and Latencies 100 IP Storage Read and Write Operations 80 60 Fibre Channel Switches can be Used in Low Latency Environments, such as Corporate Data Centers Fibre Channel Switches (64 Credits)* 40 Fibre Channel Switches (16 Credits)* 20 0 10 20 30 40 50 Round Trip Latency, in Milliseconds * Fibre Channel performance based on theoretical best case, using fully loaded 2112 byte frames
Promontory Project: Coast-to-Coast IP Storage FC FC FC FC iSCSI iSCSI IP SAN IP SAN FC FC FC FC iSCSI iSCSI IP Storage Traffic iSCSI and FC 10Gbps 80 ms round-trip latency • Provides a High-Performance, Distance-Insensitive architecture (SAN/MAN/WAN) • Enables high-speed, cost-effective backup operations, using standard high-speed data networks • Geographically distant replication sites – TRUE disaster recovery • Distributed Storage
Why IP and Nishan – Scalability
“Gluing” Together Multi-vendor FC Fabrics McData Brocade Brocade McData McData McData Brocade Brocade FCIP: Each storage fabric limited to a few switches iFCP: No limit to the size and scale of the storage network FC FC FC FC FC FC FC FC FC FC FC FC FC Extreme FC Nortel FC FC Avici Cisco Nishan FC Netgear 3Com FC FC Juniper Foundry FC Riverstone FC FC FC FC FC FC FC FC FC FC FC FC FC switch interoperability issues may limit connectivity No Point-to-Multipoint connectivity Multi-vendor interoperability Any-to-Any connectivity Lower price per port
Why IP and Nishan – Interoperability
Multi-vendor Interoperability • Interoperability is a pre-requisite in the IP World • Nishan is a prominent participant in several Interoperability forums • UNH iSCSI Consortium & Plugfests • SNW Interoperability Showcases • N+I IP Storage InteropNet • Vendor-to-vendor testing efforts • Partner Certifications • Hitachi Data Systems • Xiotech
Imation Labs Interoperability Verification Servers Operating Systems Host Bus Adapters Sun E450 HP N-Class IBM RS/6000 H70 Compaq 6400 Solaris HP-UX IBM RS/6000 AIX Windows NT4 Windows 2000 NetWare 5.1 Red Hat Linux JNI QLogic Emulex Agilent Disk Arrays Tape Libraries CLARiiON 4500 HP xp512 HDS 7700e Freedom IBM ESS “Shark” EMC Symmetrix StorageTek 9176 Compaq StorageWorks RA8000 XIOtech Magnitude LSI 4400 StorageTek L180 ADIC Scalar 1000 StorageTek 9710 Nishan partners also have done extensive interoperability testing on these and other products
Why IP and Nishan – Performance
Wire-speed iSCSI Performance Storage Subsystem 219+ MBps port throughput Server With High-Perf. iSCSI HBA Fibre Channel IPS3300 iSCSI / Gigabit Ethernet FC RAID Low CPU Utilization
SCSI Write Transaction Initiator Target Near-End Nishan Far-End Nishan FC 1G DS3 45 Mbps FC 1G FCP_CMD_WRT_16MB FCP_CMD_WRT_16MB FCP_CMD_WRT_16MB FCP_XFR_RDY-1K FCP_XFR_RDY-1K FCP_XFR_RDY-1K FCP_ DATA_OUT-1K FCP_DATA_OUT-1K FCP_DATA_OUT-1K FCP_XFR_RDY-512K FCP_XFR_RDY-512K Delay 4 x RTT FCP_ XFR_RDY-512K FCP_DATA_OUT-512K FCP_ DATA_OUT-512K FCP_DATA_OUT-512K FCP_XFR_RDY-512K FCP_XFR_RDY-512K FCP_XFR_RDY-512K FCP_DATA_OUT-512K FCP_DATA_OUT-512K FCP_DATA_OUT-512K FCP_RSP FCP_RSP FCP_RSP Write Time Aggregation
SCSI Write Transaction with Fast Write 96 MB of buffer space per Port Initiator Near-End Nishan Far-End Nishan Target FC 1G DS3 45Mbps FC 1G FCP_CMD_WRT_ 16MB FCP_XFR_RDY-16MB FCP_CMD_WRT_16MB FCP_CMD_WRT_16MB FCP_DATA_OUT-16MB FCP_DATA_OUT FCP_XFR_RDY-1KB Compression FCP_DATA_OUT-1K FCP_XFR_RDY-512KB Minimal local delay FCP_DATA_OUT-512K Delay 2 x RTT FCP_XFR_RDY-512KB FCP_DATA_OUT-512K FCP_RSP FCP_RSP FCP_RSP Fast Write can not be done without tracking each FC session’s state
Compression & Jumbo Frames • Compression • Up to 11:1 Compression Ratios • Standard Compression algorithms with extensions • “Smart” Compression - compresses just enough to match egress data rate to port speed • Both ends of a connection NEED NOT turn on compression to realize gains • Jumbo Frames • Support for maximum size FC frames - payloads up to 2048 bytes • Jumbo frame support should be end-to-end in the network • The IPS switches can handle incoming jumbo frames even if the support is not turned on. • Better overall throughput • Reduced header overhead • Higher traffic rates = higher gains • Compression works better due to bigger sized payload
Why IP and Nishan – Lower Total Cost of Ownership
Nishan can Leverage existing Fibre Channel devices FC Hosts Leverage existing investment in Fibre Channel storage devices Build on well-understood IP networking technology with existing staff and support IP Network Leverage IP’s QoS and security features FC Targets
FC SAN Extension with IP Storage Switches(E-Port) FC FC • Existing Fibre Channel Extends Easily to IP • Use standard E_Port connections on FC switches Servers Servers E_Port OSPF E_Port Fibre Channel Switch Fibre Channel Switch IP Network Multiprotocol IP Storage Switch Multiprotocol IP Storage Switch Fibre Channel Gigabit Ethernet FC RAID FC RAID Fibre Channel E_Port Compatibility
Nishan can Transition from Fibre Channel to iSCSI FC Server FC Server iSCSI Server FC Server Built-in iSCSI support Nishan IP Storage Switch IP Network IP/GE IP/GE FC FC Fibre Channel IP / Gigabit Ethernetand iSCSI FC RAID FC RAID Heterogeneous iSCSI and Fibre Channel Access
Why IP and Nishan – Enhanced Functionality
Security of Storage Data FC Authentication and Data Encryption for Storage Design Features Benefits • Standard IPSec encryption • Highly secure 3DES encryption • Off-the-shelf equipment • MAN or WAN application • Unlimited distance • Protects against traffic intrusion / snooping on critical applications (financial, government, etc.) • Additional service-revenues based on secure transport (SSP) Secured Data Transport IP Network IPSec / Firewall IPSec / Firewall Cisco CheckPoint CipherOptics SonicWall NetScreen RapidStream
Enterprise SAN Deployments with QoS IP (iSCSI, NAS) Fibre Channel SCSI Tape Library UNIX or NT Servers FC Servers FC Servers FC Director FC RAID Mission-Critical VLANs/Zones prioritize mission-critical data over other data flows
Management Scheme – Scenario 1 SoIP_Zone1 SoIP_Zone2 WWN-A WWN-B WWN-C FC Switch FC Switch FC Switch FC Switch SoIP_Zone1 WWN-A WWN-B SoIP_Zone2 WWN-C ConfigA ConfigB SANvergence Manager ZoneA ZoneB ZoneC WWN-2 Domain 07, Port 5 WWN-1 Alias A WWN-2 FC Vendor Mgmt App Alias A = WWN3 Zone1 Zone2 WWN-A WWN-B WWN-C Read-only SoIP Zones FC Island 1 Active ZoneSet = ConfigA ConfigA ConfigB IPS Fabric ZoneA ZoneC WWN-4 WWN-5 WWN-6 Active ZoneSet = Includes all Zones FC Island 2 FC Vendor Mgmt App Active ZoneSet = ConfigA Read-only SoIP Zones
Management Scheme – Scenario 2 FCSWpwwn01_ZoneA WWN-1 WWN-3 FCSWpwwn01_ZoneB WWN-2 SoIP_ZoneSet SoIP_Zone1 SoIP_Zone2 SoIP_FCSWpwwn02_ZoneA WWN-A WWN-B WWN-4 WWN-5 WWN-C SoIP_FCSWpwwn01_ZoneA SoIP_FCSWpwwn01_ZoneB WWN-2 WWN-1 WWN-3 FC Switch FC Switch FC Switch FC Switch SANvergence Manager SoIP_ZoneSet SoIP_Zone1 SoIP_Zone2 SoIP_FCSWpwwn02_ZoneA FCSWpwwn02_ZoneA WWN-A WWN-B WWN-4 WWN-5 WWN-C WWN-4 WWN-5 SoIP_FCSWpwwn01_ZoneA SoIP_FCSWpwwn01_ZoneB WWN-2 WWN-1 WWN-3 ConfigA ConfigB ZoneA ZoneB ZoneC WWN-2 Domain 07, Port 5 WWN-1 Alias A WWN-2 Alias A = WWN3 Zone1 Zone2 WWN-A WWN-B WWN-C FC Island 1 Active ZoneSet = ConfigA ConfigA ConfigB IPS Fabric ZoneC ZoneA WWN-6 WWN-4 WWN-5 Active ZoneSet = Includes all Zones FC Island 2 Active ZoneSet = ConfigA pwwn01 is the lower 3 bytes of the Principal E_Port’s WWN for SAN Island 1 pwwn02 is the lower 3 bytes of the Principal E_Port’s WWN for SAN Island 2
Storage Over IP Applications • Disaster Recovery/Remote Disk Replication • EMC, HDS, Xiotech, Compaq • Data Centers • Converged • Distributed • IP SAN Extension • Joining SAN islands • Service Provider Solution • Managed Storage Hosting Services • iSCSI integration • Storage Consolidation of “Diskless” Server • Remote Mirroring with iSCSI • Remote Backup with iSCSI
Disaster Recovery/Remote Disk Replication FC Switch FC Switch FC Switch FC Switch FC Servers FC Servers Nishan switches attached directly to storage devices IP Network HDS/EMC HDS/EMC Remote Data Center Main Data Center • Disk-to-Disk Replication over distance • EMC Symmetrix Remote Data Facilities (SRDF) - Symmetrix • HDS TrueCopy and TrueCopy 390 - Lighting 9900V Series • XIOtech REDI SAN Links - Magnitude • Compaq Data Replication Manager
Converged Data Center FC Servers IP Network Disk Disk Disk Brocade Brocade Remote Data Center Main Data Center FC / iSCSI Servers “SAN and WAN in a Box” FC Disks • “SAN and WAN in a Box” • Combines Fabric Switching and SAN Extension platform into a single platform for Remote Data Centers • Very cost effective: No need to two sets of platforms • Leverages Customer IP expertise
Distributed Data Center Local IP, Campus IP MAN/WAN Disk Brocade Brocade Disk iFCP/iSCSI Attached Departmental Servers Main Data Center FC Servers iFCP/iSCSI Attached Regional Office • Connect Departmental or Regional Servers Beyond FC Reach over IP Network • Cost Effective Backup, Storage Consolidation • No need for any tunnel-termination at both ends; Converged LAN/iSCSI HBAs • IBM Certification • iSCSI connectivity to Shark, FAStT; Includes VERITAS, Tivoli, Legato Data Center Boundary Expands via iSCSI
SAN Extension via E_Port Remote Data Center Main Data Center FC Servers FC Servers Nishan switches attach directly to Storage IP Network FC Disk FC Disk / Tape Brocade Brocade Brocade Brocade Brocade Brocade Brocade Brocade FC Servers FC Servers FC Disk FC Disk Nishan switches attach to FC Switches via E_Port • Storage Consolidation (converged zoning)
Multi-Point SAN Extension FC Server FC Server Data Center SAN IP IP Network FC IP/GigE IP Nishan IP Storage Switch Fibre Channel IP / Gigabit Ethernet Data Center SAN
Service Provider - Managed Storage Hosting Services 3000 3000 3000 3000 Service Provider POP Service Provider NOC SP-Managed Backup Storage Services Revenue Plus Transport Revenue Subscriber VLANs IPSec or IP Firewall IPSec or IP Firewall Fibre Channel SAN Service Provider POP Metro Ring Switches can be COE or CPE Subscriber “A” CPE Fibre Channel or iSCSI Servers, Storage, Switches Subscriber “B” CPE Fibre Channel Servers and Storage To Other Subscribers Gigabit Ethernet / iFCP / iSCSI Fibre Channel
Storage Consolidation of “Diskless” Servers Remote Site - 1000 miles iSCSI Hosts Fibre Channel Storage Solution: For cost-sensitive customers who have not yet storage-networked their diskless servers, implement an IP Storage Network with Nishan IP Storage switches for direct access to centralized data storage Central Data Center Campus Site iSCSI Hosts High Availability IP Storage Fabric MAN Site iSCSI Hosts Benefits: • Familiar IP and Ethernet management tools for IP network and IP Storage switches • Lower TCO on hardware components for end users , esp Fibre Channel HBAs • Migration path to new IP Storage deployments • Robust IP security and encryption tools protect mission critical data
IP Storage Remote Mirroring Configuration with iSCSI Fibre Channel Storage Fibre Channel Storage Solution: For customers that can’t implement TrueCopy, implement an IP Storage Network with Nishan IP Storage switches for direct access to remote disk devices Remote Data Center Central Data Center IP or FC Hosts Volume Manager/ Replicator High Availability IP Storage Fabric Benefits: • Zero investment in FC fabrics • Native IP extension for Volume Management across any IP network • Familiar IP and Ethernet management tools for IP network and IP Storage switches • Lower TCO on hardware components for end users • Robust IP security and encryption tools protect mission critical data
IP Storage Remote Backup Configuration with iSCSI Fibre Channel Storage Solution: For green-field deployments, implement an IP Storage Network with Nishan IP Storage switches for direct access to remote tape devices Remote Data Center Central Data Center iSCSI Hosts NetBackup High Availability IP Storage Fabric FC Tape Benefits: • Native IP extension for NetBackup across any IP network • Familiar IP and Ethernet management tools for IP network and IP Storage switches • Lower TCO on hardware components for end users • Migration path to new IP Storage deployments • Robust IP security and encryption tools protect mission critical data
Carlson Companies - World’s Largest IP SAN www.carlson.com • Carlson Companies implemented a distributed IP SAN in order to: • Storage network 10 TB of disk for a data warehouse • Support multi-customer storage service level agreements via flexible bandwidth management • Efficiently access remote site for disaster recovery • Implement centralized backup to the central data center • Integrate new native IP devices like iSCSI HBAs “By moving storage data to our IP network, we can meet both our data center and wide-area storage requirements and seamlessly integrate new storage technologies such as iSCSI.” Steve Brown, Carlson CIO / Sr. VP