180 likes | 353 Views
Voltaire The Grid Backbone™. InfiniBand CERN Seminar Asaf Somekh VP Strategic Alliances June 2006. Agenda. About Voltaire Products Update InfiniBand – Ethernet connectivity. Voltaire: The Company. 2005 Sales: 4x over 2004, 15x over 2003 Over 50,000 Ports in 2005 Solid Financing
E N D
VoltaireThe Grid Backbone™ InfiniBand CERN Seminar Asaf Somekh VP Strategic Alliances June 2006
Agenda • About Voltaire • Products Update • InfiniBand – Ethernet connectivity
Voltaire: The Company • 2005 Sales: 4x over 2004, 15x over 2003 • Over 50,000 Ports in 2005 • Solid Financing • Recent Round: $17M, Summer 2005 • Sufficient funds to breakeven • Global Locations • Business HQ: Boston • R&D Center: Hertzliya, Israel • Sales Offices: San Francisco, Philadelphia, New York, Frankfurt, London, Tokyo • Headcount : 120
Manufacturing Government Education & Research Oil & Gas Entertainment Financial Srv. Deploying Grids Globally Across Industries
Expanding ISV And Solution Partnerships ServerOEMs Management and Scheduling Storage Software Application and Middleware Infrastructure
Voltaire Products Summary Grid Directors • ISR 9096 - 96 4X (DDR or SDR) or 32 12X ports • ISR 9288 – 288 4X (DDR or SDR) or 96 12X ports • Copper and optical support • Integrated GbE and/or FC ports (up to 144) • Full redundancy (PS, FAN, Fabric, Management, ..) Blade Solutions • High performance blade solutions for IBM BladeCenterH Voltaire ISR 9288 Voltaire ISR 9096 Blade Server Connectivity Solutions
Voltaire Products Summary ISR 9024 Grid switches • ISR 9024 - 24 port IB (SDR and DDR) • ISR 6000 - Multi-Protocol (IP / FC / IB) Management & Virtualization • Embedded in switches • Highly scalable Grid management Host software • Unique High-Performance offeringsfor HPC, Financials, and Storage ISR 6000 GridVision™ Management Suite
Voltaire Top500 Leadership • Largest number of Top500 InfiniBand sites • Broadest and Strongest Channels • Joint Installations with 7 OEMs and Resellers • Top InfiniBand Site: NASA Ames #4 • Most network-efficient InfiniBand site • Number of InfiniBand sites doubled from previous list, tripled in a year • Proprietary interconnects keep going down • GbE pushed lower on the list
Cost Per TFlop $600K 609 587 $500K 507 $400K GbE Myr Actual Performance 2 2 TFlops 1.5 1.6 1.4 1 GbE Myr Voltaire InfiniBand = Network Efficiency = $$$ Example: • Assumptions: • Cluster Size: 256 Nodes • 2P Opteron Server Price: $3,000 • InfiniBand Price/Node: $900 80% Network Efficiency • Myrinet Price/Node $800 65% Network Efficiency • GbE Price/Node: $100 55% Network Efficiency
Multi-Protocol Switching Same Switch, Multiple Protocol and I/F Combinations
Voltaire IP Router Unique CapabilitiesHardware Configuration and Chassis Management • ISR 9096/9288, as well as ISR 6000 chassis are supported • sRBD is required for holding up to 3 routers (any mix) • sRBD-D is required for DDR configurations, although the IPR is an SDR device • Copper as well as optic-fiber SFPs are supported • IPRs are provided with 4 copper SFPs by default (included in price) • Cluster mode is supported (multiple devices per chassis, any mix) • Voltaire unique InfiniBand-Ethernet Silicon • Link aggregation
Voltaire IP Router Unique CapabilitiesNetworking Management • Centralized management – single point representation • Feedback from the field leads to an improved mechanism - in development • CLI and GUI based management support • Including full TFM (Traffic Flow Management) and partitioning support • Click on Routers launches their VDM • Automated configuration and application transparency by cluster learning and ARP Proxy • Monitoring - management access to programmable hardware classification counters (CLI)
Healthcare Grid Data from Hospitals iSER Native InfiniBand Storage with FalconStor IPStor Voltaire Grid Director ISR 9096 TCP/IP WAN Router Local Users IPoIBSDP IPoIBRDS InfiniBand VTL ApplicationServers Oracle 10g RAC Cluster
ISR 9288 ISR 9288 ISR 9288 ISR 9288 ISR 9288 ISR 9288 … … … … … … 32 Gb Ethernet Connectivity with InfiniBand Upper tier blocking (over-subscription) factor = 5:1 Node to node hops (worst case) = 9 Multiple trunks of 4 x 1 GbE ISR 9288 ISR 9288 IP Router IP Router 16 GbE Links IP Router IP Router 16 GbE Links IP Router IP Router IP Router IP Router 48 4X links to each lower tier ISR 9288 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 240 4X links to 120 compute nodes 194 4X links to 55 compute nodes + 42 4X links to 90 storage nodes
TITECH Grid - Protocols MPI(MVAPICH) Lustre 300 Opticallinks 650 16-Core NodesEach with 2 HCAs Stretching over 3 floors 1PB InfiniBand Storagewith Lustre Legacy NAS Storage iSER NFS
Enabling High Performance Commodity Storage with iSCSI RDMA (iSER) and InfiniBand Performance 900 MB/s 400 MB/s FC iSER Delivering unprecedented cost/performance, leveraging on industry standard components
1,024 Compute Nodes on A Single Global File Systemwith Voltaire Grid Backbone™ and HP SFS ™ 1,024 Compute Nodes4 Login Nodes2 Admin Nodes 4 Voltaire ISR 9288 Grid Directors 87 Voltaire ISR 9024Grid Switches Client Throughput:350 MB/s 12 HP SFS OSS Nodes (Lustre Servers) with 132 TBOSS Throughput 900 MB/s1 SFS Admin Node1 MDS Node Customer: D.O.DUS Air ForceProject TI-05 Fully Non-blocking10 Gbps InfiniBand Fabric