1 / 37

Boost Oracle Performance with Virident FlashMAX

Boost Oracle Performance with Virident FlashMAX. Mel Shum Senior Systems Engineer. Overview. Performance disparity in the datacenter Virident FlashMAX II PCIe enterprise f lash s torage Using enterprise f lash storage for Oracle Server side vs. s torage array flash

early
Download Presentation

Boost Oracle Performance with Virident FlashMAX

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Boost Oracle Performance with Virident FlashMAX Mel Shum Senior Systems Engineer

  2. Overview • Performance disparity in the datacenter • Virident FlashMAX II PCIe enterprise flash storage • Using enterprise flash storage for Oracle • Server side vs. storage array flash • FlashMAX Connect • vCache – Bridging legacy storage with flash • vShare- Flash with Oracle RAC • vHA – Flash in an HA environment

  3. Widening Gap CPU vs. HDDs 200 180 160 140 120 100 80 60 40 20 0 Multi-Core CPU Performance Multicore CPU Disk Widening Performance Gap Single-Core CPU Performance HDD 1996 1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009

  4. Solving the Data Delivery ProblemFlash Storage Fill the Performance Gap Ops / Second • Data closer to CPU provides low latency • Delivers the full power of Flash performance CPU 1,000,000,000’s • Standard drive form factor • Delivers limited performance DRAM 100,000,000’s Virident FlashMAX 100,000’s SATA Flash HDD 100’s Picoseconds Nanoseconds Microseconds Milliseconds Seconds Latency 4

  5. Virident FlashMAXServer Attached PCIe Flash Storage • Key differentiators • Steady, predictable application performance (vs. peak) • Highest capacity in low-profile form factor • Enterprise class availability with Flash-aware hardware RAID • Highest VDI Density • Linear Scaling of OLTP and OLAP workloads • 0.5 TB to 33 TB of flash per server, up to 15 PCIe flash cards per server

  6. It takes about 7 full racks of 15k rpm Hard Drives to achieve the same IOPS as 1 of our PCIe cards. Better Performance OR Lower Power & Cooling Costs Lower Replacement Costs

  7. Entire Oracle Database on FlashMAX • Configuration • Place entire Oracle database on FlashMAX • Use FlashMAX instead of hard drives • Advantages • High performance in IOPS, throughput and lower latency • Much lower costs in hardware expenses, operations, power and cooling • Simpler installation and maintenance Oracle Database Ideal when entire database size fits into one or more FlashMAX

  8. Partial Oracle Database on FlashMAX • Configuration • Place hot files on FlashMAX • Data files, redo logs, archive logs, temp tablespace, undo tablespace • Advantages • Significant increase in the number of transactions per second • Much lower costs in storage hardware expenses due to reduced over-provisioning • Simple deployment and extension of existing infrastructure Cold Data Hot Data Oracle Database SAN Ideal when entire database size does NOT fit into one or more FlashMAX devices

  9. Database Creation • OLTP Order Management database with 50 Million orders, 100 Million order lines, and 50 Million customers. . • The Oracle database data insert and index creation time went down from approximately 5 hours to 1 hour, a 5X improvement over a networked storage, which has significant impact on the bring-up times for databases. • Autoextending files on the Oracle DB as well as creating new database files was 10,000% faster on the FlashMAXdevice.

  10. Virident FlasMAX as Tier-0 storage • An OLTP workload was carried out with database files on (1) a midrange networked storage system, (2) a Direct Attached Storage (DAS) system, and (3) a Virident FlashMAX device. Oracle ASM was the data store for all files in all scenarios. • Sustainable transactions per second • 17X better than a networked storage system • 14X better than a DAS system • Average response time • 19X lower than a networked storage system and • 17X lower than a DAS system

  11. Oracle Smart Flash Cache on FlashMAX • Configuration • Oracle’s Smart Flash Cache (optional component in Oracle 11gR2, Oracle Enterprise Linux) • 3rd party Caching engine for Linux or Windows based Oracle deployments • Advantages • Higher transactions per second • No disruption to existing infrastructure architecture • Lower infrastructure costs • Extends the life of legacy storage infrastructure SAN Shared Database Caching Software to place hot files automatically on FlashMAX devices

  12. Oracle Smart Flash Cache on FlashMAX • Queries ran between 5X to almost 60X faster with the presence of FlashMAX • The number of physical reads dropped by 40% when using Flash Cache

  13. Oracle Smart Flash Cache on FlashMAX When to use FlashMAX for Flash Cache • Consider adding the Flash Cache when the following are true: • The Buffer Pool Advisory section of your Automatic Workload Repository (AWR) report or STATSPACK report indicates that increasing the size of the buffer cache would be beneficial • DB file sequential read is a top wait event • I/O subsystem is the bottleneck • Certain key objects are accessed by queries most often • DBWR and foregrounds are I/O bottlenecked

  14. Datacenter Storage Challenge Servers Accessing SAN Server-Side Flash vs. • Shared access • High availability • High latency • Low IOPS • Network bandwidth bottleneck • High costs • No shared access • No built-in high availability • Low latency with PCIe flash • High IOPS • Scalable aggregate bandwidth • Lower costs FlashMAX Connect closes the gap,adds shared access with vShare and HA to server-side flash

  15. FlashMAX Connect FlashMAX Connect closes the gap with: • vCache to tier data from existing storage • vShare to share block device across multiple servers • vHA to synchronously replicate flash device to a separate server to eliminate Single Point of Failure

  16. Virident FlashMAX Connect Key Value Differentiation Virident FlashMAX Connect • Key characteristics • Solid state • High performance • Read/Write asymmetry • Limited Endurance • Flash management overhead • hardware RAID • Key characteristics • Flash-aware software • Integrated with the vFAS flash-translation layer • Understands endurance and asymmetry characteristics of flash • What this means? • Any storage software layer designed needs to be flash aware • Else, will negatively impact flash performance and endurance • What this means? • Works in conjunction with vFAS software layer • Does not impact the flash performance and endurance Flash Storage

  17. vCache

  18. vCache - Accelerating Single Instance Oracle Database vCache • Key Benefits • Accelerate different kinds of database workloads • Improve the performance of legacy SAN storage with no change to storage architecture • Works with any major Linux distribution • Supports both write-through, write-back and write-around caching modes for OLTP applications SAN vCache places hot active data automatically

  19. Database – vCache Local Architecture • Absorbs writes from Oracle, flushes to slower HDDs • Caches hot read indexes and data. Oracle Oracle Oracle

  20. vCache – Enhanced performance for SAN/NAS/DAS Caching done at the vFAS layer Application Application Application Write Read Write Read Write Read SAN/NAS/DAS SAN/NAS/DAS SAN/NAS/DAS Write Back: Write Around: Write Through: • Writes directly to Flash, lazy writes to backend • Reads from Flash, unless read-miss • Writes only to backend storage, optimizing cache for reads • Reads from Flash, unless read-miss • Writes go to both Flash and backend storage • Reads from Flash unless read-miss

  21. vCache comparison 250GB database, 64GB buffer pool, Dell R720, 2xE2667, HDD = RAID-0 of 4x10K 2.5” HDDs WB mode, with FlashMAX 550

  22. vShare

  23. vShare – High Speed Storage Networking Building Block NS3 NS2 NS1 • Allows for pooling of flash devices in a central high capacity server • Ability to share flash devices across multiple servers

  24. Oracle RAC with Virident FlashMAXConnect • Highest performance all-flash storage for Oracle RAC • Lowest latency with PCIe flash and Remote Direct Memory Access over Infiniband • Proven Oracle Automatic Storage Management capabilities for data mirroring and management • 0.5 TB to 33 TB of flash per server, up to 15 PCIe flash cards per server • Linear scaling of storage performance when adding servers, up to 64 servers Active-Active Server Cluster with FlashMAX II and vShare Shared Flash Storage

  25. Low-Latency PCIe Flash Storage for Oracle RAC with Virident FlashMAX Connect Network Topology App Server App Server App Server Ethernet RAC Node 1 RAC Node 2 RAC Node 3 vShare and Oracle private network InfiniBand

  26. Low-Latency PCIe Flash Storage for Oracle RAC with Virident FlashMAX Connect Architecture Node 2 Node 1 Node 3 Database instances Database instances Database instances Oracle ASMNormal Redundancy (2-way mirroring) or High Redundancy (3-way mirroring) vShareLUN1 vShareLUN2 vSharevol. 1A vShareLUN1 vShareLUN2 vShareLUN1 vShareLUN2 vSharevol. 1A vShareLUN3 vShareLUN3 vShareLUN3 Card 1 Card 2 Card 3

  27. Low-Latency PCIe Flash Storage for Oracle RAC with Virident FlashMAX Connect Performance Advantage • Highest performance for transactions and queries • Lowest latency with PCIe flash and Remote Direct Memory Access over Infiniband • Linear scaling of storage performance when adding servers, up to 64 servers • Uniformly high performance with all data on flash • No need to worry about cache sizing, data locality, cache warm-up period • Example of clustered database performance reported by Oracle CALIBRATE_IO: • 3-node RAC cluster • Two FlashMAX II 2200GB cards per node • CPU: Dual Xeon E5-2690 • max_iops = 1434268 • latency = 0 • max_mbps = 12310 Highest performance all-flash solution for Oracle RAC

  28. vHA

  29. vHA – Low Latency Synchronous Replication Primary Application Primary Application Fail-Over Node Infiniband Switch Synchronous Replication Acknowledgement Microsecond Fail-over

  30. vHA – Low Latency High Availability Solution • High availability for server based FlashMAX PCIe flash storage • Data availability with no compromises to performance and latency • 2-way active/warm-spare config with back-to-back replication Customer Benefits Primary Secondary R W vHA vHA • High performance synchonous replication optimized for server based flash • Writes over low-latency RDMA capable connection • Full as well as incremental sync capabilities • Integration with Cluster managers vHA Features Sync Replication

  31. vHA – Block level Synchronous Replication vHA Features Application • Synchronous replication at microsecond latencies over an RDMA network • Integration with standard cluster management tools • Performance indistinguishable from local FlashMAX II device • Automatic failover for service continuity • Support for multiple FlashMAX II devices and replicated stores in a single server Filesystem High Speed, Low-latency Sync Replication FlashMAX vFAS Flash Translation Layer

  32. vHA Integration with Cluster Management Service Database Instance Highly available Database Instance Virident FlashMAX Connect vHA High speed, synchronous data replication Pacemaker Heartbeat CoroSync Cluster resource manager Linux Operating system, filesystems, etc.

  33. vHA vs. Application Based Replication • Application based replication is typically asynchronous replication not suitable for high data availability • Should a server fail, there of often no guarantee that all transactions would have been replicated to the backup server • Negatively impacts application performance due to the significant overhead • Solutions like DRBD provide low performing synchronous replication • Has not been optimized for high IOPS and low latency devices such as Virident FlashMAX storage • vHA provides low-overhead, high performing synch replication • All writes are synchronously replicated between the master and warm standby with delays on the order of 5 to 10 microseconds vs. milliseconds with other solutions • When primary goes down, automatic failover time is on the order of few seconds

  34. vHA vs. DRBD Performance Comparison Time in Seconds All replication was performed over the Infiniband connection between the two nodes. Dataset size was 2500W, and buffer pool was set to 65GB.

  35. High Availability Oracle Database with vHAImplementation Details

  36. Summary • FlashMAX II can eliminate the performance disparity in your datacenter while providing enterprise class flash storage. • Provide highest throughput and lowest latency by residing closest to the CPU and memory • FlashMAXConnect provides the software needed to transform FlashMAX II into a redundant shared SAN environment. • vCache – Bridging legacy storage with flash • vShare- Enabling flash with Oracle RAC • vHA – Enabling flash in an HA environment

  37. Thank you!

More Related