370 likes | 456 Views
The Best of Oracle Open World 2008. Barry Hodges Senior Solution Architect, Sales Consulting, Oracle NZ. A Different Perspective. Just being there … Opportunity to liaise with subject matter experts and product managers Input into the road map
E N D
The Best of Oracle Open World 2008 Barry HodgesSenior Solution Architect, Sales Consulting, Oracle NZ
A Different Perspective • Just being there … • Opportunity to liaise with subject matter experts and product managers • Input into the road map • Pre-arranged agenda adapted as new opportunities presented themselves
1000 800 600 Terabytes of Data Actual 400 Projected 200 1998 2000 2002 2004 2006 2008 2010 2012 Data Warehouses Growing RapidlyTripling In Size Every Two Years Size of the Largest Data Warehouses Source: Winter TopTen Survey, Winter Corporation, Waltham MA, 2008.
10 Hours Typical High-End Array Table Scan Time Typical Mid-Range Array 5 Hours Typical NAS 1 Hour Table Size 1TB 10 TB 100TB Data Warehouses Start Slowdown at 1TB
The Performance ChallengeStorage Data Bandwidth Bottleneck • Current warehouse deployments often have bottlenecks limiting the movement of data from disks to servers • Pipes between disks and servers are 10x to 100x too slow for data size
Solutions To Data Bandwidth Bottleneck • Ship less data through the pipes • Add more pipes • Make the pipes wider
Solution Approaches • “Brainy Software” approach - use smart database software to minimize the need for hardware • Smart Scan, OLAP, Bitmap Indexing, Join indexing, Materialized Views, Result Caches, Range Partitioning, etc. • “Brawny Hardware” approach - use powerful hardware to perform brute-force scans and joins • Brawny hardware approach only works if the rate of scanning data scales with size of data
HP Exadata Storage Server HardwareThe Core Building Block • Exadata Ships Less Data Through Pipes • Query processing is moved into storage to dramatically reduce data sent to servers while offloading server CPUs • Exadata has More Pipes • Modular storage “cell” building blocks organized into Massively Parallel Grid • Bandwidth scales with capacity • Exadata has Bigger Pipes • InfiniBand interconnect transfers data 5x faster than Fibre Channel Exadata Moves a Lot Less Data a Lot Faster
HP Exadata Cell Building Block Details • Storage Server (Cell) is building block of Exadata Storage Grid • Cells ship with all hardware and software components pre-installed • Runs Exadata Storage Software, Oracle Infiniband protocol, Oracle Enterprise Linux 5.1, and HP hardware management software • Hewlett Packard is exclusive hardware provider • Absolutely no custom hardware - all parts off the shelf high-volume
P400 Smart Array Disk Controller card - 512M battery backed cache Lights Out 100c – Management Card Infiniband DDR dual port card Cell Hardware Details – HP DL180G5 2 Intel 2.66 Ghz Xeon Quad-core Processors Redundant 110/220V Power Supplies 12 x 3.5” Disk Drives - 7200 RPM 1000GB SATA - 15000 RPM 450GB SAS 8 GB DRAM
SAS or SATA Disks in Exadata Servers • Choice of either • 300 GB 15,000 RPM Serial Attached SCSI (SAS) disks • 1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks • Choose SAS Based Servers for High Performance SUPERCEDED • Choose SATA Based Servers for High Capacity * Computed after mirroring, log files, indexes, undo and temp tablespaces
SAS or SATA Disks in Exadata Servers • Choice of either • 450 GB 15,000 RPM Serial Attached SCSI (SAS) disks • 1 TB 7,200 RPM Serial Advanced Technology Attachment (SATA) disks • Choose SAS Based Servers for High Performance • Choose SATA Based Servers for High Capacity * Computed after mirroring, log files, indexes, undo and temp tablespaces
Traditional Scan Processing Oracle Database Grid Storage Array What Were Yesterday’s Sales? Select sum(sales) where Date= ’20-Oct’ … Retrieve Entire Sales Table SUM
Exadata Smart Scan Processing Oracle Database Grid Exadata Storage Grid What Were Yesterday’s Sales? Select sum(sales) where Date= ’20-Oct’ … Retrieve Sales Amounts from Oct 20 SUM
Smart Scan Functionality • Join filtering • Star join filtering is performed within Exadata storage cells • Dimension table predicates are transformed into filters that are applied to scan of fact table • Backups • I/O for incremental backups is much more efficient since only changed blocks are returned • Create Tablespace (file creation) • Formatting of tablespace extents eliminates the I/O associated with the creation and writing of tablespace blocks • Smart scans are transparent to the application • No application or SQL changes required • Returned data is fully consistent and transactional
InfiniBand Throughput Single Connection Throughput • Graph shows throughput achieved in real-world deployments • Infiniband is held back by PCIe 1.0 x8 bus on typical host systems MB/sec 3x slower 12x slower
16 GB/sec … 8 GB/sec 4 GB/sec Massively Parallel Storage Grid • Scalable • Scales to hundreds of storage servers • Data automatically distributed across storage servers by ASM • Transparently redistributed when storage servers are added or removed • Data bandwidth scales linearly with capacity • Available • Data is mirrored across storage servers • Failure of disk or storage server transparently tolerated • Simple • Works transparently - no application changes Exadata bandwidth scales linearly with capacity
HP Oracle Database MachinePre-Configured High Performance Data Warehouse • 8 HP ProLiant DL360 Oracle Database servers • 2 quad-core Intel Xeon, 32GB RAM • Oracle Enterprise Linux • 14 Exadata Storage Cells (SAS or SATA) • Up to 21 TB uncompressed user data (SAS) * • Up to 46 TB uncompressed user data (SATA) * • 4 InfiniBand switches, 1 Gigabit Ethernet switch • Pre-installed, pre-configured Add more racks for unlimited scalability * Computed after mirroring, log files, indexes, undo and temp tablespaces
Software Components • Required Software • Oracle Database 11g Enterprise Edition • Oracle Exadata Storage Server Software • RAC • Partitioning Option • Recommended Software • Advanced Compression Option • Enterprise Manager Packs: Diagnostics, Provisioning, Tuning • OLAP Option • Data Mining Option • Advanced Security Option • Real Application Testing • Oracle Business Intelligence Enterprise Edition Plus
Build your own DB Machine Single Instance RAC InfiniBand Switch/Network * Currently certifying x86 OEL running Oracle 11.1.0.7
Exadata Performance Scales 10 Hour Table Scan Time Typical Warehouse 5 Hour 1 Hour Exadata Table Size 1TB 10 TB 100TB
M-Tel Exadata Speedup 10X to 72X Performance Improvement 28x Average Speedup
Giant Eagle Exadata Speedup 3X to 20X Performance Improvement 16x Average Speedup
Database Machine Comparison * Netezza 10100 uses PowerPC CPU’s (less powerful than Intel Xeon cores) ** Teradata BYNET Interconnect is proprietary
Data Protection Solutions • All single points of failure eliminated by the architecture • Hardware Assisted Resilient Data (HARD) built into storage • Prevent data corruption before it happens • Data Guard provides disaster protection & data corruption protection • Automatically maintained second copy of database • Flashback provides human error protection • Snapshot-like capabilities to rewind database to before error • Recovery Manager (RMAN) provides backup to disk • Archiving and corruption protection • Can be used with Oracle Secure Backup (OSB) or third party tape backup software • These work just as they do for traditional non-Exadata storage • Users and database administrator use familiar tools
Database Server Online Migration Exadata Non-Exadata Exadata Co-Existence and Migration • Databases can be concurrently deployed on Exadata and traditional storage • Smart Scan capability only works if the whole tablespace is located on Exadata storage • Online migration if currently using ASM and ASM redundancy • Migration can be done using RMAN or Data Guard
The HP Oracle Database MachineHow Much? US$24,000 / HP Oracle Exadata Storage Server US$120,000 / Oracle Exadata Storage Server Software (US$10,000 / disk) US$650,000 / HP Oracle Database Machine US$1,680,000 for Oracle Exadata Storage Server Software (US$120,000 / Storage Server) * Database 11g Enterprise Edition, RAC and Partitioning Option are required and must be licensed in addition to that above. * North America Prices. NOT inclusive of shipping, local taxes, etc
The HP Oracle Database MachineSales / Support Model • System Delivery • Hardware Service • System Sales • System Support Oracle Technology Sales Manager is the single point for sales Oracle is single point for Support
The HP Oracle Database MachineWhere Can You Try It? • NZ TBC • Singapore already • Sydney, Australia scheduled • NZ to be confirmed A queue has already formed!
The HP Oracle Database MachineHow Is Oracle Prioritising Interest? • Oracle Technology Sales Manager coordinates with Oracle data warehouse specialist Sales Consultants • We are looking for: • Well-known companies or organisations who will be references • Oracle knowledgeable staff • Performance challenges likely due to unbalanced hardware • Budget and clear business need • Query profile will benefit from Oracle Exadata Storage Server Software • Interest in full HP Oracle Database Machine configuration
Exadata Benefits • Extreme Performance • 10X and more speedup for data warehousing • Database Aware Storage • Smart Scans • Massively Parallel Architecture • Dynamically Scalable to hundreds of cells • Linear Scaling of Data Bandwidth • Transaction/Job level Quality of Service • Mission Critical Availability and Protection • Disaster recovery, backup, point-in-time recovery, data validation, encryption
The HP Oracle Database MachineThe next step in DW Hardware Solutions Custom Reference Configurations Optimized Warehouse HP Oracle Database Machine • Complete Flexibility • Any OS, any platform • Easy fit into a company’s IT standards • Documented best-practice configurations for data warehousing • Scalable systems pre-installed and pre-configured: ready to run out-of-the-box • Highest performance • Pre-installed and pre-configured • Sold by Oracle
Resources • Oracle.com:http://www.oracle.com/exadata • Oracle Exadata Technology Portal on OTN: http://www.oracle.com/technology/products/bi/db/exadata • Oracle Exadata white papers: http://www.oracle.com/technology/products/bi/db/exadata/pdf/exadata-technical-whitepaper.pdf http://www.oracle.com/technology/products/bi/db/exadata/pdf/migration-to-exadata-whitepaper.pdf