1 / 51

Oracle and NetApp

Oracle and NetApp. Mike McGuiggan Consulting Systems Engineer Northeast Region. 2005. 2004. NetApp deployment at Oracle: - over 3200 TB - 14,000 Servers ONTAP 7G FlexVol & FlexClone deployed NetApp runs Oracle ERP, CRM and HR SnapValidator announced EM Grid Control Integration.

bao
Download Presentation

Oracle and NetApp

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Oracle and NetApp Mike McGuiggan Consulting Systems Engineer Northeast Region

  2. 2005 2004 NetApp deployment at Oracle: - over 3200 TB - 14,000 Servers ONTAP 7G FlexVol & FlexClone deployed NetApp runs Oracle ERP, CRM and HR SnapValidator announced EM Grid Control Integration NetApp deployment at Oracle: - over 2000 TB - 9,500 Servers at Oracle Austin Data Center Enterprise Grid Alliance Oracle builds next Apps on NetApp storage 2002 NetApp deployment at Oracle: 500TB Oracle NetApp Joint Escalation Team ONJET Joint Center of Excellence (CoE) and professional services 2000 Oracle B2B Exchange selects NetApp NetApp is Certified Solution Partner 2003 3000+ Oracle on NetApp customers in production Linux competency center 2007 2006 1997 NetApp deployment at Oracle: - over 5500 TB - 20,000 servers OCS SnapLock Integration SnapManager for Oracle Launched 5000+ joint customers NetApp deployment at Oracle: - over 6900 TB - 20,000+ servers Oracle Enterprise Linux 4 Support SnapLock Integration 2001 OraclecertifiesNetApp NetApp runs its core business on Oracle E-Business Suite NetApp and OracleBlueprints from Oracle Consulting 1995 First filer for Oracle DB sold 1999 NetApp helpsestablishOracle Storage Compatibility Program (OSCP) Oracle and Network Appliance®12 years of innovation driving down infrastructure costs AND increasing enterprise IT productivity

  3. Safra Catz, President and CFO of OracleOOW quote: “I would like to introduce my good friend Tom Mendoza…………NetApp is a very, very close partner of Oracle…..we have worked together for a very long time in advancing technology, grid computing, and data center consolidation……..for any of you that has visited our Austin Data Center, it is a commercial for NetApp. We voted for them with our money.”

  4. Oracle Austin Data Center.Over 20,000 servers. Over 6900+ TB of NetApp Storage. Austin Data Center Stats • More than 20,000+ servers • Largest Dell/Linux installation on earth • 6,900+ terabytes of NetApp storage • Largest NetApp single installation on earth • Scaling at over 60TBs of storage each month • Over 500 mission-critical customers' apps hosted on the premises • Primary data center for 50,000+ Oracle employees • 2 acres of data center raised floor space Results • Experiencing 30% higher utilization and faster application deployment • Storage management overhead reduced 50% • Global IThas88% faster response time on NetApp FC SAN

  5. The Bottom Line

  6. Oracle as a Customer - Highlights • 99% of Oracle application development is on NetApp (2400TB) • 99% of Oracle OnDemand “Production Applications and DB” (2100 TB) • 100% Oracle University (120TB) • 100% Oracle Demos DB & Applications (500TB) • 50% Database Development (300TB) • 65% of Oracle internal production (2420 TB) “NetApp has reduced the overhead necessary to perform storage-related management activities by 50%.”

  7. NetApp Supports Them All!Fabric Attached Storage Topology Departmental NAS iSCSI SAN Enterprise NAS Enterprise SAN Corporate LAN Dedicated Ethernet Fibre Channel NAS(File) SAN(Block) NetApp® FAS

  8. Simplifying Database Management: NetApp’s Value Proposition to the DBA

  9. NetApp’s Value to the DBA • Performance and Utilization • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  10. Storage can be a performance bottleneck Duplicate database copies are needed to maintain availability and SLAs Performance of each volume is limited to the number of spindles within “Hot” volumes can’t be “helped” by disks in other volumes Capacity planning, forecasting and management are imprecise tasks Availability, scalability and capacity must be maintained or increased while driving down costs… Database Performance Tuning and Capacity Planning Challenges

  11. Provision – on – Demand … with LESS Software vol1 vol3 Full provisioning tied to physical disks Manual, inefficient Unused space not available to others data free Test SQL “HOT” FlexVol™ - Flexible, Virtualized Volumes & LUNs Conventional Volumes & LUNs vol0 vol2 P P P P HM DIR’s Oracle/Caché Data ONTAP 7G™ – FlexVols™ FlexVol™s share disk Aggregate add disks on-the-fly Grow & shrink non-disruptively P WAFL® Provisions-on-Demand P Higher Storage Utilization n Raid Groups = AGGREGATE = Physical Storage Pool Improved Performance FlexVol™ = Logical Data Container (1MB – 16TB) Thin Provision More shared spindles mean NO “HOT” vols / LUNs

  12. Snapshot Active Filesys or LUN FlexClone WAFL®, Snapshot™, and FlexClone™:The Foundation NetApp’s Unique DNA • WAFL – Write Anywhere File Layout • Core block and file storage services • Resiliency features (RAID-DP™) • Snapshot • Near-instantaneous, point-in-time “copy” of file system (vol) or LUN • Read-only • SnapRestore® • Near-instantaneous “rollback” of vol or LUN to prior Snapshot copy • FlexClone • Near-instantaneous, WRITABLE “copy” of vol or LUN • Same space-sharing characteristics Inodes, block maps A B C D D’ Y Disk blocks

  13. Snapshot (Inode Copy) Root Inode C’ Introducing SnapshotTM After Block Update Before Snapshot After Snapshot Disk Usage Root Inode A B C D Disk Blocks

  14. (New) Root Inode Snapshot™ (Inode Copy) Root Inode C’ Introducing SnapRestore® After Snapshot After SnapRestore Disk Usage A B C D Disk Blocks

  15. 8-Disk Aggregate 32-Disk Aggregate 24-Disk Aggregate Data Files All Files Transaction Log Archive Log Flashback Database Performance TuningExample Test OLTP Database 2 Test OLTP Database 1

  16. Test OLTP Database - 2 Test OLTP Database 1 8-Disk Aggregate 32 Disk Aggregate 24-Disk Aggregate Data Files All files Transaction Log Archive Log Flashback Database Performance TuningExample

  17. NetApp’s Value to the DBA • Performance and Utilization • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  18. Challenges RMAN backups consume significant physical resources Cold backups lead to lower SLAs Separate backups on each platform Time-to-recover from tape becomes prohibitive DBA’s time spent on non-value-add backup/restore tasks Backups performed with less frequency Database Backup and Recovery

  19. Significant time savings Stay online Reduce system and storage overhead Consolidated backups Backup more often A B C D D’ Y Snapshot Active Filesys or LUN FlexClone Secondary Backup SnapVault Snapshot™ SnapRestore® Redo Logs Backup and Recovery with Snapshot and SnapRestore 300GB Database Primary Backup Time toBackup To Tape (60GB/Hr Best Case) Time toRecover From Tape Redo Logs 0 1 2 3 4 5 6 7 8 Time in Hours

  20. NetApp’s Value to the DBA • Performance and Utilization • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  21. RAID-DP Reliability • 2,000 to 4,000 times more secure than regular RAID • More reliable than mirroring for double-disk failure • 14% Parity Overhead vs. 50% Overhead w/Mirror(*) • 72% more usable capacity than competitive offerings(*) (*) Comparing 2P+12D vs. 7+7 Mirror RAIDProtects against single disk failure P RAID DP Protects against any two-disk failure P DP

  22. RAID-DP vs Other RAID Methods RAID-DP provides RAID 1 protection… …with RAID 4 cost, performance and simplicity

  23. Unified Storage Architecture High Performance 2002 2001 2003 2004 2005 Q1 Q2 High Perf. (SnapLock) Low Cost ATA Drives Online Archive (SnapLock) Protect Oracle Data with SnapLock Tablespaces Datafiles (partitions) Fabric Attached Storage (FAS) Oracle Database SnapLock software helps ensure the permanence, accuracy, integrity, and security of data by enabling business records and Oracle data files to be both unalterable and rapidly accessible online for long periods of time. /oradata/2001a.dbf /oradata/2001b.dbf

  24. Migrate Data Across Storage Tiers • Periodically move data between storage tiers as access patterns change • e.g. MOVE PARTITION holding Q2 Orders from high performance storage tier to low cost storage tier • Move important data on demand • UPDATE of partition key will cause row to move to a new partition • e.g. product warranty expires • Write protect data with SnapLock on any storage tier • e.g. MOVE PARTITION to SnapLock volume and mark as “read only” and set the retention date. High Performance Storage Tier Low Cost Storage Tier Partition Rules Use Cases: Content Mgmt., ILM, Compliance, Litigation, Etc.

  25. Prevention is better than recovery… eBay suffers three outages in three days “… the larger outage was caused by a corruption of data files. The corrupted files began to replicate and quickly spread across the system, …” April 11, 2002 Oracle® Database Protect Against Oracle Block Corruption Database Block Write Volume Manager SAN / NAS Cloud I/O Driver Operating System Hardware and/or firmware failures, misconfiguration, etc. Host Bus Adapter Data passes through many layers before reaching the storage subsystem. Corruption can occur at any point in the data path.

  26. SnapValidator: Prevents Oracle block corruption • SnapValidator™ is NetApp’s implementation of Oracle’s HARD initiative • HARD stands for Hardware Assisted Resilient Data • Validates writes to volumes that contain Oracle data • Oracle checksum verification • Feature of Data ONTAP • Supported with Oracle Database 9i and 10g (NFS, iSCSI, FCP) • NetApp is the only HARD partner to support this initiative across its entire product line. • NetApp is the only HARD partner to support filesystems.

  27. NetApp’s Value to the DBA • Performance and Utilization • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  28. Challenges 4x actual storage requirement Expensive transport infrastructure Cumbersome to install and manage Difficult to keep backup copies synchronized Disaster Recovery Planning Primary Data Center Secondary Data Center Database Server Database Server DedicatedLines andSwitches RAID0 + 1Mirror Copy RAID0 + 1Mirror Copy

  29. Fast data replication and failover Significant reduction in storage required Sync or async replication More efficient network utilization Access to mirrored data Volume or qtree replication Secondary can become primary in case of disaster at primary site Easy to install and manage over existing IP infrastructure (WAN) Disaster Recovery with SnapMirror® Production Site Remote Disaster Recovery Site SnapMirror

  30. SAN SAN / iSAN Unified and Tiered Disaster Recovery with ReplicatorX® Current Instance Or any Legacy Storage HA/BC site FAS Storage FlexClone Point-in-Time Clones • Data replication and recovery over any distance in a heterogeneous environment • 100% data consistency across any number of servers, storage devices, and fabric-based devices • Guarantees block write order

  31. NetApp’s Value to the DBA • Performance • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  32. Database Cloning and the Application Development Process • Full or partial database copies required for: • App and DB Development • Maintenance (OS, DB upgrade) • Test and QA • Training and Demos • Reporting and DW ETL • Ability to do this quickly, correctly, and efficiently directly impacts Application Development and Deployment PROD SECONDARY (DR) DEV MAINT TEST/QA RPT/ETL

  33. Production database 100GB Mirror copy 100GB Development copies 300GB Testing copies 300GB Total: 800GB 8x actual storage requirement Time consuming Resource overhead Mirrored Copy Dev 1 Dev 2 Dev 3 Test 2 Test 3 Test 1 Application Development and TestingExample: Traditional Approach Production

  34. Production database 100GB Mirror copy 100GB Development copies 30GB Testing copies 30GB Total: 260GB Over 67% reduction in storage required Near instantaneous copies Negligible overhead Ability to have many more test and dev copies more clones = higher productivity Application Development and TestingExample: NetApp Approach Production Mirrored Copy Dev 1 Dev 2 Dev 3 Test 2 Test 3 Test 1 Assumption: up to 10% change in data in the test and dev environments

  35. Benefits Instantaneous copies Low resource overhead Inexpensive Easy and relatively inexpensive way to make copies of a production database without impacting the database Use database clones to test migrations, apply bug fixes, upgrades, and patches Easily reallocate storage for a database and its transaction log files A B C D D’ Y Snapshot Active Filesys or LUN FlexClone Database Maintenance with FlexClones Production Mirrored Copy Dev 1 Dev 2 Dev N Production DB Clones Test 2 Test N Test 1

  36. SAN SAN / iSAN Cloning for Production Support Applications EMC to NetApp example using ReplicatorX • Continuous replication with no disruption to production • Avoid duplicating expensive storage for production support • Local or remote environments • Integrated, instantaneous cloning of current production data • Manage up to 255 clones with minimal storage capacity Production Environment Production Support Environment • Development and Test • Reporting • Analytics / Data Warehouse ReplicatorX ReplicatorX Continuous Replication Current Instance Instantaneous Clone Or any Legacy Storage FAS Storage FlexClone Point-in-Time Clones

  37. New Database Development Methodology • Mirror PROD for initial copy (DR) • If non NetApp PROD, use ReplicatorX for SAN-to-SAN • Clone database replicas as needed • Create Snapshot™ copies of replicas for instant SnapRestore® of working databases • Exploit multiple mirrors to increase fan-out and support multiple sites Clones Secondary (DR) PROD Develop ● Test ● Deploy

  38. NetApp’s Value to the DBA • Performance and Utilization • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  39. NetApp Adds Value to Oracle ASM

  40. NetApp’s Value to the DBA • Performance and Utilization • Backup and Recovery • Data Protection • Disaster Recovery and Business Continuance • Test / Development • ASM • SnapManager for Oracle

  41. Automated, fast, and efficient Uptime AND performance Simplify backup, restore, and cloning Tight Oracle Database 10g integration Automated Storage Manager (ASM) RMAN SnapManager® for Oracle® Oracle Databases SnapManager (GUI) SnapDrive™ NFS, FCP, or iSCSI NetApp Appliance NetApp StorageAppliance

  42. Oracle Advanced

  43. Other Cool Stuff… • NFS,v4 • Support with Data ONTAP 7.3 • Planned • Feature implementation with DNFS for 11gR2 • Workload prioritization • Smart redirection • RAC Failover Management with NetApp • Integrate Manage ONTAP API’s into CRS… • If Storage not accessible, is it failing over? (planned or unplanned) • Alternative: node eviction + “suicide” + application/user must reconnect… • Oracle Enterprise Manager Grid Control • Enhanced plugin (to include blocks) • Connector (to Operations Manager) • SMB/E Solution with DNFS+SE-RAC on Windows…

  44. Without FlexShare™ Prioritize Client over System Prioritize System over Client High Priority Volumes Medium Priority Volumes Low Priority System Load (IOPS) System Volumes Client 0 10 20 30 40 50 60 70 80 Latency (msec) With FlexShare Time High Priority Volumes Medium Priority Volumes Low Priority Volumes 0 10 20 30 40 50 60 70 80 Latency (msec) FlexShare Key Features • Relative priority of different volumes • Application (user) Vs. Data ONTAP background (system) prioritization • Per-volume cache policies • Dynamic configuration updates

  45. FlexShare High Benefit Use Cases • Consolidated Environments • Production, Test, and Development on the same system • Backup/Disaster Recovery Throttling • Manage “like” data with consistent performance • Structured and unstructured • Match NetApp cache management with Oracle cache management

  46. Oracle Enterprise Manager Grid Control Plugin for NetApp Monitor Trends and Threshold Alerts Monitor Key Statistics Monitor Utilization Etc. • Ships with Oracle Enterprise Manager • Developed, maintained and licensed separately by Oracle

  47. Introducing Database NFS - DNFS • What is DNFS? • An Oracle developed and supported NFS client for all platforms. (Including Windows) • What are the benefits of DNFS? • Simpler management with enhanced performance and scalability. • No certification required  immediate customer availability • Fully tested during development rather than after deployment • Supports RAC, ASM, and HARD across all operating environments

  48. Performance • Automatic Link Aggregation • Users can specify multiple ethernet connections between the Oracle database and the NFS server • DNFS will distribute the load over all active links in a balanced fashion • Improved I/O Concurrency • Supports fully concurrent, asynchronous I/O on all platforms • Summary • Any Oracle application can easily take advantage of the performance available on multiple parallel wires • No other NFS client can do this… High performance and high throughput, regardless of operating environment and without the need for expert tuning

  49. Simplicity • Runs outside of the OS kernel • No integration with operating system’s virtual memory or buffer cache • DNFS has a shorter code path  faster than other NFS clients with fewer bugs • No mount options • Already tuned for database operations • Simple to set up  fewer operational errors • Fewer support calls

  50. Database Backup with A-SIS Deduplication(Advanced Single Instance Storage) No perceivable performance impact • Write Overhead ~1% • Read Overhead 0% Remote Office Fortune 500 Manufacturer Data Center Backup Server • Backing up Oracle Databases to NearStore • Reported 50:1 space savings with A-SIS deduplication vs tape backups • Backups are quickly recovered from disk • Initial database backup is deduplicated and reduced in size • Each subsequent backup provides space savings through deduplication A-SIS deduplication NetApp Storage 50:1 Space Savings Backup Data NearStore Hetero-geneous Storage Database Servers

More Related