1 / 45

Database and Application Consolidation on Oracle SuperCluster

Database and Application Consolidation on Oracle SuperCluster. Hunter Li Dechang Gu Session CON1658. Introduction Enabling Technologies Consolidation Use Cases Recommendations Q&A. Program Agenda.

shima
Download Presentation

Database and Application Consolidation on Oracle SuperCluster

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Database and Application Consolidation on Oracle SuperCluster Hunter LiDechangGu Session CON1658

  2. Introduction • Enabling Technologies • Consolidation Use Cases • Recommendations • Q&A ProgramAgenda

  3. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remain at the sole discretion of Oracle.

  4. Introduction

  5. The Objective Showcase the value of Oracle SuperCluster for application + database consolidation

  6. Oracle Engineered Systems Data Center Transformation Through Innovation Purpose Built Consolidation Built Exadata Exalogic Big Data Oracle SuperCluster Exalytics Database Appliance

  7. OracleSuperCluster Engineered System Building Blocks for General Purpose Application Servers ZFS NAS Storage Database Servers Exadata Storage Exalogic Exadata Oracle SuperCluster

  8. 2 * T5-8, each with 4 * SPARC T5 Processors (64 cores) 1 TB Memory 4 * InfiniBandHCAs (dual port) 4 * 10GbE NICs (dual port) 8 * 900GB SAS disks Storage 4 Exadata Storage Servers ZFS Storage Appliance (60TB disk and 4*73GB Logzillas) Switches 3 * InfiniBand 36 port switches Cisco 4948 GbE Management switch Oracle SuperCluster T5-8Half-Rack Configuration Details

  9. 2*T5-8, each with 8 * SPARC T5 Processors (128 cores) 2 TB Memory 8 * InfiniBand HCAs (dual port) 8 * 10GbE NICs (dual port) 8 * 900GB SAS disks Storage 8 Exadata Storage Servers ZFS Storage Appliance (60TB disk and 4*73GB Logzillas) Switches 3 * InfiniBand 36 port switches Cisco 4948 GbE Management switch Oracle SuperCluster T5-8Full-Rack Configuration Details

  10. Oracle SuperCluster T5-8Summary of Configurations ~2.3x Compute capacity and 33% more Exadata Storage for both Full Rack and Half Rack SSC T5-8 vs SSC T4-4

  11. Same Great Benefits Best platform for full-stack application deployments Best platform for consolidation Layered Optimized Virtualization Engineered to optimize Oracle software stack Oracle SuperCluster T5-8Configuration Overview

  12. Oracle SuperCluster Any Oracle, ISV or customer application for Solaris 10 or 11 Software Components Oracle Fusion Middleware, Exalogic Elastic Cloud, or 3rd party middleware Oracle 11gR2 Solaris 10 or Solaris 11 Oracle VM for SPARC Exadata Storage Server Software

  13. Oracle Solaris 11 Manage Both Virtual and Physical Infrastructure Physical Cloud Virtual Servers Oracle Solaris 11 Zone Zone Zone Zone Logical Domain Logical Domain VNIC Virtual NIC VNIC VirtualNetworking Virtual Switch Virtual Switch Virtual Storage Storage Pools

  14. Oracle VM Server for SPARC Efficient Hypervisor-based Virtualization Oracle Solaris 10 Oracle Solaris 10 Oracle Solaris 10 Oracle Solaris 10 Isolated OS instance in each logical (or virtual) domain SAP App Domain App Domain App Domain App Domain Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Database Domain Database Domain Database Domain Database Domain SPARC Hypervisor Firmware-based hypervisor leverages SPARC T5 architecture Each logical domain runs in dedicated CPU thread(s) T-Series Server Domains can have direct access to PCIe devices

  15. Solaris Zones • Efficient Virtualization • Namespace isolation: users, services, network, etc. • Minimal overhead and small footprint • Independent, fast reboot • Easy to clone/attach/detach • Support for older releases through Branded Zones • Supported partitioning for Oracle licensing purposes (capped zones)

  16. Solaris Network Virtualization Network infrastructure within the OS • Allows testing and implementation of complex network topologies • Zones get exclusive IP stack by default • Low-latency and high-bandwidth communication between Zones • Integrated firewall, load balancer and router • Integrated network resource control • Bandwidth and Flow

  17. Oracle Enterprise Manager Ops Center Complete Management for Oracle Hardware, OS & Virtualization • Data Center Discovery • Virtualization Management • Oracle, Zones, Containers • Configuration Management • Patch OS, Update Firmware,Configuration Compliance • Operating System Analytics • Maintenance • Health Checks, Remote Management, Phone Home

  18. App + DB Consolidation Use Cases

  19. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – A hypothetical scenario Order Mgmt Payroll Mgmt Legacy App • Order Management & Payroll Management • App running on Oracle Solaris 11 with HA • DB on Oracle RAC 11gR2 • Legacy customer application • App running on Oracle Solaris 10 • Standalone Oracle 10gR2 DB • Web site deployment • Web App(s) running on Oracle Solaris • Standalone Oracle 11gR2 DB Web Queries

  20. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – Hardware Infrastructure 10 GbE Data Center Network Oracle SPARC T5-8 Node 2 Oracle SPARC T5-8 Node 1 Sun ZFS Storage Appliance Oracle SPARC T5-8 server - Built-in, no-cost virtualization simplifies server consolidation, improves utilization, and reduces operational overhead - High speed onboard encryption engines provide data security ZFS Storage Appliance ZFS Storage Appliance Oracle Exadata Storage Servers Hypervisor Hypervisor 4 processors1 TB RAM4 PCI Bus 4 processors1 TB RAM4 PCI Bus HardwareCPU, Memory, PCIe HardwareCPU, Memory, PCIe InfiniBand Network

  21. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – LDoms Creation 10 GbE Data Center Network T5-8Node 2 T5-8 Node 1 DB Domain App Domain App Domain DB Domain App Domain App Domain App Domain Sun ZFS Storage Appliance Oracle VM Server for SPARC - Low-level implementation via firmware - Hard CPU and memory resource constraints - Guest OS fault isolation - Multiple OS versions and patch levels on the same physical host ZFS Storage Appliance ZFS Storage Appliance Oracle Exadata Storage Servers Hypervisor Hypervisor 2 processor512 GB RAM2 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor 256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus HardwareCPU, Memory, PCIe HardwareCPU, Memory, PCIe InfiniBand Network

  22. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – OS Setup Oracle Solaris Zones - Efficient virtualization with minimal overhead - Support for both Oracle Solaris 10 and Oracle Solaris 11. - Branded Zones facilitate migration from older Solaris releases - Delegated zones administration 10 GbE Data Center Network T5-8 Node 2 T5-8 Node 1 DB Domain App Domain App Domain DB Domain App Domain App Domain App Domain Sun ZFS Storage Appliance Oracle Solaris 10 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 DB Zone App Zone ZFS Storage Appliance ZFS Storage Appliance Oracle Exadata Storage Servers Oracle Solaris 11 - Binary compatibility with older releases - Proven scalability record on large number of hardware threads - Built-in virtualization with minimal overhead - Efficient Packaging system - Fine-grained security - Fine-grained control of processor and network resources Hypervisor Hypervisor 2 Processors512 GB RAM2 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 Processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus HardwareCPU, Memory, PCIe HardwareCPU, Memory, PCIe InfiniBand Network

  23. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – DB & Apps Installed Sun ZFS Storage Appliance provides performant, highly-available storage available for both shared filesystem as well as a block storage 10 GbE Data Center Network T5-8 Node 2 T5-8 Node 1 DB Domain App Domain App Domain DB Domain App Domain App Domain App Domain Sun ZFS Storage Appliance Oracle Solaris 10 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Sun Cluster Sun Cluster DB Zone App Zone ZFS Storage Appliance ZFS Storage Appliance Oracle Exadata Storage Servers Legacy App Oracle 10g R2 Single Instance Oracle Exadata storage servers - Smart use of Flash accelerates database I/O and reduces log file latency - Smart Scan provides the ability to offload database processing from compute nodes - Hybrid Columnar Compression (HCC) reduces storage footprint per database - IO Resource Manager (IORM) assigns I/O bandwidth based on database SLAs Management App Web App Management App Oracle RAC 11g R2 Oracle11g R2 Single Instance Oracle RAC 11g R2 Hypervisor Hypervisor 2 processors512 GB RAM2 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus HardwareCPU, Memory, PCIe HardwareCPU, Memory, PCIe InfiniBand Network

  24. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – Cluster Setup 10 GbE Data Center Network T5-8 Node 2 T5-8 Node 1 DB Domain App Domain App Domain DB Domain App Domain App Domain App DOmain Sun ZFS Storage Appliance Oracle Solaris 10 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris Cluster Oracle Soalris Cluster DB Zone App Zone ZFS Storage Appliance ZFS Storage Appliance Oracle Exadata Storage Servers Legacy App Oracle 10g R2 Single Instance Oracle Solaris Cluster provides application level HA while Oracle RAC provides HA for the DB. Management App Web App Management App Oracle RAC 11g R2 Oracle11g R2 Single Instance Oracle RAC 11g R2 Hypervisor Hypervisor 2 processor512 GB RAM2 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus HardwareCPU, Memory, PCIe HardwareCPU, Memory, PCIe InfiniBand Network

  25. Consolidation on ½ Rack Oracle SuperCluster Architecture Overview – System Management Oracle Enterprise Manager Ops Center 12c - Integrated control of all assets - Detailed Analytics - One-stop for system-wide maintenance - Elastic resource control based on policies - Included at no additional cost 10 GbE Data Center Network T5-8 Node 2 T5-8 Node 1 DB Domain App Domain App Domain DB Domain App Domain App Domain App Domain Sun ZFS Storage Appliance Oracle Solaris 10 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris 11 Oracle Solaris Cluster Oracle Soalris Cluster DB Zone App Zone ZFS Storage Appliance ZFS Storage Appliance Oracle Exadata Storage Servers Legacy App Oracle 10g R2 Single Instance Management App Web App Management App Oracle RAC 11g R2 Oracle11g R2 Single Instance Oracle RAC 11g R2 2 processors512 GB RAM2 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus 1 processors256 GB RAM1 PCI Bus 1 processor256 GB RAM1 PCI Bus InfiniBand Network

  26. Oracle Optimized Solutions • Designed, tested and fully documented architectures • Tuned for optimal performance and availability • Detailed Technical and Business Whitepapers

  27. Optimized Solution for PeopleSoft HCM • App Tier components deployed in Zones • Over 1M net payments per hour (batch) • Up to 8000 concurrent Self-Service users (online) • Sub-second average response times • Application-level HA with Solaris Cluster • Under 15 seconds to detect failure • Service restored in less than 2 minutes T5-8 Node 2 T5-8 Node 1 Oracle Solaris 10App Domain Oracle Solaris 10App Domain Zone Cluster Zone Cluster Oracle Solaris 11DB Domain Oracle Solaris 11DB Domain Oracle RAC InfiniBand Network

  28. Optimized Solution for SAP 10 GbE Data Center Network Oracle SuperCluster Node 1 Node 2 Node 2 • SAP Applications and Central Services run on Solaris 10 domains • HA for SAP Central Services through Solaris Cluster • Domain failure detected in 11 seconds • Service recovered in less than 2 minutes • 4x faster time to deployment compared to standalone components App Domain App Domain Solaris 10 Solaris 10 SAP SAP DB Domain DB Domain Solaris 11 Solaris 11 InfiniBand Network ZFS Appliance Oracle Exadata Storage Servers

  29. Optimized Solution for BRM T5-8 Node 2 T5-8 Node 1 Oracle Solaris 10App Domain Oracle Solaris 10App Domain • Solution under development • BRM and TimesTen deployed on Zones • IB connectivity helps meet low latency requirements • Processors sets assign cpu resources based on business cycle • Over 12M calls per hour (online) • Over 84M call records per hour (batch) COMMUNICATIONS Billing and Revenue Management COMMUNICATIONS Billing and Revenue Management TIMESTEN TIMESTEN Oracle Solaris 11DB Domain Oracle Solaris 11DB Domain InfiniBand Network

  30. Consolidation Recommendations

  31. Hardware pool (aka. Cloud Pool) Administrator / Policy managed clusters Consolidation density Over-subscription of upto 2 x cores using instance caging Storage Exadata storage supporting all its performance enhancing features Provisioning Supports native, embedded and templates-based provisioning Patching Supports in-place and out-of-place patching via rolling / non-rolling updates Consolidation Enablers for Oracle SuperCluster

  32. Resource Management Prioritization and management of workloads / databases based on IORM & DBRM policies Dynamically grow / shrink cloud pools QoS Management monitors workloads across entire system Disaster Recovery & High Availability High Availability via Oracle Solaris Cluster for applications and Oracle RAC for Oracle DB Supports Oracle GoldenGate & Oracle Data Guard Consolidation Enablers for Oracle SuperCluster

  33. Engineered with Best Practices

  34. DB Consolidation on Oracle SuperCluster Considerations • Minimum 11gR2 Domain Configuration • Must have at least 1 x IB HCA and 1 x 10Gbe physical interface • Minimum Solaris 11 Zone Configuration • 1-core (8 vcpus)

  35. DB Consolidation on Oracle SuperCluster Best Practice Summary for Isolation • Separate Oracle Grid Infrastructure per zone • Separate Database ORACLE_HOME per zone • Separate Diskgroups and Griddisks per zone • Configure Database-scoped Security

  36. DB Consolidation on Oracle SuperCluster • DB Consolidation Example Oracle • Each domain has multiple zones • Use Solaris resource manager to ensure one database in a zone doesn’t swamp another • Can dynamically shift CPU and memory resources between Zones

  37. DB Consolidation on Oracle SuperCluster ASM Deployment • Configure Diskgroup sets per zone: • DBFS_DG • 1GB minimum, required for Voting Disks • RECO_DG • DATA_DG • Stripe across all storage cells • Requires 3 * #zone griddisks • Use Database-scoped security for Diskgroup isolation

  38. DB Consolidation on Oracle SuperCluster • Capacity Analysis Storage Cells • High performance disks • 12 * 600GB 15,000 RPM drives • 9120GB capacity uncompressed triple mirrored after ASM installed • 9120GB / 22 (We have 22 x 2-Node RAC) • ~414GB per 2-Node RAC cluster • High capacity disks • 12 * 3TB 7,200 RPM drives • ~43TB / 22 • ~1.9TB per 2-Node RAC cluster 4

  39. In Summary

  40. Oracle SuperCluster Engineered with Best Practices • Built-in virtualization • Choice of virtualization based on isolation requirements • Fully tested and supported configurations • Multiple OS & patch levels on the same physical host • Legacy support with Branded Zones • Fully integrated with Exadata and Exalogic stack • Seamless system and patch management via Oracle Enterprise Manager Ops Center 12c

  41. Oracle SuperCluster Conference Sessions

  42. Graphic Section Divider

More Related