590 likes | 1.07k Views
Implementing Database Zones on Oracle SuperCluster. Mikel Manitius Venkatesh Kalipi Ramin Moazeni. Agenda. SuperCluster Overview Virtualization Concepts and Technology Database Zones Exadata Storage Cell Partitioning Use Cases. Oracle SuperCluster. SuperCluster T5-8.
E N D
Implementing Database Zones on Oracle SuperCluster Mikel Manitius VenkateshKalipi RaminMoazeni
Agenda • SuperCluster Overview • Virtualization Concepts and Technology • Database Zones • Exadata Storage Cell Partitioning • Use Cases
Oracle SuperCluster SuperCluster T5-8 SuperClusterM6-32 • Extending the Product Family • Additional Benefits: • Vertical scaling • In-memory database • In-memory applications • big memory capacity • Oracle Database 12c big memory optimizations • Mainframe-class RAS • Best Price / performance • High consolidation ratios • DB + Apps in a single rack • Scalable configurations • Exadata database optimizations • Exalogic software and other application optimizations • Optimized Virtualization • Virtual Tuning Assistant
Oracle SuperCluster T5-8 Components • 2 x SPARC T5-8 Servers • 256 T5 cores @ 3.6 GHz / 4 TB RAM • 8 x Exadata Storage Cells • 288 TB raw disk capacity for Database 11gR2 • 16.8TB Flash Cache • ZFS Network Attached Storage • 60 TB raw disk capacity for general purpose shared storage • InfiniBand Interconnect • 40 gb/s bandwidth, very low latency • Management Software • Best of Breed Technology Engineered to Work Together
SuperCluster Layered Virtualization • For All Mission Critical Applications Solaris 11 Zone Solaris 8 Legacy Zone Solaris 11 Zone Solaris 9 Legacy Zone Solaris 10 Zone Solaris 10 Zone Oracle Solaris 11 Oracle Solaris 10 Oracle VM (hypervisor) SPARC
Multiple Databases on Oracle SuperCluster • Standard Database Consolidation • Single Grid Infrastructure • Multiple Oracle Homes • Multiple DB Domains and/or DB Zones • Option 1: Dedicated Storage Cells • Minimum three storage cells per Grid Infrastructure • Dedicated I/O • Option 2: Shared Storage Cells • Partition storage cells • Shared I/O DB Zone installation is not included in standard ACS Installation • Installation services available at an additional cost
SuperCluster Full Rack – InfiniBand and Client Access Networks Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4 Cell 5 Cell 6 Cell 7 Cell 8
SuperCluster Half Rack – InfiniBand and Client Access Networks Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4
SuperCluster Half Rack – Three Domains (Two DB, One App) Client Access Network (10 GbE) DB Domain DB Domain DB Domain DB Domain App Domain App Domain SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4
SuperCluster Half Rack – Four Domains (Two DB, Two App) Client Access Network (10 GbE) DB Domain DB Domain App Domain App Domain DB Domain App Domain DB Domain App Domain SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4
SuperCluster Half Rack – Four Domains (Three DB, One App) Client Access Network (10 GbE) DB Domain DB Domain DB Domain DB Domain DB Domain App Domain DB Domain App Domain SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4
SuperCluster Half Rack – Virtualization Permutations Client Access Network (10 GbE) DB Domain DB Domain DB Domain DB Domain DB Domain DB Domain DB Domain DB Domain oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle oracle database database database database database database database database database database database database database database database database database database database database database database database database database database database database Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4
SuperCluster Half Rack – InfiniBand and Client Access Networks Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4
SuperCluster Half Rack – InfiniBand Partitions Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) SPARC T5-8 Server SPARC T5-8 Server ZFS Storage Exadata Storage (RDSv3) ZFS-SA Head 1 ZFS-SA Head 2 Cell 1 Cell 2 Cell 3 Cell 4 ZFS-SA Storage Tray
SuperCluster Half Rack – Management Network Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) SPARC T5-8 Server SPARC T5-8 Server ZFS Storage Exadata Storage (RDSv3) ZFS-SA Head 1 ZFS-SA Head 2 Cell 1 Cell 2 Cell 3 Cell 4 PDU A ILOM ILOM ZFS-SA Storage Tray PDU B IB 1 IB 2 IB 3 ILOM ILOM ILOM ILOM ILOM ILOM
SuperCluster Half Rack – Database Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) DB DB DB DB DB DB Zone Zone Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server ZFS Storage Exadata Storage (RDSv3) ZFS-SA Head 1 ZFS-SA Head 2 Cell 1 Cell 2 Cell 3 Cell 4 PDU A ILOM ILOM ZFS-SA Storage Tray PDU B IB 1 IB 2 IB 3 ILOM ILOM ILOM ILOM ILOM ILOM
SuperCluster Half Rack – Database Zones and Applications Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) DB App DB App DB DB DB DB Zone Zone Zone Zone Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server ZFS Storage Exadata Storage (RDSv3) ZFS-SA Head 1 ZFS-SA Head 2 Cell 1 Cell 2 Cell 3 Cell 4 ILOM PDU A ILOM ILOM ZFS-SA Storage Tray PDU B IB 1 IB 2 IB 3 ILOM ILOM ILOM ILOM ILOM
SuperCluster Half Rack – iSCSI LUNs: Two Two-Node RACs in Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) RAC (DB1) oracle oracle oracle oracle database database database database RAC (DB2) 11gR2 11gR2 11gR2 11gR2 Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server ZFS-SA rpool DB1 Z1 /u01 DB1 Z1 rpool DB2 Z1 /u01 DB2 Z1 rpool DB1 Z2 /u01 DB1 Z2 rpool DB2 Z2 /u01 DB2 Z2
SuperCluster Half Rack – iSCSI LUNs: Four Single Instance DBs in Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) Zone (DB1) Zone (DB3) oracle oracle oracle oracle database database database database 11gR2 11gR2 11gR2 11gR2 Zone (DB2) Zone (DB4) SPARC T5-8 Server SPARC T5-8 Server ZFS-SA rpool DB1 /u01 DB1 rpool DB2 /u01 DB2 rpool DB3 /u01 DB3 rpool DB4 /u01 DB4
Installation Process – Part I • Understand current physical architecture (diagrams) • Understand current configuration information • ACS Deployment Summary • Customer documentation • Discuss initial target architecture for DB Zones • Includes planning Oracle DBs and storage cell partitioning • Gather target configuration information • Assign IP addresses, DNS names, DB names, etc. • Discuss desired long-term architecture (future DB Zones, etc) • Planning Phase
Installation Process – Part II • OEDA tool – input configuration data • Create iSCSI LUNs (two per DB Zone) • Create ZFS pools with these iSCSI LUNs • Edit Zone configuration template (text file) • Run exavmgen script • Uses OEDA output and Zone config template. Creates XML files. • Run ssc_exavm tool • Uses XML files from exavmgen • Builds the actual DB Zones. • Configuration & Installation: Creating the DB Zones
Installation Process – Part III • Partition storage cells • Create grid disks for each disk group, for each database (RAC) • Install Oracle DB software • Install Grid Infrastructure • Install Database/RAC binaries • Build ASM Instance • Build Oracle DB • Configuration & Installation: Exadata Storage & Oracle
Exadata Storage Server Building Block • High-performance storage server built from industry standard components • 12 disks - 600 GB 15000 RPM High Performance SAS or 3TB 7200 RPM High Capacity SAS • 2 Six-Core Intel Xeon Processors (E5-2630L) • Dual ported 40 Gb/sec InfiniBand • 4 x 400 GB Flash Cards • Intelligent Exadata Storage Server Software
SuperCluster Half Rack – Storage Cell Partitioning Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) SPARC T5-8 Server SPARC T5-8 Server Cell disk 12 Cell disk 36 Cell disk 24 Cell disk 0 Cell disk 25 Cell disk 1 Cell disk 13 Cell disk 37 Cell disk 14 Cell disk 38 Cell disk 26 Cell disk 2 Cell disk 39 Cell disk 27 Cell disk 3 Cell disk 15 Cell disk 28 Cell disk 16 Cell disk 40 Cell disk 4 Cell disk 29 Cell disk 5 Cell disk 41 Cell disk 17 Cell disk 30 Cell disk 6 Cell disk 42 Cell disk 18 Cell disk 31 Cell disk 43 Cell disk 19 Cell disk 7 Cell disk 20 Cell disk 32 Cell disk 44 Cell disk 8 Cell disk 9 Cell disk 45 Cell disk 33 Cell disk 21 Cell disk 22 Cell disk 34 Cell disk 46 Cell disk 10 Cell disk 23 Cell disk 47 Cell disk 35 Cell disk 11 Cell 3 Cell 1 Cell 4 Cell 2
Storage Cell Partitioning: Exadata Storage Cell – Logical Detail Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning: Slices, Grid Disks and OS Images OS OS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning: DBFS Grid Disks OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning: DBFS Disk Group DBFS OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning: DATA Grid Disks DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DBFS OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning DG Size * REDUNDANCY / Disks = GD Size Example: Target Disk Group (DG) Size = 12 TB 12 TB * 2 (NORMAL) / 48 = 500 GB Grid Disk (GD) Size create griddiskDATA_OLTP celldisk=celldiskname[0] size=500gb create griddisk DATA_OLTP celldisk=celldiskname[1] size=500gb create griddisk DATA_OLTP celldisk=celldiskname[2] size=500gb create griddisk DATA_OLTP celldisk=celldiskname[3] size=500gb …. • Creating Grid Disks
Storage Cell Partitioning: DBFS and DATA Disk Groups DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DBFS OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning: DBFS, DATA and RECO Disk Groups DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO DBFS OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
SuperCluster Half Rack – Storage Cell Partitioning: One Two-Node RAC Database Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) RAC oracle oracle database database 11gR2 11gR2 SPARC T5-8 Server SPARC T5-8 Server Cell disk 24 Cell disk 0 Cell disk 36 Cell disk 12 Cell disk 37 Cell disk 13 Cell disk 1 Cell disk 25 Cell disk 26 Cell disk 2 Cell disk 38 Cell disk 14 Cell disk 39 Cell disk 15 Cell disk 3 Cell disk 27 Cell disk 16 Cell disk 4 Cell disk 28 Cell disk 40 Cell disk 29 Cell disk 17 Cell disk 41 Cell disk 5 Cell disk 42 Cell disk 6 Cell disk 30 Cell disk 18 Cell disk 43 Cell disk 31 Cell disk 7 Cell disk 19 Cell disk 20 Cell disk 44 Cell disk 32 Cell disk 8 Cell disk 21 Cell disk 9 Cell disk 33 Cell disk 45 Cell disk 34 Cell disk 46 Cell disk 22 Cell disk 10 Cell disk 11 Cell disk 35 Cell disk 23 Cell disk 47 DATA Cell 2 Cell 4 Cell 3 Cell 1 RECO DBFS
SuperCluster Full Rack – Storage Cell Partitioning: Two Two-Node RACs in Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) OLTP oracle oracle oracle oracle database database database database Data Warehouse 11gR2 11gR2 11gR2 11gR2 Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4 Cell 5 Cell 6 Cell 7 Cell 8 Data Warehouse OLTP
SuperCluster Half Rack – Storage Cell Partitioning: Two Two-Node RACs in Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) OLTP oracle oracle oracle oracle database database database database Data Warehouse 11gR2 11gR2 11gR2 11gR2 Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server InfiniBand ZFS-SA Cell 1 Cell 2 Cell 3 Cell 4 OLTP Data Warehouse
Storage Cell Partitioning: Unallocated Space For Future Growth DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO DBFS_OLTP OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
Storage Cell Partitioning: Multiple Grid Infrastructures Sharing Storage Cells DATA_OLTP DATA_DW DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA DATA RECO_OLTP RECO_DW RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO RECO DBFS_DW DBFS_OLTP OS OS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS DBFS Cell disk 0 Cell disk 1 Cell disk 2 Cell disk 3 Cell disk 4 Cell disk 5 Cell disk 6 Cell disk 7 Cell disk 8 Cell disk 9 Cell disk 10 Cell disk 11 Exadata Storage Cell
SuperCluster Half Rack – Storage Cell Partitioning: Two Two-Node RACs in Zones Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) OLTP oracle oracle oracle oracle database database database database Data Warehouse 11gR2 11gR2 11gR2 11gR2 Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server Cell disk 36 Cell disk 0 Cell disk 24 Cell disk 12 Cell disk 37 Cell disk 1 Cell disk 13 Cell disk 25 Cell disk 26 Cell disk 38 Cell disk 14 Cell disk 2 Cell disk 27 Cell disk 3 Cell disk 15 Cell disk 39 Cell disk 4 Cell disk 40 Cell disk 16 Cell disk 28 Cell disk 29 Cell disk 17 Cell disk 5 Cell disk 41 Cell disk 18 Cell disk 42 Cell disk 30 Cell disk 6 Cell disk 43 Cell disk 7 Cell disk 19 Cell disk 31 Cell disk 8 Cell disk 44 Cell disk 20 Cell disk 32 Cell disk 45 Cell disk 21 Cell disk 33 Cell disk 9 Cell disk 10 Cell disk 22 Cell disk 46 Cell disk 34 Cell disk 35 Cell disk 11 Cell disk 47 Cell disk 23 DATA_OLTP DATA_DW Cell 1 Cell 3 Cell 2 Cell 4 RECO_DW RECO_OLTP DBFS_DW DBFS_OLTP
SuperCluster Half Rack – Storage Cell Partitioning: Two RAC Domains Client Access Network (10 GbE) DB Domain DB Domain DB Domain DB Domain App Domain App Domain OLTP oracle oracle oracle oracle oracle oracle database database database database database database 11gR2 11gR2 11gR2 11gR2 11gR2 11gR2 Data Warehouse SPARC T5-8 Server SPARC T5-8 Server Cell disk 24 Cell disk 12 Cell disk 36 Cell disk 0 Cell disk 37 Cell disk 13 Cell disk 25 Cell disk 1 Cell disk 26 Cell disk 14 Cell disk 2 Cell disk 38 Cell disk 3 Cell disk 15 Cell disk 27 Cell disk 39 Cell disk 28 Cell disk 4 Cell disk 16 Cell disk 40 Cell disk 5 Cell disk 17 Cell disk 41 Cell disk 29 Cell disk 30 Cell disk 6 Cell disk 18 Cell disk 42 Cell disk 31 Cell disk 43 Cell disk 19 Cell disk 7 Cell disk 20 Cell disk 8 Cell disk 32 Cell disk 44 Cell disk 45 Cell disk 33 Cell disk 9 Cell disk 21 Cell disk 10 Cell disk 22 Cell disk 34 Cell disk 46 Cell disk 23 Cell disk 11 Cell disk 35 Cell disk 47 DATA_OLTP DATA_DW Cell 2 Cell 3 Cell 4 Cell 1 RECO_DW RECO_OLTP DBFS_DW DBFS_OLTP
SuperCluster Half Rack – Storage Cell Partitioning: Hybrid Combination Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) OLTP oracle oracle oracle oracle database database database database 11gR2 11gR2 11gR2 11gR2 Zone (DB2) Zone (DB3) Zone Zone SPARC T5-8 Server SPARC T5-8 Server Cell disk 24 Cell disk 36 Cell disk 0 Cell disk 12 Cell disk 1 Cell disk 25 Cell disk 37 Cell disk 13 Cell disk 26 Cell disk 14 Cell disk 38 Cell disk 2 Cell disk 27 Cell disk 39 Cell disk 15 Cell disk 3 Cell disk 16 Cell disk 4 Cell disk 28 Cell disk 40 Cell disk 41 Cell disk 29 Cell disk 5 Cell disk 17 Cell disk 42 Cell disk 6 Cell disk 30 Cell disk 18 Cell disk 7 Cell disk 19 Cell disk 31 Cell disk 43 Cell disk 8 Cell disk 20 Cell disk 44 Cell disk 32 Cell disk 33 Cell disk 21 Cell disk 45 Cell disk 9 Cell disk 46 Cell disk 10 Cell disk 22 Cell disk 34 Cell disk 35 Cell disk 47 Cell disk 11 Cell disk 23 DATA_OLTP DATA_DB2 Cell 1 Cell 4 Cell 3 Cell 2 DATA_DB3 RECO_DB3 RECO_DB2 RECO_OLTP DBFS_OLTP
SuperCluster Half Rack – Storage Cell Partitioning: Two Single Instance Databases Client Access Network (10 GbE) DB Domain (Solaris 11) DB Domain (Solaris 11) App Domain (Solaris 11) App Domain (Solaris 11) oracle oracle database database 11gR2 11gR2 OLTP DW SPARC T5-8 Server SPARC T5-8 Server Cell disk 24 Cell disk 0 Cell disk 12 Cell disk 36 Cell disk 13 Cell disk 37 Cell disk 1 Cell disk 25 Cell disk 14 Cell disk 38 Cell disk 2 Cell disk 26 Cell disk 15 Cell disk 39 Cell disk 3 Cell disk 27 Cell disk 40 Cell disk 16 Cell disk 28 Cell disk 4 Cell disk 29 Cell disk 41 Cell disk 5 Cell disk 17 Cell disk 6 Cell disk 18 Cell disk 30 Cell disk 42 Cell disk 19 Cell disk 31 Cell disk 7 Cell disk 43 Cell disk 32 Cell disk 8 Cell disk 44 Cell disk 20 Cell disk 21 Cell disk 9 Cell disk 45 Cell disk 33 Cell disk 46 Cell disk 34 Cell disk 22 Cell disk 10 Cell disk 11 Cell disk 47 Cell disk 35 Cell disk 23 DATA_OLTP DATA_DW Cell 2 Cell 3 Cell 4 Cell 1 RECO_DW RECO_OLTP
SuperCluster Best Practices for Backup and Recovery ZFS Replication (non Database data) Test Disk Backup Production DR Disk Backup Active DataGuard RMAN RMAN InfiniBand InfiniBand FiberChannel FiberChannel Media Server Media Server Tape Tape PRIMARY SECONDARY
eHealth Ontario: Half Rack SSC T4-4 – Production Client Access Network (10 GbE) DB Domain DB Domain App Domain App Domain Production (RAC) oracle oracle oracle oracle database database database database 11gR2 11gR2 11gR2 11gR2 Zone Zone Zone Zone BI/DW (RAC) SPARC T4-4 Server SPARC T4-4 Server Cell 1 Cell 2 Cell 3 Cell disk 24 Cell disk 0 Cell disk 12 Cell disk 25 Cell disk 13 Cell disk 1 Cell disk 14 Cell disk 2 Cell disk 26 Cell disk 15 Cell disk 3 Cell disk 27 Cell disk 28 Cell disk 16 Cell disk 4 Cell disk 17 Cell disk 5 Cell disk 29 Cell disk 18 Cell disk 6 Cell disk 30 Cell disk 31 Cell disk 19 Cell disk 7 Cell disk 20 Cell disk 32 Cell disk 8 Cell disk 33 Cell disk 21 Cell disk 9 Cell disk 34 Cell disk 10 Cell disk 22 Cell disk 35 Cell disk 23 Cell disk 11 DATA_PROD DATA_BIDW RECO_BIDW RECO_PROD DBFS_BIDW DBFS_PROD
JHU Applied Physics Lab – Half Rack SSC T4-4 Client Access Network (10 GbE) DB Domain DB Domain App Domain App Domain PRODUCTION PRE-PROD Zone (eBiz) Zone (eBiz) oracle oracle oracle oracle database database database database 11gR2 11gR2 11gR2 11gR2 Zone (DW) Zone (DW) SPARC T4-4 Server SPARC T4-4 Server Cell 1 Cell 2 Cell 3 Cell disk 24 Cell disk 0 Cell disk 12 Cell disk 25 Cell disk 1 Cell disk 13 Cell disk 14 Cell disk 26 Cell disk 2 Cell disk 3 Cell disk 27 Cell disk 15 Cell disk 16 Cell disk 28 Cell disk 4 Cell disk 29 Cell disk 17 Cell disk 5 Cell disk 18 Cell disk 30 Cell disk 6 Cell disk 19 Cell disk 31 Cell disk 7 Cell disk 32 Cell disk 20 Cell disk 8 Cell disk 21 Cell disk 33 Cell disk 9 Cell disk 34 Cell disk 22 Cell disk 10 Cell disk 35 Cell disk 11 Cell disk 23 DATA_DB1 DATA_DB2 DATA_DB3 DATA_DB4 RECO_DB4 RECO_DB3 RECO_DB2 RECO_DB1
SuperCluster Half Rack – Possible Upgrade Path to Two Half Racks Add second SuperCluster (T5-8), implement RAC PRODUCTION PRE-PROD Application Network (10 GbE) Database Network (10 GbE) DB Domain DB Domain App Domain App Domain DB Domain DB Domain App Domain App Domain Zone (DW) Zone (DW) Zone (eBiz) Zone (eBiz) Zone (eBiz) Zone (DW) Zone (DW) Zone (eBiz) oracle oracle oracle oracle oracle oracle oracle oracle database database database database database database database database 11gR2 11gR2 11gR2 11gR2 11gR2 11gR2 11gR2 11gR2 ZFS DB ZFS DB Exadata Storage (RDSv3) Exadata Storage (RDSv3) SPARC T5-8 Server SPARC T4-4 Server SPARC T5-8 Server SPARC T4-4 Server Cell 3 Cell 2 Cell 1 Cell 4 Cell 2 Cell 3 Cell 1 ZFS-SA ZFS-SA
Full Rack SuperCluster: US Public Sector Agency – Production Client Access Network (10 GbE) 32 c / 1 TB 16 c / 512 GB 32 c / 256 GB 16 c / 256 GB 32 c / 1 TB 16 c / 512 GB 32 c / 256 GB 16 c / 256 GB DB Domain DB Domain App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 32 parked cores 32 parked cores App 1 App 2 App 1 App 2 App 3 App 3 oracle oracle oracle oracle database database database database 11gR2 11gR2 11gR2 11gR2 OLTP OLTP DW DW Zone Zone Zone Zone SPARC T5-8 Server SPARC T5-8 Server App 5 App 6 App 4 App 5 App 6 App 4 ZFS Storage Zone Solaris 10 Zone Zone Solaris 10 Zone Zone Zone Exadata Storage (RDSv3) ZFS-SA Head 1 ZFS-SA Head 2 Cell 1 Cell 2 Cell 3 Cell 4 Cell 5 Cell 6 Cell 7 Cell 8 ZFS-SA Storage Tray HIGH Redundancy (HC Disks)
Full Rack SuperCluster: US Public Sector Agency – DR and Test (NOTE: One Node View) Client Access Network (10 GbE) 4 c / 128 GB 4 c / 128 GB 4 c / 128 GB 4 c / 128 GB 32 c / 1 TB 16 c / 256 GB 32 c / 128 GB 16 c / 128 GB DB Domain DB Domain App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 App Domain Solaris 11 16 parked cores App 1 App 2 App 1 App 2 X2 App 3 App 3 oracle oracle oracle oracle database database database database 11gR2 11gR2 11gR2 11gR2 OLTP OLTP DW DW Zone Zone Zone Zone DISASTER RECOVERY TEST SPARC T5-8 Server App 5 App 6 App 4 App 6 App 4 App 5 ZFS Storage Zone Zone Zone Solaris 10 Zone Zone Solaris 10 Zone Exadata Storage (RDSv3) ZFS-SA Head 1 ZFS-SA Head 2 Cell 1 Cell 2 Cell 3 Cell 4 Cell 5 Cell 6 Cell 7 Cell 8 ZFS-SA Storage Tray NORMAL Redundancy (HC Disks)