An Exploration of Oracle Database 12c Key Feature Sets

1. An Exploration of Oracle Database 12cKey Feature Sets Jim Czuprynski Zero Defect Computing, Inc. September 22, 2013

2. My Credentials • 30+ years of database-centric IT experience • Oracle DBA since 2001 • Oracle 9i, 10g, 11g OCP • ~ 100 articles on databasejournal.com and ioug.org • Teach core Oracle DBA courses (G/I+RAC, Exadata, Performance Tuning, Data Guard) • 2009: Oracle Education Partner Trainer of the Year • Speaker at Oracle OpenWorld, IOUG COLLABORATE11, and OUG Norway 2013 • Oracle-centric blog (Generally, It Depends)

3. Our Agenda • DBA 3.0: Consolidate or Perish! • Multi-Tenancy Databases: CDBs and PDBs • SQL Plan Management Upgrades • Information Lifecycle Management • Automatic Data Optimization • Online Datafile and Partition Movement • Policy-Based Automatic Redaction • Q+A

4. DBA 3.0: Consolidate or Perish! You’ll just have to do more with less. - Our CIOs, 2013 Less is more.– Ludwig Mies van der Rohe, c.1950 Engineered systems are the new 800-pound gorillas “Testing in production” is considered blasphemy …but DBAs must be able to guarantee excellent application performance beforerollout of new releases • Resource consolidation is the new reality • Earlier releases used instance caging, DBRM I/O management, and Exadata IORM to enforce it • Oracle 12cR1 offers several excellent, intrinsic consolidation features

5. Ex Uno, Multi:Multi-Tenancy Databases

6. Multi-Tenancy: CDBs and PDBs • Oracle Database 12cR1 offers a completely new multi-tenancy architecture for databases and instances: • A Container Database (CDBs) comprises one or more Pluggable Databases (PDBs) • CDBs are databases that contain common elements shared with PDBs • PDBs are much like traditional databases in prior releases … • …but PDBs offer extreme flexibility for cloning, upgrading, and application workload localization

7. CDBs and Common Objects CDBs and PDBs share common objects CDB1 • A CDB owns in common: • Control files and SPFILE • Online and archived redo logs • Backup sets and image copies • Each CDB has one SYSTEM, SYSAUX, UNDO, and TEMP tablespace • Oracle-supplied data dictionary objects, users, and roles are shared globally between CDB and all PDBs Data Dictionary Roles Users PDB3 PDB1 PDB2 SPFILE SYSAUX SYSTEM UNDOTBS1 Control Files TEMP ORLs ARLs Backups Image Copies

8. PDBs and Local Objects CDB1 PDBs also own local objects • PDBs have a local SYSTEM and SYSAUX tablespace • PDBs may have their own local TEMP tablespace • PDBs can own one or more application schemas: • Local tablespaces • Local users and roles • PDBs own all application objects within their schemas By default, PDBs can only see their own objects AP MFG HR MFG_ROLE AP_ROLE HR_ROLE PDB3 PDB1 PDB2 SYSTEM SYSTEM SYSTEM SYSAUX SYSAUX SYSAUX TEMP TEMP TEMP MFG_DATA AP_DATA HR_DATA

9. Shared Memory and Processes DW and DSS BATCH + IDL CDBs and PDBs also share common memory and background processes • All PDBs share same SGA and PGA • All PDBs share same background processes • OLTP: Intense random reads and writes (DBWn and LGWR) • DW/DSS: Intense sequential reads and/or logicaI I/O • Batch and Data Loading: Intense sequential physical reads and physical writes OLTP CDB1 SGA & PGA Others LGWR DBWn PDB3 PDB1 PDB2 System Storage

10. Sharing: It’s a Good Thing! Sharing common resources - when it makes sense - tends to reduce contention as well as needless resource over-allocation: • Not all PDBs demand high CPU cycles • Not all PDBs have same memory demands • Not all PDBs have same I/O bandwidth needs • DSS/DW: MBPS • OLTP: IOPS and Latency Result: More instances with less hardware

11. PDBs: Ultra-Fast Provisioning Four ways to provision PDBs: • Clone from PDB$SEED • Clone from existing PDB • “Replugging” previously “unplugged” PDB • Plug in non-CDB as new PDB CDB and PDBs stay alive during any of these operations! CDB1 PDB$SEED PDB1 PDB3 PDB5 11gR2DB PDB2 PDB4

12. XStream: Extreme Replication As of Oracle 12cR1, Oracle Streams is deprecated in favor of XStream • XStream Outbound Server handles CDC (change data capture) sourced directly from PDB(s) committed transactions • XStream Inbound Server(s) replicates CDC to any PDB(s) (but never to a CDB) • Because it’s based on Oracle GoldenGate, XStreammay require licensing of additional OGG features

13. SQL on Autopilot: Adaptive SQL Efficiency, Performance, and Tuning

14. Adaptive SQL Plan Management Automatic Plan Evolution (APE) now available via package DBMS_SPM • By default, a new automatic task runs during regular maintenance window • Auto-evolution of all non-accepted plans(NAPs): • Most recentlyadded plansget precedence • NAPs that still perform poorly: Wait 30 days • Any NAPs that perform better are automatically enabled • New SPM report procedure shows results of Automatic Plan Evolution

15. SPM Evolve Advisor In prior releases: • All SQL Plan evolution had to be performed manually • Gathering SPM advice on whether evolution was even possible was a manual process In this new release: • Automatic SQL Plan Evolutiontasks included • Manual advice and implementation also supported via new DBMS_SPMprocedures • Warning! Tuning Pack licensing may be required

16. Cardinality Feedback Cardinality Feedback was introduced in Oracle 11gR2 as part of Adaptive Cursor Sharing: • Captures actual execution statistics during query execution • Compares expected vs. actualcardinality during first execution of query • During second execution, optimizer uses actual execution statistics to reparse statement’s plan • Works best for non-skewed row sources with limited volatility

17. Adaptive Execution Plans (AEP) The optimizer can now adaptively recognize and capture multiplepotential execution sub-plans within an existing execution plan: • AEP constructs dynamic plans automatically • AEP dynamic statistics collector buffers each row set • If a new row count exceeds prior counts during statement execution, the optimizer will choose an alternative favored subplan (e.g. HASH JOIN instead of NESTED LOOP) • Otherwise, AEP will utilize the original sub-plan • Largest AEP benefit: Sub-plans whose row sets contain dramatically skeweddata

18. Automatic Re-Optimization (ARO) For some statements, ARO features may help to overcome intrinsic limitations of AEP dynamic plans: • The optimizer discovers an inefficiency during a statement’s first execution that AEP cannot resolve (e.g. order in which row sets are joined) • During the next execution, the optimizer gathers additional statistics to improve the join order • All subsequent executions of the same statement improve as more execution statistics and optimizer statistics are gathered

19. SQL Plan Directives The latest release offers the capability to capture and retain compilation and execution statistics within the data dictionary: • Before, a statement’s compilation and execution statistics were retained onlywithin the Shared Pool • Now these statistics will be retained within the data dictionaryinstead as SQL Plan Directives (SPDs) • SPDs are not SQL statement specific! • They pertain to best methods to process row sets • Therefore, multiple future queries may benefit • DBMS_XPLAN.DISPLAY … +NOTES tells if an SPD has been used against an existing SQL statement • New data dictionary views capture SPD metadata

20. Information Lifecycle Management (ILM) and Automatic Data Optimization (ADO)

21. Automatic Data Optimization (ADO) • ADO offers capability to move and/or compress data based on observed usage patterns • Uses heat maps to determine how often data has been access • Tracks exactly how data has been utilized (DML vs. query, single-block vs. table scan) • Data usage patterns can be tracked at tablespace, segment, and row level

22. Heat Maps: “How Hot Is It?” ADO leverages heat maps to: • Capture data usage frequencies • Determine which compression level is most appropriate for how data is being used • Determine which data could be movedfrom a high-performance storage tier to a lower-performance tier • Decide when data should be moved between different tablespacesor partitions to limit possible out-of-space conditions

23. Heat Maps: An Example Heat map shows heavy DML and queries: Leave data uncompressed After 3 days of more limited access: Enable ADVANCED compression After 30 days of only limited access: Enable HCC QUERY LOW* compression After 90 days of no access: Enable HCC ARCHIVE HIGH* compression * Requires Exadata, ZFS Appliance, or Pillar Axiom storage

24. Information Lifecycle Management Information Lifecycle Management (ILM): • Offers ability to track effectiveness of ADO policies • Measures how much data has effectively been migrated to different storage levels based on ADO policies currently in place • Avoids incrementing ILM activity when normal maintenance tasks (e.g. gathering optimizer statistics) should be safely ignored

25. In-Database Archiving (IDA) Avoids unnecessary deletion of rows when they no longer contain valid data • Activated via new ROW ARCHIVAL attribute of data segment • During initial INSERT, each row’s state is set to default value of zero (0) in ORA_ARCHIVE_STATE hidden column • Rows can be marked as inactive by setting ORA_ARCHIVE_STATE to one (1) • Unless the ORA_ ARCHIVE_STATE column is mentioned in query, a row’s IDA status is invisible and only active rows will be returned to query • Inactive rows can be compressed!

26. Temporal Validity (TV) TV allows specification of time periods when data stored within a table will be actually considered “valid” • Implemented through new PERIOD FOR table attribute • Specified TV dimension can then be populated as desired with both time-valid and non-time-valid data • Non-time-valid data can be compressed until it’s no longer needed (or until needed as well!)

27. Perpetual Motion:Moving Datafiles and Partitions Online

28. Online Move Datafile (OMD) Online Move Datafile (OMD) offers the ability to: • Move anydatafileto other storage system without first offlining it • Move any datafilefrom non-ASM to ASM storage • Move any datafile to a different compression level (e.g. uncompressed to OLTP or HCC) Implications: • Data objects within the datafile’s tablespace are always accessible • DML and DDL against those data objects are never interrupted Engineered Traditional SAN EXT3GFSNTFS ASM Uncompressed or Advanced Compression Advanced or HCC Compression

29. Online Move Partition (OMP) Online Move Partition (OMP) offers the ability to: • Move, split, or merge partitioned objects without interrupting DML against data objects within those partitions • Migrate partitions from one compression level to another • Global and local indexes are still maintained .. all without interrupting DML against most data objects within those partitions P1 P1 P2 P2 P3 P3 P1 P1 P2 P2 P3 P3

30. Hiding In Plain Sight:Oracle Data Redaction (ODR)

31. Policy-Based Data Redaction Oracle Data Redaction (ODR) offers ability to: • Partially obscure or completely hide sensitive data • Implement recognized standards (PII, PHI, PCI) for confidential data • “Anonymize” data for development or QA purposes • Allow selected users to see all or just some of data values based on custom viewing policies • No changes to existing application code are required

32. ODR: Redaction Policies Redaction policies: • Are implemented via new package DBMS_REDACT (think: DBMS_FGA, DBMS_RLS) • Are only applied to outbound queried data • Are applied to one or more columns in a table or view • Can be joinedtogether logically to provide a comprehensive redaction strategy

33. ODR: Redaction Types Redaction types enable ODR to: • Completely hide data (e.g. returned as empty string) • Partially obscure data (e.g. show only last 4 digits of SSN) • Completely obscure data by returning “anonymized” data values of same size / length • Provide custom obfuscation for specific data using regular expressions that vary conditionally

34. ODR: Practical Examples

35. ODR: Best Practices For optimal effectiveness: • Grant access to ODR procedures sparingly • Minimize the number of columns redacted • Consider whitelisting instead of blacklisting • Regular expressions take more resources to implement redaction than any other method, so use them sparingly

36. Thank You For Your Kind Attention! Please feel free to evaluate this session: http://www.ioug.org/eval • Session #UGF-9757 • An Exploration of Oracle Database 12cKey Feature Sets • If you have any questions or comments, feel free to: • E-mail me at jczuprynski@zerodefectcomputing.com • Follow my blog (Generally, It Depends): http://jimczuprynski.wordpress.com • Follow me on Twitter (@jczuprynski) • Connect with me on LinkedIn (Jim Czuprynski)

37. COLLABORATE14.IOUG.ORG April 7 – 11, 2014The Venetian Resort, Las Vegas, NV • Network with 5,000+ database and application professionals • 5 days of in-depth education built by users, for users • Complimentary Pre-Conference Workshops for IOUG registrants Attend for free! IOUG’s Call for Speakers is now open collaborate14.ioug.org/call-for-speakers

38. Training Close to Home IOUG Master Class Series Returns Coming soon to a city near you! One Day Interactive Training Events to meet your educational needs Communities • Maximum Availability Architecture with Oracle’s Larry Carpenter and Joe Meeks • October 15: Milwaukee, WI • October 16: Rochester, NY • Performance and Internals with Craig Shallahamer November 6: Chicago, ILNovember 8: Atlanta, GA • Get more information at www.ioug.org/masterclass • or visit the IOUG kiosk in Moscone West, 2nd floor

39. Come See IOUG at the User Group Pavilion Win a Free Registration to COLLABORATE 14! Stop by the IOUG kiosk in the User Group Pavilion in Moscone West, 2nd floor, to pick up a lucky poker chip and see if you are a winner of a free registration to COLLABORATE 14 in Las Vegas!

40. www.mhprofessional.com/dbsecUse Code: db12c Complimentary eBook Register Now