1 / 57

Oracle Data Integration Solutions Product Update: Oracle GoldenGate and Oracle Data Integrator

maine
Download Presentation

Oracle Data Integration Solutions Product Update: Oracle GoldenGate and Oracle Data Integrator

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

  2. Oracle Data Integration SolutionsProduct Update: Oracle GoldenGate and Oracle Data Integrator

  3. Program Agenda • Market Overview • Oracle Data Integration Overview • Oracle Data Integrator Product Update • Oracle GoldenGate Product Update • More Information

  4. Market Overview

  5. Market OverviewExponential Growth in Data Volumes 45 PB+ Maintained by Large Orgs 45%+ Annual Growth 15 out of 17 Industry Sectors in the U.S. Have More Data Than the U.S. Library of Congress

  6. Market OverviewExponential Growth in Data Volumes More Data leads to More Data Challenges

  7. Market OverviewData Integration and Data Quality Markets estimates the DI market will reach $2.8 billion estimates the DQ market will reach $1.75 billion by 2016 with an average growth rate of 18.2%

  8. Oracle Data Integration (DIS) Breadth Enables Leverage and Agility Data Quality Data Integration Match/Merge Profiling Standardization Heterogeneous Virtualization Big Data ETL/E-LT Replication

  9. Oracle Data Integration Complete Offering for Enterprise Data Integration • Complete and best-of-breed approach for enterprise data integration • Maximum performance with lower TCO, ease of use and reliability • Certified for leading technologies to deliver fast time to value Oracle Data Integrator Legacy Oracle GoldenGate Applications Oracle Enterprise Data Quality OLTP Oracle Data Services Integrator • Oracle Customers Report: • 80% lower TCO • Five times higher performance • 70% reduction in development costs Unstructured Modernization Custom MDM BI Big Data Synchronization SOA

  10. Oracle Data Integrator Bulk Data Processing and Data Transformation • Certified for leading technologies to deliver fast time to value High-performance, low cost of ownership E-LT architecture • Lightweight deployment • Flexible, easy to enrich functionality Oracle Data Integrator Legacy High Performance E-LT Declarative Design Applications Extensible Knowledge Modules OLTP CEP Data Services Unstructured Capable of Integrating Structured & Unstructured Data

  11. Oracle GoldenGate Real-time Data Integration • High-performance, low-impact real-time data integration and replication • Timely data for improved business insight • Continuous availability for 24/7 operations Oracle GoldenGate Legacy Log-based Change Data Capture and Delivery Active-Active Replication Applications Heterogeneous Source and Targets OLTP Reliability and Transaction Integrity Unstructured CEP Integration, Real-time Events

  12. Oracle Data IntegratorProduct Update

  13. Why Data Integrator for Oracle? • Heterogeneous Database Platforms • Native Support for Oracle and Non-Oracle Databases • Faster and Simpler Architecture for High-end Warehouses • E-LT Architecture is Superior fastest data loading • Transformations can run anywhere: Sources, Mid-Tier or Target • Easily & Elegantly Embedded • Runs native to SOA and Oracle Application stack technologies • 100% Java, JEE and JSE Deployment Modes • E-LT Architecture means no data choke points in mid-tier • Flexible Batch or Real-Time Data Flows • Common design point and easy migration to realtime data flows • Automatically generates DB CDC or best-of-breed CDC with GoldenGate

  14. Oracle Data Integration: Two Part Strategy Embedded Technology & Content Best of Breed Standalone Platform • Unique value proposition: Apps include pre-built integration content • Dramatically lowers the cost of adding & integrating an application • Examples: Oracle BI Applications, Oracle Governance Risk & Compliance, Application Integration Architecture (AIA), many more…

  15. Key ODI Internal OEM Patterns ERP ODI GRC ERP ODI ERP DW ODI App App ODI

  16. Note: This list is not all inclusive Engineered Together @ Oracle ODI Integrated ODI Embedded Pre-built Content ODI Integrated ODI Embedded Pre-built Content Key: ODI Integrated  ODI has special technical integrations or features to support the named Oracle Application / Component ODI Embedded  ODI is included with the Oracle Application / Component with a special license type (eg: Restricted Use etc) Pre-built Content  the Oracle Application / Component is delivered with pre-built ETL mappings/content that run in ODI

  17. Oracle ETL Roadmap

  18. Evolving Data Integration RoadmapOracle’s Investment Direction is Constantly Reviewed and Refined Roadmap 2000 to 2007 Roadmap 2007 to 2008 ODI OWB-EETL OWB-EETL OWB 2006 2007 OWB (free DB features) OWB (free DB features) Roadmap 2009 to 2010 Roadmap from Jan 2010 to Current ODI ODI New ETL KMs KMs OWB-EETL OWB-EETL OWB (free DB features) OWB (free DB features)

  19. Oracle ETL Roadmap Since Jan 2010 As Communicated to OWB and ODI Customers World-Wide ODI 12c12.1 UnifiedTeam ODI-EE License OWB-EE 11gR2 ODI 11g11.1.1.3 ODI 11g11.1.1.6 ODI 11g11.1.1.7 Late 2011 CY13 CY13 Oct 2008 Jan 2009 Sep 2009 Jul 2010 OWB-EETLConcepts Knowledge Modules ODI-EE License In-Database ETL Features No new major feature enhancements. Bug fixes, patches and DB certifications continue

  20. ODI Release Themes

  21. ODI Core Release Cycle CY13 H1CY13 H1CY12 H1CY12 H1CY11

  22. OWB Support Policies Customer Downloadable OWB Support Policies: http://www.oracle.com/us/support/library/lifetime-support-technology-069183.pdf For more Information about Support Levels: http://www.oracle.com/us/support/lifetime-support/index.html

  23. Must OWB Customers Migrate to ODI? • Existing OWB customers are NOT being forced to migrate to ODI • Oracle is not intending to create a “forcing-function” for existing OWB customers to pay more License fees • Oracle offers “Lifetime Support” option for Sustaining Support on all OWB features • For OWB customers who are initiating new ‘greenfield’ ETL projects – Oracle recommends to consider ODI first • For any new customers who are initiating new ‘greenfield’ ETL projects – Oracle recommends to consider ODI first • ODI is the strategic go-forward ETL platform from Oracle

  24. Oracle Best Practices for Tech Migrations • Understand that OWB and ODI are different ETL tools • There is no “free lunch” when migrating – a technical migration between different tools will never be 100% perfect or predictable • Manual re-implementation might be the best-bet • Optimizing ETL jobs in ODI will typically yield the best performing results (vs. semi-automatic conversion utilities) • Semi-automated conversion services are available • Oracle Partners offer semi-automatic conversion utilities and offshore services that may dramatically accelerate your conversion from OWB to the ODI product. • Oracle does not guarantee any of these services, but does advise and give input to the 3rd party partners on the development of their conversion utilities.

  25. OWB to ODI Component Equivalency • OWB ETL  Oracle Data Integrator • All OWB ETL features would map to ODI (where applicable, this does not mean that the two products are feature-equivalent) • OWB Data Quality  Oracle Enterprise Data Quality for ODI • All OWB DQ features would map to EDQ for ODI (where applicable, this does not mean that the two products are feature-equivalent) • Exceptions: ODI offers built-in “Check Flow” features that supply light DQ functionality inline to the ETL – these are considered base ETL features • OWB Data Profiling  Oracle Enterprise Data Profiling • All OWB DP features would map to EDP (where applicable, this does not mean that the two products are feature-equivalent)

  26. OWB Features Not Supported in ODI 11g • Oracle Data Integrator is a highly advanced best-of-breed ETL product, but OWB had evolved several features that were strongly coupled to other Oracle technologies. Here are our plans to fill the gaps: • Oracle Discoverer Integration • Why: ODI integrates with OBIEE for Lineage & Impact Analysis • Future: deep ODI integration with Oracle BI Server • Dimensional Modeling • Why: With ODI, data modeling comes from best-of-breed modeling tools • Future: tightly integrate ODI with Oracle SQL Developer • OMB Scripting • Why: Scripting with ODI leverages ODI Java SDK APIs • Future: integrated Groovy scripting • PL/SQL Code Generation • Why: ODI generates transformation SQL (native to whichever DB is required), no procedural code is generated from ODI.

  27. Oracle GoldenGate Product Update

  28. Overview of New Features • Integrated Capture • Enhanced Conflict Detection & Resolution • Support for Global Deployments • Security and Performance • Extensibility • Manageability and Monitoring • Expanded Heterogeneity

  29. Integrated Capture • Overview Integrated Capture for Oracle Database Oracle GoldenGate 11gR2 • Moves GoldenGate’s capture capabilities closer to the Oracle Database engine. • Enables 100% support for capture and delivery of compressed objects within Oracle Database and Oracle Exadata

  30. Brings GoldenGate Capture (Extract) closer to the RDBMS engine Leverages Proprietary Oracle Database Mining API Parallelism in mining and transforming redo records into LCRs Improved RAC coordination and automated node handling Tighter integration and faster development of new Oracle features Multi Threaded Uses producer thread to capture REDO record and consumer thread to process the REDO records. Performance gain from parallel processing Integrated Capture Overview

  31. Supports multiple deployment configuration Source : Source database and Integrated Capture process are in the same machine Downstream : Source database and Integrated Capture process are in the different machine Easy transition for existing GoldenGate customers Customers may choose which option they prefer based on their requirements. Integrated Capture Overview “On Source” “Downstream”

  32. When to Consider Classic Capture If you don’t need XML types, XA on RAC, compressions etc. Future Direction Classic Capture will be around for long time Core specific features, bug fixes and patches will be available on both Captures Oracle specific features will be only available in integrated extract. Adding Oracle specific feature exclusively to classic extract will not be possible.  Classic Capture

  33. Enhanced Conflict Detection & Resolution (CD&R) • Overview Enhanced Conflict Detection & Resolution Oracle GoldenGate 11gR2 • Automated detection and resolution of data conflicts for active-active or multi-master deployments. • Robust, easier to code, and less time to implement.

  34. Enhanced Conflict Detection & Resolution Overview • Replaces expensive hand-coding of CD&R rules with easy and expandable rules. • Options to use pre-built methods to resolve conflicts • Overwrite, Ignore, Discard, Usemax and Usemin • Supported datatypes • NUMERIC, DATE, TIMESTAMP, CHAR/NCHAR, VARCHAR/ NVARCHAR • Supports heterogeneous deployments

  35. Support for Global Deployments • Overview Global Deployment Support Oracle GoldenGate 11gR2 • Allows Oracle GoldenGate to support databases using multi-byte/Unicode object and column names.

  36. GoldenGate deployment in a non-English environment Supports European Accent characters, Multi-byte characters Automatic conversions of transactional data across different character set environments Native error messages, supports case sensitivity Database object name support Non US-ASCII Character Support (both DDL/DML) Database Like Object Level Case Sensitivity Support Support for Global Deployments Overview

  37. Security • Overview Security Oracle GoldenGate 11gR2 • The Most Secure Version of GoldenGate • Oracle GoldenGate 11gR2 supports Federal Information Protection Standard (FIPS) and BLOWFISH encryption algorithms to provide secure data movement across systems and regions

  38. Support FIPS compliant encryption algorithm in addition to current BLOWFISH algorithm On disk encryption for trail file In password encryption When transferring data across the network NOTE: Only supported on Linux, Windows, and Unix. IPv6 support Mandate from the government The existing GoldenGate library of IPC routines is based on IPv4. All existing GoldenGate calls using IPv4 AP were changed to use IPv6 APIs. Security Overview

  39. Performance • Overview Performance Improvements Oracle GoldenGate 11gR2 • Performance improvements for data replication across geographically separated systems in high-latency networks

  40. Performance Overview of Data Pump Improvements • Prior to Oracle GoldenGate 11gR2 • Synchronous data communication between Data Pump and remote collector process • Oracle GoldenGate 11gR2 • Acknowledgement message can be skipped for every data sent • Remote collector does not send an acknowledgement to the Data Pump unless a packet contains a flag requesting a response.

  41. Extensibility • Overview Extensibility Oracle GoldenGate 11gR2 • Using Event Markers allows GoldenGate implementations to be extended to kick-off actions based on an incident (DML,DDL, data value)

  42. Extensibility Overview • Event Marker Systems • Enables the Oracle GoldenGate processes to take a defined action based on an event record in the transaction log or in the Trail • Supported Event Actions • TRACE, LOG, CHECKPOINT BEFORE, IGNORE, DISCARD, SHELL, ROLLOVER, REPORT ABORT, CHECKPOINT AFTER, FORCESTOP, STOP • Robust option for customers requiring non-standard processing based on specialized events.

  43. Event Marker System User/Application changes Event record Event record Event record LAN / WAN / INTERNET Over TCP/IP Target Database Source Database Transaction Logs

  44. Manageability & Monitoring • Overview Monitoring Oracle GoldenGate 11gR2 • The new Oracle GoldenGate Monitor product provides complete view of the GoldenGate implementations. • Integration with Oracle Enterprise Manager

  45. Management Pack for Oracle GoldenGate Monitoring • Advanced monitoring, alerting (SNMP support), lag graphs, and historical repository. • Based on new agent infrastructure, which will be the foundation for all future integration projects. Supports GoldenGate 11.1.1.1.1+ • Oracle GoldenGate Monitor

  46. Management Pack for Oracle GoldenGate Monitoring • Oracle Preferred monitoring tool, covers entire Oracle stack – Database, Storage, FMW etc • For customers, who prefers to drill into DB sessions, OS stats, etc, apart from monitoring GoldenGate process • Included in Management Pack • Enterprise Manager Plug-in

  47. Expanded Heterogeneity • Overview Expanded Heterogeneity Oracle GoldenGate 11gR2 • Expanded data type support for existing supported platforms • Added native log based capture from IBM DB2 on iSeries and Delivery to PostgreSQL

  48. Expanded Heterogeneity Overview Platform Description

  49. Supported Datatypes Numeric (BIGINT, DECIMAL, DOUBLE, FLOAT, INTEGER, NUMERIC, REAL, SMALLINT) String, Binary (CHAR, BINARY, VARCHAR, VARBINARY) Large Objects (BLOB, CLOB, DBCLOB, GRAPHIC, VARGRAPHIC) Times and Dates (DATE,TIME, TIMESTAMP) Un supported Datatypes DATALINK, UDT, DECFLOAT and XML DB2 iSeries Capture

More Related