1 / 34

Next-Generation Data Integration on Oracle Exadata

rozene
Download Presentation

Next-Generation Data Integration on Oracle Exadata

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

  2. Next-Generation Data Integration on Oracle Exadata

  3. Program Agenda • Introduction • Oracle Data Integration Overview • Engineered Together • Customers • Summary

  4. Change is Inevitable and UnstoppableData Volumes and Retention Times Grow Continually Data volumes continue to increase exponentially Infrastructure costs go up Data processing tasks take longer Overall data complexity increases Data Volume Data lifetimes are getting longer Storage requirements and costs increase “Active” vs. “Archive” data must be defined Regulatory requirements = immediate data access Data Lifetime

  5. Change is Inevitable and UnstoppableBatch Processing Windows Are Shrinking Batch processing takes too long 8x5 Hours Global 24 x7 operations limit downtime Processing volumes exceed batch windows Even the best hardware will struggle eventually Minutes Insufficient Time 24x7 Seconds MB GB TB Amount of Data

  6. Data captured Analysis completed • Change is Inevitable and UnstoppableReacting Quickly to Your Data, Creates Value for the Enterprise Faster business decisions for operational excellence Business event Time available to capture data is decreasing Analysis of increasing data volumes = delays Operational excellence requires immediate action Business Value Real-time capture and action is available already Action taken Action Time Based on Richard Hackethorn’s Component’s of Action Time

  7. Oracle Data Integration Overview

  8. Oracle Data IntegrationComplete Offering for Enterprise Data Integration • Complete and best-of-breed approach for enterprise data integration • Maximum performance with lower TCO, ease of use and reliability • Certified for leading technologies to deliver fast time to value Oracle Data Integrator Legacy Oracle GoldenGate Applications Oracle Enterprise Data Quality OLTP • Oracle Customers Report: • 80% lower TCO • Five times higher performance • 70% reduction in development costs Oracle Data Service Integrator Unstructured Modernization Synchronization Migration MDM BI SOA Big Data

  9. Oracle Data IntegratorBulk Data Processing and Data Transformation Oracle Data Integrator Legacy • High-performance, low cost of ownership E-LT architecture • Lightweight deployment • Flexible, easy to enrich functionality • Declarative Design Applications • High Performance E-LT OLTP • Extensible Knowledge Modules Unstructured • CEP Data Services

  10. Oracle GoldenGateReal-time Data Integration Oracle GoldenGate Legacy • High-performance, low-impact real-time data integration • Timely data for improved business insight • Continuous availability for 24/7 operations Log-based Change Data Capture and Delivery Applications Bidirectional Replication CEP Integration, Real-time Events OLTP Heterogeneous Sources and Targets Unstructured Reliability and Transaction Integrity

  11. Summary: Oracle Data Integration Private Cloud Public Cloud Any Data, Any Source,Any LatencyOn Premise,On Cloud Zero Downtime, High Performance Trusted Data Fast Time-to-Value Oracle SOA Suite, BPM Suite, Oracle Business Analytics Oracle Enterprise Data Quality Oracle GoldenGate Oracle Data Integrator Big Data Connectors Data Service Integrator Oracle Cloud Application Foundation OLTP OLAP Legacy Unstructured

  12. Engineered Together

  13. Exadata Database MachineBest Platform to Run the Oracle Database • Best Machine for Data Warehousing • Best Machine for OLTP • Best Machine for Database Consolidation

  14. Data IntegrationSolutions for ExadataUse Cases

  15. Solution ODI for bulk loading Exadata Run ODI Agent on Exadata JVM Fastest possible data transformations Benefits No extra ETL servers Uses Exadata advanced SQL functions Parallel statements in Exadata, not ETL server Integrated Management & Monitoring Easier to deploy than conventional ETL tools Faster time to market Data Warehouse Bulk Loading with E-LTFastest ETL Solution for Exadata Extract Load Transform

  16. Nobody Beats ODI on Exadata7.5TB per Hour of Real World Data Loading and Transformations • ODI ELT w/ Exadata • ODI scales with Exadata • ODI runs on Exadata – no ETL hardware required • No new hardware required as data sets grow • ODI processes used only during integration runs • Exadata continually available for OLTP, BI, DW, etc • Common administration, monitoring and management • All the benefits of rapid tool-based ETL development • Conventional ETL • Additional hardware ($$) needed to scale • ETL parallel optimization and design ($$$) is heavily dependent on resources available to the ETL environment • ETL engine hardware resources only used for ETL  • Different management, monitoring and administration from database and BI infrastructure ($$)

  17. Oracle Data Integrator Enterprise EditionBest ETL Platform for Exadata • ODI’s E-LT architecture is best for Exadata • Exadata powers all transformations • No additional hardware is required • ODI performance scales linearly with Exadata infrastructure • ODI transforms the data without it ever leaving the Exadata Machine • ODI implements Exadata best practices • Fastest Loading Mechanisms • External Tables, SQL*Loader, DBLINK, Data Pump • Out of the box Index Management • Support for bitmap indexes, unique/non-unique indexes • Advanced Oracle Features Support • Optimizer hints (Direct Path loading, Parallel, etc) • Merge & Multi-Table Insert statement • Any Oracle function can be leveraged (incl. analytic functions)

  18. Solution Any data, any time – at the right time! OGG & ODI for data delivery to Exadata OGG for true Real Time and ODI to cover all other intra-day or daily latencies Benefits OGG is non-invasive – no load on Sources! ODI tools can model data delivery at any latency – using Oracle GoldenGate, Triggers or Delta ETL jobs Lower costs, and data delivered at the speed of Business (at the right time) Real-Time Data Warehouse UpdatesGet Data intoExadata at Any Latency GoldenGate Fastest OGG ODI DB Triggers Supporting most popular DBMS’s Delta ETL

  19. Zero Downtime Database ConsolidationConsolidating Old DBs into Exadata Doesn’t Require Downtime Solution • Seamless migration of on-premise data to private database clouds without downtime • Bi-directional transaction replication between old databases and Exadata (or Oracle Database Appliance) using GoldenGate • Data transformations, loads using Oracle Data Integrator Benefits • Zero Downtime for key databases and apps • Minimize risk with phased, rolling upgrades • Faster return on investment, due to faster consolidation ERP CRM 0 1 0 0 0 0 1 0 0 0 0 1 0 0 0 1 1 0 1 0 1 1 0 1 0 1 1 0 1 0 0 1 0 1 1 0 1 0 1 1 0 1 0 1 1 0 1 0 0 1 0 1 0 0 1 0 1 0 0 1 Warehouse HR Data Mart

  20. Cloud Enablement: Migration to Oracle ExadataMigrate Non-Oracle Appliances to Exadata with Native Tools Solution • ODI for modeling and mapping non-Exadata sources into the Exadata data models • Native support for Netezza, Teradata, and DB2/z SQLs and DB Utilities • GoldenGate for real-time CDC from Teradata or DB2 zSeries Benefits • Tool-based migration is more repeatable and more automate-able • Active-Active phased transition option • More maintainable solution that can also be part of the long-term plans

  21. Data Integration for Big Data and ExadataImproving Productivity and Efficiency for Big Data • Benefits • Improves productivity for transforming Big Data • Optimizes the loading of Big Data with Oracle Loader for Hadoop • Reduce complexities of processing Hadoop through graphical tooling • Consistent tooling across BI/DW, SOA, Integration and Big Data Oracle Data Integrator Transforms Via MapReduce Activates Oracle Loader for Hadoop Loads Oracle Exadata

  22. Adoption of Oracle Data Integration @ Oracle Oracle ERP Applications Oracle Industry Applications Business IntelligencePerformance Management EBS PeopleSoft JDE E1 Agile PLM Retail BIApplications BI EEServer FusionApplications FusionMDM FusionFinancials Insurance Comms Planning Essbase Financial Management SpendAnalyzer Integration Packs EPMA Profitability Management CRMOn-Demand LifeSciences TradePromotions TransportationManagement RetailFinancials Integration Middleware SOASuite ActivityMonitor EventProcessor ServiceBus BPELPM WebLogic EnterpriseManager Oracle Database (Standard) Oracle Database (Enterprise Edition & Exadata) Big Data Appliance ODIIntegrated OWBEmbedded ODIIntegrated TimesTenIntegrated ExadataCertified ODIEmbedded

  23. DIM DIM Best Data Integration Solution for ExadataTop Performance, Integrated and “Red Stack” Optimized • Run Data Integration Products Directly on Exadata • Use Data Integration Products to Migrate, Consolidate, and for Data Warehousing • Support Any Heterogeneous Data Feeds • Non-Invasive Source Capture • Most Cost-Effective and High-Performance Data Loading Oracle Data Integrator DIM DIM Oracle GoldenGate EMP DEPT Batch Feeds, Incremental Updates and in-DB transformations via ELT FACT 24 EMP DEPT

  24. Customers

  25. Customer Example: TurkcellData Warehousing on Oracle Exadata • Integrated network operations systems to the data warehouse to offer a global reporting solution • Achieved 167% ROI after 9 months by implementing an E-LT architecture • 20X Performance improvement using Oracle Data Integrator on Exadata • The combined solution helped decrease data preparation time for data mining from 27–29 days to 2–3 days • High-Performance E-LT for Data Warehousing

  26. ODI and Exadata – Real World ExampleA Disruptive Improvement in Performance 5hrs 11mins 42X IMPROVEMENT • A complex branch of the customer’s tax allocation process runs 5 hrs 11 mins during quarter close • Exadata and ODI (E-LT) combined is able to execute the process 42Xfaster(7mins 20 secs) Job execution time in minutes 7min 20sec

  27. Summary

  28. Optimized bulk loads, Leverages Infiniband, Smart Storage No data transfer to/from separate ETL server Transformations use Exadata optimized SQL Native Batch And Real-Time integration capability Zero down-time migrations to Exadata Bridge for your Enterprise data and Big Data Appliance Tightly integrated with Exadata, Exalytics Optimized for Oracle Engineered Systems Real-Time Analytics

  29. Oracle Data Integration Oracle OpenWorld Shanghai - Schedule Thursday (25-July) Session ID: CON2068
Session Title: Real-Time Data Warehousing with Oracle Data Integrator and Oracle GoldenGate
Venue / Room: Expo Centre - Room 425
Date and Time: 7/25/13, 10:15 - 11:15 Session ID: CON2067
Session Title: Oracle Data Integration Services Product Update: Oracle GoldenGate and Oracle Data Integrator
Venue / Room: Expo Centre - Room 616
Date and Time: 7/25/13, 14:00 - 15:00 Wednesday (24 – July) Session ID: CON1732
Session Title: Managing Your Data with Oracle’s Data Integration Platform
Venue / Room: Expo Centre - Room 425
Date and Time: 7/24/13, 14:00 - 15:00 HOL1738 Hands-On Lab
Session Title: Deep Dive into Oracle GoldenGate 
Venue / Room: Expo Centre - Room 407/408
Date and Time: 7/24/13, 17:15 - 18:15

  30. Join the Data Integration Community LinkedIn“Oracle Data Integration” Oracle’s Data Integration blogblogs.oracle.com/dataintegration Twittertwitter.com/ORCLGoldenGate Facebookfacebook.com/OracleDataIntegration Oracle’s Data GoldenGate YouTube channelyoutube.com/oraclegoldengate Oracle.com/goto/dataintegration

  31. The preceding is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract.It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

More Related