Extracting Strategic Insights from Business Data with Oracle Data Integrator (CON8516)

2. Extracting Strategic Insights from Business Data with Oracle Data Integrator(CON8516) JayantMahtoProduct Manager, Oracle Data Integrator Christophe Dupupet Director FMW Architects Team: The A-Team

3. The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions.The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.

4. Program Agenda • Oracle Data Integration Market Overview • Oracle Data Integrator Technical Overview • BI Applications 11.1.1.7.1 • BI Applications architecture with ODI as DI platform • Specific ODI features used in BI Applications • Advantages of ODI as Data Integration platform

5. Oracle Data IntegrationMarket Overview

6. Market OverviewExponential Growth in Data Volumes 45 PB+ Maintained by Large Orgs 45%+ Annual Growth 15 out of 17 Industry Sectors in the U.S. Have More Data Than the U.S. Library of Congress

7. Market OverviewExponential Growth in Data Volumes More Data leads to More Data Challenges

8. Market OverviewData Integration and Data Quality Markets estimates the DI market will reach $2.8 billion estimates the DQ market will reach $1.75 billion by 2016 with an average growth rate of 18.2%

9. Oracle Data IntegrationTechnical Overview

10. Oracle Data Integration (DIS) Breadth Enables Leverage and Agility Data Quality Data Integration Match/Merge Profiling Standardization Heterogeneous Virtualization Big Data ETL/E-LT Replication

11. Real-time replication; optimized for Database 12c and Oracle Exadata End-to-end integrated with simplified deployment Unified tooling for both structured data sources and Hadoop / NoSQL Flexible deployment on-premise or in the Cloud for heterogeneous systems Expanded support for 3rd party systems and Oracle Applications in real-time data integration and continuous availability solutions Oracle Data Integration 12c Delivering Real-Time Integration for Big Data and Cloud Cloud Oracle Data Integrator Apps Oracle GoldenGate Oracle Enterprise Data Quality Database Oracle Data Service Integrator Big Data

12. Oracle Data IntegratorBulk Data Processing and Data Transformation Oracle Data Integrator • Certified for leading technologies to deliver fast time to value • High-performance, low cost of ownership E-LT architecture • Lightweight deployment • Flexible, easy to enrich functionality Cloud High Performance E-LT Apps Declarative Design Database Extensible Knowledge Modules CEP Data Services Big Data Capable of Integrating Structured & Unstructured Data

13. Extract Transform Load Industry Leading PerformanceExtremely Fast Execution and Reduced Cost Conventional ETL Architecture • E-LT provides a flexible architecture for optimized performance • Benefits • Leverages set-based transformations • Improves performance for loading, • no network hop • Takes advantage of existing hardware Next Generation Architecture “E-LT” Extract Load Transform Transform

14. Declarative Design Improved Developer Productivity and Lower Maintenance Costs • Easy for moderate use cases • Universal for big and complex use cases • Quick to define and refactor maps • Extensible model for any data integration mechanism • Benefits • Significantly reduces the learning curve • Shortens implementation times • Simpler maintenance

15. Knowledge ModulesPluggable Architecture for Superior Flexibility Pluggable Knowledge Modules Architecture Key Architecture Benefits: Sample Out-of-the-Box Knowledge Modules SAP/R3 GoldenGate SQL Server Triggers Oracle DBLink JMS Queues Check MS Excel TPump/ Multiload Oracle Merge Oracle Web Services Siebel DB2 Journals DB2 Exp/Imp Oracle SQL*Loader Check Sybase Type II SCD Siebel EIM Schema DB2 Web Services • Ease of maintenance, • Flexibility, Leverage existing and new best practices, • Reduces cost of ownership

16. Broad Heterogenous ConnectivityLeverages Existing IT, Faster Implementation • Big Data: Hadoop support • Best for Oracle: Merge, Spatial, Multi-Table Insert, Optimizer Hints and more • Real-Time: CDC with GoldenGate • Applications: E-Business Suite, Siebel, PeopleSoft, JD Edwards Enterprise One, JD Edwards World, SAP ERP and SAP BW • Heterogeneous: Optimizations for all major RDBMS: IBM DB2, Microsoft SQL Server, Teradata, Netezza etc. Legacy Applications Databases Unstructured JMS

17. DIM DIM Best Data Integration for Exadata Top Performance, Integrated & “Red Optimized” • Support Any Legacy Data Feeds • Non-Invasive Source Capture • Support traditional use cases; Data Warehousing, Reporting, Data Distribution, etc. • Most Cost-Effective and High-Performance Exadata Data Loading Oracle GoldenGate Non-Invasive Real Time Transaction Feeds DIM DIM Oracle Data Integrator EMP DEPT FACT Batch Feeds EMP DEPT

18. Solution Oracle Data Integrator and Oracle GoldenGate to capture data (structured or unstructured) and immediately move information where it is needed. Enterprise Data Quality to cleanse and standardize data Real-time and bulk data movement, data synchronization, data quality, and data services Big Data transformation, real-time capture for Fast Data Benefits No resource / performance impact to source systems Live data, 100% change detection, available for better informed decision making Get double-duty from database investment by using it for transformations Maximizes availability of source systems and DW due to smaller batch windows. Data Integration for BI and Data WarehousingHigh Performance E-LT, Real-Time Analytics, Fast Data

19. To fill a shape with an image. Use existing picture box, DO NOT delete and create new picture box. Right click on the shape. At the bottom of the submenu select “Format Shape” Select “Fill” at the top of the “Format Shape” dialog box. Select “Picture or Texture fill” from the options. And select “File” under the “Insert from” option. Navigate to the file you want to use and select “Insert” On the “Format” tab, in the Size group, click on “Crop to Fill” in the Crop tool and drag the image bounding box to the desired size DELETE THIS INSTRUCTION NOTE WHEN NOT IN USE BI Applications 11.1.1.7.1

20. Oracle BI Apps: Deeper than Dashboards 1. 2. Pre-Built Analytic Warehouse Certified Application Integration • Business Analytics Warehouse • Over 300 star schemas • Designed for analysis and reporting • Pre-mapped integration • Fusion, EBS, PSFT, SEBL , JDE, IBM • Role-based Security 3. 4. Best Practice Metrics Role-Based Dashboards • Over 10,000 metrics • Additional pre-defined calculations • Based on best practices • Over 500 Dashboards and Pages • Over 3,000 reports • Across Lines of Business

21. BI Applications 11.1.1.7.1 Summary of Features • Most significant BI Applications release in three years. • Significant expansion of content and new products • Completely re-architected solution leveraging the power of ODI • Released on the latest version of OBIEE 11.1.1.7

22. BI Applications 11.1.1.7.1 Summary of Features Continued • Number of new out-of-the-box tools to increase productivity and drive down TCO • Golden Gate option available for customers that have significant ETL time pressures • Localized in 28 languages

23. Summary of Release BI Applications 11.1.1.7.1 Price Analytics for EBS • Financials: Fixed Assets, Budgetary Analysis • HR: Time & Labor, Payroll Analysis • Projects: Resource Management, GL reconciliation • CRM: Service Contracts, Price Analytics for EBS • Procurement & Spend :Sourcing • Supply Chan: Costing, Inventory Aging & Cycle Counts Student Information Analytics New Applications & Adapters New Content Enhancements Oracle Data Integrator Oracle GoldenGate • GUI Based Configuration • Functional Setup Tool New TCO Tools New OBIEE 11.1.1.7 New Data Integration

24. Next Generation Data Integration BI Apps 11.1.1.7.1 with Oracle Data Integrator and Golden Gate Oracle Data Integrator provides • In-database E-LT Transformation vs. E-T-L • Best in class performance, scalability, availability • Lightweight deployment for lower TCO • Faster time-to-value through declarative design Oracle Golden Gate option for BI Apps • Reduce load on source system by streaming data continuously into persistent store in the DW • More reliable change data capture and delete support • Enables near real time DW refresh

25. Oracle BI Applications PlanningCurrent Releases and Roadmap • For Applications Unlimited customers • ETL with Informatica • New Manufacturing Analytics • New Enterprise Asset Management Analytics • New SLA support for EBS R12 (patch) • For SAP customers • ETL with ODI • Fin, Proc & Spend, Supply Chain Analytics • For Application Unlimited customers • ETL with ODI • New Student Information Analytics • New Golden Gate option • New content in all major products • Fusion & AU: release alignment • ODI and Informatica : release alignment • New content: Talent Management, PLM Analytics integration, EAM enhancements, Student Analytics enhancements, EVM • New adapters: Procurement & Spend Analytics for JDE, Manufacturing Analytics for JDE, Supply Chain & Order Management Analytics for PeopleSoft • New cloud adapters: Adapters to Fusion CRM, HCM & ERP Cloud Services, Taleo adapter • Cost of Ownership Improvements: Data Lineage, ETL Validation, platform support • Endeca Extensions • BI Applications as Oracle Cloud Service • New content/modules: Continue to fill key content gaps based on customer demand • New cloud adapters: RightNow adapter, Eloqua adapter • Unstructured/big data analytic applications e.g. Customer 360 • Continue user experience redesign by leveraging BI Foundation Suite platform developments incl Mobile App Designer • Additional cost of ownership improvements What’s Next 0-12 month planning cycle Future DirectionsPost 12 month planning cycle BI Apps 7.9.6.4January 2013 BI Apps 7.9.7.2 September 2012 BI Apps 11.1.1.7.1 May 2013

26. To fill a shape with an image. Use existing picture box, DO NOT delete and create new picture box. Right click on the shape. At the bottom of the submenu select “Format Shape” Select “Fill” at the top of the “Format Shape” dialog box. Select “Picture or Texture fill” from the options. And select “File” under the “Insert from” option. Navigate to the file you want to use and select “Insert” On the “Format” tab, in the Size group, click on “Crop to Fill” in the Crop tool and drag the image bounding box to the desired size DELETE THIS INSTRUCTION NOTE WHEN NOT IN USE BI Applications Architecture with ODI as DI platform

27. BI Applications Architecture 11.1.1.7.1

28. Default ETL Architecture for DW

29. BI Apps DW ETL Architecture + SDS Optimized ETL for local SDS Optimized for Incremental ETL Generated based on a customers BI Apps deployment

30. To fill a shape with an image. Use existing picture box, DO NOT delete and create new picture box. Right click on the shape. At the bottom of the submenu select “Format Shape” Select “Fill” at the top of the “Format Shape” dialog box. Select “Picture or Texture fill” from the options. And select “File” under the “Insert from” option. Navigate to the file you want to use and select “Insert” On the “Format” tab, in the Size group, click on “Crop to Fill” in the Crop tool and drag the image bounding box to the desired size DELETE THIS INSTRUCTION NOTE WHEN NOT IN USE Specific ODI features used in BI Applications

31. ODI 11g features used by BI Applications 11.1.1.7.1 • Shortcuts • Release tags • Materialization • Variables • Tracking variables and sequences • Enhanced variable handling in the load plan • Enhanced Session Logging • Load Plan

32. ODI 11g features • Used in development for • Datastores • Integration interfaces • Packages • Procedures. • Shortcuts

33. ODI 11g features • Release tags • Materialization • Shortcuts continued

34. ODI 11g features • Tracking variables and sequences used in executed session. • Hiding unused variables in Load Plan to improve readability. • Variable Enhancements

35. ODI 11g features • Parallel • Sequential • Conditional execution • Restartability • Exception handling. • Load Plan

36. Manage Load Plans Load Plan Administration

37. Manage Load Plans Defining a Load Plan

38. Manage Load Plans Fact Groups Selection

39. Manage Load Plans Generating a Load Plan

40. Manage Load Plans Executing a Load Plan

41. To fill a shape with an image. Use existing picture box, DO NOT delete and create new picture box. Right click on the shape. At the bottom of the submenu select “Format Shape” Select “Fill” at the top of the “Format Shape” dialog box. Select “Picture or Texture fill” from the options. And select “File” under the “Insert from” option. Navigate to the file you want to use and select “Insert” On the “Format” tab, in the Size group, click on “Crop to Fill” in the Crop tool and drag the image bounding box to the desired size DELETE THIS INSTRUCTION NOTE WHEN NOT IN USE Advantages of ODI as Data Integration platform

42. Oracle BI Applications with ODIWhy is it Better? ODI is Faster Fastest E-LT Bulk/Batch Performance Faster Real Time integration (sub-second) with CDC, Replication, and SOA Faster Project Setup, Design and Delivery ODI is Simpler Simpler Setup, Configuration, Management, and Monitoring Simpler way to do Mapping using Declarative SQL Interfaces Simpler Deployment with Fewer Hardware Devices Simpler extensibility with Knowledge Module code templates ODI Saves Money (Lower TCO, Higher ROI) Less Hardware & Energy Costs with E-LT Architecture Less Time Wasted on Unnecessary ETL Mappings, Scripting, and Training Less Integration Overhead Integrating with Applications, SOA, and Management

43. ODI is Faster7.5TB per Hour of Real World Data Loading and Transformations • ODI ELT w/ Exadata • ODI scales with Exadata • ODI runs on Exadata – no ETL hardware required • No new hardware required as data sets grow • ODI processes used only during integration runs • Exadata continually available for OLTP, BI, DW, etc • Common administration, monitoring and management • All the benefits of rapid tool-based ETL development • Conventional ETL • Additional hardware ($$) needed to scale • ETL parallel optimization and design ($$$) is heavily dependent on resources available to the ETL environment • ETL engine hardware resources only used for ETL  • Different management, monitoring and administration from database and BI infrastructure ($$)

44. ODI and Exadata – Real World ExampleA Disruptive Improvement in Performance 5hrs 11mins 42X IMPROVEMENT • A complex branch of the customer’s tax allocation process runs 5 hrs 11 mins during quarter close • Exadata and ODI (E-LT) combined is able to execute the process 42Xfaster(7mins 20 secs) Job execution time in minutes 7min 20sec

45. ODI is SimplerSpeed Project Delivery and Time to Value with ODI • Development Productivity • 40% Efficiency Gains • Environment Setup (ex: BI Apps) • 33-50% Less Complex

46. 2 1 Define What You Want Automatically Generate Dataflow Better Developer Productivity and Lower Maintenance ODI-EE Declarative Design Conventional ETL Design • ETL Data Flow Graph - Laborious • Developer must define every step of Complex ETL Flow Logic • Traditional approach requires specialized ETL skills • And significant development and maintenance efforts • ODI - Declarative Set-based Design • Simplifies the number of steps • Automatically generates the Data Flow whatever the sources and target DB • Benefits • Significantly reduce the learning curve • Shorter implementation times • Streamline access to non-IT pros ODI Declarative Design DefineHow: Built-in Templates 46

47. Extract Transform Load ODI Saves MoneyE-LT Runs on Existing Servers with Shared Administration • Typical: Separate ETL Server • Proprietary ETL Engine • Expensive Manual Parallel Tuning • High Costs for Standalone Server • ODI: No New Servers • Lower Cost: Leverage Compute Resources & Partition Workload efficiently • Efficient: Exploits Database Optimizer • Scalable: Scales as you add Processors to Source or Target • Manageability: Unified Enterprise Manager • Pricing: AST lower than Informatica OEM • Benefits • Better Hardware Leverage • Easier to Manage & Lower Cost • Simple Tuning & Linear Scalability Conventional ETL Architecture Next Generation Architecture “E-LT” Extract Load Transform Transform

48. Questions & Answers

49. Join the Data Integration Community LinkedIn“Oracle Data Integration” Oracle’s Data Integration blogblogs.oracle.com/dataintegration Oracle Data Integrator Bookshttp://www.packtpub.com/oracle-data-integrator-11g-getting-started/bookhttp://www.packtpub.com/oracle-data-integrator-11g-cookbook/book Twittertwitter.com/ORCLGoldenGate Facebookfacebook.com/OracleDataIntegration Data Integration YouTube channelyoutube.com/oraclegoldengate Oracle.com/goto/dataintegration

50. Oracle OpenWorld – Key DIS Sessions Oracle Data Integrator