1 / 39

Oracle GoldenGate Management Pack Update (CON9105)

Oracle GoldenGate Management Pack Update (CON9105). Joe deBuzna Sr. Principal Product Manager, Oracle Data Integration September 2013. Agenda. Review of GoldenGate Deployment Architectures The Basics of GoldenGate Monitoring Advanced GoldenGate Monitoring What’s new: Product Update for 12c

basil
Download Presentation

Oracle GoldenGate Management Pack Update (CON9105)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Oracle GoldenGate Management Pack Update (CON9105) Joe deBuznaSr. Principal Product Manager, Oracle Data Integration September 2013

  2. Agenda • Review of GoldenGate Deployment Architectures • The Basics of GoldenGate Monitoring • Advanced GoldenGate Monitoring • What’s new: Product Update for 12c • Resources and Q&A

  3. Oracle Data Integration Solutions • Over thousands of customers including Fortune 500 companies, representing Financial Services, Communications, Healthcare, Public Sector, Retail, Utilities industries • 4 of top 5 largest commercial banks • 3 of top 3 busiest ATM networks • 5 of top 5 financial data services companies • 5 of top 5 telecommunications providers • 3 of top 5 largest food & drug stores

  4. Fun Facts About Oracle GoldenGate That’s the Magic of Macy’s Shopping at the worlds largest retails and your credit card transactions are moved in real-time to data centers around the world, before being approved, using Oracle GoldenGate (Retail Decision) The Safer, Easier Way to Pay When you check your account on Paypal.com, GoldenGate updates the portal and back-end systems to make sure you see the latest information Say it with Flowers Ordering from 1800-Flowers, Oracle GoldenGate will move your order to their reporting systems to help process and track your order seamlessly No Charge ATM Fees 3 of the 3 busiest ATM Networks use Oracle GoldenGate for Continuous Availability. Get Sick in Pittsburgh If you get a health check at UPMC, the clinical applications that doctors use are supported by Oracle GoldenGate to enable high-availability

  5. Oracle Data Integration (DIS) Breadth Enables Leverage and Agility Data Quality Data Integration Match/Merge Profiling Standardization Heterogeneous Virtualization Big Data ETL/E-LT Replication

  6. Oracle Data Integration Complete Offering for Enterprise Data Integration • Complete and best-of-breed approach for enterprise data integration • Maximum performance with lower TCO, ease of use and reliability • Certified for leading technologies to deliver fast time to value Oracle Data Integrator Legacy Oracle GoldenGate Applications Oracle Enterprise Data Quality OLTP Oracle Data Services Integrator • Oracle Customers Report: • 80% lower TCO • Five times higher performance • 70% reduction in development costs Unstructured Modernization Custom MDM BI Big Data Synchronization SOA

  7. Oracle Data Integrator Bulk Data Processing and Data Transformation • Certified for leading technologies to deliver fast time to value • High-performance, low cost of ownership E-LT architecture • Lightweight deployment • Flexible, easy to enrich functionality Oracle Data Integrator Legacy High Performance E-LT Declarative Design Applications Extensible Knowledge Modules OLTP CEP Data Services Unstructured Capable of Integrating Structured & Unstructured Data

  8. Oracle GoldenGate Real-time Data Integration • High-performance, low-impact real-time data integration and replication • Timely data for improved business insight • Continuous availability for 24/7 operations Oracle GoldenGate Legacy Log-based Change Data Capture and Delivery Active-Active Replication Applications Heterogeneous Source and Targets OLTP Reliability and Transaction Integrity Unstructured CEP Integration, Real-time Events

  9. Oracle Enterprise Data Quality Data Quality for Customer and Product Data • Improves data accuracy, usability and ‘fitness for purpose • Unified interface for ease-of-use, lower TCO • Depth of capability in multiple data domains reduces project risk Oracle Enterprise Data Quality Legacy Profile, Explore, Audit Parse, Standardize, Cleanse Applications Match, Merge, Enrich OLTP Governance Unstructured Case Management

  10. Oracle Data Services Integrator Data Federation and Virtualization • Easily develop data services and ad-hoc queries without infrastructure changes • Open and standards based—SOA, Web Services, Java, Service Data Object Oracle Data Services Integrator Legacy Federated Data Services Data Virtualization Applications Integrates with Oracle SOA OLTP Bidirectional Reads & Writes Unstructured Integrates with Oracle Business Analytics

  11. Oracle GoldenGate Low-Impact, Real-Time Data Integration & Transactional Replication Zero Downtime Upgrade & Migration New DB/HW/OS/APP Fully Active Distributed DB High Availability/ Disaster Recovery Legacy Systems Log-based Changed Data Query & Report Offloading Reporting Database Data Warehouse Real-time BI, Operational Reporting, MDM Oracle & Non-OracleDatabase(s) Data Integrator Global Data Centers ODS Data Synchronization within the Enterprise Message Bus Message Bus Event Driven Architecture, SOA

  12. Oracle GoldenGate Modular Architecture LAN / WAN / Internet Over TCP/IP Capture Pump Delivery Trail Files Trail Files Delivery Capture Pump TargetOracle / Non-OracleDatabase SourceOracle / Non-OracleDatabase Bi-directional • High performance, even in high-volume systems • Low impact on the infrastructure • Non-intrusive • Flexible, supports heterogeneous systems • Reliable, resilient against interruptions, outages Trail Files Trail Files

  13. GoldenGate: Flexible Deployment Architectures Unidirectional Query OffloadingZero-Downtime Migration Bi-Directional Hot Standby or Active-Active for HA Peer-to-Peer Load Balancing Multi-Master Broadcast Data Distribution Integration/Consolidation Data Warehouse Data Distribution via Messaging BPM BAM CEP

  14. The Basics of Monitoring • Review of GoldenGate Deployment Architectures • The Basics of GoldenGate Monitoring • Advanced GoldenGate Monitoring • What’s new: Product Update for 12c • Resources and Q&A

  15. The Basics of Monitoring Primary Concerns • Status of replication components – Up or Down? • Time lag between those components – How far behind? • Warning and error messages – Do I need to be worried? • Transaction volumes – How much data?

  16. The Basics of Monitoring How to Monitor Primary Concerns • Manual GGSCI commands • Parameter settings • Custom scripts (GGSCI wrapper; error log parser) send email • Heartbeat tables (DocID 1299679.1) • Custom integration into existing systems (email, SNMP) • Native Oracle tools (repository, email, SNMP, 3rd Party Calls)

  17. The Basics of Monitoring Manual GGSCI commands • INFO ... SHOWCH • STATS EXTRACT/REPLICAT ... • Now with REPORTCDR! • SEND EXTRACT/REPLICAT ... • CACHEMGR {CACHESTATS | CACHEQUEUES | CACHEPOOL} • REPORT • LOGSTATS • GETTCPSTATS • GETLAG

  18. The Basics of Monitoring Parameter Settings • REPORTCOUNT EVERY 5 MINUTES, RATE 8871390 records processed as of 2013-09-14 10:01:27 (rate 10205,delta 11303) • WARNLONGTRANS 3h, CHECKINTERVAL 10m 2013-09-26 23:36:34 WARNING OGG-01027 Oracle GoldenGate Capture for Oracle, eaa.prm: Long Running Transaction: XID 1.1.215749, Items 1, Extract EAA, Redo Thread 1, SCN 0.460257239 (460257239), Redo Seq #1658, Redo RBA 239056912.

  19. The Basics of Monitoring Custom Scripts - GGSCI wrapper; error log parser • World’s smallest OGG monitoring & alert script? if [ `echo "info all"|./ggsci|grep “ABENDED"|wc -l` -gt 0 ];then \ echo "info *"|./ggsci|mailx -s "OGG Alert: Abend" you@mail.com;fi • Error Log Scraping 101: tail -n 1 -f ggserr.log|while ((1)); do read gdategtimeglevelgmsg; \ if [ $glevel = "ERROR" ]; \ then echo "$HOSTNAME: $gdate $gtime $glevel $gmsg“ \ |mailx -s "OGG Alert: Log Error" you@mail.com;fi;done

  20. The Basics of Monitoring Heartbeat Table to Record Lag & Operations Count • Use and extend the heartbeat table (DocID 1299679.1): TABLE SOURCE.OGG_HEARTBEAT, TOKENS ( CAPGROUP = @GETENV ("GGENVIRONMENT", "GROUPNAME"), CAPTIME = @DATE ("YYYY-MM-DD HH:MI:SS.FFFFFF","JTS",@GETENV ("JULIANTIMESTAMP")), DELTAOPS = @COMPUTE(@GETENV ("DELTASTATS", "DML") + (@GETENV ("DELTASTATS", "DDL")))), FILTER (@STREQ (EXTRACT_NAME, @GETENV ("GGENVIRONMENT", "GROUPNAME")));

  21. The Basics of Monitoring Custom integration into existing systems • Does this monitoring product look familiar?

  22. Advanced Monitoring • Review of GoldenGate Deployment Architectures • The Basics of GoldenGate Monitoring • Advanced GoldenGate Monitoring • What’s new: Product Update for 12c • Resources and Q&A

  23. Advanced Monitoring Monitoring OGG for the Enterprise

  24. Management Pack for Oracle GoldenGate Advanced Monitoring • Oracle Preferred monitoring tool, covers entire Oracle stack – Database, Storage, FMW etc • For customers, who prefers to drill into DB sessions, OS stats, etc, apart from monitoring GoldenGate process • Included in Management Pack • Enterprise Manager Plug-in

  25. Management Pack for Oracle GoldenGate Advanced Monitoring • Advanced monitoring, alerting (eMail, SNMP, OS call), lag graphs, and historical repository. • Agent based; Supports GoldenGate 11.1.1.1.1+ • Oracle GoldenGate Monitor

  26. Oracle GoldenGate Veridata Advanced Monitoring - Data Validation • A high-speed, low impact data comparison solution • Identifies and reports data discrepancies between heterogeneous databases • Works on active databases without affecting availability • A must for any database migration • Benefits: • Reduce financial/legal risk exposure • Speed and simplify IT work in comparing data sources • No disruption to business systems • Confident decision-making and reporting • Enterprise Manager Plug-in

  27. What's New:Product Update for 12c • Review of GoldenGate Deployment Architectures • The Basics of GoldenGate Monitoring • Advanced GoldenGate Monitoring • What’s new: Product Update for 12c • Resources and Q&A

  28. What’s New? Product Update for 12c • Take Action! • Start, Stop and Kill processes • Edit configuration files • Better Troubleshooting! • View ggserr.log and report files • View discard files • View parameter files

  29. What’s New? Start, Stop, Kill Processes! Product Update for 12c

  30. What’s New? Start Options! Product Update for 12c

  31. What’s New? Edit Configuration Files! Product Update for 12c

  32. What’s New? Better Troubleshooting! Product Update for 12c

  33. Questions & Answers

  34. Join the Data Integration Community LinkedIn“Oracle Data Integration” Oracle’s Data Integration blogblogs.oracle.com/dataintegration Twittertwitter.com/ORCLGoldenGate Facebookfacebook.com/OracleDataIntegration Oracle GoldenGate YouTube channelyoutube.com/oraclegoldengate Oracle Technology Network Oracle’s Public Help Forumhttp://forums.oracle.com/forums/forum.jspa?forumID=860&start=0 Oracle.com/goto/dataintegration

  35. Oracle OpenWorld – Key DIS Sessions Oracle GoldenGate

  36. Graphic Section Divider

More Related