300 likes | 317 Views
Learn why DataMirror Integration Suite 2005 is the ideal solution for real-time information integration. Explore the benefits, features, and use cases of this powerful integration tool.
E N D
Get the Real-Time Information AdvantageThe Right Time for Real TimeEcht Zeit für EchtzeitGeorg Sehrt
TOP DOAG Regionaltreffen Rhein-Main 14.06.2005 - DataMirror : • Warum Integration Suite 2005 ? • Unternehmensszenario • Wer ist DataMirror • Wie funktioniert das in Echtzeit
Warum Integration Suite 2005? Unternehmensanforderungen für Integration Suite 2005: • Gesetzliche Vorschriften • Operationale Entscheidungen • Informationszuverlässigkeit • Informationsgewinnung • Effektivität, Zusammenschlüsse von Firmen • Absicherung
Über DataMirror • Founded in 1993 • Stock Symbols: • Nasdaq: DMCX • TSX: DMC • Over 250 employees worldwide • Over 2.000 customers across all industry verticals • International Offices in North America, Europe, and Asia • DACH Office in Darmstadt Germany
ETL vs. DTC Extract, Transform, Load Detect, Transform, Communicate • E – Extract • Uses SQL queries to retrieve data from source system • Significant impact on database/application performance • T – Transform • Stages the data • Performs computationally-intensive transformations • Only after-image available • May require annotation with date/time- stamp • L – Load • Batch-loading operation for entire data set • Potential interruption to application execution • D – Detect information change • Captures changes from logs incrementally (Change Data Capture) • Minimal impact on database/application performance • T– Transform • No staging required • Lightweight transformation on either source or target system • Access to before and after image • No impact on source system architecture • C – Communicate • Continuous flow of transformed information • No service interruption REALTIME BATCH VS.
Real-Time Integrations Beispiel SAP Transactions Real-Time Integration Target Engine SQL DW Oracle Real-Time Integration Source Engine Database Log Real-Time Auditing Sybase Audit
Flexibler Daten Fluss 1-way 2-Way Cascade Distribute Consolidate Multi-thread Bi-directional
2- Way CRM CRM CRM CRM CRM ERP ERP ERP ERP Bi-Directional “Two Way” vs “Bi-Directional” System A System B Different database schemas updated on each system. System A System B The same database schemas updated on each system. Often complex implementation
Recursive Updates System A System B CRM CRM 1 ERP ERP • User Enters Transaction On System A • Journal/Log Entry Created On System A • Transaction Replicated To System B • Transaction Applied On System B • Journal/Log Entry Created On System B • Transaction Replicated Back To System A • Transaction Applied On System A 2 4 3 Log Log “Ping” 0011 System A System B CRM CRM ERP ERP 5 7 6 Log Log “Pong”
Transformation Server Architektur Central Point of Control Subscribers (Targets) Publishers (Sources) Metadata Metadata Database Change Log Broker (Engine) Broker (Engine) Database Database TCP/IP Asynchronous
Was ist LiveAudit ApplicationDatabase Product ID Action Qty Drug001 Make 1000 Drug001 Calibrate Test Eqmt - Drug001 Test Initiated 1000 Drug001 Test Result: Passed Drug001 Bottle 1000 Drug001 Ship 1000 LA LiveAuditDatabase Date / Product Time Actn User ID Mfg Action Qty 05/31/01-0800 I jwalker Drug001 Make 1000 05/31/01-1300 I jwalker Drug001 Calibrate Test Eqmt - 05/31/01-1500 I jwalker Drug001 Test Initiated 1000 06/01/01-0800 I jwalker Drug001 Test Result: 1000 Particles Found 06/01/01-0900 D jwalker Drug001 Particles Found 06/01/01-1100 U swilson Drug001 Test Initiated 1000 06/02/01-0800 U swilson Drug001 Test Result: Pass 1000 06/01/01-1600 I jwalker Drug001 Bottle 1000 06/05/01-0800 I jwalker Drug001 Ship 1000
DB/XML Transform Architektur Mapping Object Readers Writers Database Database XML XML Engine Text File Text File EDI File EDI File Xpath expressions Xpath/XSLT Functions DB/XML functions Formatting Objects Default value assignment external Java objects database key generation db incremental update Any Format Any Format Any Format
GUI - EA Monitor • Visualize complex networks through user-defined network diagrams • Evaluate the health of the network through operational status metrics • Troubleshoot issues and fine-tune performance using latency metrics
37283 Duggan Ira 613-555-8367 25 89732 Muntz Josie 704-555-2738 25 CUST_NO L_NAME F_NAME PHONE REP_NO 58699 Smith John 404-555-3874 45 37283 Duggan Ira 613-555-8367 25 89863 Quinn Fran 905-555-1296 11 89732 Muntz Josie 704-555-2738 25 ROW SELECT REP_NO = 25 CUST_NO L_NAME F_NAME REP_NO 37283 Duggan Ira 25 89732 Muntz Josie 25 Filtering • Row filtering allows you to select rows • Column filtering allows you to select columns
EMP LAST FIRST HIRE_DATE STAT SALARY MAX 1234 Moreiro Nicole 01/05/97 A $55,000 $60,000 2345 Ellison Val 04/12/97 I $40,000 $50,000 EMP_ID FULL_NAME HIRE_DATE STATUS %SALARYMAX 001234 Nicole Moreiro 01/05/1997 Active 92% 002345 Val Ellison 04/12/1997 Inactive 80% Transformations Increase Field Size Century Dates Transform Fields Derived Fields Concatenation
CUSTOMER TABLE Cus_ID Customer Name Customer Address CUS001 ABC Ltd. London Order Number Order Date Transporter Code Customer Code TRANSPORTER TABLE ORD001 12/3/99 TRA001 CUS001 Courier Code Transporter Name TRA001 AK Road Masters SUBSCRIBER ORDER TABLE Order Number Order Date Transporter Name Customer Name Customer Address ORD001 12/3/99 TRA001 ABC Ltd. London Joins at Publisher PUBLISHER ORDER TABLE
DERIVED EXPRESSIONS ------------------------------------------------------- %BEFORE Net change (before image) %CURR Current image %CONCAT Concatenation %REPLACE Character substitution %SUBSTRING Substring %LOWER Lower case character conversion %UPPER Upper case character conversion %PROPER Proper case character conversion %LTRIM Left Trim blank characters %RTRIM Right Trim blank characters %TOCHAR Convert to character %TONUMBER Convert to number %TODATE Convert date format %TOTIME Convert time format %CENTURY Add a 2 digit century to your date %IF Conditional %VAR Initialise a result variable %USER Call user exit program %GETCOL Get a column from another table %STRPRC Call user exit stored procedure Derived Expressions JOURNAL CONTROL COLUMNS ----------------------------------------------------------------------- &CCID An identifier for the transaction with the update. &CNTRRN Source table relative record number &CODE Always “U” for refresh. Always “R” for mirror. &ENTTYP Indicates the type of update. &JOB The name of the source job that made the update. &JOBNO The operating system user Id of the update process. &JOBUSER The operating system user at the time of the update. &JOURNAL The name of the journal, as described in Properties. &JRNFLG Indicates if before image is present &JRNLIB The name of the journal schema. &LIBRARY The source table schema or its alias. &MEMBER The source table name or its alias. &PROGRAM The name of source program that made the update. &OBJECT The source table name or its alias. &SEQNO The sequence number of this update in the journal. &SYSTEM The hostname of the source system &TIMSTAMP Time of the update or refresh. &USER The user ID which made the update.
Summarization ORDER TABLE DAILY ORDER TABLE
EMPLOYEE_PERSONAL TABLE Employee Number Employee Phone Employee Address EMP001 (416) 819-1234 Markham Employee Number Employee Name Employee Hire date Employee Salary EMP001 Elmer Cecilio 11/08/99 30000 EMPLOYEE TABLE Employee Number Employee Name Employee Hiredate Employee Phone Employee Address EMP001 Elmer Cecilio 11/08/99 (416) 819-1234 Markham Row Consolidation 1:1 Row Consolidation: Allows users to merge data from multiple source tables into one or more rows in a subscription table. 1:1 (with a single row change affecting only one row in a target table) EMP TABLE
DEPT TABLE Department Number Department Name Department Location DEPT001 Finance New York Row Consolidation 1:Many 1:Many (with a single row change affecting one or many rows in a target table) EMP TABLE EMPLOYEE TABLE
What Our Customers Are Saying… “DataMirror’s solution is a critical component of our business strategy. The solution’s robust, real-time data integration capabilities provide us with high visibility into inventory levels, sales reports, e-Business channels, and other business-critical operations, allowing us to better manage sales cycles and deliver superior customer experiences worldwide.” Jim Hill, Manager of Database Services, Tiffany & Co.
What Our Customers Are Saying… “Prior to implementing the PointBase solution, all local development, testing, tutorials, and sample applications were run on multiple databases. With PointBase, we have a unified database that minimizes internal research and development time and allows us to make efficient use of our product development and licensing funds.” Dave Glende, CTO, Unify
What Our Customers Are Saying… “From the implementation phase through to the production phase, our requirements have been met with a high level of diligence, professionalism, and willingness on the part of DataMirror. We can now rest assured that our customers will continue to receive the level of service they deserve and expect from us.” Licenciado Walter Alperín, iSeries Technology Planning, Lloyds Bank Argentina
Vorteile Integration Suite • Real-time & minimal latency • Real-time data warehousing • Performance • Increased scalability • Minimal impact on operational system performance • No impact on operational system architecture • Rapid implementation
Danke • Pause • Kundenbeispiel
Product Support www.datamirror.com/support • 24/7 support • Problem and resolution tracking • Electronic problem entry • Escalation • Online knowledge base • New release & PTF downloads from the web • Discussion forum • Remote dial-in (WebEx) Slide Menu
Flexibler Daten Fluss 1-way 2-Way Cascade Distribute Consolidate Multi-thread Bi-directional