180 likes | 462 Views
Data Consistency Verification with Veridata. Lorena Lobato Pardavila - CERN. Veridata Overview. CLIENTS. REPOSITORY. OGG Veridata Agents. SOURCE. OGG Veridata CLI. OGG Veridata Server. TARGET. n : n. DATABASES. OGG Veridata Web.
E N D
Data Consistency Verificationwith Veridata Lorena Lobato Pardavila - CERN Replication Technology Evolution for ATLAS Data Workshop
Veridata Overview CLIENTS REPOSITORY OGG Veridata Agents SOURCE OGG Veridata CLI OGG Veridata Server TARGET n : n DATABASES OGG Veridata Web Replication Technology Evolution for ATLAS Data Workshop • Is a high-performance cross-platform data comparison tool that supports high-volume compares • Allows data consistency validation on “hot” data sets
Veridata Overview Replication Technology Evolution for ATLAS Data Workshop
System Requirements Replication Technology Evolution for ATLAS Data Workshop • DYNAMICPORTLIST in each GoldenGateManager process (Might use 20 ports) • For Veridata Agent • Every VA must be installed for each database instance that contains data that is to be compared • Possibility of running multiple agents from a single install • 1GB of RAM • Java 1.6.0 or later is required for release 11.2.1 • Ojdbc6.jar • For Veridata Server : 200 MB of fixed virtual memory for basic task • Privileges: Create a user and password and database role named VERIDATA_ROLE • CREATE SESSION, CREATE TABLE, CREATE VIEW, CREATE PROCEDURE, CREATE SYNONYM • Grant VERIDATA_ROLE to the user • Specify QUOTA UNLIMITED on the user's default tablespace
Setting up the Veridata Compares Replication Technology Evolution for ATLAS Data Workshop Create database connections, source and target Create group, a group of comparing pairs Create compare pairs, what tables to compare Create a job, to run one or more groups Run a job Compare results
Step 1: Connection Replication Technology Evolution for ATLAS Data Workshop Create the connection to the corresponding databases where Veridata Agents are displayed
Step 2: Groups Creation Replication Technology Evolution for ATLAS Data Workshop
Step 3: Compare pair Replication Technology Evolution for ATLAS Data Workshop
Step 4: Job Creation Replication Technology Evolution for ATLAS Data Workshop
Step 5: Run / Execute Job Replication Technology Evolution for ATLAS Data Workshop
Step 6: Results Replication Technology Evolution for ATLAS Data Workshop
Reports Replication Technology Evolution for ATLAS Data Workshop
Veridata Key Points • Powerful tool for the data missing-synchronization identification • Along with GoldenGate, allows data real-time integration and continuous availability solutions validated data consistency • Stores OOS(Out-of-Sync) reports in binary, XML or both • Agents can connect remotely, not needed installation in target databases • 200GB production data have been compared in an ATLAS environment with a speed of 16.86 MB/sec • Veridata 12.1.3 coming soon • It will have the ability to repair/fix out of sync data • It will require WLS 12.1.3 • Summer Student to investigate deeply Veridata Replication Technology Evolution for ATLAS Data Workshop
Live Demo itrac910:8830/veridata/ Replication Technology Evolution for ATLAS Data Workshop
THANK YOU! lorena.lobato@cern.ch Replication Technology Evolution for ATLAS Data Workshop