420 likes | 613 Views
iWay Data Profiler. Product Highlights. 5.0 GA. Anand Maheshwari. What is iWay Data Profiler.
E N D
iWay Data Profiler Product Highlights 5.0 GA Anand Maheshwari
What is iWay Data Profiler iWay Data Profiler provides the ability to look at data quality from a business user perspective with dashboard templates to view, monitor, compare, and report by leveraging the turnkey business intelligence technology through semantic analysis, complex business rules and data drill-down.
Features • Ability to profile data against a set of standard (pre-defined) data quality rules and metrics • Ability to create custom organization specific data quality indicators • Advanced comparison of data profiling and quality indicators • Ability to create and execute data quality projects against varying payloads • Ability to rollup data with drill through • Advanced administration capability • Advanced auditing capability • Easier migration from earlier versions • Ability to track background processes for faster troubleshooting and status • Use of current standards like JQuery for enhanced user experience • Support for all leading database platforms • Support for wide variety of OS platforms • Support for German, French, Spanish and English locales • Increased performance through several tuning efforts
1. Ability to profile data against a set of standard (pre-defined) data quality rules and metrics - Comparison
1. Ability to profile data against a set of standard (pre-defined) data quality rules and metrics – New Features • Uploading profile in background • View result to display uploading progress • Export profile report in XLS format
2. Ability to create custom organization specific data quality indicators – Comparison
2. Ability to create custom organization specific data quality indicators – New Features • Easy to understand the data quality indicators through multiple reports • Flexibility to compare the expressions • View Result to display progress for the background processes
2. Ability to create custom organization specific data quality indicators – New Features • Easy to understand the data quality indicators through multiple reports
2. Ability to create custom organization specific data quality indicators – New Features • Flexibility to compare the expressions
2. Ability to create custom organization specific data quality indicators – New Features • View Result to display uploading progress
3. Advanced comparison of data profiling and quality indicators - Comparison
3. Advanced comparison of data profiling and quality indicators – New Features • Additional table report and chart type • Display of both success and failure count and percentages • Informative table report display with charts
4. Advanced comparison of data profiling and quality indicators – New Features • New design of data displayed in dataset table, for Profile & DQI • Modified default report as 3D Bar
4. Ability to create and execute data quality projects against varying payloads – New Features • Data Quality Projects for Profiles/DQIs enables running a DQC plan for generating a Data Profile/DQI and loading into database repository • Create data quality project • Manage data quality project • Reusability of plan - The same plan can be executed against different inputs • View Result for different level of progress
4. Ability to create and execute data quality projects against varying payloads – New Features • Create project – option to upload Profiling plans and DQI plans • Plan can be with drill-through and also with Rollups
4. Ability to create and execute data quality projects against varying payloads – New Features • Manage project
4. Ability to create and execute data quality projects against varying payloads – New Features • Reusability of plan : The same plan can be executed against different inputs
4. Ability to create and execute data quality projects against varying payloads – New Features Note: • Plan is supported with TXT and CSV Input, Other Input in DQC like XML, Database is not supported in the current version • Output can only be profile steps (or DQI steps depending on the type of DQ project) • The following input settings of the input file can be modified without DQC GUI: • Number Of Lines In Header • Field Separator • Line Separator • String Qualifier • Encoding
4. Ability to create and execute data quality projects against varying payloads – New Features • View Result for different level of progress
5. Ability to rollup data with drill through – New Features Roll up is a part of iWay Data Profiler that enables a user to profile view a specific subset of a data. • Rollups for: • Data Analysis • Primary Key • Business Rules.
5. Ability to rollup data with drill through – New Features • Enabled drill-through for the subset of data
6. Advanced administration capability – New Features • Hierarchical folder structure to manage profiles, DQIs, datasets, templates • Grouping related things together based on the user choice • Sharing and easy to compare • Created a group called “Admin” and linked all folders to it • Folder structure for a user • Private • My Group • Custom • Public • Created default base roles: admin, power, technical and analytical with varying authorizations
6. Advanced administration capability – New Features • Manage Folders
6. Advanced administration capability – New Features • Manage Roles
6. Advanced administration capability – New Features • Manage Groups
6. Advanced administration capability – New Features • Manage Users
7. Advanced auditing capability – New Features • Audit (Tracking user name, IP address, login time and logout time) with different databases • Enhanced user security • Filter audit information • Track log in and log out time in iDP with IP Address • Track invalid login & iDP server manager login
7. Advanced auditing capability – New Features • Audit information for a user
7. Advanced auditing capability – New Features • Filter audit information
8. Easier migration from earlier versions – New Features Includes • Upgrade script is for migrating from the older version to newer version • 4.1 5.0 • Available for: • MySql • MSSQL • Oracle • There is no loss of data exists in database “idp_data” Does not include • Synonym creation • Drill-through adapter creation in WebFOCUS
9. Ability to track background processes for faster troubleshooting and status – New Feature • Interface for the user to monitor the back-end process • Multilingual support for view process result – Available for Profile, DQI, DQ Project and Custom Reports
Benefits • Web enabled thereby single deployment and access anywhere • Aids in the identification of data quality issues • Expertise and support of a mature business intelligence product – WebFOCUS • Data quality comparison over time • Documents and audits quality-control processes for review • Streamlines offline maintenance activities to ensure optimum performance • Share the reports using a secured connection • Mobile support
iWay Data Profiler Thank You ! 5.0 GA Anand Maheshwari
Multilingual support • iWay Data Profiler supports multi-languages • English • German • Spanish • French • Note: ISM Tracking Edit page language will change corresponding to the language choose in ISM configured not based on the IDP chosen language.
Performance tuning • JAVA code has been restructured for better performance • Complete recoding using XPATH and transaction based multiple coding being undertaken as processing of complicated Rollups found to crash the JVM • The maximum size of the Profile XML file, which can be uploaded into DP, has been increased from 1MB to 300 MB
Revamped iWay Data Profiler with JQuery • JQuery Functionalities • Enhance look and feel • Styling • Cross browser compatibility • Support all mobile devices • Grouping related things together • Sharing • Easy to compare • Fast loading • Alerts and alignment • Expand All/ Collapse All functionality • More/ Less functionality • Pagination • Homepage carousel – to show case different graphs of iDP • Landing page accordion layout – to display different iDP modules
Modified both Windows and Linux installer • Updated both Windows and Linux Installer scripts for DQ Project to get the Drill-through DB credential from the installer • Installer is available in English, German, French, Spanish • Same Linux build is supported for AIX platform
Backward Compatibility with iWay Data Quality Center • Modified iDP for • Profiling • DQI • Support across versions • DQC 7.0.1 & higher • Input data • Reports