480 likes | 509 Views
ArcGIS Data Reviewer. Planning and Deploying Data Quality Services. Edwin Waite & Shankar Chandrasekaran. A few examples of why data validation matters. Leaning Tower of Pisa. Mars Climate Orbiter (1999). Garbage in Garbage Out (GIGO). Buildings. Water Bodies. Roads.
E N D
ArcGIS Data Reviewer Planning and Deploying Data Quality Services Edwin Waite & Shankar Chandrasekaran
A few examples of why data validation matters Planning and Deploying Data Quality Services
Leaning Tower of Pisa Planning and Deploying Data Quality Services
Garbage in Garbage Out (GIGO) Buildings Water Bodies Roads Type Presentation Title Here
Garbage in Quality Out Buildings Water Bodies Roads Type Presentation Title Here
What is ArcGIS Data Reviewer for Server? • System to support data quality management for ArcGIS • Automates quality control process • Monitor and Measure data quality Validate Review Summarize
Enterprise Quality Management System Data Reviewer Server GIS Data Type Presentation Title Here
Benefits of Data Reviewer for Server • Provides accurate data for your applications • Measure and report data quality • Eliminate costs associated with poor data quality
Monitoring your data with validation Validate Planning and Deploying Data Quality Services
Automated Validation Different Type of Issues in GIS Data Attribution Feature Integrity Spatial Relationships Metadata Type Presentation Title Here
Automated Validation • Checks validate data based on conditions you define. • Results are written to the Reviewer workspace.
Automated Validation • Over 40 rules out of the box • Ability to extend validation with custom rules • Rules are authored using ArcGIS Data Reviewer for Desktop Item Metadata Spatial Relationships Featureintegrity Attribute/Table
Automated validation • Group checks into batch jobs Planning and Deploying Data Quality Services
Automated Validation Architecture ArcGIS Server Reviewer Service Scheduler Execution Details REST API Data Reviewer Web API Validation Service Reviewer Workspace Data Workspace Type Presentation Title Here
Automated Review Demo Organization Contributor Planning and Deploying Data Quality Services
Questions ? Planning and Deploying Data Quality Services
Analyzing Validation Results Planning and Deploying Data Quality Services
Summarize data quality • Dashboard • Provides transparency to stakeholders on data quality • Ability for stakeholders to make informed and accurate decisions • Interactively summarize results based on different perspectives • Summaries are derived from results Planning and Deploying Data Quality Services
Summarize data quality Dashboard - Perspectives What are the issues on a geographic extent? How severe are the issues with my data? How many types of issues do I have in my data? How many issues have been reviewed and fixed? How many issues do I have by feature class? Planning and Deploying Data Quality Services
Dashboard ArcGIS Server Reviewer Service REST API Data Reviewer Web API Dashboard Reviewer Workspace Planning and Deploying Data Quality Services
Results • Results are records that are stored in Reviewer workspace • Contains information about a feature or a row which failed QC standard • Query Results • Apply filters • Sort/Page Automated Validation Results Planning and Deploying Data Quality Services
Results • Spatial and non-spatial • Attributes describe check, problem, and validation information • Object ID provides link back to feature that failed validation Planning and Deploying Data Quality Services
Results ArcGIS Server Reviewer Service REST API Data Reviewer Web API Results Reviewer Workspace Planning and Deploying Data Quality Services
Analyze Results demo Data Stewards Contributor Planning and Deploying Data Quality Services
Questions ? Planning and Deploying Data Quality Services
Visual Review Process Reviewer Service Write Results Editor Reviewer Geodatabase ArcGIS Server Planning and Deploying Data Quality Services
Benefits of Visual Review • Get feedback from Subject Matter Experts (SME) • Identify missing or incomplete data • Track issues reported Type Presentation Title Here
Questions ? Planning and Deploying Data Quality Services
Deploying Data Quality Services Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Single machine deployment Desktop Web Device Client ArcGIS Server Server Data Workspace Reviewer Workspace Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Single machine Deployment ArcGIS Server Single Machine Validate Inspect and Analyze Validate Validate Inspect and Analyze Inspect and Analyze Map Service GP Service Map Service Map Service GP Service GP Service Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Multi-machine deployment Desktop Web Device Client Web Adaptor Servers Data Workspace Reviewer Workspace ArcGIS Servers Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Multi-machine deployment ArcGIS Servers Inspect and Analyze Inspect and Analyze Inspect and Analyze Validate Validate Validate Map Service GP Service Map Service GP Service Map Service GP Service Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Amazon Elastic Cloud Deployment Desktop Web Device Client Amazon Elastic Cloud Data Workspace Reviewer Workspace Planning and Deploying Data Quality Services
Deploying Data Reviewer Services Amazon Elastic Cloud Deployment AGS - Amazon EC AGS - Amazon EC Validate Validate Inspect and Analyze Inspect and Analyze Map Service GP Service Map Service GP Service Planning and Deploying Data Quality Services
Data Reviewer Server Out of the Box Server components Execute Batch Job GP Service Reviewer Service REST API Web components Client API Reference (JavaScript & Flex) Starter Applications (Batch Validation Manager) Widgets (Flex & JavaScript) Reviewer Service Execute BatchJob GP Service Planning and Deploying Data Quality Services
Data Reviewer Platform ArcGIS Data Reviewer for Desktop Define and author Quality Control Standards Configure Reviewer Workspace to store results ArcGIS Data Reviewer for Server Schedule and run automated validations Analyze result stored in Reviewer workspace Submit SME feedback for Reviewer workspace for visual review Client API’s Develop applications to access data quality services Planning and Deploying Data Quality Services
Widgets and Starter Apps - Demo Planning and Deploying Data Quality Services
ArcGIS Data Reviewer Server System Architecture Batch Validation Validation Service Data Workspace Dashboard HTTP/REST Results Visual Review Reviewer Workspace Planning and Deploying Data Quality Services
Resources • Product page • www.esri.com/datareviewer • Resource Center • http://resources.arcgis.com/en/communities/data-reviewer/ • Training • www.esri.com/training • Questions & comments • datareviewer@esri.com Planning and Deploying Data Quality Services
Gallery Apps Templates Tutorials API Documentation Live Samples Resource Center – Data Reviewer
Planning and Deploying Data Quality Services Questions ?
Thank you… Please fill out the session survey: Offering ID: 1313 Online – www.esri.com/ucsessionsurveys Paper – pick up and put in drop box Planning and Deploying Data Quality Services