WebVizOr: A Fault Detection Visualization Tool for Web Applications

1. Navigation Frame Current Test Case Oracle Views Available Current Response Current Oracle View Navigation Buttons Web Application Server code Oracle Detected Faults in this Test Case Oracle Not Run No Faults Found Faults Found Test Case’s Responses Oracle Detected faults in the Suite … Highlighting Indicating Found Differences All Test Cases Listed HTML responses … Side by Side View of Two Sets of Responses Figure 2: A screen snapshot of WebVizOr’s fault report. Detailed Test Case Information Figure 1: A screen snapshot of WebVizOr presenting the results of executing the same test suite on two versions of a web application. WebVizOr Execute Oracles Identify Faults Present Results Oracle Scripts (Filter) Directory of HTML Responses Test Case (HTTP Requests) Information Oracle Script (Compare) Application Description # Test Cases Total # Requests Avg. Case Size Masplas Regional Workshop Registration and Management 169 1,107 6.6 requests DSpace Digital Publications Library 1,800 22,129 12.2 requests Fault Information Oracle Reports Usage Initialization Time Generated HTML Files Filtered Text Files Comparison Files View Single Application Version 2 0 0 Masplas 1 sec DSpace 5-15 sec Compare Dual Application Versions 2 2 per oracle 1 per oracle Masplas 5 sec DSpace 22 sec WebVizOr: A Fault Detection Visualization Tool for Web Applications Holly Esquivel Barbara Hazelwood Sara Sprenkle and Lori Pollock Goal: Illustrate and evaluate the uses of WebVizOr, a new tool to aid web application testing Department of Computer Science & Information Systems • h t t p : / / w w w . c i s . u d e l . e d u / ~ h i p e r Motivation Tool Features • Test web applications for correctness • Problem: Difficult to analyze results of large test suites • Our Contribution: • Visualization tool that enables navigation of test suite results • Integration of various test oracles that identify possible faults in web applications Visualize Oracle Comparator Results View Saved HTML Responses Highlighted differences in filtered responses allow the user to quickly monitor • HTML tag change • Page content change Single Suite Version: • View results of test suite execution (responses) in rendered or raw HTML form Dual Suite Version: • View results of two sets of test suite executions (responses) side by side • Utilize oracles to compare, view, and detect potential faults in responses Test Suite Fault Report General Web Application Testing Process WebVizOr’s fault report allows the user to • View suite’s results • Jump to and view a test case or response • View an oracle’s results on the suite or a test case Requests Responses WebVizOr … Test Suite Expected Results Actual Results Oracle View Detailed Test Case Info Test case details allow user to • View complete HTTP request • Determine if error in response corresponds with request parameters • Jump to and view associated response Possible Fault Pass Uses in Industry and Research Summary of Evaluation Ease of Navigation: • Navigate to any response in 4 clicks or less • Go directly to responses listed in fault report Oracle Integration: • Integrated seven oracles • Created fault report for easy access to oracle results Real-world web application testing: Regression Testing • Useful during maintenance or before release of a new application version WebVizOr Architecture Extensibility: • Update a single configuration file to integrate new oracles Portability: • Under investigation Oracle Development: • Use of the tool within our group has already led to the development of two new oracles Subject Web Applications: Future Work • Evaluate Oracles • Some oracles are better at catching certain faults • Quantitative and qualitative analysis of oracles’ false positives and false negatives • Develop New Oracles • Use analysis to create more accurate oracles Time and Space Costs: O u r w o r k w a s f u n d e d b y C R A – W D i s t r i b u t e d M e n t o r P r o j e c t