1 / 9

Automated Planning for Hierarchical GUI Test Case Generation

This paper explores the use of automated planning for generating test cases for hierarchical GUIs. It discusses the state-of-the-art in GUI testing, planning processes, and related work by Atif M. Memon. Presented by Bob Mazzi on 9/30/08.

guzik
Download Presentation

Automated Planning for Hierarchical GUI Test Case Generation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SOA for Hierarchical GUI Test Case Generation Using Automated Planning.by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa. Presented by Bob Mazzi 9/30/08

  2. GUIs – Older than you think • First GUIs – Xerox PARC 1981 • Windows GUIs 1985 – Present • 85-94 Installed within DOS • 95 – Present True Standalone OS • Apple GUIs 1984 – Present • IBM OS/2 1987 – 2006 ( RIP )

  3. GUI = Graphic User Interfaces M.M Kaddah “ Interactive Scenarios for the development of a Unser Interface Prototype” 93 GUI Design B.A. Meyers “Why are Human-Computer Interfaces Difficult to design and Implement?” 7/93 D. Rosenberg “User Interface Prototyping in the 90’s” 93 R.M. Mulligan, M.W. Altom, D.K. Simkin “User Interface Design…” 91 J. Nielson “Iterative User Interface Design” 11/93 A. Kaster “User Interface Design…” 91 General Test Processes See Slide 4 GUI Tools B.A. Meyers “User Interface Software Tools” 95 M.G. El-Said, G. Fischer, S.A Gamalei-Din, M Zaki “ADDI A Tool for Automating the design of visual Interfaces” 97 GUI Testing Planning of Testing See Slide 5 A. Walworth “Java GUI Testing” 98 A. Howe etal “Test Case Generation as an AI Planning Problem” 97 L. The “Stress Tests for GUI Programs” 9/92 L.R. Kepple “The Black Art of GUI Testing” 2/94 This Paper April 2000 M.L. Hammontree etal “ Integrated Data capture and Analysis Tools for research and testing a GUI” 5/92 L. White “Regression Testing of GUI Event Interactions” 11/96 D.J. Kasik, H.G. George “Toward Automatic Generation of Novice User test scripts” 4/96 Subsequent Work State of the Art

  4. T.S. Chow “Testing Software Design Modeled by Finite-State Machines” ” 3/78 S. Esmelioglu etal “Automated Test case Generation Planning and Reporting” 10/97 P.J. Bernhard “A Reduced Test Suite for Protocol Performance testing” 7/94 J.M. Clarke “Automated Test Generation from a Behavioral Model” 5/98 H. Cho etal “Redundancy Identification/Removal and Test Generation for Sequential circuits…” 7/93 R.K. Shehady etal“A method to Automate User Interface Testing …” 6/97 General Test Processes. to Slide 3 State of the Art / General Testing

  5. M. Peot, D. Smith “Conditional Nonlinear Planning” 6/92 D.S. Weld “An introduction to Least Commitment Planning” 94 D.S. Weld “Recent Advances in AI Planning” 99 K. Erol et al “HTN Planning: Complexity and Expressivity” 8/94 A.L. Blum, M.L. Furst “Fast Planning through Planning Graph Analysis” 97 J. Koehler etal “Extending Planning Graphs to the ADL Subset” 97 H. Kautz, B. Selman “ The Role of Domain Specific Knowledge in the planning as Satisfiability Framework” 98 Test Planning Processes. To Slide 3 State of the Art / Test Planning

  6. Overall Timeline • 1981 Early GUI Precursors ( Xerox / PARC ) • 1983 First Apple GUI ( Lisa ) • 1985 First Microsoft GUI ( Win 1.0 ) • 1987 First IBM GUI ( OS/2 ) • 1978-97 – General topic of “Testing” papers • 1991-93 – GUI Design papers • 1992-98 – GUI Testing papers • 1995-97 – GUI Tools papers • 1999 – This paper

  7. Related Work • Atif M. Memon • 6 Papers with M. Pollack and M.L. Soffa • 1 Paper with M.L. Soffa • 4 papers with Adithya Nagarajan • 3 papers with Ishan Banerjee • 3 Papers with Xun Yuan • 3 Papers with Jaymie Strecker • 3 papers with Qing Xie • 2 papers with Scott McMaster • Martha E. Pollack • 6 Common papers, no other related papers • Mary Lou Soffa • 7 Common papers, no other related papers • Adithya Nagarajan & Ishan Banerjee • 3/4 Common papers, no other related papers • Xun Yuan • 3 Common papers, no other related papers • Jaymie Strecker • 3 Common papers, no other related papers • Qing Xie • 3 Common papers, One other related paper? • Scott McMaster • 2 Common papers, no other related papers

  8. Subsequent Related Work by Atif Memon • Atif Memon's Publications • 2009 • “Using Reverse Engineering for Automated Usability Evaluation of GUI-Based Applications” by Atif M. Memon. • “Testing Graphical User Interfaces” by Jaymie Strecker and Atif M. Memon.2008 • “Using a Pilot Study to Derive a GUI Model for Automated Testing ” by Qing Xie and Atif M. Memon. • “Test Case Generator for GUITAR” by Daniel Hackner and Atif M. Memon. • “Relationships Between Test Suites, Faults, and Fault Detection in GUI Testing” by Jaymie Strecker and Atif M. Memon. • “Call-Stack Coverage for GUI Test-Suite Reduction ” by Scott McMaster and Atif M. Memon. • “Automatically Repairing Event Sequence-Based GUI Test Suites for Regression Testing”by Atif M. Memon. • “Alternating GUI Test Generation and Execution” by Xun Yuan and Atif M. Memon. • 2007 • “Fault Detection Probability Analysis for Coverage-Based Test Suite Reduction” by Scott McMaster and Atif M. Memon. • “Designing and comparing automated test oracles for GUI-based software applications” by Qing Xie and Atif M. Memon. • “Covering Array Sampling of Input Event Sequences for Automated GUI Testing” by Xun Yuan, Myra Cohen. And Atif M. Memon, • “Automated GUI Testing Guided by Usage Profiles” by Penelope Brooks and Atif M. Memon. • “An event-flow model of GUI-based applications for testing” by Atif M. Memon. • “Agile Quality Assurance Techniques for GUI-Based Applications” by Qing Xie and Atif M. Memon. • “Faults' Context Matters” by Jaymie Strecker and Atif M. Memon. • “Using GUI Run-Time State as Feedback to Generate Test Cases” by Xun Yuan and Atif M. Memon. • 2006 • “Model-Based Testing of Community-Driven Open-Source GUI Applications” by Qing Xie and Atif M. Memon. • “Employing user profiles to test a new version of a GUI component in its context of use” by Atif M. Memon. • “Studying the Characteristics of a `Good' GUI Test Suite” by Qing Xie and Atif M. Memon. • “Call Stack Coverage for GUI Test-Suite Reduction” by Scott McMaster and Atif M. Memon. • “Techniques and processes for improving the quality and performance of open-source software”by Adam Porter, Cemal Yilmaz. • 2005 • “Studying the Fault-Detection Effectiveness of GUI Test Cases for Rapidly Evolving Software” by Atif M. Memon and Qing Xie. • “Rapid "Crash Testing" for Continuously Evolving GUI-Based Software Applications” by Qing Xie and Atif M. Memon. • “Call Stack Coverage for Test Suite Reduction” by Scott McMaster and Atif M. Memon. • “Automating regression testing for evolving GUI software” by Atif Memon, Adithya Nagarajan, and Qing Xie.

  9. Subsequent Related Work by Atif Memon • 2004 • “Empirical Evaluation of the Fault-Detection Effectiveness of Smoke Regression Test Cases for GUI-Based Software” by Atif M. Memon and Qing Xie. • “Automated GUI Regression Testing Using AI Planning” by Atif M. Memon. • “A Distributed Continuous Quality Assurance Process to Manage Variability in Performance-intensive Software” by Arvind S. Krishna, Cemal Yilmaz. Atif M. Memon, Adam Porter, Douglas C. Schmidt, Aniruddha Gokhale, and Balachandran Natarajan, • “Using Tasks to Automate Regression Testing of GUIs” by Atif M. Memon. • 2003 • “Regression testing of GUIs” by Atif M. Memon and Mary Lou Soffa. • “Advances in GUI Testing” by Atif M. Memon. • “What Test Oracle Should I Use for Effective GUI Testing?” by Atif M. Memon, Ishan Banerjee, and Adithya Nagarajan. • “DART: A Framework for Regression Testing Nightly/daily Builds of GUI Applications” by Atif M. Memon, Ishan Banerjee, and Adithya Nagarajan. • “ Automatically Testing “Nightly/daily Builds” of GUI Applications” by Atif M. Memon, Ishan Banerjee, and Adithya Nagarajan. • 2002 • “GUI Testing: Pitfalls and Process” by Atif M. Memon. • 2001 • “Hierarchical GUI Test Case Generation Using Automated Planning” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa. ( This paper ) • “Coverage criteria for GUI testing” by Atif M. Memon, Mary Lou Soffa, and Martha E. Pollack. • “A comprehensive framework for testing graphical user interfaces” by Atif M. Memon.Ph.D. dissertation, 2001. Advisors: Mary Lou Soffa and Martha Pollack; Committee members: Prof. Rajiv Gupta (University of Arizona), Prof. Adele E. Howe (Colorado State University), Prof. Lori Pollock (University of Delaware) . • 2000 • “Automated test oracles for GUIs” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa. • “A Planning-Based Approach to GUI Testing” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa. • “Plan Generation for GUI Testing” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa. • 1999 • “Using a goal-driven approach to generate test cases for GUIs” by Atif M. Memon, Martha E. Pollack, and Mary Lou Soffa.

More Related