60 likes | 205 Views
Text to Test: Deriving Test Cases and Scripts from Use Case Requirements. Goals: Target test automation via the automatic generation of high quality, fault targeted test cases and test automation scripts based on industry standard practice of use cases.
E N D
Text to Test:Deriving Test Cases and Scripts from Use Case Requirements • Goals: • Target test automation via the automatic generation of highquality, fault targeted test cases and test automation scripts based on industry standard practice of use cases. Amit Paradkar (paradkar@us.ibm.com) IBM Research
…and, oh by the way, Text-2-Test works too! • Analyzed 80 use cases from literature and industry (DSN’2009) • Very High precision and recall • Highly Effective Pronoun Resolution • Data collected from an actual GBS project (10 Subjects) • Quality improvement in requirements • Test Group (Text2Test+Training) gained ~ 183% in 3 months. • Control Group (just Training) gained ~82% in 3 months • Quality improvement in test generation • Test Group ~92% • Control Group ~51% • Evaluated effect of introducing Text2test on quality of requirements and generated test cases. (ICST’2010) • Higher quality requirements • Test cases with better coverage • Actual Project information from the two iterations • 17 Use Cases; 38 Test Cases developed by the team • 80 hours to manually create the test cases based on the use cases • Text2Test Results • 22 test cases generated • 10-15 hours per iteration (Mostly for pre-processing the use cases) • Test generation almost instantaneous • Net savings in test creation: Approximately 70% (~50/80) effort reduction • Evaluated applicability and effectiveness of Text2Test for a retail industry back end application. • Significant productivity boost
Text2Test – How It Works: Use case authoring and analysis 3.Analysis of high level use cases 1. Identification of Actors, Business Items, Action Verbs, and Conditionals 2. Reformatting of use case text and classification of action verbs 4.Visualization of use case control flow
3.Generate traceability between test cases and use case requirements Text2Test – How It Works: Test Case and Test Script Generation 1. Selection of Use Cases for Test Generation 4.Generation of manual test scripts 2. Generation of Test Cases to cover all use case flows and dependencies between use cases