1 / 10

Using evolutionary algorithms to guide search for test data within equivalence classes

Using evolutionary algorithms to guide search for test data within equivalence classes. Felix Lindlar. Autobahn Speed = 240km/h, 300km/h, 350km/h ???. Tester. …accelerate the car to autobahn speed wait for a short period of time and then…. Problem Description.

temima
Download Presentation

Using evolutionary algorithms to guide search for test data within equivalence classes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using evolutionary algorithms to guide search for test data within equivalence classes Felix Lindlar

  2. Autobahn Speed = 240km/h, 300km/h, 350km/h ??? Tester …accelerate the car to autobahn speed wait for a short period of time and then…

  3. Problem Description • Tester often think in Equivalence Classes when designing test cases • Selection of appropriate test cases based on experience • Many times not systematic • Loss of information • Simple Examples (from industrial test specification):

  4. Idea • Using equivalence classes instead of samples for test case specifications • Examples: Advantages • Higher test coverage of requirements • Extension of test methodology • Definition of test cases similar to (higher level) requirements (i.e. weaker) • Less test cases have to be defined  higher level of abstraction Disadvantages • Methodology and tools for handling equivalence classes not yet developed  New approach required

  5. Proposed solution • Idea • Extending test methodology to cover equivalence classes • Using evolutionary algorithms to guide search within equivalence classes • Enhance existing test cases • Advantages • Higher level of automation • Higher data coverage of requirements • Systematic exposure of errors • Systematic search within equivalence classes • Make equivalence classes manageable • Challenges • Find use cases (complex/simple functions) • Deal with complexity (multi dimensionality) • Generate objective function from existing analysis mechanisms • Test ending criteria

  6. Field of Application • Automated search for requirement violations (counter example generation)  No errors found with traditional approach, but parameter tuning within equivalence classes uncovers faults • Test data optimization (selection of representatives, increase quality of test cases)  Not only violations of requirements but also extreme values (e.g. runtime) of interest • Generating test data for subsequent test stages  Using valuable HiL testing time efficiently, reuse of critical test data identified by evolutionary engine (MiL test) • Increase test coverage of requirements • Integrate idea with TPT, a tool which is used at Daimler

  7. gas pedal MiL SiL PiL HiL brake pedal wheel speed ECU ... TPT – A quick introduction • Platform Independence • Abstraction • Test Automation • Piketec GmbH • Embedded Systems Testing • Test Modeling

  8. assessment description Testassessment fully automated scenario description data logs Test execution TPT Virtual Machine Platform adapter SUT platform specific TPT Test Process ? ??? test results Tester Test modeling Test documentation

  9. Level 3 Level 2 Level 1 Structural Test of TPT-Assessments • Trying to break requirements (red squares) • Examples: • - “Temperature( PartXY ) > 300° Celsius” • - “Operation NOT finished after 10s” • Evolutionary tuning of parameters within equivalence classes to cover desired branches CFG TPT Assessment

  10. Questions & Comments

More Related