1 / 20

Igor Cernopolc 15 th May 2014

Metrics in Automation testing - theory and practice. Igor Cernopolc 15 th May 2014. Why Metrics?. Testing Metrics help organization to obtain the information it needs to continue improve its

beryl
Download Presentation

Igor Cernopolc 15 th May 2014

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Metrics in Automation testing - theory and practice Igor Cernopolc 15th May 2014

  2. Why Metrics? Testing Metrics help organization to obtain the information it needs to continue improve its testing process, reduce errors and increase the quality of deliverables, thus achieving the desired Goal.

  3. What is a that? Metric is a standard unit of measurement that quantifies results. It is obtained using measurement based techniques which are applied to processes, products and services as applicable.

  4. Metricscategories

  5. Lifecycle

  6. What are automated testing metrics? Automated testing metrics are metrics used to measure the performance (past, present, and future) of the implemented automated testing process and related efforts and artifacts.

  7. Is my metric a good one? • A good automated testing metric has the following characteristics: • It is objective • It is measurable • It is meaningful • Data for it is easily gathered • It can help identify areas of improvement • It is simple.

  8. Metrics in automation testing • Automatable Percentage • Test Automation coverage • Automation test design productivity • Automation test execution productivity • Effort savings through test automation • ROI of Test Automation

  9. Automatable Percentage • *100 • PA= Percent automatable • ATC= Number of test cases automatable • TC= Total number of test cases

  10. Test Automation Coverage • *100 • PTC= Percent of automated test coverage • AC= Automated TC’s • C= Total number of TC’s

  11. Automation test design productivity • *100 • PTD= Percent of automated tests • AC= Automated TC’s • T= Timeframe • PAC = Planned TC’s

  12. Automation test execution productivity • *100 • PTE = Percent of executed tests • AC= Executed TC’s • T= Timeframe • PAC = Planned TC’s

  13. Effort savings through test automation

  14. ROI of Test Automation

  15. Let’s share How we all automated, with and without metrics

  16. Few more things • Reliability vs Validity • Ratio, Proportion, Rate, Percentage, Absolute values • Don't measure for the sake of measure • Track and measure on an ongoing basis

  17. Q&A are Welcomed 

  18. In one word • Before measuring anything,

  19. In one word • Before measuring anything, set goals

  20. Thank you Igor Cernopolc igor.cernopolc@gmail.com

More Related