Measure inspection performance in software defect management

1. Measure inspection performance in software defect management DifeiJia 6916448Jiajie Chen 7353053 submitted to Professor ShervinShirmohammadi in partial fulfillment of the requirements for the course ELG 5100

2. What can be done further Why Inspection Is Important in Software PM Introduce DI & IPM metrics Case Study and Observation What we do in inspection Agenda

3. Why Inspection Is Important • Inspection is time consuming at first, but save resource in the whole lifecycle view. • An inspection time of 10% at each phase of development results in more than 90% defect-free product.

4. Related inspection type • Code Review: examines blocks of code, fix any defect not properly implemented or anything could be improved. • Peer Review: Identify the problems that can be fixed early in the lifecycle. For management and control purposes. • Items to be covered • Control Flow Check • Data Check and Data Flow Check • Design • Calculation and numeric check

5. Inspection vs. Technical Review

6. Problems in Current Inspection Too old: The inspection as described in the IEEE standard is basically the same as the Fagan Inspection, as invented and described by Michael Fagan in 1976 Not practical: require a lot of roles (manpower) and meeting which is not applicable nowadays, problem like: time pressure, global team… Lack measurement on the Inspection performance, nor on the inspector.

7. Introduction of metrics • The existing industrial environment only indicates an inconsistent effort estimation of the inspection team. • Therefore, two metrics(DI & IPM) are introduced to measure the quality levels of inspection process and inspectors’ performance. • Further more, implementation of DI & IPM enable the software industry to estimate and predict the quality levels of inspection process.

8. Depth of Inspection (DI)

9. Depth of Inspection (DI) • Depth of Inspection and its influencing parameters.

10. Inspection Performance Metric (IPM )

11. FAMI(Four-step Approach Model of Inspection)

12. Achieve desirable DI using Bayesian Belief Network(BBN)

13. Case Study

14. Observation 1:Testing time % has a down trend with the growth of project scaleInspection time and Preparation time % have an ascending trend • Design Phase (%Time) • Implementation Phase (%Time)

15. Observation 2: • First figure is symmetric, because Ni+Nt = 100% • Design phase has some bugs missed • Similar to DI, it tells inspection performance Ni – % of defects captured through inspection Nt – % of defects captured through testing Req. & Des. Phase

16. Checking DI and IPM: Des.Phase Req.Phase Imp.Phase

17. Our finding Di is related with how much time spent in inspection Des.Phase Req.Phase Imp.Phase

18. Conclusion:

19. Desirable DI&IPM • Desirable DI Classification • Desirable IPM Classification

20. Improve Inspection process

21. THANK YOU！