80 likes | 193 Views
ECE 453 – CS 447 – SE 465 Software Testing & Quality Assurance Case Studies Instructor Paulo Alencar. Overview. Investigation on how to improve the inspection process An experiment on software process improvement
E N D
ECE 453 – CS 447 – SE 465 Software Testing & Quality AssuranceCase StudiesInstructorPaulo Alencar
Overview • Investigation on how to improve the inspection process • An experiment on software process improvement • Three case studies related to software inspections were presented (e.g., 120 participants) • The effect of group size and hands-on experience • Stalhane, T., Awan, T., Improving the Software Inspection Process, EuroSPI, LNCS 3792, pp. 163-174, 2005.
Main Results • How many persons in a group identified each defect?
Main Results • The probability of reporting a defect as a function of persons that found it? 4
Main Results • Therefore: - If nobody had found the defect during individual inspection, there was a 10% probability that the group would find it during the meeting; - If only one person in the group found the defect there was a 50% probability that the group would report it; - If more than two persons found the defect (mostly all), the probability of reporting the defect rose to 80% and 95%. • The results motivated the authors to try to find ways to improve the inspection process. 5
Main Results • Experiment 1 – Group size: the larger the group, the higher the number of defects reported (groups of size 2, 5; using or not using checklists) 6
Main Results • Experiment 2 – The influence of experience and the effect on three common types of defects (high/low experience; wrong code, missing code, extra code) • Low (high) experience is better at finding missing (extra) code • First four defects: missing; next 4 extra; last four: wrong 7
Main Results • General advice: • Large groups do better than small groups • Hands-on experience is important • A review must be understood as a social process • The ordering of the items in a checklist is important • Long checklists should be split into smaller checklists covering each area of concern – the fatigue effect