1 / 83

CIS-74 Computer Software Quality Assurance

CIS-74 Computer Software Quality Assurance. Systematic Software Testing Chapter 11: Improving the Testing Process. Process Improvement Models. 1. One produced by authors 2. CMM 3. ISO 4. TPI. Improving the Testing Process (Authors’ Model). Step 1: Baseline Current Practices

garry
Download Presentation

CIS-74 Computer Software Quality Assurance

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. CIS-74 Computer Software Quality Assurance Systematic Software Testing Chapter 11: Improving the Testing Process

  2. Process Improvement Models 1. One produced by authors 2. CMM 3. ISO 4. TPI

  3. Improving the Testing Process (Authors’ Model) Step 1: Baseline Current Practices Key terms: Baseline: a measurement of where a specific process is at any given point in time. Benchmark: a measurement of where a specific process is when compared to other companies or a model. (Also used to refer to software performance.)

  4. Improving the Testing Process (Authors’ Model) Step 2: Develop Vision and Goals The point? Keep everyone focused on the same target. Great quote: “If you don’t know where you’re going, any road will get you there.” Key term: Escape: a defect that is not discovered by current evaluation activity, and hence, “escapes” to the next phase.

  5. Improving the Testing Process (Authors’ Model) Step 3: Formulate/Prioritize Requirements The point? How to get from the Step-1 baseline to the Step-2 goals.

  6. Improving the Testing Process (Authors’ Model) Step 4: Establish a Project The point? Ensuring that the process improvement effort will have sufficient resources to succeed.

  7. Improving the Testing Process (Authors’ Model) Step 5: Develop a Plan The recommendation? Use the test plan template as a starting point if no project plan template is available in your organization.

  8. Improving the Testing Process (Authors’ Model) Step 6: Introduce Change Incrementally The points? • Trying to do too much too soon can backfire. • It’s hard to measure the ROI on a specific improvement if multiple improvements are implemented at the same time.

  9. Improving the Testing Process (Authors’ Model) Step 6: Introduce Change Incrementally (continued) Key terms: Influence leader: “One whose example is followed by his or her peers because the influence leader is perceived to be exceptionally innovative, authoritative, or technically astute.”

  10. Improving the Testing Process (Authors’ Model) Step 6: Introduce Change Incrementally (continued) Adaptive Change - little potential for resistance Innovative Change - moderate potential for resistance Radically Innovative Change - high potential for resistance

  11. Improving the Testing Process (Authors’ Model) Step 7: Measure Results The point? Determining if the project has met the requirements specified in Step 3.

  12. Improving the Testing Process (Authors’ Model) Step 8: Return to Step 1 The point? Process improvement is a never-ending effort!

  13. Authors’ Suggestions for Obtaining Buy-In • Ask the developers and testers to participate in creating the requirements. Key term: “Not Invented Here” syndrome, often abbreviated as NIH. • Effective Communications The testing staff must be confident that their recommendations will be taken seriously.

  14. Authors’ Suggestions for Obtaining Buy-In(continued) • Metrics Provide metrics early on that make clear the benefits of the proposed change. • Develop Feedback Loops Developers & testers must have opportunity to provide feedback on what is and is not working.

  15. Authors’ Suggestions for Obtaining Buy-In(continued) • Provide Training (on the process improvement process). • Pick a Champion and Sponsor. Champion: “An influence leader who’s willing to serve as the on-site oracle for the new process.” Sponsor: “A senior manager who can help fight for resources and get buy-in.”

  16. Authors’ Suggestions for Obtaining Buy-In(continued) 7. Post-Project Reviews Can be used instead of first two steps of the authors’ suggested process improvement model. Purpose: • Identify strengths to repeat on future projects. • Identify opportunities for improvement.

  17. ISO Certification International Organization for Standardization Federation of standardization bodies from 140 countries ISO not an acronym! From Greek word “isos” which means “equal” ISO 9000 standards for quality management system

  18. ISO Certification(continued) ISO audits apply to entire organization, not just the testing group. Companies undergoing ISO audits are usually more open to process improvement activities. Cons of ISO Certification: old-fashioned, just a paper trail (in the minds of some).

  19. Capability Maturity Model (CMM) Level 1: Initial Level 2: Repeatable Level 3: Defined Level 4: Managed Level 5: Optimizing

  20. Capability Maturity Model (CMM)(continued) Level 1: Initial Process is ad hoc and undisciplined!

  21. Capability Maturity Model (CMM)(continued) Level 2: Repeatable Focus is on project management.

  22. Capability Maturity Model (CMM)(continued) Level 3: Defined Focus is on documenting processes.

  23. Capability Maturity Model (CMM)(continued) Level 4: Managed Focus is on quantitative understanding and control of processes and products.

  24. Capability Maturity Model (CMM)(continued) Level 5: Optimizing Focus is on continuous process improvement.

  25. Capability Maturity Model (CMM)(continued) Pros: • High visibility within software industry Cons: • Doesn’t focus on developer, tester, OR customer, and hence, lacks their input • Assumes correlation between level of process use and quality of product • Too much process for small entrepreneurial organizations

  26. Test Process Improvement (TPI) Model Developed in response to the CMM’s failure to address testing issues until Level 3 Breaks testing process into 20 key areas which need to be addressed by testing org Each key area must be rated as to its “Level of Maturity” (A-D, with D the highest).

  27. Test Process Improvement (TPI) Model(continued) Not all of the 20 key areas have all four levels of maturity. Checkpoints: TPI questions which have to be answered in order to determine the level of maturity for a key area Improvement suggestions: Advice on how to facilitate the test improvement process

  28. Test Process Improvement (TPI) Model(continued) Three labels for Level of Maturity--Controlled, Efficient, & Optimizing--are imprecise. True rating is based on where shading occurs within the TPI Assessment matrix. To really get into using TPI, one needs to read Test Process Improvement book by inventors of TPI.

  29. Final Words from Authors Regardless which process improvement model your org uses, it’s necessary to continuously seek to improve your testing effectiveness!

  30. Review Questions

  31. What is the name for a measurement of an organization’s processes at a particular point in time?

  32. What is the name for a measurement of an organization’s processes at a particular point in time? A baseline

  33. What is the name for a measurement of where an organization’s processes are compared to other companies or to a static model?

  34. What is the name for a measurement of where an organization’s processes are compared to other companies or to a static model? A benchmark

  35. What is the term for a defect that is not discovered by the current evaluation activity and hence, is pushed on to the next phase?

  36. What is the term for a defect that is not discovered by the current evaluation activity and hence, is pushed on to the next phase? An escape

  37. What is the term for a person whose example is followed by his or her peers because s/he is perceived to be exceptionally innovative, authoritative, or technically astute?

  38. What is the term for a person whose example is followed by his or her peers because s/he is perceived to be exceptionally innovative, authoritative, or technically astute? An influence leader

  39. Which type of change has the lowest potential resistance to change--innovative, adaptive, or radically innovative?

  40. Which type of change has the lowest potential resistance to change--innovative, adaptive, or radically innovative? Adaptive

  41. What is the term for an influence leader who’s willing to serve as the on-site oracle for a new process?

  42. What is the term for an influence leader who’s willing to serve as the on-site oracle for a new process? A champion

  43. What is the term for a senior manager who can help fight for resources and get buy-in for process improvements?

  44. What is the term for a senior manager who can help fight for resources and get buy-in for process improvements? A sponsor

  45. What phrase mentioned in the book has as its acronym NIH? (NIH was not mentioned in the book.)

  46. What phrase mentioned in the book has as its acronym NIH? (NIH was not mentioned in the book.) Not Invented Here

  47. What is the full-length name of ISO?

  48. What is the full-length name of ISO? International Organization for Standardization

  49. How come the short name for the International Organization for Standardization is ISO rather than IOS?

  50. How come the short name for the International Organization for Standardization is ISO rather than IOS? ISO is derived from the Greek word isos, which means “equal.”

More Related