The “Ws” of Software Measurement

1. The “Ws” of Software Measurement by Steve Neuendorf Presented at SASQAG 6/15/2006

2. First Things First • Before you can mind your “Ps” (as in productivity) and “Qs” (as in quality), you must first get your “Ws” (of software measurement in order: • Why • What • When • Where • Who

3. WhyIf you don’t know where you’re going, any road will do. • Why are you measuring? (What are the goals of your measurement program?) • Management requirement; • Everybody is doing it (competitors, “Best Practice”); • Check list item; or • To be better, faster, and cheaper • FUD

5. WhatSomething not worth doing is not worth doing well. The scope and content of your measurement program must align with your goals. No one likes a hypocrite, or so the saying goes. A hypocrite professes to live by one set of standards, but acts upon another, often driven by an insidious hidden agenda. By contrast, most people admire the person of integrity. The person of integrity “walks the talk”; his or her actions are based on goals, which support higher level goals, which ultimately support a set of high level values. The person of integrity does. We come to know the difference by measuring the alignment of their actions, goals, and values.

6. What (Continued) A company, too, can be hypocritical. It may articulate an inspiring vision and set of values, but act on an entirely different set of standards. Unlike the human variety, however, corporate hypocrites are seldom conniving. Rather, they simply lack the integrated set of goals and measures--the measurement system--needed to translate vision and values into actions that will move the company in the right direction. Gouillart, Kelly; Transforming the Organization; McGraw Hill, 1995; p 69.

7. Common Metaphor

8. What (continued) • Three dimensions of measurement • Scope (What is included) • Coverage (How much is done and when) • Accuracy (How close must we be) • Cost of measurement must be matched to desired benefits

9. What (continued) • Three Measurement Programs (at least) • Executive • Management • Production • Three Sets of goals (at least)

10. Quality Size Cost Process What (continued)The Measures • The elements of measurement Activities Products

11. Special Cause Analysis Common Cause Analysis Analysis of Variation Engineered Engineered Standards Development Standards Standards Quality Metrics Cycle Time Metrics Productivity What (continued) The Building Blocks Resource Use and Timing Quality Measures Measures Size Attributes Foundation Activities Products

12. When • Resource Dependence • How many resources are committed • Time Dependence • How many cycles, data points are required • Benefits dependence • What returns the most, fastest

13. Where • The biggest opportunity • Maximum return • The biggest problem • Reduced loss and waste • The biggest risk • Greater certainty

14. Who • STAKEHOLDERS • Interest in the outcome / Influence on the outcome • Sponsor(s) • Make/Enforce Policy; Provide Resources • Champion(s) • Provide Leadership; Overcome Obstacles • Doer(s) • Right Skills and Experience • Produce

15. What do you want metrics to tell you? Purpose Who? Stakeholders for Metrics Influence Stakeholders What satisfies the purpose ? Metric Interest Purpose Available? How are the metrics produced? No Yes Measure Metric Measure Stakeholder Analysis

16. Got it? • Now, • Ask Me How