E N D
1. DoD Software Intensive Systems Day
STC, May 1, 2004
(boehm@sunset.usc.edu)
(http://sunset.usc.edu) Experience FactoryPilot Workshop, Q&ABarry Boehm, USC/CeBASE
2. ©USC-CSE 2 Outline Experience Factory and CeBASE Overview
Example Experience Factory Approach
Example Experience Factory Guidelines
DoD Experience Factory Pilot Program
Questions & Answers
3. ©USC-CSE 3 Experience Factory Overview Organized approach for strategic process improvement
At organization, portfolio, and project levels
Gets you to CMMI Levels 4 and 5
Involves goal negotiation, feedback control
Goal-Model-Question-Metric paradigm
Organized Experience Base
Originated with UMD/NASA/CSC Software Engineering Lab
Versions successfully applied at TRW, USC
Major improvements in productivity, quality, cycle time, and predictability
4. ©USC-CSE 4 Org. Improvement Goals
Goal-related questions, metrics
Org. Improvement Strategies
Goal achievement models
5. ©USC-CSE 5 Initiative Plans
Initiative-related questions, metrics
Initiative Monitoring and Control
Experience-Base Analysis Experience Factory Framework - II
6. ©USC-CSE 6 Initiative Plans
Initiative-related questions, metrics
Initiative Monitoring and Control
Experience-Base Analysis Experience Factory Framework - III
7. ©USC-CSE 7
8. ©USC-CSE 8
9. ©USC-CSE 9 Outline Experience Factory and CeBASE Overview
Example Experience Factory Approach
Example Experience Factory Guidelines
DoD Experience Factory Pilot Program
Questions & Answers
10. ©USC-CSE 10 Example Experience Factory Approach: Goal-Model-Question-Metric and Shared Vision 1. Proposed Goal: Reduce Software
defect rates, delivered defect density
2.
11. ©USC-CSE 11 Example Experience Factory Approach: Goal-Model-Question-Metric and Shared Vision 2. Relate to system goal shortfalls:
ask why initiative is needed
Too much downtime on operations critical path
Too many defects in operational plans
Too many new-release operational problems
3. Formulate system-level goal: Decrease
software-defect-related losses in operational
effectiveness
With high-leverage problem areas above as specific subgoals
4.
12. ©USC-CSE 12 EF Approach: GMQM and Shared Vision 4. Perform system problem-area root cause analysis:
ask why problems are happening via models
Example: Downtime on critical path
13. ©USC-CSE 13 EF Approach: GMQM and Shared Vision 4. Perform system problem-area root cause analysis
5. Identify candidate improvement initiatives
Use Opportunity Trees to sort out options
6. Develop Results Chains for improvement initiatives
Identify Success-critical stakeholders
7. Develop stakeholder win-win Shared Vision package
Top- level goals, models, questions, metrics
8. Develop, execute, monitor, control Initiative Plans
14. ©USC-CSE 14 DMR/BRA Results Chain
15. ©USC-CSE 15 EasyWinWin Activities This slide gives an overview about the EasyWinWin activities and shows which thinkLets/tools are adopted in the approachThis slide gives an overview about the EasyWinWin activities and shows which thinkLets/tools are adopted in the approach
16. ©USC-CSE 16 Converge on Win Conditions
17. ©USC-CSE 17 MBASE Shared Vision Package-Section 2 of Operational Description 2. Shared Vision
2.1 System Capability Description
2.1.1 Benefits Realized
2.1.2 Results Chain
2.2 Key Stakeholders
Roles, responsibilities, contributions to Results Chain
2.3 System Boundary and Environment
Context Diagram
2.4 Major Project Constraints
Add for Scaling Up
2.5 Top-level business case
2.6 Inception phase plan, resources required
2.7 Initial Spiral objectives, constraints, alternatives, risks
18. ©USC-CSE 18 Software/System Improvement: Tinker AFB
19. ©USC-CSE 19 Improved Cycle Time (Supplier Component)B-1 TPS Maintenance, Tinker AFB
20. ©USC-CSE 20 Software/System Balanced Scorecard: AIS
21. ©USC-CSE 21 Early Defect Removal Results:AIS
22. ©USC-CSE 22 Conclusions So Far System-level Experience Factory provides key to tremendous system productivity, quality, and cycle time gains
Relative to software-only initiatives
Enables transition from SW CMM to CMMI
Some early related examples: Tinker AFB, AIS
CeBASE EF methods and tools facilitate SW CMM to CMMI transition and rapid benefits realizaiton
Specific examples next
23. ©USC-CSE 23 Outline Experience Factory and CeBASE Overview
Example Experience Factory Approach
Example Experience Factory Guidelines
DoD Experience Factory Pilot Program
Questions & Answers
24. ©USC-CSE 24 Example Experience Factory Guidelines Opportunity Trees
Software Dependability
Rapid Application Development
Software Productivity
Overall CeBASE Method Framework
25. ©USC-CSE 25
26. ©USC-CSE 26
27. ©USC-CSE 27
28. ©USC-CSE 28
29. ©USC-CSE 29
30. ©USC-CSE 30
31. ©USC-CSE 31
32. ©USC-CSE 32
33. ©USC-CSE 33
34. ©USC-CSE 34
35. ©USC-CSE 35
36. ©USC-CSE 36
37. ©USC-CSE 37
38. ©USC-CSE 38
39. ©USC-CSE 39
40. ©USC-CSE 40
41. ©USC-CSE 41
42. ©USC-CSE 42
43. ©USC-CSE 43
44. ©USC-CSE 44 Example Experience Factory Guidelines Opportunity Trees
Software Dependability
Rapid Application Development
Software Productivity
Overall CeBASE Method Framework
45. ©USC-CSE 45
46. ©USC-CSE 46
47. ©USC-CSE 47
48. ©USC-CSE 48 MBASE Electronic Process Guide (1)
49. ©USC-CSE 49
50. ©USC-CSE 50 CeBASE Method Coverage of CMMI - I Process Management
Organizational Process Focus: 100+
Organizational Process Definition: 100+
Organizational Training: 100-
Organizational Process Performance: 100-
Organizational Innovation and Deployment: 100+
Project Management
Project Planning: 100
Project Monitoring and Control: 100+
Supplier Agreement Management: 50-
Integrated Project Management: 100-
Risk Management: 100
Integrated Teaming: 100
Quantitative Project Management: 70-
51. ©USC-CSE 51 CeBASE Method Coverage of CMMI - II Engineering
Requirements Management: 100
Requirements Development: 100
Technical Solution: 60+
Product Integration: 70+
Verification: 70-
Validation: 80+
Support
Configuration Management: 70-
Process and Product Quality Assurance: 70-
Measurement and Analysis: 100-
Decision Analysis and Resolution: 100-
Organizational Environment for Integration: 80-
Causal Analysis and Resolution: 100
52. ©USC-CSE 52
53. ©USC-CSE 53
54. ©USC-CSE 54 Application to DoD Software Intensive Systems FY2001
Identify early adopters for pilot application
Tailor Experience Factory, GMQM, CeBASE Method to early adopters’ context
FY2002-3
Operate pilot, train organization in self-application
Expand to increasingly wider usage, self-sustaining operation
55. ©USC-CSE 55 Conclusion System-level Experience Factory provides key to tremendous system productivity, quality, and cycle tim gains
Relative to software-only initiatives
Enables transition from SW CMM to CMMI
Some early related examples: Tinker AFB, AIS
CeBASE EF methods and tools facilitate SW CMM to CMMI transition and rapid benefits realization
Goal-Model-Question-Metric paradigm
Opportunity Trees and their components
MBASE, Results Chains, and Win-Win Spiral Model
Win Win Groupware, Rational tools, COCOMO II Suite
Current opportunity to become pilot early adopter