E N D
1. A Mini Assessment Method For The CMMI (or CMM)Stephen Gristock, Reuters
2. Session Objectives To establish the principles behind assessments and provide an understanding of various assessment options
To establish why (and how) a smaller scale, less formal, assessment methodology should be used
To provide an overview of a proven Mini Assessment method
3. Back To Basics!
4. Capability Maturity Model Integrated Collaborative effort between Software Engineering Institute (SEI) and Industry bodies
Platform representing multiple disciplines: SW, SE, IPPD, SA
Two representations (Staged and Continuous)
Launched Aug’00
V1.1 Current
5. CMMI Maturity Levels & Process Areas (PA)
6. Assessment Principles What is an Assessment?
Objective snapshot against model
Support Process Improvement
Confidential & Collaborative
Provides organizational focus for improvement
7. SEI Appraisal Method Definitions SW-CMM
CAF
CMM Appraisal Framework
CBA-IPI
CMM Based Appraisal for Internal Process Improvement
CMMI
ARC
Assessment Requirements for CMMI
SCAMPI
Standard CMMI Assessment Method for Process Improvement
8. ARC Assessment Requirements CMMI
Broad descriptions across Assm lifecycle
Provides Classes of assessments:
A CLASS (Full- SCAMPI)
B CLASS (Initial/incremental-Mini)
C CLASS (Quick check/self)
9. Applying CMMI During Assessment REQUIRED
Specific/Generic Goals
EXPECTED
Specific/Generic Practices
INFORMATIVE
Sub-practices
10. CMMI Mini Assessment Method(stand by for action!)
11. SCAMPI vs. MINI Greater rigor/depth
Wider scope
Detailed plan
Team (Lead Assessor +4)
Stringent rules of evidence
Mandatory opening, draft
Final presentation to all staff
Ratings and Findings
Registered with SEI
Minimally Invasive/duration
Narrow focus (model/org)
Basic Plan
Smaller Team
Relaxed rules of evidence
Optional opening, draft
Shorter interviews
Concise data consolidation
Presentation to affected staff
PA Calc used
Scores Findings
Not registered with SEI
12. CMMI Mini Assessment Assets CMMI PA Calculator
CMMI Scoring Criteria
CMMI Assessment Guidelines (Conforms to ARC Class B)
13. Basic Assessment Steps
14. Assessment Preparation LOGISTICS
Team (composition, mix, training)
Schedule, facilities, travel, briefings
SCOPING
Planning Info Gathering- project spreadsheet, orgchart
CMMI Levels/PAs, sample projects, interviewees, evidence requirements
15. Data Gathering DOCUMENT REVIEWS
Online
Hard-copy
INTERVIEWS
Cross section disciplines/functions
Question strategy
Survey
COLLECTION
Mini charts
16. Data Consolidation SEQUENCE
Notes
Rules of evidence
CMMI Mini Chart (Observations)
Findings
17. Deliverables PA Scores
PA Calculator : Spreadsheet reflecting CMMI (Staged Representation) L2-L5
Scoring and Comment Fields
Scores (0-10) based on approach & deployment
Presentation/Report
Scores, findings, actions, managers slide, reflect survey results, next steps
18. Scoring Scheme
19. In Practice: A Case Study
20. REUTERS Global Media & Information
~21,000 Employees
Founded 1851
140 Countries
Corporate PI (CMM since 1996)
North American CMMI Pilot
21. The Reuters Experience
24 North American groups (predominantly development) baselined
2 Mini assessments per group p.a.
Reinforced commitment & awareness
Provided focus for change
Provides a mechanism for the exchange of best practice/tools
Enabled identification of centers of excellence
22. Benefits vs. Hazards Benefits:
Less consumptive (assessors & org)
Enables increased frequency of assessments (sustained focus)
Provides granular score rather than binary rating
Hazards:
Less extensive review
Unhealthy focus on scores?
23. Key Points MINI ASSESSMENTS ARE:
Internal
Limited in scope and impact
Smaller duration, teams & sample set
Use a sub-set of the SEI assm methods augmented by additional techniques
Use PA Calculator scoring
Not used to rate or re-rate
Potentially, performed more frequently to assess progress and stimulate PI activity
24. Questions?
Stephen.gristock@reuters.com