Continuous Appraisal Method (CAM): A New Paradigm for Benchmarking Process Maturity

1. Continuous Appraisal Method (CAM): A New Paradigm for Benchmarking Process Maturity Marvin Carr Lockheed Martin Mission Systems – Systems and Software Resource Center and W. Neil Crowder Lockheed Martin Information Systems

2. Why A New Method? • Continuous Process Improvement applies just as much to process maturity appraisal methods as to organizational processes • There has been a good deal of recent discussion on improving the current process maturity appraisal method – the CMMSM Based Appraisal for Internal Process Improvement (CBA IPI) • The opportunity for change is now…Systems Engineering is coming under the CMMI umbrella

3. Improvement Opportunities • Make appraisals less expensive • Make appraisals less invasive to the organization and projects • Help focus organizations on Continuous Process Improvement as opposed to a special event “test” • Get more improvements as a direct result of the appraisal

4. Improvement Opportunities • Create a cooperative non-adversarial relationship between the appraisers and participants • Address the perception of “cherry-picking” appraisal target programs • And…ensure the depth and credibility of the appraisal is not diminished (preferably enhanced)

5. The CAM Process Repeat for All Programs Congrats, You’re Organization is Level ___ !!!! Assess Process Assess Process Maintenance • Organization • 3-4 Target Programs • All Focus Areas • All Specific Practices Improve Process Document Discrepancies

6. Key Features of CAM • Based on accepted systems engineering practices of: • Build-a-little/test-a-little • Regression testing • Fully compliant with EIA/IS 731.2 • Performed over an extended period of time • Each project is reviewed at the Specific Practice level…SP by SP • Method is non-adversarial…the only way to fail is to not correct deficiencies

7. Key Features of CAM • Appraisal Team is made up of a minimum of two people (consistent with CBA IPI technique of 2-person “mini-teams”) • Independent Appraisal Team Lead • Organization’s Process Owner • No preparation time for projects • No objective evidence library to build • Participants don’t “study the test” • No practice interviews • Project personnel are incentivized to participate AS additional critical reviewers

8. Key Features of CAM • Appraisal team reviews all (100%) SPs • Objective evidence is reviewed • by the appraisal team in preparation for the appraisal, and • with the practitioners at the practitioners workstation during the appraisal • Action items are assigned and tracked to correct process deficiencies • Successful completion of an SP occurs after all action items have been signed off by the independent Appraisal Team Lead

9. Key Features of CAM • A maintenance review is performed when all SPs in all FAs have been successfully addressed …are the projects maintaining the processes as an entire set? …are the projects continuing to perform the processes as assessed? …no “surprises”

10. What Are the Drawbacks? • Must maintain a consistent appraisal team • Lead assessors must commit to returning visits for an extended time • Organization must keep the appraisal as a top priority for an extended time • Requires the organization to adopt an on-going (continuous) commitment to process improvement

11. Summary • For organizations committed to Continuous Process Improvement, CAM provides a high value added, non-adversarial, process maturity appraisal method at reduced cost • For more information concerning CAM contact: Marvin CarrLockheed Martin Mission Systems Systems and Software Resource Center9211 Corporate BlvdRockville, MD 20850(301) 640-2444marvin.carr@lmco.com