290 likes | 433 Views
ASN (RDA) Chief Systems Engineer. DoN PoPS to ICPM Core Common Metrics and OSD DAPS NDIA ICPM. 16 November 2009. DoN Probability of Program Success (PoPS) to ICPM Core Common Metrics and Defense Acquisition Program Support (DAPS). Requested to compare/contrast ICPM and PoPS
E N D
ASN (RDA) Chief Systems Engineer DoN PoPS to ICPM Core Common Metrics and OSD DAPS NDIA ICPM 16 November 2009
DoN Probability of Program Success (PoPS)to ICPM Core Common Metrics and Defense Acquisition Program Support (DAPS) • Requested to compare/contrast ICPM and PoPS • Also looked at DAPS to PoPS
Naval Probability of Program Success (PoPS) v2.0 Program Health PoPS Criteria Scoring (Example) Factors Metrics Criteria • 6 October 2008 PDASN Memo Naval PoPS Guidance: • Required for all DoN Gate Reviews and any time program health is discussed • Standard DoN method of representing the health of all ACAT Programs and any other programs subject to the DoN Acquisition process • Use the methods and tools described in the Naval PoPS Guidebook and supplemental Handbooks • Consistent means to assess program health, criteria adjusts as Program matures • Used for Portfolio Assessments and identification of Department wide systemic issues 3
Predictive Measures of Program Performance Program Health Program Cost & Schedule Supply Chain Performance Requirements Stability & Completeness Technical Performance & Productivity Variance Customer Satisfaction Factors Parts Demand Fulfillment TPM (Summary quick look) Cost Performance Index CPAR Requirements Volatility Schedule Performance Index Award Fee TBD/TBR Burn down Supplier Acceptance Rate TPM Progress/Regress Burn Down Chart Product Performance Requirements Traceability Cum CPI vs. TCPIEAC Supplier Late Starts Software Productivity Baseline Execution Index Risk & Opportunity Management Funding Stability & Contract Health Resources Issues/Help Needed Late/On-time Starts Critical Path Staffing & Critical Skills Risk / Opportunity Summary Program Funding Plan Top 8 IT Readiness Indicators Action Tracking / Burndown Risk / Opportunity relative to MR Physical Inventory, Maintenance, Records, Relief of Stewardship Program Funding Status Critical Skills Risk Mitigation Plan Contract Change Volume Staffing Profile ICPM Core Common Metrics Categories Metrics • Transparency of data to avoid surprises • Clear Understanding of Requirements • Transparency of Technical Performance • Cost / Schedule Performance, Risk Management, Resources, and Supplier Performance • Help Needed Culture – Across All Program Lines and Open Communication Relative to Issues • Clear, Continuous Feedback from the Customer • Under Development by NDIA ICPM • Shared view of program performance by customers and industry • Establishes critical behaviors / techniques for program success • Portfolio management 4
Defense Acquisition Program Support (DAPS) DoD DAPS Program Assessment Pre-Milestone A 3.0 Management 3.1 Acquisition Strategy 3.1.1 Credibility - The program manager (PM) is developing a credible Acquisition Strategy that will provide the basis for meeting program objectives and therefore will be an aid in gaining program acceptance and support. 3.1.1.Q1: How is the Acquisition Strategy realistic? 3.1.1.Q2: Does the program face any of the following pressures, which work against the realism of the Acquisition Strategy? 3.1.1.Q3: How is the Acquisition Strategy stable? 3.1.1.Q4: Are any of the potential causes of instability to the Acquisition Strategy present? Etc. • Defines the PSR approach to assess defense system development programs by the OSD Program Support Team. • not a checklist to be followed rigidly, nor must each assessment address all assessment areas and sub-areas listed. • Tailorable to ensure important areas are not overlooked and comprehensively examined • Includes an extensive list of programmatic and technical factors that are used to build the review plan. Resources Program Performance Mission Capabilities / Req’ts Generation Special Interest Areas Management Technical Process Areas Sub-Areas Budget Sufficiency & Phasing Acquisition Strategy Design Considerations Effectiveness Readiness Levels CONOPs Suitability Knowledge-based Decisions and Milestones Analysis of Alternatives Requirements Development Staffing Level Survivability Program Schedule Overview Capabilities Program & Project Management Technical Baseline Production Engineering Tools Contracting Software Design Verification Supportability Planning Criteria
Key Assessment Areas / FactorsICPM versus PoPS version 2.0 *Particular Criteria and number is dependent on Life Cycle Phase All ICPM Categories and Metrics are included in PoPS Factors and Metrics
Key Assessment Areas / FactorsDAPS versus PoPS version 2.0 *Particular Criteria and number is dependent on Life Cycle Phase
SummaryDAPS versus PoPS DoN Gate Review and DoN SETR Process
Summary • ICPM and DoN PoPS • ICPM appears to serve Executive Level discussions • ICPM assessment factors similar to those in PoPS • However differences in Criteria may be warranted • ICPM – Health of Program from Contractor view • PoPS – Health of Program from Government view • DAPS and DoN PoPS • DAPS is a mix of Executive and Management Level information • DAPS factors covered by • DoN Gate Reviews Core Criteria and PoPS (Exec / Management Level) • Systems Engineering Technical Reviews (SETRs) (Management / Detail Level) • DoN PoPS • Executive Level with input from Management / Detail Reviews (SETR) • Used continuously for life of Program • As input for Major Decision Reviews (Gate and Milestone) • Applicable to All ACAT Programs
Details of Core Criteria and Templates by Gate - URL: https://nserc.navy.mil/asnrda/asn_rda_pops/pops20dev/Step%202%20Draft%20Documents/Forms/AllItems.aspx?RootFolder=%2fasnrda%2fasn%5frda%5fpops%2fpops20dev%2fStep%202%20Draft%20Documents%2f0%20Draft%20Core%20and%20Briefing%20Templates%20in%20Exec%20Staffing&FolderCTID=&View=%7b7AEE306D%2d7B71%2d4326%2d999E%2dDEEC9A1DF241%7d Details of PoPS Criteria and Templates by Gate - URL:https://nserc.navy.mil/asnrda/asn_rda_pops/pops20dev/Step%202%20Draft%20Documents/Forms/AllItems.aspx?RootFolder=%2fasnrda%2fasn%5frda%5fpops%2fpops20dev%2fStep%202%20Draft%20Documents%2fProposed%20PoPS%20v2%20Criteria%20and%20Templates%20in%20Exec%20Staffing&FolderCTID=&View=%7b7AEE306D%2d7B71%2d4326%2d999E%2dDEEC9A1DF241%7d
Resources Assessment ICPM versus PoPS Assessed at DoN Gate Reviews and SETRs
Management Assessment DAPS versus PoPS Assessed at DoN Gate Reviews and SETRs
Technical Process Assessment DAPS versus PoPS Assessed at DoN SETRs Assessed at DoN Gate Reviews and SETRs
Technical Process Assessment DAPS versus PoPS, Con’t Assessed at DoN Gate Reviews and SETRs