DTM 11-003 R&M Engineering Implementation Strategy Andrew Monje

1. DTM 11-003 R&M Engineering Implementation Strategy Andrew Monje Deputy Assistant Secretary of Defense, Systems Engineering Office of the Under Secretary of Defense (Acquisition, Technology and Logistics) 16 Aug 2011

2. Purpose / Agenda PURPOSE • Provide overview of the R&M Implementation Strategy upon approval of DTM 11-003 AGENDA • DTM Overview • Policy Implementation - DTM 11-003 • Process - Guidance & Standards/DIDs • People - Human Capital • Summary • Open Discussion

3. Engineering activities (AS to describe tasks and processes to be stated in the RFP) R&M Allocations, block diagrams and predictions Failure definitions and scoring criteria Failure Mode, Effects and Criticality Analysis (FMECA) Built-in test and maintainability demonstrations Reliability Growth testing at system/subsystem level Failure Reporting, Analysis and Corrective Action System (FRACAS) Preliminary RAM-C Report in support of MS A and updated for MS B & C Provides early (Pre-MS A) reliability, availability, maintainability and ownership cost feasibility assessments of alternative concepts Includes early formulation of maintenance & support concepts Provides an audit trail that documents and supports JCIDS thresholds Ensures correct balance between the sustainment metrics (Availability-KPP, Materiel Reliability-KSA, and Ownership Cost-KSA) Provides early risk reduction by ensuring requirements are realistic and correct AS and SEP to specify how the JCIDS sustainment thresholds have been translated into R&M design requirements for use in contract specifications DTM 11-003 Overview

4. DTM 11-003 Overview • Reliability Growth Strategy • Documents system-level reliability growth curves in the SEP beginning at MS A and updated in the TEMP beginning at MS B • Establishes intermediate goals for reliability growth curves that will be tracked through fully integrated system-level test and evaluation events until the threshold is achieved • Requires MS C PMs and Operational Test Agencies to assess reliability growth required to achieve the reliability threshold during Initial Operational Test and Evaluation • Tracking and Monitoring • Requires PMs to report status of reliability objectives and/or thresholds as part of the formal system engineering review process • Incorporates Reliability Growth Curves into the Defense Acquisition Executive System (DAES) review process

5. Policy Implementation DTM 11-003 DoDI 5000.02 Encl(6) Test Technology Development Strategy/ Acquisition Strategy Preliminary Design Review Report DAES Quad Chart Test & Evaluation Master Plan (TEMP) Life-Cycle Sustainment Plan DoDI 5000.02 Encl(13) Lifecycle Logistics Systems Engineering Plan (SEP) DTM to Policy and Acquisition Document Relationships • Incorporating DTM in DoD 5000 and affected Governance Documents • DoDI 5000.02 & enclosure 12 (SE) revision – Complete & sent to DPAP • Enclosure 13 (Logistics) – Comments provided to L&MR • Systems Engineering Plan Outline – Approved • Acquisition Strategy Outline – Approved • Preliminary Design Review Report Guideline – Completed • TEMP outline – Currently in review • LCSP outline – In work • DAES RVW Growth Quad chart – In work Encl(12) System Engineering DTM 11-003 3/21/11 Status: In review/In-work Approved

6. Annotated Outlines for TDS/AS, SEP Released as “Expected Business Practice” Systems Engineering Plan Annotated Outline TDS/AS and SEP outlines signed April 20, 2011 Technology Development Strategy [or] Acquisition Strategy Annotated Outline April 20, 2011 http://www.acq.osd.mil/se/docs/PDUSD-ATLMemo-Expected-Bus-Practice-TDS_AS_SEP-20Apr11.pdf

7. R&M in the TDS/AS • Identify the engineering activities to be stated in the RFP and required of the contractor to demonstrate the achievement of the reliability and maintainability design requirements. • Provide a table (see example below) to specify how the sustainment key performance parameter thresholds have been translated into reliability and maintainability design and contract specifications … The reliability threshold is often expressed as Mean Time Between Failure (MTBF). Use the appropriate life units (e.g., hours, cycles, etc.). “MTTR” is “mean time to repair;” “N/A” may be entered if an item is not applicable.

8. New Reliability Reporting Document the Reliability Growth Curve beginning at MS A, updated at each successive milestone, … Implementation of New Reliability Policy and report planning to generate R&M artifacts.

9. Process - Guidance & Standards/DIDs Key R&M Engineering Standards & DIDs DAG LM&R Chapter 5 Updates • Update to DAG Chapter 4 R&M Sec 4.4.15 • Include overview of R&M Eng Activities by phase • Apply R&M Eng activities based on program position in Life Cycle • Also based on acquisition strategy and equipment type • Provides guidance on Reliability Growth Program • Includes R&M contract guidance with associated DIDs • Collaborate with DAG Editors (i.e., to ensure R&M guidance is properly integrated • Develop R&M Engineering Guidance with task descriptions per phase • Describes R&M engineering activities across typical program areas • Forming R&M Standards working group • Priority given to standards that directly relate to the R&M engineering activities required by the DTM • R&M Eng Mgt STDs 1st (i.e. 785, 470, & 2165) • Design & Reliability Growth STDs (i.e. 1629, 1635) Defense Acquisition Guidebook DAG SE Chapter 4 Updates R&M Engineering Guidebook DAG DDT&E Chapter 9 Updates

10. Materiel Solution Analysis Phase MS A MDD AOA DOD 5000.02 LIFECYCLE ENTRY ICD TES SEP ITR TDS ASR Draft CDD MS-A PHASE FUNCTIONS 1 2 12 15 19 2 1 23 RAM-C REPORT SUMMARY R&M PLANS TECHNOLOGY DEV PHASE INPUT TO SEP PM PLAN PROGRAM REVIEW ICD R&M PLANS MSA PROJECT CONTROL (SECT. II) 3 16 R&M DATA RQMTS UPDATE R&M DATA RQMTS DATA CONTROL(SECT. III) 8 17 CONFIG MGMT. TECH DEV SYSTEM SPEC CONFIGURATION MANAGEMENT (SECT. IV) 7 10 18 A ACCEPT SYSTEM ENGINEERING (SECT. V) R&M RQMTS. ANALYSES TRADEOFF STUDIES R&M ANALYSIS REPORTS 9 11 REJECT MAINT. ANALYSIS LIFE CYCLE SUSTAINMENT PLAN LOGISTICS PLANNING (SECT. VI) 13 INPUT TO TES TEST AND EVALUATION (SECT. VII) 4 5 6 14 20 22 GOV TASK ASSIGNMENT PR & RFP FOR MSA REVIEW CONTRACT INPUT TO TDS PR/RFP TECH DEV PHASE PROPOSAL EVAL CRITERIA PROCUREMENT (SECT. VIII) FUNCTIONAL BASELINE

11. PeopleHuman Capital R&M Engineering E&T Strategy • Objective: Increase PM demand for R&M Engineering and enhance R&M Engineering professional capabilities to successfully implement a R&M program. • Approach • Define R&M Engineering tasks • Develop R&M Engineering competencies for PM and R&M Engineers • Submit R&M competencies to DAU for curriculum development via SE FIPT chair • DAU develops training architecture, curriculums, training content and delivers training. Capture/Define R&M Engineering Tasks and Associated Roles Define R&M Engineering Competencies For Associated Roles (incl. KSAs) Define R&M Engineering Learning Architecture (e.g. CLMs, SPRDE/SE Courses & R&M Competencies Integration, Dedicated R&M Courses) Develop and Deliver Training

12. Summary • Actively engaged on all Focus Areas to improve “Technical Health” of R&M Engineering • Institutionalizing the process across the Services • Collaborating with other functionals (e.g., test, logistics …) • DTM implementation will: • Not burden the programs with unreasonable expectations • Not drive a “One Size Fit All Solution” on programs • Smartly apply engineering activities based on acquisition strategy & life cycle position