290 likes | 298 Views
FCS ACQUISITION & EVALUATION TEAMING. Army Test and Evaluation Command. TT. Cap/Lim By Mission + Unks. Element Level Cap/Lim E, s, s, + Unks. FCS FoS/SoS Cap/Lim E, s, s, + Unks. OT. Data. Core Compl Systems. Joint/ Compl Systems. Sensitivity Analyses By Thread. M&S.
E N D
FCS ACQUISITION & EVALUATION TEAMING Army Test and Evaluation Command
TT Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks OT Data Core Compl Systems Joint/ Compl Systems Sensitivity Analyses By Thread M&S M&S M&S Cap/Lim @ SoS, S, S, + Unks Cap/Lim @ Mission, S, S, + Unks Cap/Lim S, S, +Unks Cap/Lim S, S, +Unks Updated as Systems Mature Evaluation Strategy Elements (Platforms, Networks, …) FCS MISSION MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) Mission Threads (O&O) Decomposition Red Blue Capabilities & Limitations By Mission + Unks
Traditional Acquisition Program Mission Mission Capability Exists Fielded Unit “PROXY” Issues Effective Suitable Survivable, KPP’s COIC’s, ORD Requirements New Equipment
FCS Acquisition Program Mission Relates To Warfighter Needs Relates To Identified Criteria Capabilities Effective Suitable Survivable, KPP’s COIC’s, ORD Requirements New Fielded Unit
ATEC’s Role • Independent Evaluator For FCS • Develop MOEs And MOPs To Support Platform And FoS/SoS Assessment Of: • Specs • ORD Requirements • KPPs • COICs • Address The Capabilities & Limitations Of The FCS Enabled UA Mission Accomplishment • Produce An Evaluation Of Whether The FCS FOS, In The Context Of The UA, Is Effective, Suitable, And Survivable • Work In A Collaborative Environment To Maximize Commonality Of Resources & Ensure The Success Of FCS
Aberdeen Proving Ground, Maryland National Capital Region Warren, Michigan Picatinny, New Jersey Ft. Monmouth, New Jersey Huntsville, Alabama CTO Organization Primary Functional Management Location Director ATEC Deputy Director LSI Deputy Director PMO Deputy Director Analysis Support Evaluation Liaison Cell St. Louis Office System of System Level Test Planning, Integration, & Execution Test Assessment & Reporting M&S/T&E Integration Test Resources Product Assurance & Verification Test Support & Facilities System Level C4ISR Manned Combat Systems Unmanned Ground Systems Unmanned Aerial Systems Lethality/ Munitions Complementary Systems Test Integration Field Offices Ft. Huachuca Ft. Hood WSMR UAMBL YPG
COLLABORATION PROCESS O&O, ORD Combat Developer Defines Scenarios And Vignettes FCS That Meets User’s Needs Within A Shortened Acquisition Cycle Mission Decomposition: Detailed Look at User Intent And How FCS Enabled Unit Of Action Will Fight PM/LSI: SoS Spec, FCS Design O&O, ORD, Spec, Mission Decomp O&O, ORD, Spec, Mission Decomp, T&E Plans ATEC: Evaluation Plan to Assess Capabilities & Limitations Plan Together, Test Once, Share the Data
TT Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks OT Data Core Compl Systems Joint/ Compl Systems Sensitivity Analyses By Thread M&S M&S M&S Cap/Lim @ SoS, S, S, + Unks Cap/Lim @ Mission, S, S, + Unks Cap/Lim S, S, +Unks Cap/Lim S, S, +Unks Updated as Systems Mature Evaluation Strategy Elements (Platforms, Networks, …) FCS MISSION MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) Mission Threads (O&O) Decomposition Red Blue Capabilities & Limitations By Mission + Unks
Platform/FoS/SoS Capabilities/Limitations • MOEs, MOPs Based On COIs, ORD, KPP, AIs • Platform Level • Based On Unique Platform Requirements • FoS/SoS Level • Based On Synergistic Effects Of Multiple Platforms • Focused On FCS’ Contributions To Capabilities • Requires Complimentary Systems To Execute FCS Test • Basis To Determine Capabilities And Limitations At All Levels
TT Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks OT Data Core Compl Systems Joint/ Compl Systems Sensitivity Analyses By Thread M&S M&S M&S Cap/Lim @ SoS, S, S, + Unks Cap/Lim @ Mission, S, S, + Unks Cap/Lim S, S, +Unks Cap/Lim S, S, +Unks Updated as Systems Mature Evaluation Strategy Elements (Platforms, Networks, …) FCS MISSION MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) Mission Threads (O&O) Decomposition Red Blue Capabilities & Limitations By Mission + Unks
Mission Capabilities & Limitations • MOEs, MOPs Based on O&O, ORD, • Based On Live, Virtual & Constructive Events • Utilize Mission Decomposition Process To: • Assist In OT Planning • Correlate Capabilities And Limitations At Platform, FoS & SoS To Required Tasks • Determine Requirements For Force Effectiveness M&S • Focused On FCS Contributions To Mission • Sensitivity Analyses Conducted To: • Determine If Other FCS Or Complimentary Systems May Alleviate Shortfalls In Capabilities Caused By: • Technical Limitations • Environmental Influences (Including Threat Effects) • … • Enable Army Examination Of Alternate Scenarios/ Red Responses
Missions Tasks Mission Decomposition • Achieve air superiority • Destroy WMD capability • Facilitate control of energy centers • Destroy resisting Rebel forces JTF TASKS • Destroy WMD • Seize oil and gas pipelines and prod facilities • Seize the RHC fac of the IFP mil forces • Seize vital infrastructure with min coll damage • Facilitate the transition of power • Destroy Rebel forces in zone JFLCC TASKS • Seize RHC fac with min coll damage • Defeat Rebel forces W&S/W of Baku • Conduct vertical maneuver to Baku UE1 TASKS • Establish multiple FOBs, on order conduct • handover FOB security to 3d BN 504 PIR • Defeat rebel forces W/SW of Baku • Secure OBJ CAMEL UA1 UA1 TASKS • Defeat enemy forces withdrawing to Baku • Seize bridge vic OBJ BISHOP • Conduct air assault with 1 dismounted INF CO CAB2 TASKS
Missions Tasks Task Decomposition • Defeat enemy forces withdrawing to Baku • Seize bridge vic OBJ BISHOP • Conduct air assault with 1 dismounted INF CO CAB2 Tasks TASKS AUTL Task ART 8.1.2 Conduct an Attack TASKS • TA 1 Deploy Conduct Maneuver • TA 2 Develop Intel • TA 3 Employ Firepower • TA 5 Exercise C2 AUTL Sub-tasks TASKS ART 7.2.1 Collect Relevant Information ART 7.2.3 Display COP Tailored to User Needs ART 7.2.5 Disseminate a COP & Execution Info ART 7.2.2 Process Relevant Information to Create a COP Lower AUTLTasks TASKS • Conduct UAV Flight Operations • Conduct GCS (C2V) mission activities • Conduct Autonomous Surveillance MTP Tasks TASKS
FCS Task to Functional Capability Mapping Tasks Capabilities
FCS Functional Capability to ORD Requirements Tasks Capabilities
FCS ORD Requirements to Materiel Capabilities Materiel
UA Level (Mission) UA Mission Capabilities/Lim FoS/SoS Level FoS/SoS Capabilities/Lim Platform Capabilities/Lim Platform Level Capabilities/Limitations Assessed At All Levels JTF Mission JFLCC Task UE Task UA Task FCS Task Platform Task Subsystem Task As defined in O&O Decomposition As defined in COIC, KPP, ORD As defined in ORD, Spec ………
Example Feedback to Be Provided to TRADOC and LSI Systems Engineering as a Result of this Endeavor thus far: • ORD 1215 - ”FCS FoS systems must be capable of automated precision engagements with automated fire control, distribution and clearance procedures with a manual back-up. (Threshold).” Rational paragraph indicates requirement enables “rapid selection of high payoff and most dangerous targets while static or moving”. • SOS Spec - no capability at SOS level in spec for “rapid selection of high payoff and most dangerous targets while static or moving”; only addresses “rapid selection of high payoff and most dangerous targets” in paragraph 3.7.4.2.1.4.1 and 3.7.4.2.1.4.1 for threshold and objective requirements for MCS (ORD 3407) MCS. SOS Spec does not include ORD 3825 which indicates selection of high payoff targets requirement for ICV. • ORD 1159 – “FCS systems must accomplish position/navigation (horizontal and vertical) to a one meter Spherical Error Probable (SEP) with a Low Probability of Detection (LPD)/ Interception (LPI) and in the presence of electronic jamming. (Objective)” • SOS Spec - (3.2.1.3.2) identifies requirement as Objective. Only other references to navigation are 3.2.1.8.15.3.1- kit to enable legacy systems to be interoperable; 3.7.18.1- auto navigation for UAS CL I; 3.7.23.2.1.2.24 – UGS position themselves; directly enables 18 tasks from 3 missions, indirectly enables 37 tasks from 3 missions • O&O (SORC) – Required Capability - Terrain Analysis. ORD addresses in 5.9.2 – no ORD Reference number; addresses in Appendix H, 2.5.1.3.1.1.6; Appendix F, Table 302; Appendix J IERs. • SOS Spec – could not find any reference to requirement for terrain analysis; directly enables 21 tasks from 3 missions, indirectly enables 35 tasks from 3 missions
Applying Mission Decomposition & Capability Mapping to Construct Operational Test Events Sample Application
MCS C2V SUGV NLOS-C UA Missions in OT System Task 1 Task 2 Task 3 Unit Mission Lane Task 1 Task 2 Task 3 Task 1 Task 2 Task 3 SoSIL Unit Mission Lane Larger Unit Mission Lane Task 1 Task 2 Task 3 Task 1 Task 2 Task 3 CL III UAS Task 1 Task 2 Task 3 Unit Mission Lane Task 1 Task 2 Task 3 Live Loop Virtual Loop
RECON MTP 34-5-0041 Conduct UAV Flight Operations MTP 34-5-0052 CGS Mission Activities 1.3.3.1 Conduct Zone Recon Unit Mission Lane MCS MCS ART 7.2.1 Collect Relevant Information ART 7.2.2 Process Relevant Information to create COP C2V C2V ART 7.2.5 Disseminate COP & Execution Information MCS SUGV SUGV ART 3.3.1.1 Conduct Surface to Surface Atk ART 7.2.3 Display COP Tailored to User Needs Unit Mission Lane ART 8.1.2 Conduct an Attack 3.3.1 Conduct Lethal FS ART 7.2.1 Collect Relevant Information NLOS MTP 34-5-0041 Conduct UAV Flight Operations NLOS C NLOS C CL III UAS ART 2.4.1 Conduct Lethal Direct Fire Against a Surface Target ART 7.2.3 Display COP Tailored to User Needs Unit Mission Lane 8.5.1 Attack By Fire an Enemy Force /Position ART 7.2.1 Collect Relevant Information XX-XX Conduct Autonomous Surveillance Sample Task Set Applied OT Model System Task 1 Task 2 Task 3 Unit Mission Lane Task 1 Task 2 Task 3 Task 1 Task 2 Task 3 SoSIL Unit Mission Lane Larger Unit Mission Lane Task 1 Task 2 Task 3 Task 1 Task 2 Task 3 CL III UAS Task 1 Task 2 Task 3 Unit Mission Lane Task 1 Task 2 Task 3 Live Loop Virtual Loop
TT Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks OT Data Core Compl Systems Joint/ Compl Systems Sensitivity Analyses By Thread M&S M&S M&S Cap/Lim @ SoS, S, S, + Unks Cap/Lim @ Mission, S, S, + Unks Cap/Lim S, S, +Unks Cap/Lim S, S, +Unks Updated as Systems Mature Evaluation Strategy Example Platforms FCS MISSION MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) MOPs/MOEs Platform Level (ORD, Spec) Mission Threads (O&O) Decomposition Red Blue Mission Delayed Awaiting Ground Sensor for NLOS Capabilities & Limitations By Mission + Unks UAV Cannot Be used as Sensor for NLOS in the precision mode UAV TLE =120M NLOS = 25M CEP Comanche Provide Location Accuracy for NLOS
TT Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks OT Data Core Compl Systems Joint/ Compl Systems Sensitivity Analyses By Thread M&S M&S M&S Cap/Lim @ SoS, S, S, + Unks Cap/Lim @ Mission, S, S, + Unks Cap/Lim S, S, +Unks Cap/Lim S, S, +Unks Updated as Systems Mature Evaluation Strategy Example Platforms FCS MISSION MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) MOPs/MOEs Platform Level (ORD, Spec) Mission Threads (O&O) Decomposition Red Blue Manned Grnd Vehicle Protection Limited to 14.5mm Capabilities & Limitations By Mission + Unks Network Provides Enemy Location to Commander Prior to Engagement Enemy Destroyed Out of Contact WIN-T/JTRS Provides Connectivity UAV Provides Enemy Location
The Road Ahead • TRADOC Complete Decomposition of 1st Mission • TRADOC, ATEC, PM/LSI Identify M&S Requirements • Develop Common Database For All Stakeholders • Identify All T&E Events • Include All Measures For Evaluation • Capabilities and Limitations Based • Evaluation of Data and Confidence Levels Continuously Updated
FY2011 FY2012 FY2013 FY2003 FY2004 FY2005 FY2006 FY2007 FY2008 FY2009 FY2010 FY2002 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Q1 Q2 Q3 Q4 FOC UA 1.6a MS B Facilitization IOC UA(-) W/ILOs SoS CDR SoS PDR SFR LL IPR Waiver Initial Production Decision LFT - FUSL System of System Testing Production Spec Verif / Integr Qual Testing -SDD Spec Verif / Integr Verif Testing - Prod SoSIL Dev IP P1 Integration Integration IT/UT IT/UT IP S1 Assessment TRR TRR Init Sys Deliveries Assessment IP S2 IP P2 IP P2 Sims Deliveries ASARC Integration Integration CTD IT/UT IT/UT TRR Assessment Assessment Demos Init Sys Deliveries TRR Early Emulators Deliveries IP S5 ** IP S3 SDD Integration Integration IMT Integration IMT Assessment TRR Assessment IT/UT Assessment Init SW Deliveries TRR TFT#P1 TFT#P2 LUT3 IP S4 IOT FDTE Init DP PIs Deliveries Integration OE/CE OE/CE IT/UT Assessment TRR Log Demo Continuous Evaluation Init Sys Deliveries TFT#S4 TFT# S2 TFT# S3 LUT2 LUT1 ** SW Testing only Log Demo Log Demo Integrated Evaluation Process Alt 5A v12 4-13-03 FCS Test Program Schedule
HWIL • MIL • Digital • SWIL • SILs • PRO-E • BRL CAD • Element Level Models • Mobility (NATO Reference Model) • C4.(Comms, COP, FIRES) • ISR/Fusion • Synthetic Environment • Behavioral • Environ (Atmosphere, Propagation) • Threat (behavior, Platform, Signature) • Observable(Obscuration, Wx, Signature) Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks Joint/ Compl Systems Core Compl Systems Sensitivity Analyses By Thread HWIL MIL Digital SWIL SILs SoSIL Wrap-Around Sim SoSIL Wrap-Around Sim Federated Battle Labs Force-On-Force M&S M&S In Support of Evaluation Elements (Platforms, Networks, . . . ) MISSION FCS MOPs/MOEs Element Level (ORD, Spec) MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) Mission Threads (O&O) Decomposition Red Blue Capabilities & Limitations By Mission + Unks Updated as Systems Mature
Cap/Lim By Mission + Unks Element Level Cap/Lim E, s, s, + Unks FCS FoS/SoS Cap/Lim E, s, s, + Unks Platform Level, Embedded Core Compl Systems Joint/ Compl Systems Sensitivity Analyses By Thread RTCA, Field Data Collection Systems, Large Scale Data Integration RTCA, C3 Driver, Embedded, Field Data Collection Systems Updated as Systems Mature Instrumentation & Facilities In Support of Evaluation Elements (Platforms, Networks, etc.) FCS MISSION MOPs/MOEs FoS/SoS Level (ORD, Spec, KPP, COIC) MOPs/MOEs Element Level (ORD, Spec) Mission Threads (O&O) Decomposition Red Blue Capabilities & Limitations By Mission + Unks