230 likes | 354 Views
Multi-dimensional Clustering Analysis Ex: Cluster on Information. Location(A/C). ID(Track). Review_ID_Indicators. Conduct_DCA_Intercept_&_Escort. Control DCA. Issue_DMZ_Violation_Report. Location(Track). Engagement_order. Issue_Level_1_Query. Respond_to Air_Threat.
E N D
Multi-dimensional Clustering AnalysisEx: Cluster on Information Location(A/C) ID(Track) Review_ID_Indicators Conduct_DCA_Intercept_&_Escort Control DCA Issue_DMZ_Violation_Report Location(Track) Engagement_order Issue_Level_1_Query Respond_to Air_Threat Conduct_Threat_Assessment IFF(A/C) Range(Track,USN_Ship) Conduct_Engagement_with_Birds Clear_Aircraft_Departing_CV Engagement_solution IFF(Track) Information features • Goal: Maximize information within watchstanders; minimize info overlap when unnecessary • Conduct_DCA & Control_DCA use similar info; Review_ID & Conduct_engage-ment do not. Info Task
Phase D: Engineering Team Interactions Information Variables Decision Variables Action Variables Outcome Variables • Uniquely assign tasks when possible to minimize routine communications between team members • May need to split tasks if individuals are overloaded • Detailed Modeling Tool: Note: Splitting tasks introduces new communication workload
Intra- and Inter-Task Analysis Engage_with_Birds Respond_to_air_threat Firing Solution Weapons Initiate/Confirm Engage Order no longer a go Away Yes System Status Weapons Away (Y/N?) Track is Firing Solution NOT covered Track’s visual still a go Yes display profile Track is covered (Y/N?) ‘Weapons Ring’ Msg Track Verbal Report Kill Yes ‘Issue Track Report’ Msg Release Missiles Engage Orders Kill Evaluation (Y/N?) Track is covered Initiated Engagement Order Firing Solution In - bound In - bound ‘Initiate/Confirm still a go (Y/N?) Missile (Y/N?) ‘Kill Evaluation’ Msg msg missile Engagement’ Msg Track’s meeting Initiate Engage Orders (Y/N?) System’s moving Weapons ROE (Y/N?) 2 ROE twds releasing Weapons (Y/N?) Away No Engagement Solution System’s moving ‘Produce Engagement Track’s failure to twds releasing Weapons Engagement Status Solution’ Msg respond to Level II Warning System’s failed in Track’s approaching Engage Orders 3 moving twds releasing its weapons range (Y/N?) NOT Initiated Weapons Track’s failure to respond to Illumination Evaluate_threat Intra- and inter-task analyses suggest opportunities to combine tasks into roles INFORMATION Variables INFORMATION Variables DECISION Variables DECISION Variables ACTION Variables ACTION Variables OUTCOME Variables OUTCOME Variables
Example Objective: Balancing Workload in the Team Instant Workload Threshold 0 Objective 1: Workload Accumulation Balance DM1 DM2 DM3 DM4 DM5
Notional Workload Analysis Team Leader 1 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601 Information Coordinator Watchdog 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601 Battle Manager Air Coordinator - 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601 101 201 301 401 501 601 701 801 901 1001 1101 1201 1301 1401 1501 1601
Outline of Presentation • Value of modeling C2 Organizations • Prescriptive vs. descriptive modeling • Model-Based Experimentation • TIDE modeling approach • C2 Design Example: AWACS • How to use TIDE products
AWACS Design Challenge How do you design an optimal command & control teams for complex, variable AWACS missions to take advantage of advanced information fusion technology? TIDE Design Approach • Mission analysis • What needs to be done • What information is available • Task analysis • How is it done • What information is used • Organizational analysis • How is information shared • Who does what
Example: AWACS Crew Optimization • Human-Centered Re-Engineering of AWACS Command and Control Teams (REAC2T) • Phase III SBIR Project funded by AWACS System Program Office ESC, Hanscom AFB • Demonstrate proven, scientific approach to C2 team design in AWACS domain • Team Integrated Design Environment (TIDE) • Present ACC/Wing with proof-of-concept for crew optimization • Evaluate impact of information fusion on mission performance and operator functions • Introduce optimized team structures to enhance mission performance
AWACS Example: Inputs to Mission Model • Mission decomposition and evaluation • Work with operational community to define current approach to mission completion • CONOPS, tactics, roles, and responsibilities • Red Flag Spin-Up Training • Tinker AFB • Live Fly Red Flag Exercises • Five flights, Nellis AFB • Cognitive Task Analysis • Wing Tactics Office, Tinker AFB • SD instructors Fighter Weapons School, Nellis AFB
TIDE Prototype Software • Mission & task graphs are converted into data tables to serve as input for optimization algorithms
Preliminary Results: Baseline 14 Operator Task Distribution Max Workload = 1400 Colors represent unique operational tasks
Impact of Technology (MSI) Insertion:Non-Optimized 14 Operator Configuration Max Workload = 950 Colors represent unique operational tasks
Impact of Technology (MSI) Insertion:Optimized 14 Operator Configuration Max Workload = 750 Colors represent unique operational tasks
Impact of Technology (MSI) Insertion:Optimized 12 Operator Configuration Max Workload = 800 Colors represent unique operational tasks
Internal Communication: Outgoing Messages 120 160 500 140 140 100 450 120 400 120 80 350 100 100 300 Outgoing Messages Outgoing Messages Outgoing Messages 60 80 80 Outgoing Messages 250 60 200 60 40 150 40 40 100 20 20 20 50 0 0 0 0 MCC SD STK OCA Chk_In HVAA STK_Ast OCA_Ast ASO ECO AAST AST_1 AST_2 AST_3 MSS W1S W2 W3 W4 W5 W6 S1S S2 S3 S4 S5 MCC SD STK OCA Chk_In HVAA STK_Ast OCA_Ast ASO ECO AAST AST_1 AST_2 AST_3 MCC SD STK OCA Chk_In HVAA STK_Ast OCA_Ast ASO ECO AAST AST_1 AST_2 AST_3 DMs DMs DMs DMs Baseline MSI Non-Optimized 14 160 500 1. Technology Insertion 2. Optimal Team MSI Optimized 14 MSI Optimized 12 3. Manning Optimization
Summary: Model-based Re-Engineering of AWACS Command & Control Teams (REAC2T) 12 10 Faster Teams 8 Average Task Delay (seconds) 6 4 2 Task Model 0 Baseline New Tech Only New Tech + Optimized 1 New Tech + Optimized 2 Crew Configuration • Re-engineering based on AWACS mission task models • Scientific C2 team design approach to AWACS domain: TIDE -Team Integrated Design Environment • Org. design for new technology insertion and optimized manning
Outline of Presentation • Value of modeling C2 Organizations • Prescriptive vs. descriptive modeling • Model-Based Experimentation • TIDE modeling approach • C2 Design Example • How to use TIDE products
TIDE Model Products Team Descriptions 4.0 CAS (8) CV (1) TARP (1) 4.1 4.2 4.3 Rifle Co (3) Rifle Co (3) Stinger (1) Cobra (2) Cobra (2) Stinger (1) 4.2.1 4.2.2 Eng . (1) Eng . (1) MED (1) MED (1) MCM (1) MCM (1) CG(1), DDG(2) VF(8), FFG(2) Mapping of Tasks to Team Members Performance Predictions Detailed Specification of Team Roles: • When Tasks are performed • How Decision are made • What Resources are used • What Information is used • What Communications are required
Multiple Applications of TIDE Model Tide Input Model IDAO Decomposition IDAO Decomposition Event Event - - Task Mapping Task Mapping I19 - Mission requirements and priorities A22 - Monitor the T36 - Maintain air picture accurate track / T95 - Monitor Organizational Design Mission Decomposition Task Decomposition symbology airspace I49 - Fighter correlation weapons T19 - Fuse data status from multiple sources to locate T42 - Make picture objects (detect) calls TCTC Mission TCTC Mission TCTC Mission TCTC Mission D4 - Decide I17 - how to use T22 - Interpret / Intelligence available air AND Filter information Operate MCS systems Operate MCS systems Operate MCS systems Operate MCS systems data and ground T86 - Provide Record keeping Record keeping Record keeping Record keeping resources target location Surveillance/detect Surveillance/detect Surveillance/detect Surveillance/detect T20 - Utilize air objects air objects air objects air objects Manage ATO execution Manage ATO execution Manage ATO execution Manage ATO execution organic radar data OR AND Training Programs ID/track air objects ID/track air objects ID/track air objects ID/track air objects I41 - Fighter fuel status Create/maintain recognizable Create/maintain recognizable Create/maintain recognizable Create/maintain recognizable A31 - Target the T43 - Respond to T102 - Receive Pass/receive information Pass/receive information Pass/receive information Pass/receive information & integrated air picture & integrated air picture & integrated air picture & integrated air picture threat requests for information from information (RFI) pilots Respond to threats Respond to threats Respond to threats Respond to threats C2 Process Re-engineering I51 - Threat/ target Airborne (C2 of airborne assets) Airborne (C2 of airborne assets) Airborne (C2 of airborne assets) Airborne (C2 of airborne assets) ATSO (self preservation) ATSO (self preservation) ATSO (self preservation) ATSO (self preservation) T24 - Provide all T56 - Receive location available amplifying mission effectiveness O14 - Commit pair ASK FOR INPUT ASK FOR INPUT ASK FOR INPUT ASK FOR INPUT information (tracks) / BDA fighters to ATSO to ATSO to ATSO to ATSO (self (self (self (self - - - - preservation) preservation) preservation) preservation) Define Threats Define Threats Define Threats Define Threats Monitor system for jamming Monitor system for jamming Monitor system for jamming Monitor system for jamming Decide to engage or not Decide to engage or not Decide to engage or not Decide to engage or not T47 - Distribute mission status Respond to pop Respond to pop Respond to pop Respond to pop - - - - up targets up targets up targets up targets Analyze system resources Analyze system resources Analyze system resources Analyze system resources Respond to Threats Respond to Threats Respond to Threats Respond to Threats to to to to locate locate locate locate jammers jammers jammers jammers while while while while Monitoring system for jamming Monitoring system for jamming Monitoring system for jamming Monitoring system for jamming Identify Identify Identify Identify Threat Threat Threat Threat Execute electronic counter Execute electronic counter Execute electronic counter Execute electronic counter Direct weapons Direct weapons Direct weapons Direct weapons to target/threat to target/threat to target/threat to target/threat Locations Locations Locations Locations measures measures measures measures while Monitoring while Monitoring while Monitoring while Monitoring system for jamming system for jamming system for jamming system for jamming Identify Identify Identify Identify Threat type Threat type Threat type Threat type Broadcast Broadcast Broadcast Broadcast jammer jammer jammer jammer location location location location while Monitoring system while Monitoring system while Monitoring system while Monitoring system for jamming for jamming for jamming for jamming Time on Target (ToT) Intelligent Agents Synthetic Task Environments Interface Design
Model-driven Measurement Process Success in Meeting Training Objectives How well are training objectives met? Learning Objectives Success at JTF; Certification in JTF Environment Measurement Improve by X% Challenges Competencies: KSA Assessment Knowledge, Skills, Individual What KSAs do learners have/lack? and Abilities Team Diagnose individuals’ needs for additional training Team-of-Teams Stimulated or Trained by... Performance Measures by Task Tasks How well did learners perform? Theories of Performance Link Skills to Behaviors to Tasks Put together into vignettes... Scenario Stories and TIDE Model MOPs & Measurement Tools events Subject Matter Experts
User/SME input and review Organizational Structure Decision-Maker Model Task, Assess Task Platform platform needed Task, Assess Platform need to request Receive platform Platform, Task, Team Optimal Design (TOD) status DM Platform Platform, DM Task Hierarchy Mission Analysis T 50 60 70 80 90 100 R DM Leader 79.7 Mission Outcome 85.1 Sub 1 76.2 Sub 2 Sub 3 Computational Organization Model TIDE Integrated Toolset Task Network Simulation SIMULATION-BASED EVALUATION ANALYSIS DESIGN
Some Current Military Applications of the TIDE Modeling Methods and Tools • Joint Task Force Adaptive Architectures for Command and Control (A2C2) • Next Generation Navy Surface Ships (SC-21/DD-21) • Human-Centered Re-Engineering of AWACS Command and Control Teams (REAC2T) • Uninhabited Combat Air Vehicle (UCAV) Control Center • Kwajalein Radar/Missile Control Center (ATIDS) • Air Operations for Time Critical Targets (JFACC) • Time Critical TargetingCell in Air operations (CAOC) • Effects-Based Operations in Operations Center (EBO) • Army Future Combat Systems (FCS) • Global Wargame JTF Org. Design and Assessment • ….
Summary: Why Model C2? • TIDE is a method to optimize decision-making organizations to capitalize on advanced technology • Model-based organizational structures are “congruent” with mission needs • Modeling guides experimentation and performance assessment • Analysis and design tool for system designers • Cost and risk reduction • New technology payoffs • Mission/organization model serves multiple purposes • Organizational design: Provide alternative, optimized organizations • Team training: Highlight areas for team training • Synthetic tasks: Develop environments to train and evaluate teams • Interface design: Functional definition of GUI