180 likes | 327 Views
Automation Surprises. Sarter , Woods, & Billings, 1997. Anticipated Benefits & Problems. Benefits Quantitative aspects Reduced workload Reduced operational costs Increased precision Fewer errors Problems Need more training Too much reliance on automation
E N D
Automation Surprises Sarter, Woods, & Billings, 1997
Anticipated Benefits & Problems • Benefits • Quantitative aspects • Reduced workload • Reduced operational costs • Increased precision • Fewer errors • Problems • Need more training • Too much reliance on automation • Presentation of too much information
Unexpected Problems • Workload • Unevenly distributed, not reduced • Time • Users • Referred to as “clumsy automation” • Quality of workload is affected • Require users to perform sustained attention tasks
Unexpected Problems • New Attentional and Knowledge of Demands • Operators have gaps or misconceptions in their model of a system • Input-output relationships • “Inert” knowledge problem • Unable to apply knowledge • Operators are “miscalibrated” with their understanding of the system • Overconfidence • Inadequate feedback
Unexpected Problems • Breakdowns in Mode Awareness • Advanced technology creates a complex system with many different modes • Mode errors occur due to automation • Occurs most in non-normal or time pressured situations • New Coordination in Demands • Developers assume machine activity replaces human activity • Substitution myth • Automation changes the system dynamics • “Decompensation incident” • Automation compensates for a fault up to a point
Unexpected Problems • Need for New Approaches to Training • More training time isn’t the answer • Nature of the training is what needs to change • Training to create a mental model of the system • Encourage active exploration of the available options and dynamics of the automation
Unexpected Problems • Complacency and Trust in Automation • Situations that occur frequently can cause complacency • “The design of the joint human-machine system has created a role where people must monitor for rare events- a sustained attention task.”
Automation Design Technology-Centered Human-Centered • “Science finds, industry applies, man conforms” • Attempts to modify people • Training • More technology to eliminate the need for human activity • “People propose, science studies, technology conforms” (Norman, 1933) • Focuses on the Human-machine system
Humans: Still Vital After All These Years of Automation Parasuraman and Wickens, 2008
Overview • Focused on three major “discoveries and developments” • Levels and Stages of Automation • Reliance and Compliance with Automation • Adaptive Automation
Levels & Stages of Automation • Stage 1 - Information acquisition • High LOA (Level of Automation) • Filtering – certain items are brought to user’s attention, and some are hidden • Medium LOA • Organization of incoming data • Stage 2 - Information analysis • Supports working memory, situation assessment, diagnosis, and inference • Used for predictions to show future state of the system
Level & Stages of Automation • Stage 3 - Decision Making • Automation based on “if-then” rules • Medical or Aviation fields • Stage 4 – Action • High LOA when under extreme time pressure • More complicated than the first two stages because they must take into account costs and values of the possible outcomes • High risk automation should generally have low LOA at the stages 3 and 4. • To allow user input into decision making
“Information automation may promote superior performance than decision automation because the user must continue to generate the values for the different courses of action”
Reliance & Compliance • Use of automation is dependent upon trust • Based on the type and frequency of faults • Low level of trust • Users have more confidence in themselves and will not use automation • High level of trust • Leads to overreliance on automation • Complacency
System reliability • Setting the threshold is very important • Signal Detection Theory • Can be hurt by many misses or false alarms
Adaptive Automation • Vary function allocation during system operations • Reduces workload when operators are overwhelmed • During low task load, operators can be brought back in to perform previously automated tasks • Reduce complacency • Boost situational awareness
Adaptive Automation • Implementation • Measure operator physiological states • Have the operator remain in charge of adaptive changes, and have them decide when to use automation • What do you think of these possible methods?