220 likes | 376 Views
Trust, Trustworthiness, and Trustabilty. John D. Lee Department of Industrial and Systems Engineering University of Wisconsin-Madison. Why consider trust? It seems to make a difference.
E N D
Trust, Trustworthiness, and Trustabilty John D. Lee Department of Industrial and Systems Engineering University of Wisconsin-Madison
Why consider trust? It seems to make a difference http://www.dailymail.co.uk/news/article-1164705/BMW-left-teetering-100ft-cliff-edge-sat-nav-directs-driver-steep-footpath.html
20+ Million lines of code In the navigation system http://spectrum.ieee.org/green-tech/advanced-cars/this-car-runs-on-code
Human-automation interaction architectures Cooperation Reliance Shared resources Automation Human Human Automation Automation Controlled Process Controlled Process Competing goals Automation Human Automation Controlled Process
Lee, J. D., & See, K. A. (2004). Trust in technology: Designing for appropriate reliance. Human Factors, 46(1), 50-80.
Gladwell’s problem with rankings • Stanford’s undergraduate Aeronautics program ranked top 10 in country • More than just a single, context-independent certification of trustworthiness • Trustworthiness of automation • to do what • in what context • in what way http://www.newyorker.com/reporting/2011/02/14/110214fa_fact_gladwell
Lee, J. D., & See, K. A. (2004). Trust in technology: Designing for appropriate reliance. Human Factors, 46(1), 50-80.
Basis of trust Ability Benevolence Trust Integrity Lee & Moray (1992)Mayer, Davis & Schoorman(1995) Purpose Benevolence Process Integrity Performance (M, SD …) Ability Mayer, Davis & Schoorman, 1995, Academy of Management Review
Basis of trust:Surface and depth cues • Depth cues: Algorithm characteristics • Purpose of algorithms relative to what role • Process relative to human: same, optimal, different • Performance and capability and verification for what context • Surface cues: Interface features that should not matter, but often do • Social response to technology, particularly with voice • Color pallet and layout??? • Physiological and social context manipulations(e.g., Liquid trust)
Oxytocin and the physiological basis of trust • Trust governs willingness to take risks in social exchange relationships • People often respond to technology in a social fashion • Factors influencing oxytocin levels may affect trust in decision aids Kosfeld, M., Heinrichs, M., Zak, P. J., Fishbacher, U., & Fehr, E. (2005). Oxytocin increases trust in humans. Nature, 435, 673-676.
Trust in humans Trust in technology • Beyond Purpose, Process and Performance (Benevolence, Integrity, Ability) • Reciprocity: Trusting behavior contingent on trusting behavior of partner • Joint risk: • Trustor at risk for trustee performance • Trustee reputation at risk • Trusting outcomes: Cooperation and reliance • Trust evolves through a dynamic interaction
Lee, J. D., & See, K. A. (2004). Trust in technology: Designing for appropriate reliance. Human Factors, 46(1), 50-80.
PerceptionActionActionPerception Purpose Ability Process Benevolence Trust Trust Performance Integrity Trust influences the information people seek Trust develops not just in response to provided information, but a result of active exploration and experimentation Reliance action
Trustable technology • Beyond trusthworthy to trustable • Coordinate surface and depth features (algorithms and interface) • Display transparency • Making the purpose, process, performance visible • Making the history of purpose, process, performance visible (Role and reputation) • Interactive transparency
Interactive transparency Show a family of suggested routes, not just optimal Show most dissimilar routes routes with similar objective function Interactive objective function (e.g., sliders to adjust weighting of constraints)
Research issues Trust relationships: Reliance, compliance, and cooperation Measures of trust calibration (calibration, resolution, specificity, timeliness…) Trust and trustworthiness in context Creating trustable, not just trustworthy technology Depth features: Match automation algorithms to human process, Maximize performance, or Minimize similarity with human Surface features: Understand when technology engages a social response Enhance display and interactive transparency Support performatory and exploratory automation interactions