110 likes | 308 Views
ISAT Working Group Augmented Cognition Eric Horvitz (Chair), Lee Kollmorgen , Randy Pausch, Paul Rosenbloom , Dylan Schmorrow , Jean Scholtz , Allen Sears, Keith Holcomb, Jack Thorpe November 2000. Apply computation to support / augment human cognition. Challenge and Opportunity.
E N D
ISAT Working GroupAugmented CognitionEric Horvitz (Chair), Lee Kollmorgen, Randy Pausch, Paul Rosenbloom, Dylan Schmorrow, Jean Scholtz, Allen Sears, Keith Holcomb, Jack Thorpe November 2000
Apply computation to support / augment human cognition Challenge and Opportunity Volume of information, overall complexity of defense tasks continue to grow at a rapid pace, in stark contrast to human cognitive abilities, which remain relatively static: Attention Memory Learning Comprehension Sensory bandwidth Visualization abilities Judgment and decision making Planning and control In contrast, computational capabilities have continued to grow rapidly
Today Augmented Cognition Human abilities Computational resources, prowess Timing and Opportunities: Trends
Timing and Opportunities: Trends Augmented Cognition Complexity Information Resources People Tasks Time available
Timing and Opportunities • Leap in computational resources, algorithms • Context sensitivity • Sensors, vision, web connectivity, multiple information sources. • Automated goal analysis • Situation awareness • Context availability • Pervasive computing, technologies supporting mobility
Abilities & efficiencies Concept Attainment Memory Divided Attention Computation Augmented Cognition Efforts • Characterizing inefficiencies, problems, opportunities re: performing critical tasks based on fundamental cognitive limitations • Identify, apply results from cognitive psychology to build computation solutions • Identify new cognitive psychology research • Identify new joint CS—cognitive psychology efforts Target Cognitive Tasks Existing Psychological Results on Cognitive Limitations
Abilities & efficiencies ? Concept Attainment Memory Divided Attention Augmented Cognition Efforts • Characterizing inefficiencies, problems, opportunities re: performing critical tasks based on fundamental cognitive limitations • Identify, apply results from cognitive psychology to build computation solutions • Identify new cognitive psychology research • Identify new joint CS—cognitive psychology efforts Target Cognitive Tasks * New Cog. Psych. Research * HCI, Aug. Cognition Research Existing Psychological Results on Cognitive Limitations
Autonomous learning, exploring, engaging users Level 5 • Proactive, continual computation & exploration • Companion systems Rich understanding, leveraging knowledge about human cognitive capabilities and limitations Level 4 • Enhanced concept acquisition • Lifelong memory agents • Judgment debiasing tools Methods for Fluid Mixed-initiative interaction • Tight, effective collaborative interaction • Natural conversation • 1:n oversight of autonomous systems • Automated fielding of components of problem to user and system Level 3 Computational Solutions to Basic Limitations in Memory, Judgment, Concept Acquisition Level 2 • Context-sensitive reminder systems • Enhanced training tools • Reasoning about interruption, divided attention Leverage Sensing, Inference about Context • Context-Sensitive UI, assistance • Situation Assessment • Respond to commands, requests in appropriate manner Level 1 Augmented Cognition Roadmap
Some Study Directions • Foundations of Augmented Cognition Technologies (FACT) • Mixed-initiative control and monitoring within human-’bot systems • Cognitive power tools for warfighters • Smart ambient companions (SAC) • Information triage and rendering • Dynamic, scalable task organization and execution
Some Study Directions • Foundations of Augmented Cognition Technologies (FACT) • Continue to flesh out challenges and opportunities, scope terrain & directions • Case studies, as appropriate • Cognitive power tools for warfighters • Smart ambient companions (SAC) • Information triage and rendering • Mixed-initiative control and monitoring within human-’bot systems E. Horvitz would chair Seek psychologist as co-chair
Some Study Directions • Mixed-initiative control and monitoring within human-’bot systems • Tasking groups • Strategies for monitoring groups • Extending conceptual foundations of computer—human, human-human interfaces • Attentional issues • Considerations of context, content, goals • Communication under limited resources Paul Rosenbloom would chair.