120 likes | 236 Views
Natural Gaze Behavior (and Gaze-Contingent Interfaces) Max Planck Institute for Biological Cybernetics Tübingen. What is Florian attending to ?. ?. Image courtesy of VIZ-KN. What is Florian attending to ?. ?. Foveal resolution. Image courtesy of VIZ-KN. Project goals.
E N D
Natural Gaze Behavior (and Gaze-Contingent Interfaces)Max Planck Institute for Biological CyberneticsTübingen
What is Florian attending to ? ? Image courtesy of VIZ-KN
What is Florian attending to ? ? Foveal resolution Image courtesy of VIZ-KN
Project goals • Track user’s gaze in realtime • Describe natural gaze behavior on wall-sized displays • Factors that influence gaze behavior • Exploit gaze behavior
Tracking Gaze - Hardware + Videobasedeyetrackers Body motion trackers EyeSeeCam http://www.journalofvision.org/8/14/12/Schumann-2008-jov-8-14-12.pdf
Tracking Gaze - Software(https://www.sourceforge.net/projects/libgaze) • Open-source framework for combining eye-tracking and head-tracking systems • Linux/MacOS/Windowsbasic • implementation in C • APIs in: • jGaze (Java) • pyGaze (Python) • libgazesharp (C#) EyeTracker: Eyelink2 libGaze Application HeadTracker: Vicon Display: Planar
Tracking Gaze – FrameworkHerholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R….
91°/2.2m libGaze evaluationHerholz S., Chuang L., Tanner T., Bülthoff H.H., Fleming R., libGaze: an open-source library for computing gaze in real-time,Journal of Vision. (in preparation) head restrained 74.5°/1.8m 10°= head free Movement Errors Calibration Errors Fixation Errors
1 Describing natural gaze behaviorChuang L., Herholz S., Bülthoff H.H., Fleming R., Unrestrained gaze statistics on natural image processing,Vision Research. (in preparation) FreeViewing CountAnimals Natural task Eye-Head Coordination
What Influences Gaze Behavior ? Rate Attractiveness Count Animals PERCEPTUAL IMAGE COGNITIVE TASK SENSORY CUES
Exploit Gaze Behavior • Multi-modal interfaces (demo in collaboration with HCI-KN) • Facilitate user experience with gaze-contingent actions (DFG proposal with HCI-KN) • Evaluate ‘real-estate’ value of large displays (VIZ-KN) • Overcome computational bottlenecks (CG-Tü)