1 / 12

“EyeMouse”: An interaction device for severely motor-disabled people

“EyeMouse”: An interaction device for severely motor-disabled people. Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University of Florence. EyeMouse. Human-machine interaction system replacing the mouse with eye movements.

hart
Download Presentation

“EyeMouse”: An interaction device for severely motor-disabled people

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. “EyeMouse”: An interaction device for severely motor-disabled people Carlo Colombo, Massimiliano Corsini Media Integration and Communication Center University of Florence

  2. EyeMouse • Human-machine interaction system replacing the mouse with eye movements • Designed to exploit the residual mobility of severely motor-disabled people (e.g. multiple sclerosis)

  3. Interaction • User eye movements are captured through computer vision… • …and then transformed into commands for the on-screen PC interface CVInterpreter Interface commands Live camera images User Screen action feedback

  4. Eye capture • External eye and iris are captured by elastic template matching (snakes) Snake template Iris (circle) external eye (ellipse)

  5. Eye remapping Image plane Screen plane • The iris position in the image is remapped onto the screen plane • The image-to-screen map is calibrated at startup

  6. Mouse functionalities • Navigation: eye movements • Selection: eye persistence, eye blinks • Interface feedback compensates for slight remapping errors

  7. “X” movement

  8. “O” movement

  9. Current work • Accommodation of head motion • Automatic recovery of tracking errors for prolongated interaction

  10. Contacts Prof. Carlo Colombo Dipartimento Sistemi e Informatica Via S. Marta 3 – Firenze Centro di Eccellenza MIUR per la Comunicazione e Integrazione dei Media Sede RAI, Largo A. de Gasperi 1 - Firenze www.dsi.unifi.it/users/colombo colombo@dsi.unifi.it

More Related