1 / 29

Á lvaro Cassinelli, St é phane Perrin, Masatoshi Ishikawa Ishikawa-Namiki-Laboratory Parallel Processing for Sensory inf

Smart Laser-Tracking for Human-Machine Interface. Á lvaro Cassinelli, St é phane Perrin, Masatoshi Ishikawa Ishikawa-Namiki-Laboratory Parallel Processing for Sensory information University of Tokyo . Today’s approach. UI : “WIMP” + alphanumeric input

marli
Download Presentation

Á lvaro Cassinelli, St é phane Perrin, Masatoshi Ishikawa Ishikawa-Namiki-Laboratory Parallel Processing for Sensory inf

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Smart Laser-Tracking for Human-Machine Interface Álvaro Cassinelli, Stéphane Perrin, Masatoshi Ishikawa Ishikawa-Namiki-Laboratory Parallel Processing for Sensory information University of Tokyo

  2. Today’s approach UI : “WIMP” + alphanumeric input I/O Device: touch sensitive screen+stylus Input and interaction with “ever-shrinking” portable electronic devices physical interaction …Next step ? • remove the need for any physical I/O space at all • remove the need of any additional input device I. The problem: nice: input space is merged with viewing space  ”ergonomics-independent” miniaturization (*) windows, icons, menus and pointer

  3. ...By providing the PDA with intelligent sight: - hand/finger position - handwritten character recognition • gestures recognition, etc Low, medium or high-level vision drawbacks: • May require intensive computation • Not robust enough • Sensitive to external illumination conditions/backgrounds... In a word: passive-vision input versatile but not mature yet… …in any case overkill for the problem at hand! (“inputspace-less” WIMP) How to remove the input space? (non-invasive techniques!)

  4. what a short-sighted PDA would actually see… proximity sensor... + ...angular information should provide sufficient data for tracking! animal antenna cane for the blind Closer look at the problem... • Hand/finger closer than anything else • fingertip always visible (no occlusion) • fingertip “shape” simple and stable  cost-efficient, ROBUST, FAST! …but cumbersome, annoying?

  5. And... - laser can be used as output device (on any external surface, including the retina: VRD) The proposed “antenna”: a directive beam of light advantages: - active lighting: provides and control illumination - real-time, precise 3D measures (telemetry) - measurement of surface roughness, speed, even biometric data. Inconvenients: no haptic feedback (just like passive vision, but visual cues possible).

  6. VERY! Thanks to today’s “MOEMS” technology... The realm of “MOEMS” (micro-opto-electro-mechanical systems): Electronic circuit, photodetectors, laser diodes sources and mirrors integrated in the SAME chip. ... but how realistic is the integration of a LASER RADAR on a PDA?

  7. Hardware (discrete components): • laser diode, • a pair of steering micro-mirrors, • single non-imaging photodetector. II. Smart Laser Scanner Prototype

  8. smart laser scanner: laser excursion is locked around the area of interest circular laser “saccade” Tracking sequence repeated every millisecond. kHz refreshing rate explains algorithmic extreme simplicity Tracking Principle

  9. Prototype Smart Scanner in Action

  10. 2 DOF (using fingertip) (angular precision: better than tenth of a degree)

  11. 3 DOF (using fingertip) Depth precision: (intensity based) around 1cm up to 2 m

  12. a little farther away …

  13. Simultaneous tracking (up to four targets without hardware duplication)

  14. Several users…

  15. … unique user, higher DOF

  16. Achieving 6 DOF (using three tracking points)

  17. Fast 3d tracking of a ping-pong ball

  18. Interactive laser annotation

  19. UIs based on this 3D Input Device: Proof-of-principle examples

  20. 3D locator X/Y/Z translation Gestural command: RIGTH CLICK LEFT CLICK

  21. Interface for visualizing 2D data Positional command: X/Y translation ZOOM (+) Gestural command: ZOOM (-) LEFT CLICK RIGHT CLICK

  22. Visualization interface for video Positional command: X/Y translation Frame position (+) Gestural command: Frame position (-) Zoom x2 Zoom /2

  23. Proposed solution: use laser “light antennas” to track one (or more) fingers. • Advantages: • fast (no image processing), • precise 3D measurements, • insensitive to external light conditions, • no markers necessary, • can be used as output device. Conclusion The problem: design a 3D input device that does not interfere with technological miniaturization

  24. MOEMS integration: PDA on a keychain, PDA on a chest-pin: touching the pin or activates tracking, a gesture can be used to ask for emails, and these are read on the hand... Further Work Study of adaptive saccade shapes (ex: follows the hand contour) Prototype without mobile parts, using multiple laser beams...

  25. Speed (3m/s) Precision (cm) multi-tracking (up to four fingers) see more at both #102 Interactive laser annotation ACR - 5.4.2005

More Related