1 / 21

Paul Varcholik, Joseph J. LaViola Jr., Denise Nicholson Institute for Simulation and Training

TACTUS: A Hardware and Software Framework for Research in Multi-Touch Interaction. Paul Varcholik, Joseph J. LaViola Jr., Denise Nicholson Institute for Simulation and Training University of Central Florida pvarchol@ist.ucf.edu , jjl@eecs.ucf.edu , dnichols@ist.ucf.edu.

kennan
Download Presentation

Paul Varcholik, Joseph J. LaViola Jr., Denise Nicholson Institute for Simulation and Training

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TACTUS: A Hardware and Software Framework for Research in Multi-Touch Interaction Paul Varcholik, Joseph J. LaViola Jr., Denise Nicholson Institute for Simulation and Training University of Central Florida pvarchol@ist.ucf.edu, jjl@eecs.ucf.edu, dnichols@ist.ucf.edu

  2. Multi-Touch: Introduction

  3. Framework Motivation • Primary multi-touch components • Physical interaction surface • Software system for collecting and interpreting points of contact Present a barrier to entry for researchers focused on higher-level interface issues or application development

  4. Multi-Touch Origins (pre-2000) • Keyboards • Touchscreens • Pen-based computing • 1984 – Bob Boie (Bell Labs) perhaps the first multi-touch screen • 1985 – Bill Buxton, Multi-Touch Tablet • 1990 – Sensor Frame, Paul McAvinney (CMU) • Optical Sensor • 3 fingers (some trouble with ambiguous finger positions) • 1998 – Fingerworks

  5. Multi-Touch Origins (2000 to present) • 2001 – Paul Deitz – Mitsubishi DiamondTouch • 2003 – Jazz Mutant • 2004 – Andy Wilson – TouchLight • Oct. 2005 – Jeff Han – FTIR, UIST Paper • Feb. 2006 – Jeff Han – TED Talk • 2006 – Jeff Han – Perceptive Pixel (CNN Magic Wall) • Spring 2007 – Microsoft Surface • Summer 2007 – Apple iPhone • 2008 – Open-Source Community • 2009 – Windows 7

  6. Framework Requirements

  7. Framework Requirements

  8. Multi-Touch Hardware • Frustrated Total Internal Reflection (FTIR) • Optical waveguide • Supporting structure (e.g. cabinet) • IR sensing camera • Projector and diffuser • IR emission source • Computer

  9. Multi-Touch Efforts: Hardware

  10. Software Framework • Image processing • Presentation layer • Multi-platform communication • Pen/writing style interaction (Ink) • Gesture recognition

  11. Image Processing Pipeline Webcam RotateFlip Background Filter Camera Frame 24bpp Blob Detection Threshold GrayScale Binary Image 1bpp Grayscale Image 8bpp Scaling Calibration Point Tracking Processed Frame

  12. Image Processing Raw Camera Frame Background Filtered Threshold Processed Points

  13. Multi-Touch Efforts: Software

  14. Mouse Emulator

  15. Multi-Touch Efforts: Video Montage

  16. Multi-Touch Efforts: Additional Videos • Demo Explorer • Improved Calibration • Multi-Touch Starcraft • Mouse Emulator • Ink Demonstration • Particle System Demonstration • SurfaceSimon • SurfaceCommand

  17. Conclusions • The Framework: • In development since Fall 2007 • Open-source availability since Spring 2008 • Now in its fourth major release • Answers most of the specified requirements • Successfully employed by UCF and colleagues from Brown University • Downloaded extensively by the open-source community • Provides a robust, extensible platform for research in multi-touch interaction

  18. TACTUS: A Hardware and Software Framework for Research in Multi-Touch Interaction Paul Varcholik, Joseph J. LaViola Jr., Denise Nicholson Institute for Simulation and Training University of Central Florida pvarchol@ist.ucf.edu, jjl@eecs.ucf.edu, dnichols@ist.ucf.edu Questions?

  19. Resources: Commercial Platforms • Microsoft Surface • Mitsubishi DiamondTouch • Apple iPhone & iPod Touch • Perceptive Pixel • N-trig • MultiTouch OY (Finland) • Jazz Mutant • HP TouchSmart • Dell Latitude XT2 • TacTable

  20. Resources: Open-Source Platforms • TouchLib (NUI Group) • tBeta (NUI Group) • reacTIVision • Bespoke Multi-Touch Framework • Sparsh UI (Iowa State) • BBTouch • Touche`

  21. Resources: Online • NUI Group • TouchKit by NOR_/D • Multi-Touch Systems that I Have Known and Loved – Bill Buxton, Microsoft Research • Jeff Han’s TED Talk • Bespoke Software

More Related