1 / 15

ReachMedia on-the-move interaction with everyday objects

ReachMedia on-the-move interaction with everyday objects Assaf Feldman, Pattie Maes, Sajid Sadi and Emmanuel Mugia The Media Laboratory Massachusetts Institute of Technology. Question. Can we merge the virtual world with the physical world?. An Interface Problem. Not enough pixels

barbie
Download Presentation

ReachMedia on-the-move interaction with everyday objects

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ReachMedia on-the-move interaction with everyday objects Assaf Feldman, Pattie Maes, Sajid Sadi and Emmanuel Mugia The Media Laboratory Massachusetts Institute of Technology

  2. Question Can we merge the virtual world with the physical world?

  3. An Interface Problem Not enough pixels Too many clicks

  4. Requirements • Natural and seamless interaction • Hands and eyes free • Socially acceptable

  5. IO Input – RFID, Gestures,Keypad. Output –audio,text The smart phone as a general interface

  6. Touch based interaction with objects

  7. Gestures Slight flick for menu navigation Previous Next Select - Socially acceptable.

  8. Demo

  9. Objects ID • Gestural input: • Next • Previous • Select RFID Object ID, user input MITe receiver Audio & XML Content • Audio output: • Earcons • Voice menus Context Manager Interaction mediation via Mobile device Multi modal interface via accessories RFID Augmented physical objects

  10. Hardware - Sensors • RFID • Cheap • Great Context • Accelerometers (House_n MITEs) • Cheap • Small • Low power

  11. Signal processing • 25 features - Time domain feature extraction • Cross correlation (3) • Power (3) • Turning points (18)

  12. Classification • Online (Real Time) classification • Good accuracy using Naïve Bayes and HMMs • Preliminary results ~98% accuracy:

  13. The big picture • Integrate digital world (information & services) and physical world (physical objects/environment) • Make interfaces more responsive and proactive (objects & environment monitor user and (proactively) present information & services relevant to user’s current needs/interests)

  14. Ambient Intelligence 3rd floor

More Related