150 likes | 465 Views
ReachMedia on-the-move interaction with everyday objects Assaf Feldman, Pattie Maes, Sajid Sadi and Emmanuel Mugia The Media Laboratory Massachusetts Institute of Technology Question Can we merge the virtual world with the physical world? An Interface Problem Not enough pixels
E N D
ReachMedia on-the-move interaction with everyday objects Assaf Feldman, Pattie Maes, Sajid Sadi and Emmanuel Mugia The Media Laboratory Massachusetts Institute of Technology
Question Can we merge the virtual world with the physical world?
An Interface Problem Not enough pixels Too many clicks
Requirements • Natural and seamless interaction • Hands and eyes free • Socially acceptable
IO Input – RFID, Gestures,Keypad. Output –audio,text The smart phone as a general interface
Gestures Slight flick for menu navigation Previous Next Select - Socially acceptable.
Objects ID • Gestural input: • Next • Previous • Select RFID Object ID, user input MITe receiver Audio & XML Content • Audio output: • Earcons • Voice menus Context Manager Interaction mediation via Mobile device Multi modal interface via accessories RFID Augmented physical objects
Hardware - Sensors • RFID • Cheap • Great Context • Accelerometers (House_n MITEs) • Cheap • Small • Low power
Signal processing • 25 features - Time domain feature extraction • Cross correlation (3) • Power (3) • Turning points (18)
Classification • Online (Real Time) classification • Good accuracy using Naïve Bayes and HMMs • Preliminary results ~98% accuracy:
The big picture • Integrate digital world (information & services) and physical world (physical objects/environment) • Make interfaces more responsive and proactive (objects & environment monitor user and (proactively) present information & services relevant to user’s current needs/interests)
Ambient Intelligence 3rd floor