200 likes | 305 Views
Invisible Interfaces. Ken Fishkin, Anuj Gujar, Beverly Harrison, Roy Want. Trend. Exponential growth in computer speed; Moore’s Law, but Limited growth of bandwidth and naturalness of our physical interaction with the computer. Emerging UI Paradigm. AR, VR Phicons. “Invisible
E N D
Invisible Interfaces Ken Fishkin, Anuj Gujar, Beverly Harrison, Roy Want Ken Fishkin, Nov. 2000
Trend • Exponential growth in computer speed; Moore’s Law, but • Limited growth of bandwidth and naturalness of our physical interaction with the computer Ken Fishkin, Nov. 2000
Emerging UI Paradigm AR, VR Phicons “Invisible Interfaces” Interaction Bandwidth GUI command line switches & knobs 50’s 60’s 70’s 80’s 90’s 98 Time Ken Fishkin, Nov. 2000
Towards “Invisible Interfaces” Goal: to seamlessly blend the affordances and strengths of physically manipulatable objects with virtual environments, devices and artifacts Invisible Interfaces Physical Virtual Ken Fishkin, Nov. 2000
Our Invisible Interface Efforts • Manipulative UI • PDAs • pressure sensors, tilt sensors • Proximal UI • mobile computing • RF sensors • wireless networking Ken Fishkin, Nov. 2000
Manipulative UI Approach interaction through transparently mimicking familiar physical manipulations via augmenting handheld devices invisible interfaces + Ken Fishkin, Nov. 2000
Video... • 3 tasks • navigation through an ordered list • navigation within a document • annotation optimization (handedness detection) Ken Fishkin, Nov. 2000
Key Design Considerations • Match properties • e.g., book - unit pages, sequential ordering preserved but thickness or extent is lost • Match manipulations • e.g., book - flicking corners consistent but moving by “chunks” is not • Match feedback • visual, auditory, kinesthetic (tactile) Ken Fishkin, Nov. 2000
Navigation - Rolodex Physical Rolodex manipulation Virtual Rolodex manipulation Ken Fishkin, Nov. 2000
Navigation - Rolodex Behind the scenes... Custom circuitry on back Side view - Palm Pilot Pressure sensors Ken Fishkin, Nov. 2000
Navigation Within a Book Physical page turning Page turning via strokes Ken Fishkin, Nov. 2000
Navigation Within a Book Moving by “chunks” relative to beginning/ending of book Moving relative to beginning/ending of document Ken Fishkin, Nov. 2000
Navigation Within a Book Behind the scenes... degree of spatial pressure location Ken Fishkin, Nov. 2000
Next Iteration Ken Fishkin, Nov. 2000
Annotation Optimization Virtual annotation (handedness) Physical annotation Ken Fishkin, Nov. 2000
Annotation Optimization Behind the scenes... Pressure pad Ken Fishkin, Nov. 2000
Annotation Optimization The result... Ken Fishkin, Nov. 2000
Lessons Learned • No prior model that physical interaction has an effect (unexpected, learning needed) • Fidelty of matching is crucial (“interface fusion”), based on real world expectations • Inadvertent action is problematic • Careful kinesthetics design needed (range of motion, precision, JNDs) Ken Fishkin, Nov. 2000
Lessons Learned • User comments: “intuitive”, “cool”, “pretty obvious in terms of what’s going on” • Users explored the range and space of manipulations (as in novel GUIs) • Passive interactions perceived as “magical” • Enhanced interaction experience “beyond the laptop” Ken Fishkin, Nov. 2000
Related Work • Physical input devices: “phicons” [Ishii et al], “bricks” [Fitzmaurice] • Unique input devices: “doll’s head” [Hinkley et al] • Augmented devices [Rekimoto] [Small & Ishii] • Ubicomp, PARC tabs [Weiser & Want PARC] Ken Fishkin, Nov. 2000