1 / 24

Informal PUIs: No Recognition Required

Informal PUIs: No Recognition Required. James Landay Jason Hong Scott Klemmer James Lin Mark Newman. WIMPy User Interfaces. Windows, Icons, Menus, Pointer Hitting limitations of this kind of interface WIMP designed for limited audience Full use of eyes Literate Full use of hands

miller
Download Presentation

Informal PUIs: No Recognition Required

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Informal PUIs: No Recognition Required James Landay Jason Hong Scott Klemmer James Lin Mark Newman

  2. WIMPy User Interfaces • Windows, Icons, Menus, Pointer • Hitting limitations of this kind of interface • WIMP designed for limited audience • Full use of eyes • Literate • Full use of hands • WIMP designed for limited situations • Fixed location (often offices) • Sitting down • Single person

  3. Perceptual User Interfaces • PUIs leverage our innate perceptual, motor, and cognitive abilities • Speech recognition, computer vision, sketching, handwriting • Sketching is one part of this bigger push • PUIs more useful for different audiences and wider range of situations • Mobile workers or Home • Speech => Hands-free • Location Tracking => Physical motion

  4. PUIs and Recognition • Key question: • When should perceptual input be recognized? • Immediate recognition can interfere with creativity and communications

  5. Communication and Creativity • Informal visual representation • communicates “unfinished” • encourages creativity • faster to create • higher level comments • Formal visual representation • communicates “finished” • inhibits creativity (detailed) • slower to create • lower-level comments

  6. Informal User Interfaces • Historic bias towards formal user interfaces • Computation over creativity and communication • Structured input to simplify computation • Position: • Recognition interferes with creativity and communication due to errors and perception • Recognition should be minimized or deferred for these kinds of apps

  7. Informal User Interfaces • Sketching • Speech • Handwriting

  8. Informal User Interfaces • Sketching • Speech • Handwriting

  9. Slide Landay (1996)

  10. Slide Gross and Do (UIST96)

  11. Slide Lin, Newman, Hong, Landay (CHI2000)

  12. DENIM Video

  13. Informal User Interfaces • Sketching • Speech • Handwriting

  14. Slide Stifelman, Arons, Schmandt (CHI2001)

  15. Read my important email SUEDE:Informal Prototyping for Speech-based UIs • Supports design practice • example scripts • Wizard of Oz • error simulation • iterative design • Informal user interface • no speech recognition or synthesis • need not be programming expert • fast & fluid design

  16. Slide Klemmer et al (UIST2000)

  17. SUEDE Video

  18. Informal User Interfaces • Sketching • Speech • Handwriting

  19. NotePals:Informal Handwriting Capture Davis et al (CHI99)

  20. NotePals:Informal Handwriting Capture

  21. Takeaway Ideas • Perceptual user interfaces useful for more audiences and more places • Informal User Interfaces valuable for PUIs • Minimize or defer recognition • Creative or communications-oriented tasks • Informal User Interfaces can be applied to a range of perceptual input • Sketching • Speech • Handwriting

  22. Informal PUIs: No Recognition Required James Landay Jason Hong Scott Klemmer James Lin Mark Newman

  23. Backup Slides

  24. Backup Slides Igarashi, Edwards, LaMarca, and Mynatt (AVI2000)

More Related