1 / 25

Personal Universal Controllers: Controlling Complex Appliances with GUIs and Speech

Personal Universal Controllers: Controlling Complex Appliances with GUIs and Speech. Jeffrey Nichols and Brad A. Myers Carnegie Mellon University April 8, 2003. CHI 2003 Conference on Human Factors in Computing Systems Ft. Lauderdale, Florida. The Problem. Appliances are too complex.

sherlock_clovis
Download Presentation

Personal Universal Controllers: Controlling Complex Appliances with GUIs and Speech

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Personal Universal Controllers:Controlling Complex Appliances with GUIs and Speech Jeffrey Nichols and Brad A. Myers Carnegie Mellon University April 8, 2003 CHI 2003 Conference on Human Factors in Computing Systems Ft. Lauderdale, Florida

  2. The Problem Appliances are too complex

  3. The Problem, cont. • Each complex appliance has its own idiosyncratic interface! • Home and Car Stereos • VCRs & Camcorders • Car Navigation Systems • Answering Machines • … • Increasingly Computerized • Low Usability

  4. Feedback Specifications Control Our Solution Separate the interface from the appliance! Handheld becomes personal universal controller (PUC) Key Features • User interface-independent appliance specification • Automatic generation of GUI and speech interfaces

  5. Automatic Generation of UIs Benefits • All interfaces consistent for the user • With conventions of handheld Other applications and UI guidelines • Even from multiple manufacturers Addresses idiosyncracy problem! • Multiple modalities (GUI + Speech UI) • Can take into account user preferences • Will work on special purpose devices (for disabled)

  6. Appliances Controller Devices Overview

  7. Demonstration #1 Sony Camcorder PocketPC, Smartphone, Speech, Tablet PC

  8. Architecture - Appliance Adaptors - Comm. Protocol - Interface Generators XML-based

  9. XML-based Specification Language Describes appliance with these features: • Functions of Device State Variables and Commands • Labeling Multiple labels are necessary • Grouping Hierarchical groups • Dependency Information For enabling and structure

  10. Demonstration #2 Windows Media Player PocketPC, Smartphone

  11. Demonstration #3 GMC Information System / Climate Control PocketPC

  12. Important Work By Others • INCITS V2 Standardization Effort SIG at CHI 2003 Toward a Unified Universal Remote Console Standard Thursday 9:00-10:30, in Room 122 • Xweb (now ICE) [Olsen Jr., UIST 2000] • Stanford iRoom, iCrafter [Ponnekanti, Ubicomp 2001] • Speakeasy [Newman, UIST 2002]

  13. Future Work • Improve quality of generated user interfaces • More and better rules • Specification and generation of more appliances • answering machine, navigation system • Consistent interface generation • New interfaces modeled on past interfaces • Generating interfaces for the “experience” • One interface generated for multiple connected appliances • General purpose appliance adaptor for HAVi and UPnP protocols

  14. Funding National Science Foundation Microsoft General Motors Pittsburgh Digital Greenhouse Equipment Grants Mitsubishi (MERL) VividLogic Symbol Technologies Hewlett-Packard Lucent PUC Project Members Brad A. Myers Thomas K. Harris Roni Rosenfeld Michael Higgins Joseph Hughes Kevin Litwack Rajesh Seenichamy Mathilde Pignol Stefanie Shriver Jeffrey Stylos Peter Lucas Acknowledgements

  15. Thanks! Conference on Human Factors in Computing Systems (CHI) April 8, 2003 http://www.cs.cmu.edu/~pebbles/puc/ http://www.cs.cmu.edu/~jeffreyn/

  16. Rise of Mobile Devices Mobile devices are becoming cheaper and more common

  17. Two-way X10 Lighting PocketPC, Smartphone Demonstration #4?

  18. X10 Demo #1

  19. Back X10 Demo #2

  20. DV Camera #1

  21. Back DV Camera #2

  22. Back Windows Media Player

  23. Back GM Driver Information System

  24. Back GM Climate Control System

More Related