100 likes | 247 Views
Automatically Generating Interfaces for Multi-Device Environments. Jeffrey Nichols Carnegie Mellon University • Intel Research Seattle Workshop #5: Multi-Device Interfaces for Peripheral Interaction The Fifth International Conference on Ubiquitous Computing Seattle, Washington USA.
E N D
Automatically Generating Interfaces for Multi-Device Environments Jeffrey Nichols Carnegie Mellon University • Intel Research Seattle Workshop #5: Multi-Device Interfaces for Peripheral Interaction The Fifth International Conference on Ubiquitous Computing Seattle, Washington USA
My Problem Appliances are too complex
My Solution Interfaces Control Feedback Separate the interface from the appliance! Several ways to separate interfaces • Pre-programmed interfaces on mobile device • Downloadable pre-designed interfaces • Automatic interface generation Specifications
Three Multi-Device Interactions • Single UI device controlling one or more appliances
Three Multi-Device Interactions • Single UI device controlling one or more appliances • Multiple users controlling an appliance
Three Multi-Device Interactions • Single UI device controlling one or more appliances • Multiple users controlling an appliance • One user using multiple UI devices to control an appliance
Personal Universal Controller (PUC) We have built an automatic interface generation system • Abstract specification language • Interface generators for multiple platforms • PocketPC • TabletPC (Desktop) • Smartphone • Speech (with “Speech Graffiti” platform) • Architecture for controlling real appliances • Windows Media Player (shown) • Sony DV Camcorder • Axis UPnP Pan-Tilt Camera • Lutron and X10 Lighting • Many others…
Multi-Device UI and the PUC PUC supports all three multi-device interactions Third interaction could be improved however • Support for a fluid user experience Controllers need to know what others are doing E.g. When light controls are used on one device, other devices also display light controls • Specialization Currently each controller provides access to all appliance functionality with roughly the same structure Each controller should specialize; provide better access to features that will be accessed from its type of interface Access to all features should be maintained
Funding National Science Foundation Microsoft General Motors Pittsburgh Digital Greenhouse Equipment Grants Mitsubishi (MERL) VividLogic Symbol Technologies Hewlett-Packard Lucent Lutron Lantronix PUC Project Members Brad A. Myers Kevin Litwack Thomas K. Harris Roni Rosenfeld Michael Higgins Joseph Hughes Rajesh Seenichamy Mathilde Pignol Stefanie Shriver Pegeen Shen Jeffrey Stylos Suporn Pongnumkul Peter Lucas Acknowledgements
Thanks for listening! For more information… http://www.cs.cmu.edu/~pebbles/puc/ http://www.cs.cmu.edu/~jeffreyn/