230 likes | 317 Views
Post-Desktop User Interfaces iStuff and the Search for the Great Unified Input Theory. Jan Borchers Stanford University CS547, Oct 17, 2002. The Ubicomp Vision. “The most profound technologies are those that disappear.” [Weiser] We only notice tools when they fail us. [Heidegger].
E N D
Post-Desktop User Interfaces iStuff and the Search for theGreat Unified Input Theory Jan Borchers Stanford University CS547, Oct 17, 2002
The Ubicomp Vision “The most profound technologies are those that disappear.” [Weiser] We only notice tools when they fail us. [Heidegger]
The Idea A Physical User Interface Toolkit to Facilitate Ubicomp UIResearch
Others Have Been There • HandyBoard [MIT] • Tangible Bits [MIT] • Context Toolkit[GaTech] • Phidgets[Calgary] • Etc...
Leveraging Infrastructure • iRoom • iROS • EventHeap
Event Heap Architecture Application1 Application2 TCP/IP connection Event Heap
Event Heap Architecture Example: MultiBrowse a URL to a different machine IE IE MultiBrowse S MultiBrowse R “show URL” TCP/IP connection “show URL” Event Heap
iStuff Architecture iStuff Device Wireless connection iStuff component Transceiver Application Proxy (on PC) TCP/IP connection Event Heap
iStuff Architecture iButton example wireless button RF connection iStuff component RF Receiver Application Proxy (on PC) “button1 pressed” TCP/IP connection “button1 pressed” Event Heap
iStuff Architecture iSpeaker example portable radio FM connection iSpeaker component FM transmitter Application Proxy (on PC) “speak text” TCP/IP connection “speak text” Event Heap
iSlider iButtons iMike iStylus X10 RF iDog iMouse Anoto Pen iBuzzer iLight iSpeaker iStuff Components Input Output
Event Heap App to Speak Text import iwork.eheap2.*; class speaktext { static void main(String []args) { try{ EventHeap theHeap=new EventHeap(args[0]); Event myEvent=new Event("AudioEvent"); myEvent.setPostValue("AudioCommand", "Read"); myEvent.setPostValue("Text", args[1]); theHeap.putEvent(myEvent); } catch(Exception e) { e.printStackTrace(); } } } >speaktext iw-room2.stanford.edu "Hello World"
iStuff Architecture: PatchPanel Intermediary for abstraction wireless button RF connection iStuff component RF Receiver Application PatchPanel Proxy (on PC) “button1 pressed” TCP/IP connection “mark video” Event Heap
Evaluation • Start the Room • iPen • iPong • SuperSlider
Evaluation • iClub • Meeting Annotation
Great Unified Input Theory • Why are we doing this? • “Mouse & Keyboard” for Ubicomp? • Selection and Focus for Ubicomp? • Taxonomy of Modalities • iWall
Post-Desktop Era We are living in exciting times!
Heidegger revisited “Technology is the extension into the physical world of our intentionality”?
istuff.stanford.edu Thanks! Tico Ballagas Maureen Stone Michael Champlin Merrie Ringel Joyce Ho Ya’ir Aizenman Josh Tyler ...and many others!