120 likes | 129 Views
Explore major categories of human-computer interface (HCI) inputs and outputs, including clickless interfaces, handwriting recognition, machine learning, synthetic speech, virtual reality environments, natural physics, and background sounds.
E N D
Interfaces: Media and Devices CS5540 HCI Rich Riesenfeld Fall 2007
Major Categories • Input • Harder • Output • More successful history
Inputs - 1 • Clickless Interface Example • http://www.dontclick.it • TTY • Voice • Gesture • Haptic • Phantom devices, etc • Handwriting
Inputs - 2 • Eye tracking • Body forces • Live seat • Sides of back • Etc • Structured light • Body sensors • Animation
Inputs - 3 • Widgets • Buttons, sliders, menus, toggles, etc • User Recognition • Get your coffee the way you always get it! • Machine Learning • Watch and learn • Windows menus: What is on top of menu?
Inputs - 4 • Read CNS signals • Muscle signals • Lie detector • Skin conductivity • Direct brain signal interface • cyberkineticsinc.com • ALS • Spinal cord injury sufferers
Outputs – 1 • Flat screen • Resolution, colors, refresh rate, … • Stereopsis Techniques • Color filters: R/G, etc • Polarized glasses • Sound • Synthetic effects • Speech
Outputs – 2 • Sound • Synthetic, unnatural sounds • Laser, “wrong,” “dive” • Realistic: • prerecorded DB • generated • Speech • Synthetic • Real, prerecorded
Outputs – 3 • VR Environments • 3D • Fantasy worlds • Overlays on realworld • Breast biopsy procedure • Assembly or Maintenance Info • HUDs in cockpit • Reduce cognitive overload
Outputs – 3 • VR Environments • Smell • Vibrations • Newtonian Physics: ON • Exploit the known, natural experience • Highly predictable • Concise • Provide normal physics of environment • Inertia • Collisions (no penetrations) • Gravity • Friction • Noise
Outputs – 4 • Background sound • Movie score • Important • Not natural
End Interfaces: Media and Devices