420 likes | 509 Views
Interfaces: Media and Devices. CS5540 HCI Rich Riesenfeld Fall 2008. Major Categories. Input Harder Output More successful history. Inputs - 1. Clickless Interface Example http://www.dontclick.it TTY Voice Gesture Body language Using succinct communications Haptic
E N D
Interfaces: Media and Devices CS5540 HCI Rich Riesenfeld Fall 2008
Major Categories • Input • Harder • Output • More successful history
Inputs - 1 • Clickless Interface Example • http://www.dontclick.it • TTY • Voice • Gesture • Body language • Using succinct communications • Haptic • Phantom devices, etc
Inputs - 2 • Clickless Interface Example • http://www.dontclick.it • Handwriting • Security identification • Fingerprints • Laser identification • Eye tracking • Movement
Inputs - 3 • Body forces • Live seat • Sides of back • Etc • Transporter (gestural communications) • Segway Video • Winglet Video
Inputs - 4 • Simulators • Disney, Pilot training, NASA • Structured light • Body sensors • Animation • Motion capture
Inputs - 5 • Widgets • Buttons, sliders, menus, toggles, etc • User Recognition • Get your coffee the way you always get it! • Machine Learning • Watch and learn • Windows menus: What is on top of menu?
Inputs - 6 • Multi-channel • Games • Simulators • Training/Education • Music • Electronic keyboard
Inputs - 7 • Read CNS signals • Muscle signals • Lie detector • Skin conductivity • Direct brain signal interface • cyberkineticsinc.com <braingate.com> • ALS • Spinal cord injury sufferers
Outputs – 1 • Flat screen • Resolution, colors, refresh rate, size … • “Big Board” on CNN, MSNBC • Stereopsis Techniques • Left/Right visual separation • Color filters: R/G, etc • Polarized glasses
Outputs – 2 • Sound • Synthetic, unnatural sounds • Laser, “wrong,” “dive” • Realistic: • prerecorded DB • generated • Speech • Synthetic • Real, prerecorded
Outputs – 3 • Visualizations • Scientific visualization • Information visualizaiton
Outputs – 5 • VR Environments • 3D • Spinal medication • MRI visualizations • Fly throughs • Fantasy worlds
Outputs – 6 • Overlays on real-world • Breast biopsy procedure • Assembly or Maintenance Info • HUDs in cockpit • Reduce cognitive overload
Outputs – 7 • VR Environments • “Holodecks”, synthetic spaces, avatars • Virtual “try on” for clothes • Smell • Vibrations • Newtonian Physics: ON • Exploit the known, natural experience • Highly predictable • Concise
Outputs – 8 • Newtonian Physics: ON (cont ) • Provide normal physics of environment • Inertia • Collisions (no penetrations) • Gravity • Friction • Noise • Provide artificial physics • New rules/forces
Outputs – 9 • Background sound • Movie score • Important • Not natural
Large Screen Displays • Large touch display with gestures
Large Screen Displays • Large multi-point input display
Virtual, Remote (Robotic) Surgery • Robotic Surgery • daVinci System
Synthetic Worlds • Siggraph (2001)
Video Clips • Magic Board 1 • Magic Board 2 • Magic Board 3 • Braingate 1 • Braingate 2
Transporter/Winglet • Segway device
End Interfaces: Media and Devices