1 / 50

Chapter 6 Input Technologies and Techniques

Explore the pros and cons of direct and indirect input devices and modalities of interaction for Human-Computer Interaction tasks. Learn about sensor-based inputs in Chapter 7.

licata
Download Presentation

Chapter 6 Input Technologies and Techniques

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 6 Input Technologies and Techniques

  2. Input device choice example Pen vs touch + accurate pointing + drawing, hand-writing + extra functions on the pen (e.g. buttons) - pen takes one hand - pen should be always available - starting the interaction is slow Choose the input device for your HCI task!

  3. Writing with two hands?

  4. Multiple input devices

  5. Interaction technique • Input devices sense physical properties of people, places, or things. • An interaction technique provides a way for users to accomplish tasks by combining input with appropriate feedback (e.g. pinch-to-zoom) • A user interface consists of input device(s), interaction technique(s), a mental model etc.

  6. POINTING INPUT TECHNOLOGIES

  7. Input Device Properties • linear position vs motion vs force vs angle • set of device’s states • number of dimensions • metrics • pointing speed and accuracy, error rates • device acquisition time:time to moveone’s hand to a device • learning time, cognitive comfort

  8. Direct input devices • unified input and display surface • touchscreens or display tablets operated with a pen • Disadvantages: • lack buttons • occlusion • bad scaling for big screens

  9. Direct input devices • special input devices (pen) • soft-touch vs. hard-touch • multi-touch • force sensing (7 levels) • parallax (<2mm), lag (<100ms)

  10. Direct input devices • guestures pl. SecondLight • fingerprintdetection • fingeridentification

  11. Indirect input devices • input and display are on different devices • mouse, keyboard etc • Disadvantages: • input signal has to be shown on the display • no explicit feedback

  12. Indirect input devices • absolute (digitizing tablets) vs relative position (mouse) • touchpad • touchpad and touchscreen are different! • trackball • joystick • isometric vs. isotronic

  13. States of input devices

  14. Text entry • QWERTY (1868): 30-80 wpm • Alternative keyboard layouts offer ~ 5%performance gain • touchscreen keyboards • size of keys • „attention blinking” • software enhancement: word prediction, guestures • hand-writing (paper and pencil ~ 15 wpm) • might be useful at very short texts (words) • Speech recognition (speech ~150 wpm)

  15. MODALITIES OF INTERACTION

  16. Modalities of interaction • both hands • keyboard + mouse • hand-held devices • geustures • good mental model, association is required • speech • instructions with limited dictionary • speech to text

  17. Modalities of interaction • free-space gestures semiotic, ergotic, epistemic • whole-body input pl: Microsoft Kinect • Sensors…

  18. Trends • newsensors and input devices e.g. fingerprintinstead of password • higherabstractionlevel of APIs e.g. Hungarian speech2text is availableas a module • syntesis of variousmodalities, input signals • machinelearning • „do less, butdoitwell”

  19. Chapter 7 Sensor- and recognition-based input for interaction

  20. Sensors • Sensors convert a physical signal into an electrical signal thatmay be manipulated symbolically on a computer. • cost of sensors has been decreasing • optical mouse • accelerometers (automotive air-bag systems)

  21. Sensor inputs Sensor2 SensorN Sensor1 Environment Current state of the user User model ApplicationN Application1 Application2

  22. Sensors in HCI • Occupancy and Motion • Infrared motion detectors (~10 μm) • Air pressure sensors (door opens) • Pressure mat switches • computer vision, acoustic • Range Sensing • triangulation (LED or ultrasonic) • stereo cameras

  23. Sensors in HCI • Position • GPS • in-building GPS: triangulation (RF, WiFi …) • multiple cameras (position of body parts) • time-of-flight • Movement and Orientation • wearable sensors • gyroscope (MEMS)

  24. Sensors in HCI • Touch sensors • Gaze and eyetracking) • computer vision • What object the user is looking at? • Speech • challenges: background noise, speaker identification • non-verbal information (prosody, intonation etc)

  25. Sensors in HCI • Gestures • hand pose, spatial trajectory of the hands, pointing to indicate an object • computer vision or wearable • Identity detection • biometric sensors: fingerpring, retina, shape of hand, hand-writing, speech… • computer vision (eg. face detection, QR code) • RFID

  26. Sensors in HCI • Context • temperature, air pressure, lights • Sensing affect • boredom, interest, pleasure,stress, or frustration • galvanic skin response, blood volume pulse etc… • Brain-computer interfaces • invasive vs non-invasive technologies • EEG: measures electricalactivity at local parts of the brain using electrodes placed carefullyon the scalp

  27. Sensor inputs Sensor2 SensorN Sensor1 SIGNAL PROCESSING Environment Current state of the user Usermodel ApplicationN Application1 Application2

  28. Signal processing Time series analysis • Preprocessing eg. Kálmán-filter • Featureextraction eg. Fourier transformation • Classification/modeling

  29. INPUT TECHNOLOGIES IN TRENDY GADGETS

  30. Wearables

  31. Fitness trackers

  32. Smart watch

  33. Fingerprint reader

  34. Eye-scroll

  35. Smart glass

  36. Voice recognition

  37. Virtual reality

  38. Smart home

  39. Autonomous driving

  40. Self-driving on a motorway

  41. Chapter 61 Social Networks and Social Media

  42. web 1.0 – static web (contentcreators and readers) web 2.0 – usersactivelycreatecontent and consume web 3.0 – semantic web ???

  43. 5.6M English Wikipedia article • 50M Flickr photo/month • 300h/min video upload to Youtube • 500M tweet/day

  44. Social networks • information-sharing and finding, gaming, shoping, eventorganisation, dating, professionalforum • Recommendersystems • Collaborativefiltering • more trustinfriends’ preferencesthanunknowpeople

  45. Be careful what to share…

  46. Filter bubble [video]

  47. Summary • Direct and indirect input devices • Interaction modalities • Sensor types

More Related