1 / 15

Tatiana Evreinova / Multimodal Interaction Research Group

Usability Exploration of the Visual Textual Imaging. Tatiana Evreinova / Multimodal Interaction Research Group Oleg Spakov / Gaze-Based Interaction Research Group Tampere Unit for Computer-Human Interaction. Problems.

fay-gamble
Download Presentation

Tatiana Evreinova / Multimodal Interaction Research Group

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Usability Exploration of the Visual Textual Imaging Tatiana Evreinova / Multimodal Interaction Research Group Oleg Spakov / Gaze-Based Interaction Research Group Tampere Unit for Computer-Human Interaction

  2. Problems • lip reading requires a great concentration of visual attention and can be very stressful • even qualified sign language interpreters cannot interpret everything in group situations • the usage of subtitling signing has a high level of transmission difficulties and still remains as an extremely expensive method of information imaging

  3. Previous research To facilitate associative interpretation new tokens were mapped through eight directions

  4. Previous research 2/2

  5. Objectives in general • to develop communication techniques through graphical imaging of textual information for the profoundly deaf and hard-of-hearing people • to find out an approach that would require minimum resources of visual perception by using pseudo-graphic tokens; these tokens must be perceived preattentively and reduce cognitive loading experimental setup

  6. Schedule

  7. Research methods • constructive research to design and simulate the new techniques for textual imaging, software tools and algorithms for visibility evaluation of graphic tokens • empirical research based on tracking of the eye movements subjective / objective evaluation: • tachistoscopic evaluation • visual scan time measurement

  8. Resources SMI Eye-Gaze tracking system allows recording eye movements iComponent provides a possibility to use SMI Eye_Gaze data in other application through a simple interface [developed by Oleg Spakov] iView 3.01 program processesSMI Eye_Gaze data and displayssaccadic movements (row data), fixations and scanpaths

  9. experimental setup Testing (1/2) 20 volunteers from staff and students at the University of Tampere took part in the testing All participants had normal or corrected-to-normal vision with no known hearing deficit 6 phonetic fonts were exposed throughout experimental session

  10. Testing (2/2) Each font was exposed on the screen for 7 seconds Formal experiment has taken 7 days monitoring of the testing on the examiner side

  11. Preliminary results 1/3 A A Arial Comic A A Courier Impact fixations and scanpaths recorded by SMI iView 3.01 program

  12. Preliminary results 2/3 pseudo-graphic token A Times New Roman fixations and scanpaths recorded by SMI iView 3.01 program

  13. Preliminary results 3/3 Fixation areas the average value of fixation areas during an exposition of visual stimuli

  14. Prospective applications development of new communication techniques for strengthening of visual and linguistic feedback between the deaf /hard-of-hearing people and digital television environment

  15. Thanks for your time & attention

More Related