1 / 33

Tactile Graphics with a Voice 2015

Tactile Graphics with a Voice 2015. Richard Ladner University of Washington. Text Book Translation Problem. images. math. text. Tactile Perception. Somatosensory system. Tactile Perception Limitations. Resolution of human fingertip: 25 dpi

cterence
Download Presentation

Tactile Graphics with a Voice 2015

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Tactile Graphics with a Voice2015 Richard Ladner University of Washington

  2. Text Book Translation Problem images math text

  3. Tactile Perception Somatosensory system

  4. Tactile Perception Limitations • Resolution of human fingertip: 25 dpi • Tactual field of perception is no bigger than the size of the fingertips of two hands • Color information is replaced by texture information • Visual bandwidth is 1,000,000 bits per second, tactile is 100bits per second

  5. Resolution Study .35mm 1 mm 2 mm • On average, blind participants could sense 1 mm separation but no smaller. • On average, sighted participant could sense 1.5 mm separation but no smaller.

  6. Blind Spatial Perception • Tactile perception can lead to a “spatial” model in the brain.

  7. Tactile Graphic

  8. Tactile Graphics Kit

  9. Tactile Graphics Printing • Embossing Printer • Thermoform • Swell Paper

  10. Tiger Embosser • 20 dpi (raised dots per inch) • 7 height levels (only 3 or 4 are distinguishable) • Prints Braille text andgraphics • Prints dot patterns fortexture • Invented by a blind physicist,John Gardner

  11. Refreshable Tactile Display

  12. Graphics

  13. Graphic Translation <LocationInformation> <NumLabels>16</NumLabels> <Resolution>100.000000</Resolution> <ScaleX>1.923077</ScaleX> <ScaleY>1.953125</ScaleY> - <sd> <x1>121</x1> <y1>45</y1> <x2>140</x2> <y2>69</y2> <Alignment>0</Alignment> <Angle>3.141593</Angle> </Label> location file text extract preprocess original scanned image clean image puregraphic textimage

  14. Graphic Translation <LocationInformation> <NumLabels>16</NumLabels> <Resolution>100.000000</Resolution> <ScaleX>1.923077</ScaleX> <ScaleY>1.953125</ScaleY> - <Label> <x1>121</x1> <y1>45</y1> <x2>140</x2> <y2>69</y2> <Alignment>0</Alignment> <Angle>3.141593</Angle> </Label> location file y (0,20) x=15 15 10 5 O x 5 10 15 20 20 x+y=20 (15,0) (15,5) pure graphic y (#0,#20) x.k#15 #15 #10 #5 O x #5 #10 #15 #20 #20 x+y.k#20 (#15,#0) (#15,#5) Braille text textimage

  15. Available Books • Computer Architecture: A Quantitative Approach, 3rd Edition25 minutes per figure (230 figures) • Advanced Mathematical Concepts, Precalculus with Applications6.3 minutes per figure (1,080 figures) • An Intoduction to Modern Astrophysics10.2 minutes per figure (467 figures) • Discrete Mathematical Structures8.8 minutes per figure (598 figures) • Introduction to the Theory of Computation, 2nd Edition13.3 minutes per figure (180 figures)

  16. TGA Workflow • Advantages • Much faster production • Batch processing instead of one figure at a time • Much tedious work is avoided • Disadvantages • May be of lower quality than custom translation • A lot of technology needs to be mastered

  17. One-offs vs. Mass Production 1916 Woods Dual Power 1906 Reo Model T

  18. Audio-Tactile Graphics Talking Touch Tablet Digital Pen audio-tactile graphic

  19. Tactile Graphics with a Voice: using QR codes to access text in tactile graphics • C.M. Baker, L.R. Milne, J. Scofield, C.L. Bennett, RE Ladner. Proceedings of the 16th international ACM SIGACCESS conference on Computers. ASSETS 2014.

  20. Tactile Graphics with a Voice

  21. System Use

  22. Top Modes Silent Verbal Finger Pointing

  23. Study • 10 blind users • 4/10 non-Braille • 4 tasks • 3 modes • 6 sessions

  24. Parabola Line Triangle Bar Chart Tasks

  25. Time F2, 640=0.619, p=.5391 F5, 640=2.268, p<.05

  26. Time outs

  27. Accuracy

  28. Preference • 4 preferred silent • To be honest, I use screen readers every day and I am so sick of electronic noise. • 4 preferred finger pointing • I like the concept of the finger pointing. I feel more confident that since it looks for a finger it’s getting the right QR code if you have multiple on the same page. • 2 preferred verbal • The other thing I like about Verbal mode is that every time I hear a zero I think so I need to move it a little bit

  29. Braille comparison In a study of 82 images from a pre-calculus textbook, on average Braille took up more space • Braille was larger in 326 out of 626 labels • Braille labels: 327 sq. mm • QR codes: 225 sq. mm

  30. Braille - Time

  31. Braille - Accuracy

  32. Questions

More Related