150 likes | 247 Views
The Use of Labeling to Communicate Detailed Graphics in a Non-visual Environment. Hesham M. Kamel James A. Landay Group for User Interface Research EECS Department University of California, Berkeley. IC2D Features. Grid-based Recursive grid for precise drawing Keyboard navigation
E N D
The Use of Labeling to Communicate Detailed Graphics in a Non-visual Environment Hesham M. Kamel James A. Landay Group for User Interface Research EECS Department University of California, Berkeley
IC2D Features • Grid-based • Recursive grid for precise drawing • Keyboard navigation • Voice feedback • Users could draw pictures, but without labels
Labeling Tactile Images Tactile map of California by ViewPlus Technologies Inc
Presentation Overview • IC2D in a Nutshell • Problems with Existing Tools • IC2D Labeling Mode • Pilot Study • Conclusion
Problems with Existing Tools • Difficult to use existing labeling methods • Insufficient feedback about drawings • Hard to build mental model of drawings • Difficult to communicate drawings between blind and sighted users
Labeling in IC2D • Allows objects and groups of objects to be annotated • Allows hierarchical labeling structure
Circle Line Line Example of Labeling (Part 1) • Draw a wheel • Consists of a circle and two lines
Example of Labeling (Part 2) • Label tire and spokes Front Tire Spoke1 Spoke2 Circle Circle Line Line Line Line
Front Spokes Group Example of Labeling (Part 3) • Group individual spokes together • Label that group Front Tire Spoke1 Spoke2 Circle Circle Line Line Line Line
Front Spokes Front Wheel Group Group Example of Labeling (Part 4) • Group front tire and front spokes together • Label that group Front Tire Spoke1 Spoke2 Circle Circle Line Line Line Line
Pilot Study • 4 participants • 3 blind • 1 partially blind and blindfolded • Task • Say what the picture is • Describe objects in picture
Spokes Wheel Tire Spoke1 Spoke2 Group Group Circle Circle Line Line Line Line Browsing Labels • Two ways • Exploring the image • Traversing the hierarchy
Pilot Study Results • Recognition of drawings created by sighted and blind users • Participants successfully described differences • Size, type, direction • Observation • Inability to recognize 3D effect of car
Conclusion • Introduced IC2D grouping and labeling scheme • Offers an intuitive way to access and enhance semantic information • Helps blind people build mental models of drawings • Assists in communication between blind and sighted users • Future work: copy, cut, paste; object library
For More Information http://guir.berkeley.edu/ic2d http://guir.berkeley.edu