1 / 10

CMPS 261 – Project Proposal

Visually Representing American Sign Language Translations Victor Geislinger. CMPS 261 – Project Proposal. Background/Motivation. American Sign Language (ASL) Fingerspelling (FS) Handshapes Basis of language. Background/Motivation. Interpreters Emergency Inaccessible Expensive

maxwell-frost
Download Presentation

CMPS 261 – Project Proposal

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Visually Representing American Sign Language Translations Victor Geislinger CMPS 261 – Project Proposal

  2. Background/Motivation • American Sign Language (ASL) • Fingerspelling (FS) • Handshapes • Basis of language

  3. Background/Motivation • Interpreters • Emergency • Inaccessible • Expensive • Learning Tool • Feedback

  4. Method • Collect Data via Leap Motion Controller • Focus on hand(s)/finger(s) • Real time capture http://reviews.cnet.com/input-devices/leap-motion-controller/4505-3133_7-35823002.html

  5. Method • Categorize individual letters • Form hard to determine • Classify group shapes • Easier to guess • “Autocorrect” feature

  6. Method • Transitions sometimes exist as one unit • “J” and “Z” • Double letters • “I-L-Y” • “A-I-R” • “B-U-S”

  7. Output • Gives interpreted word/sentence • Color coded to give likely letter from shape group

  8. Output • Features other possible guesses • Given by opacity, position, and/or hierarchy tree • Gives timeline of duration of letter • Possibly used to visually see speed of speech

  9. Potential Issues/Challenges • Identifying letters from same group • Difficult/impossible to do with current technology • Differences in style/accent • Transition lengths • Output might have to many possibilities

More Related