1 / 23

Show & Tell Sign Language Translator Glove

Show & Tell Sign Language Translator Glove. Saron Paz Zvika Markfeld Tomer Daniel Oleg Imanilov. What is it?. An open source software & hardware Combining : Arduino Sensors Android ADK Android. What it does?.

trixie
Download Presentation

Show & Tell Sign Language Translator Glove

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Show & TellSign Language Translator Glove Saron Paz Zvika Markfeld Tomer Daniel Oleg Imanilov

  2. What is it? An open source software & hardware Combining: • Arduino • Sensors • Android ADK • Android

  3. What it does? • A glove that translates a predefined vocabulary of the deaf and mute sign language into text

  4. How does it work? Lily-Pad Arduino samples sensors attached to glove ADK board relays data from the Lily-Pad to Android Android uses a back propagation Neural Network to analyze data

  5. What is Lily-pad? Arduino compatible microcontroller board designed for wearablesand e-textiles

  6. Glove sensors Flex Sensors measure finger bending WiiNunchuck= Accelerometer + Gyros Conductive tape detects fingers touching

  7. Flex sensor • Flex Sensor changes resistance when bent • Using a voltage divider the voltage is read by Arduino ADC (10 bits)

  8. Wiinunchuck

  9. WiinunchuckSensors Joystick Accelerometer (X,Y,Z) Gyros (Roll, Pitch) 2 Buttons I2C & Power

  10. What is Android ADK?

  11. What is a neural network? • Interconnected group of artificial neurons • Good at pattern recognition

  12. Software view GUI Artificial Neural Network Sensor Control Relay ADK library ADK library Serial Serial

  13. How we built it?

  14. Prototyping Flex sensors

  15. Prototyping Flex sensors

  16. Flex sensor output

  17. Adding nunchucksensors

  18. The problem with ASL

  19. The final glove

  20. Challenges • How to position flex sensors? Fix tip to top and pass through sewn loops • How to distinguish between R,U,V,S,E,T,N? Conductive tape detects fingers touching • How to distinguish between each letter? Time based • How to record movement? Freeze in the middle

  21. Demo

  22. Who are we?

  23. Reference • Show & Tell Google code project • http://code.google.com/p/adk-sign-language-translator-glove/ • Sensors • Flex Sensors • http://www.sparkfun.com/products/8606 • http://www.sparkfun.com/products/10264 • Nunchuck • http://www.dealextreme.com/p/designer-s-nunchuck-controller-for-wii-24529 • Arduino • Wiichuck class • http://www.arduino.cc/playground/Main/WiiChuckClass • Android ADK • http://developer.android.com/guide/topics/usb/adk.html

More Related