1 / 24

Supervisor: Dr. ElSayed Eissa Hemayed

Supervisor: Dr. ElSayed Eissa Hemayed. 2/3/2010. Team Members. Marwa Ibrahim Lamey . Mayada Ibrahim Aly . Mona Sherif Ahmed. Suad Mohamed Barakat. 2/3/2010. Agenda. Introduction. Project Overview. Tools. Time Plan. 2/3/2010. Intro. Overview. Introduction. Tools.

bien
Download Presentation

Supervisor: Dr. ElSayed Eissa Hemayed

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Supervisor: Dr. ElSayedEissaHemayed 2/3/2010

  2. Team Members • Marwa Ibrahim Lamey. • Mayada Ibrahim Aly. • Mona Sherif Ahmed. • Suad Mohamed Barakat. 2/3/2010

  3. Agenda • Introduction • Project Overview • Tools • Time Plan 2/3/2010

  4. Intro. Overview • Introduction Tools Time Plan 2/3/2010

  5. Background Yasser Albehiry, “5 million deaf looking for someone to speak in their behalf”, October Magazine, No 1733, Jan 10th, 2010 (in Arabic). • Fact: There exists 5 million deaf persons in Egypt • Can’t we help them interacting with the community!??... Intro. Overview Tools Time Plan 2/3/2010

  6. Problem definition • Hearing children can be taught many lessons and morals through stories. What about deaf children? Intro. Overview Tools Time Plan 2/3/2010

  7. This is not always the picture Intro. Overview Tools Time Plan Al Amal School- Resala Charity 2/3/2010

  8. Intro. Overview • Project Overview Tools Time Plan 2/3/2010

  9. Our Scope • Our prototype is to translate a category of children stories to the sign language in real time • Goal: To minimize the gap between hearing parents or teachers and deaf children Intro. Overview Tools Time Plan 2/3/2010

  10. Description • Input: Arabic story speech signal • Output: A 3D character performing the sign language • Type: Desktop Application Intro. Overview Tools Time Plan 2/3/2010

  11. Market Survey • iCommunicator • IBM SiSi • King Fahd University Intro. Overview Tools Time Plan 2/3/2010

  12. SIGNlator Uniqueness • Arabic speech recognition • Start from speech and end up with sign language Intro. Overview Tools Time Plan 2/3/2010

  13. SIGNlator Features • Translation of Arabic speech to sign language in real time. • Translation of Arabic text to sign language. • Learning mode. Intro. Overview Tools Time Plan 2/3/2010

  14. Block Diagram Intro. Text to Sign language القاموس الاشاري العربي للصم Overview Recognizer Graphics module Tools Time Plan Controller 2/3/2010

  15. Automatic Speech Recognition-Architecture Recognizer Intro. Language Model Recognizer Overview Feature Extraction • Search Audio Words Tools Time Plan Acoustic Model Dictionary

  16. Block Diagram Intro. Text to Sign language القاموس الاشاري العربي للصم Overview Recognizer Graphics module Tools Time Plan Controller 2/3/2010

  17. Challenges • Tackling a new field • Phonemes of Arabic language. • Prepare the training set. Intro. Overview Tools Time Plan 2/3/2010

  18. Future Work • Change the program type to be mobile application. • Integrate with “Sound of Signs “Project Intro. Overview Tools Time Plan 2/3/2010

  19. Tools • Recognizer : • Text to Sign language: • C# using Microsoft Visual Studio 2008 • SQL Server 2005 • Graphics module: • GUI: Intro. HTK Overview Tools Quest3D 4.0 Time Plan • Expression Studio 2 ( Blend) 2/3/2010

  20. Time Plan Brain Storming Working Period 84 days Market Research Idle period 25 d Design 34d Mid-Terms 6d Design 18d Finals 8/7/09 30/9/09 38days 4 Phases 1/10/09 26/10/09 43days Mid-Terms 27/10/09 30/11/09 16d 4 Phases 5/12/09 11/12/09 28 d Finals 12/12/09 30/12/09 51 days Testing 1/1/10 8/2/10 7d Documentation 9/2/10 24/3/10 6d 25/3/10 10/4/10 11/4/2010 9/5/2010 10/5/10 30/6/10 4 Phases: Implementation Integration Testing Documentation 1/7/10 8/7/09 9/7/10 15/7/10 2/3/2010

  21. Sponsors agile solutions, real result 2/3/2010

  22. Thank you T H A N K Y O U 2/3/2010

  23. ASR Categories • Unlimited words can be recognized if added to the dictionary. • Less accurate but still acceptable accuracy • Very high accuracy • Maximum 150 words. Intro. Overview Tools Time Plan Our Choice!!

  24. Causes of deafness • 9.6% Pregnancy-Related causes • 8.4% Post-Natal causes • 28% Genetic causes • 54% Unknown causes Not necessary to be born for deaf parents

More Related