70 likes | 349 Views
Final year project Presentation Ross Duignan. Electronic and Computer Engineering NUI Galway. Project Milestones. Implementation of basic ASR and TTS functionality Intercept calls so app can be used during call I mplement a “gesture recognition” system
E N D
Final year project PresentationRoss Duignan Electronic and Computer Engineering NUI Galway
Project Milestones • Implementation of basic ASR and TTS functionality • Intercept calls so app can be used during call • Implement a “gesture recognition” system • Analyse computational complexity of app • Investigate/implement emotion recognition functionality for app’s speech recognition
Background Introduction to some key concepts on Android: • Layout • Activity • ASR and TTS • Services • Shared Preferences
Basic Application (ASR &TTS) • Application’s layout • Implementing simple ASR • Implementing simple TTS • Integrating the two functionalities • Issues overcame
Integrating ASR and TTS • Initializing Conversation • Issues with continuous ASR • Saving/re-using phrases
Telephony Service • Intercepting call • Initializing app • Recording voice messages
Work To Be Done • Implement “Gesture Recognition” functionality based on advice from DeafHear Ireland • Investigate app’s power consumption • Alter code to make app more efficient • Investigate how to detect emotions from voice signal using Mathlab