1 / 12

SpeechClipse v 1.0 “ An Effective Plug-In for the Eclipse IDE ”

Improve productivity and accessibility with speech control plug-in for Eclipse, ideal for physically challenged users or those with Carpal Tunnel Syndrome. Customizable, rule-based grammar, and future-ready design.

perezl
Download Presentation

SpeechClipse v 1.0 “ An Effective Plug-In for the Eclipse IDE ”

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SpeechClipsev 1.0“An Effective Plug-In for the Eclipse IDE” Team Members: Faizan, Javed Qasim, Ijaz Rajesh, Sudarsan Raymond, Corvin Shairaj, Shaik Suman, Roychoudhury Advisors: Dr.Jeff Gray & Dr.Barrett Bryant http://www.cis.uab.edu/info/Eclipse/SpeechClipse/ Computer and Information Sciences Department University Of Alabama at Birmingham

  2. Motivation • Speech plug-in to positively affect individuals who are physically challenged or diagnosed with Carpal Tunnel Syndrome (CTS) • Increased productivity and ease of IDE navigation by concurrent control • Customizable and Taylor-Made speech control • Contribution towards Eclipse community http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  3. Background How does a Typical Speech Engine works ? Picture - Courtesy Microsoft Corporation http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  4. Implementation • The user defined “Speech-Robot” Class to translate speech commands into keyboard events • Mapping Eclipse events to speech commands through rule based grammar rules • Extensible design to accommodate future IDE events • Complete control of keyboard through used defined KeyMap Class • JSGF (Java Speech Grammar Format) to specify rules http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  5. RECOGNIZER Rule-Based Grammar NAVIGATOR SYNTHESIZER TOKEN SpeechClipse Control Flow Diagram http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  6. CloudGarden’s Speech Engine • JSAPI based implementation • Consists of both Recognizer and Synthesizer • Supports both Rule-Based and Dictation grammar http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  7. Grammar • SpeechClipse Control: • Grammar rules and event properties are the primary ways of controlling the speech recognizer’s activity • JSAPI Specifications: • JSGF (Java Speech API Grammar Format) Currently Used In SpeechClipse • JSML (Java Speech API Markup Language) Will be used in future versions of SpeechClipse http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  8. Advantages of SpeechClipse • Increase productivity to users by allowing multi-tasking • Speech enabled programming environment for various users groups • Better recognition by adapting Speech-engine with user voice • Highly Customizable • Rich set of Speech Commands: • Hand’s Free Refactoring • Hand’s Free Debugging • Code templates • Speech Wizards http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  9. Current Status • Efficient navigation of Eclipse IDE • Code-Templates: • Automate the typing of standard programming constructs • Speech-Hot-Keys: • Accomplish the effect of multiple keyboard or mouse clicks • Access to standard external applications • An extensible design • Ability to dynamically update the SpeechClipse grammar • Harness the powerful refactoring and debugging capabilities of Eclipse through Speech commands http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  10. Video Demonstration • Project creation • Standard keyboard capabilities • Project compilation and building • Hand’s free Debugging • Hand’s free Refactoring • Generating Java-Documentation SpeechClipse http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  11. Future Work • Improve the Grammar using of all the capabilities of rule-based grammars. • Implement Lazy-Typing using Dictation grammar • Emulate mouse movements • Ability to effectively code and store identifier-names • Speech synthesis (Futuristic) for visually impaired http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

  12. Thank You http://www.cis.uab.edu/info/Eclipse/SpeechClipse/

More Related