1 / 23

Home Automation with Speech Recognition

Billy Overton 2012-9-19. Home Automation with Speech Recognition. Controlling Your Devices. Getting back to software. Common Communication Methods. RS-232 HTTP GET/POST Infrared Custom. RS-232. Pros Many devices have RS-232 control Extremely simple Has common libraries

kevyn-thomas
Download Presentation

Home Automation with Speech Recognition

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Billy Overton2012-9-19 Home Automation with Speech Recognition

  2. Controlling Your Devices Getting back to software

  3. Common Communication Methods • RS-232 • HTTP GET/POST • Infrared • Custom

  4. RS-232 • Pros • Many devices have RS-232 control • Extremely simple • Has common libraries • Usually well documented • Cons • Uncommon Hardware • No common command set

  5. RS-232 in PowerShell http://files.support.epson.com/pdf/plhc87u/plhc87uug.pdf

  6. HTTP GET/POST • Pros • Uses pre-existing controls systems • Can be as simple as an iframe • Customizable • Cons • Usually less documented

  7. Infrared • Pros • Almost everything has a remote • Will cover all the functions a user wants • Has premade tools: (Win)LIRC • http://lirc.sourceforge.net/remotes/ • Cons • Time consuming • Hardware Dependent

  8. Custom • Pros • You can do anything you want • Cons • More hardware

  9. Speech Recognition with Kinect From voice to code

  10. Microsoft SDKs • Kinect for Windows • Microsoft Speech Platform

  11. Kinect Setup

  12. Kinect Setup

  13. Kinect Setup

  14. Speech Recognition • Speech Recognition Engines • Grammars • Recognition Results

  15. Speech Recognition Engines • There are two types • We’ll use SpeechRecognitionEngine();

  16. Grammars • Define what we are looking for • Have three methods of creation • GrammarBuilder class • SrgsGrammar class • Srgs XML file

  17. GrammarBuilder • Allows you to add items such as strings and Choices objects to build a grammar • Used to create a Grammar object

  18. GrammarBuilder Example

  19. Adding a Grammar • recognitionEngine.LoadGrammar(g)

  20. Listening for Speech • Two Methods • Synchronous • recognitionEngine.Recognize() • Returns RecognitionResult • Asynchronous • recognitionEngine.RecognizeAsync() • recognitionEngine.RecognizeAsync(mode) • Raises SpeechRecognized event

  21. RecognitionResult • Contains all data regarding one grammar match. • Most notably contains: • Result.Text • Result.Confidence

  22. Full Example

  23. Questions and Contact Information • Name: Billy Overton • Email : overtonb@goldmail.etsu.edu • IRC: logos on irc.freenode.net • Join us in the #etsuacm channel

More Related