1 / 13

Programming by Voice with Scratch: Teaching the Cat to Obey a Bird

Programming by Voice with Scratch: Teaching the Cat to Obey a Bird. Ramaraju Rudraraju, Srinivasa Datla, Avishek Banerjee, Mandar Sudame Univ. of Alabama at Birmingham, Department of Computer and Information Sciences Jeff Gray University of Alabama, Department of Computer Science

lottie
Download Presentation

Programming by Voice with Scratch: Teaching the Cat to Obey a Bird

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Programming by Voice with Scratch:Teaching the Cat to Obey a Bird Ramaraju Rudraraju, Srinivasa Datla, Avishek Banerjee, Mandar Sudame Univ. of Alabama at Birmingham, Department of Computer and Information Sciences Jeff Gray University of Alabama, Department of Computer Science Gary Edwards United Cerebral Palsy of Greater Birmingham This research sponsored by a Google Research Award

  2. Overview of Presentation Scratch Script Video Motivation Myna Features Architecture & Working of Myna Dynamic Grammars

  3. Scratch Script Get your popcorn, its Movie Time!!

  4. Motivation • The WIMP Metaphor Window Menu Pointing Device Icons

  5. Motivation The WIMP assumes dexterity The MYNA Solution for Scratch

  6. Features • Drag and Drop Navigation • Continuous Navigation • Navigation using Transparent Frames Types of Navigation

  7. Features (An extension of Transparent Frames) • Drop After • Drop In • Drop Before Macro Commands

  8. Myna Architecture Component Mappings Cloud Garden Model Sprite State Storage MYNA Speech Recognizer Component Hierarchy Grammar View Controller Command Executor Java Robot Scratch UI Transparent Frames

  9. Under the Hood of Myna Move Right Controller Model Grammar Grammar Mappings Mappings Command Executor Command Executor Speech Recognizer Speech Recognizer Component Hierarchy Component Hierarchy Java Robot Java Robot

  10. Dynamic Grammar Resume Pause File Navigation Grammar Navigation Grammar Default Grammar Default Grammar Speech Pause Grammar File Grammar File Grammar Control Grammar Looks Grammar

  11. Looking Ahead • Limitations • Scratch needs to be in maximized mode • Not compatible with different screen resolutions • Myna is not scroll-enabled • Large vocabulary and still growing! • Future Work • Integration with UCP - Deep human subjects testing with United Cerebral Palsy of Greater Birmingham • Portability on other platforms • Configurable screen resolutions

  12. Summary • Myna is our preliminary attempt towards voice-driven programming applied to Initial Learning Environments (ILEs) to overcome the physical challenges of using the traditional WIMP metaphor • Our long-term goal is to assist children with disabilities by giving them a learning tool that enables them to encounter the joys and excitement of programming, while also improving their logic skills

  13. Thank you Questions and comments? https://sites.google.com/site/projectmyna2010/ Additional questions? teammyna@googlegroups.com

More Related