140 likes | 223 Views
HOMMER: Holistic Model for Minority Education & Research. Speech, Robotics, and Vision Laboratory. by Dr. Clement Allen. Department of Computer and Information Sciences. May 5th, 2004. Spoken Language Understanding. Autonomous Robotics. Machine Vision.
E N D
HOMMER: Holistic Model for Minority Education & Research Speech, Robotics, and Vision Laboratory by Dr. Clement Allen Department of Computer and Information Sciences May 5th, 2004
Spoken Language Understanding • Autonomous Robotics • Machine Vision Department of Computer and Information Sciences May 5th, 2004 Speech, Robotics, and Vision • Goals • Provide instructional and research laboratory for:
Speech, Robotics, and Vision • Goals • Provide support for student assignments that are applied to these areas Examples: compiler for a robot language data structures speech processing JAVA class for robot controller • Provide support for researching problems in these areas Department of Computer and Information Sciences May 5th, 2004
impact drive and assist Speech, Robotics, and Vision • Expose undergraduates to “exciting” technologies and research Research activities Teaching environment Department of Computer and Information Sciences May 5th, 2004
Speech JSBB (Java Speech Builder) • A visual development environment for creating speech applications. • The tool generates a Java program that implements the behavior described by the developer. • Based on OGI Speech Toolkit (CSLU) Department of Computer and Information Sciences May 5th, 2004
Start book who jim ask1 mary found ask2 bob return stop tell ask3 JSBB (Java Speech Builder) Department of Computer and Information Sciences May 5th, 2004
JSBB (Java Speech Builder) VoiceCal -A voice-based appointment scheduler Speech-based Music player Speech-based FAMU student information system Undergraduate projects Department of Computer and Information Sciences May 5th, 2004
JSBB (Java Speech Builder) Master’s Thesis VoiceUML Department of Computer and Information Sciences May 5th, 2004
JSBB (Java Speech Builder) Create a class called Registration Master’s Thesis SpeechJava FILE EDIT public class Registration { } Department of Computer and Information Sciences May 5th, 2004
ROBOTICS Recruited students Purchased robots Built robots Developed Java-based robot controller Department of Computer and Information Sciences May 5th, 2004
start robot choice left forward back right continue Results • Speech interface to Java-based Robot Controller • Developed using JSBB Department of Computer and Information Sciences May 5th, 2004
start robot choice left forward back right move forward continue turn right Department of Computer and Information Sciences May 5th, 2004
Speech, Robotics, and Vision Future Work • Extend JSBB • Improve Robotics capabilities • Develop and incorporate vision framework • Develop course resources Department of Computer and Information Sciences May 5th, 2004
Speech, Robotics, and Vision Collaborations Dr. Emanual Collins Department of Mechanical Engineering FAMU/FSU College of Engineering Dr. Juan Gilbert Human Centered Computing Lab Auburn University Department of Computer and Information Sciences May 5th, 2004