50 likes | 72 Views
Intelligent Robot Architecture (1-3). Background of research. By recognizing and analyzing user’s utterances and actions, an intelligent robot must be able to capture the intention of the user to make correct responses
E N D
Intelligent Robot Architecture(1-3) • Background of research • By recognizing and analyzing user’s utterances and actions, an intelligent robot must be able to capture the intention of the user to make correct responses • In a multimodal dialog environment, a human and a robot interact by using combinations of spoken language and various gestures, even facial expressions. Therefore, a multimodal interface technique is important for developing an intelligent robot • Research objectives • Multimodal interaction manager model • - Combine and analyze the speech and gesture - Recognition to capture the intention of the user - Decide the robot’s intention according to the user’s intention. i.e., decide what to do and what to say. • Intelligent user modeling - Define generic user models and develop a reinforcement learning for a friendly evolving interaction.
Intelligent Robot Architecture(1-3) User’s Intention Recognizer Robot’s Task Planner Discourse History Discourse Knowledge Speech & Gesture Recognition Multimodal Interaction Manager Real-world & Object Ontology Anaphora Recognized Speech & Gesture Dialogue Model Observation Drinking Action Drinking Time Multimodal Instance Grounding Drinked Drink Observation Time Drinking Agent Instance Observing Agent Time Instance Volume Volume Model Observed Object Agent Absolute Cord X,Y,Z On Observable Object 사람 Robot space Hold At Vision Drink Notebook Table Cup 거실 솔의눈 컵101 • Research contents • Developing a multimodal interaction model - Developing a Multimodal anaphora processing method - Defining the representation of user’s intentions and robot’s domain actions in a multimodal interaction environment - Developing a prototype system of a multimodal interaction manager
Intelligent Robot Architecture(1-3) • Research contents • Recognition model of user’s goal and intention • - Developing to analyze user’s intention using a • plan inference technique and a dialogue manager • - Developing a sentence generation engine • Inference technique based on user models • - Defining a ontology to include a user profile. • i.e., preference, life pattern
Project Leader Jungyun Seo Dept. of Computer Science & Interdisciplinary Prog. of Integrated Biotechnology, Sogang Univ. seojy@sogang.ac.kr, http://nlp.sogang.ac.kr Research Institutes : Sogang University, Kangwon National University, Dongseo University Researchers : 18(Univ. 18, Industry 0)