1 / 8

WP1 UGOT demos

WP1 UGOT demos. 2nd year review Saarbrucken Mar 2006. GoDiS features. System makes sure that the system and the user have heard and understood each other (“grounding”) User can give information in any order (“accommodation”)

donald
Download Presentation

WP1 UGOT demos

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. WP1 UGOT demos 2nd year review Saarbrucken Mar 2006

  2. GoDiS features • System makes sure that the system and the user have heard and understood each other (“grounding”) • User can give information in any order (“accommodation”) • User can take own initiatives, and the system can handle multiple simultaneous topics / tasks (“multiple tasks”) • System generates clarification questions of there is some problem (”clarification”) • and more...

  3. Multimodality in GoDiS • Two kinds of multimodality • Parallel multimodality • All modalities convey all the information, without support from other modalities • Integrated multimodality • Information is distributed over several modalities; Modalities are combined to convey information

  4. Parallel multimodality in GoDiS • AgendaTalk application • Demo in demo session • Two separate interfaces to the same application • Speech interface • GUI interface • Only speech input and output handled by GoDiS dialogue manager

  5. Nuance ASR + TTS module GoDiS core agent update select IS MIVs RIVs rules domain agenda device resource Agenda GUI (BORG) Agenda database

  6. Integrated multimodality in GoDiS • Multimodal Menu-based Dialogue (MMD) • Dialogue plans are based on existing menu system • Menus can be navigated by speech, GUI or combination of both • Original GUI menu interface can be used as usual • User can control player using speech only, if necessary • Modalities can be freely mixed and changed at any point • No need to learn menu structure or even commands • Both speech and GUI input/output handled by GoDiS dialogue manager • Demo (film): DJ-GoDiS

  7. Graphical I/O module Nuance ASR + TTS module GoDiS core agent update select IS domain player device player device database Music player agent Music database agent DJ-GoDiS(current version)

  8. Graphical I/O module Nuance ASR + TTS module GoDiS core agent update select GF IS domain player device player device database Music player agent Music database agent DJ-GoDiS with GF multimodal grammar

More Related