160 likes | 319 Views
Tampere Unit for Human-Computer Interaction University of Tampere. Markku Turunen MUMIN workshop, Helsinki, 15-16.11.2002. Outline. Topics Research themes, context and methods Applications Future challenges and topics for discussion. Research themes.
E N D
Tampere Unit for Human-Computer InteractionUniversity of Tampere Markku Turunen MUMIN workshop, Helsinki, 15-16.11.2002
Outline Topics • Research themes, context and methods • Applications • Future challenges and topics for discussion
Research themes Interaction techniques for speech applications • adaptive multilingual speech inputs and output • error handling strategies • interaction (dialogue) management strategies • fusion and fission of multimodal information • information representation in distributed applications • context-awareness, privacy and trust
Research context Pervasive and mobile settings • multiple simultaneous multiparty dialogues • human-to-computer, human-to-human • implicit modalities: sensor information, position etc. • speaker recognition and verification • telephony applications, mobile settings • special user groups (e.g. visually impaired users)
Research approach Constructive HCI research • architectures for adaptive applications • prototype applications • support for iterative development • support for evaluation: Wizard of Oz, usability evaluation • support for data (corpus) collection
Architecture research speech application development framework • a framework for adaptive speech applications • designed especially for multilingual and distributed applications • overall focus on system level adaptivity • current focus on ubiquitous and multimodal applications • Java and XML, freely available • used in several projects and applications
Application prototypes Jaspis-based speech applications • speech-based timetable services • multilingual e-mail applications • mobile speech applications • ubiquitous computing applications traditional, unimodal applications innovative, multimodal applications
Applications: Busman (Bussimies) / Interact Speech-enabled timetable services • speech interface for (bus) timetables • “natural” spoken queries • “mass-market” application • two independent versions: • Busman (Bussimies): Tampere version • USIX-Interact: Helsinki version, collaboration with other universities (e.g. UIAH)
Applications: Mailman (Postimies) / AthosMail Multilingual speech-based e-mail systems • Basic e-mail features for telephone users (IMAP/POP3) • Finnish and English & English / Swedish • ASR + DTMF inputs • Main focus on intelligible and pleasant speech outputs • in collaboration with visually impaired users • AthosMail: EU-funded IST project (DUMAS)
Applications: Mobile applications Mobile speech applications • integration of services • support for group communication (awareness, shared knowledge) • visually impaired users (short message services etc.) • office environments • mobile usage
Applications: Doorman (Ovimies) Speech-based ubicomp systems • identifies the target of the visitor’s visit or the identity of the staff member • opens the door and guide the visitors in our premises • conveys personal and organizational messages to staff members
Applications: Doorman (Ovimies) Technology • speech synthesis, speech recognition, speaker recognition, anthropomorphic guidance, physical switches, sensors • EMFi-technology: wall and ceiling mounted loudspeakers and floor-sensors • telephone and PDA interfaces for mobile users
Discussion topics Discussion topics • English vs. Nordic languages • Freely available and open-source components • Demonstrations vs. working applications
TampereUnit forComputerHumanInteraction Department of Computer and Information Sciences http://www.cs.uta.fi/hci/spi/ spi@cs.uta.fi mturunen@cs.uta.fi