1 / 15

Engineering Dialog for Gadgets

Engineering Dialog for Gadgets. Thomas K Harris September 12, 2003. ???Questions???. Motivation: Is speech a useful modality for electronic devices? Hardware: How would one get speech in “other” devices? Architecture: What should the system look like?

adamma
Download Presentation

Engineering Dialog for Gadgets

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Engineering Dialog for Gadgets Thomas K Harris September 12, 2003

  2. ???Questions??? • Motivation: Is speech a useful modality for electronic devices? • Hardware: How would one get speech in “other” devices? • Architecture: What should the system look like? • Dialog: What should/will these conversations be like?

  3. Current Speech Application Concept Phone Client PDA Client Computer Client Speech Application Backend

  4. Current Electronic Devices ??? ??? ??? Speech Application Frontend

  5. Protocol-based Architecture Havi adapter Speech Graffiti Personal Universal Controller X10 adapter

  6. Speech Graffiti Dialog • Artificial subset language • Tree-structured functions • Universal conversational primitives • User-directed • Great for recognition • Entirely declarative (and automatic)

  7. Minimal Keywords • hello-james • options • where-am-i, where-was-i • go-ahead, ok • status • goodbye • what-is, what-is-the • how-do-i • more

  8. Session Management • hello-james/goodbye • User: blah blah blah...System: ignoring userUser: hello-jamesSystem: stereo, digital cameraUser: stereoSystem: stereo hereUser: goodbyeSystem: goodbyeUser: blah blah blah...System: ignoring user

  9. Query • what-is path/status • User: what-is-the am frequencySystem: the am frequency is five hundred thirtyUser: what-is randomSystem: random is offUser: what-is-the stereoSystem: the stereo is tuner

  10. help/exploration/implicit navigation • how-do-i.../options/path options • User: control alarm clock radio optionsSystem: alarm, clock, radio, sleep...User: moreSystem: x10, stereoUser: stereo optionsSystem: while turning stereo on: off, am, fm, auxiliary, cd...

  11. invocation/specification/implicit exploration/navigation • Path • User: stereo auxiliarySystem: while turning the stereo on and switching to auxiliary: auxiliaryUser: cdSystem: while switching to cd mode: cdUser: playSystem: while playing a cd: play

  12. list navigation • More • User: radio band am optionsSystem: bracketed list [frequency, kabc, k001, k002, k003, k004, k005][fm][off, volume][alarm, clock, sleep][x10, stereo] rendered: frequency, kabc, k001, k002...User: moreSystem: k003, k004, k005...User: moreSystem: fm, off, volume...

  13. orientation • where-am-i • User: what is the discSystem: the disc is threeUser: where am iSystem: stereo cd disc

  14. Research Questions • Is the subset language learnable? • Once learned, is it efficient? • Are user mistakes infrequent enough? • Are system mistake infrequent enough? • Can one generalize from one device to another? • Is the subset language well retained?

More Related