60 likes | 178 Views
Electric Secretary. Proposal: Parsing spontaneous utterances for Corrected/Completed Speech ("transcript") Low-compression summarization ("minutes") Question answering Meeting context Spontaneous speech: Incomplete, Agrammatical, Disfluent, Poor function words Dialog:
E N D
Electric Secretary • Proposal: Parsing spontaneous utterances for • Corrected/Completed Speech ("transcript") • Low-compression summarization ("minutes") • Question answering • Meeting context • Spontaneous speech: • Incomplete, Agrammatical, Disfluent, Poor function words • Dialog: • Multiple speakers, deictic reference
Meeting Minutes • Compressed • Reorderedf. MOO Help-Sheet • The MOO Help-Sheet is currently under revision, and will be mailed as soon as possible.http://www.techfak.uni-bielefeld.de/bcd/Faculty/Meetgs96/vsns-bcd-faculty-15Mar96-minutes.html
Human Transcription • Gesture • DisambiguationGeorgF says, "I'll email the MOO Help sheet to all Instructors"PaulSt says, "OK! Thanks."RebeccaP says, "Do we again have consulting students to help with working with the MOO if we want to do something fancy with it?"GeorgF nods.Robertgi says, "Georg has posted about 100 jobs for consultants."http://www.techfak.uni-bielefeld.de/bcd/Faculty/Meetgs96/vsns-bcd-faculty-15Mar96
Speech Recognition • ViaVoice advertises 95% • Meetings not dictated! • Tiny experiment:Georg has posted about 100 jobs for consultantsTortoise was said about hundred jobs for consultants I never did anything fancy, but it has occurred to me that I didn't I never did anything fancy but as occurred to me that Recorded by Andy Chang in conversational voice, with high quality microphone, using extensively trained ViaVoice recognizer in dictation mode. Thanks, Andy!
Prior Work • Berkeley/MIT: Meeting Recording, Correction Krste Asanovic, Adam Janin, ...http://www.icsi.berkeley.edu/~janin/mrpda/ • Edinburgh: Parsing and Tagging David McKelvie, Henry Swift Thompsonhttp://www.ltg.ed.ac.uk/~dmck/PPP/ • Brown: Edit Detection and Parsing Eugene Charniak, Mark Johnsonhttp://www.cs.brown.edu/people/ec/
Value Added! • Transcription • Removing edits: finding similar parses • Hallucinating function words: missing parse location • Combination with visual input (pointing)? • Summary • Focus tracking, reference resolution • Question Answering • Syntactic transformations • Domain-specific knowledge