1 / 30

Just-in-Time Interactive Question Answering

Just-in-Time Interactive Question Answering. Sanda Harabagiu: PI. Language Computer Corporation. Just-in-Time Interactive Question Answering. People Sanda Harabagiu, PI Dan Moldovan Larry Daffner John Williams. Objective of Research Project.

jonah-gibbs
Download Presentation

Just-in-Time Interactive Question Answering

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Just-in-Time Interactive Question Answering Sanda Harabagiu: PI Language Computer Corporation

  2. Just-in-Time Interactive Question Answering • People • Sanda Harabagiu, PI • Dan Moldovan • Larry Daffner • John Williams AQUAINT June 2002 Workshop - JITIQA

  3. Objective of Research Project • Address the interactive aspect of Q&A systems design and implement a dialog shell that can be used with any Q&A system • Extension of work in factual Q&A with dialog capabilities already tested in call center systems AQUAINT June 2002 Workshop - JITIQA

  4. Novelty • Usage of just-in-time citations of other analyst’s similar Q&A sessions: • Just-in-time citations are provided by Just-in-Time Information Seeking Agents (JITISA) • JITISA: intelligent agents that proactively search and retrieve information that might be useful without requiring any action from the professional analyst • Non-intrusive software agents that monitor the dialog contexts generated when different agents interrogate Q&A systems AQUAINT June 2002 Workshop - JITIQA

  5. Tasks Proposed AQUAINT June 2002 Workshop - JITIQA

  6. Tasks Proposed AQUAINT June 2002 Workshop - JITIQA

  7. Building a Dialog Manager • Wizard-of-Oz Experiments • Extract the features from the Wizard-of-Oz Data • Implement the dialog manager with a strategy that optimizes the features AQUAINT June 2002 Workshop - JITIQA

  8. Wizard of Oz Experiments • Year 1: Open-Curtain experiments • Main focus: gauge the acceptability of the system-user interaction. • General assumption = no actually system exists, • develop a detailed conception of the system such that the responses to the user’s questions are known • Year 2: Study annoyance factors AQUAINT June 2002 Workshop - JITIQA

  9. Our assumption • Build a “transition network” of questions, answers and follow-up questions • Completely unrestricted dialog on the user’s side • The user asks any questions • Be able to refine the transition network by allowing different turns AQUAINT June 2002 Workshop - JITIQA

  10. User2 Q1 Q3 Different Perspectives Open-Curtain Wizard-of-Oz experiment • Start with a complex question (which eventually does not return any acceptable answer) User1 User1 Q1 Q1 Q2 Q2 Q2 Q3 Qn 10AM 11AM 2PM Q3 Information Satisfaction Temporal Perspectives AQUAINT June 2002 Workshop - JITIQA

  11. AQUAINT June 2002 Workshop - JITIQA

  12. AQUAINT June 2002 Workshop - JITIQA

  13. violence Semantic Representation CAUSE West Bank now Semantic Representations for Interactive Q/A Example: Why is there so much violence on the West Bank now ? Processing: Syntactic Parse - binary dependencies AQUAINT June 2002 Workshop - JITIQA

  14. Novel Representation Frame-like template: Event: template slots: event: violence entity: agent ?? patient ??  location: West Bank Motivation: the answer time: now  May 2, 2002 The same template can be generated by another reformulation of the original question: “What are the causes of the current violence in the West Bank ?” information coming from the answer now AQUAINT June 2002 Workshop - JITIQA

  15. AQUAINT June 2002 Workshop - JITIQA

  16. Ideal Case • Create a complex “transition network” containing all possible follow-up questions and all possible dialog paths Q1 Q2 Q3 AQUAINT June 2002 Workshop - JITIQA

  17. AQUAINT June 2002 Workshop - JITIQA

  18. Template River Flow Question: What are the causes of the current violence in the West Bank? STATEEVENT = Template Name Event: violence Entity: Israel Location: West Bank Time: now Answer: Large parts of the West Bank and Gaza remain under Israeli military occupation. New slot: Motivation: Israeli occupation of West Bank Filler is a paraphrase of the answer Template (Question) AQUAINT June 2002 Workshop - JITIQA

  19. Follow-up Question Possibilities: • -same event -a new slot • Relation -slot from Template -other entity/event -… Possible Motivator: Elaboration AQUAINT June 2002 Workshop - JITIQA

  20. Color Code • Same slot, Same filler yellowblue • Same slot, Different filler red River of colors AQUAINT June 2002 Workshop - JITIQA

  21. AQUAINT June 2002 Workshop - JITIQA

  22. How are templates generated? • 2-Phase Process • First, templates are proposed by a linguist novice, having a clear goal. (Larry) • Second, they are refined by John and Sanda. • Phase I: Larry develops an algorithm of identifying fillers for each template. Sources: Question Parse, Semantic Form Answer Parse, Semantic Form AQUAINT June 2002 Workshop - JITIQA

  23. Phase II • Generate template slots automatically (John Williams) Sources: Question Parse, Semantic Form Answer Parse, Semantic Form Dialog annotations, NE Recognizer Dialog motivators and Context modeling AQUAINT June 2002 Workshop - JITIQA

  24. Template Generation • Larry has created several types of templates: EVENT STATE RELATION ATTITUDE ATTRIBUTES MOTIVATION -definition questions -causality questions INVOLVEMENT CONTRAST AQUAINT June 2002 Workshop - JITIQA

  25. Example • RELATION Templates: Generated by: What is Ariel Sharon’s connection to the Palestinians? How do Israel’s Likud and Labor parties differ on peace with Palestine? • ATTITUDE Templates: What is Ariel Sharon’s position on Palestine? Why is Jerusalem important to Palestinians? What were Ehud Barak’s views on peace with the Palestinians? Why did the Lebanese Phalange hate the Palestinians? How do the Hashemites view the Palestinian Authority? AQUAINT June 2002 Workshop - JITIQA

  26. Research Challenges • How many template kinds are sufficient? • How should they be organized? • What is the relationship between template kinds, question classes and dialog context? AQUAINT June 2002 Workshop - JITIQA

  27. Novelties • Open-Domain Questions • No pre-defined task -Task needs to be “guessed” as the dialog evolves • A general template algebra needs to be implemented to: • Deal with templates created in an ad-hoc manner • Help define the template motivators • New set of motivators (e.g. elaboration, tangent) AQUAINT June 2002 Workshop - JITIQA

  28. Phase III and IV • Phase III: Use two analysts to conduct a dialog starting with the same first question and the same general goal. Study the completeness and efficiency of the dialog motivators as well as the possible overlap. • Phase IV: Allow mixed initiative. AQUAINT June 2002 Workshop - JITIQA

  29. Enhance the Q/A Accuracy • Definition questions • Causality questions • Causality-Effect/Involvement questions • Attitude questions AQUAINT June 2002 Workshop - JITIQA

  30. Thank You ! AQUAINT June 2002 Workshop - JITIQA

More Related