1 / 25

Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain

Explore the RavenClaw architecture for automated medical diagnosis. Learn dialog management and conversation strategies.

lflora
Download Presentation

Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Madeleine, a RavenClaw Exercise in the Medical Diagnosis Domain Dan Bohus, Alex Rudnicky MITRE Workshop on Dialog Management, Boston, October 2003

  2. Recognition SPHINX Synthesis FESTIVAL Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  3. HUB FESTIVAL SERVER Overall Architecture (internals) Recognition SPHINX Parsing PHOENIX/HELIOS Galaxy Dialog Manag. RAVENCLAW Back-end (perl) Synthesis FESTIVAL Language Gen. ROSETTA Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  4. Recognition SPHINX Synthesis FESTIVAL Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  5. Recognition SPHINX Text I/O TTYServer Synthesis FESTIVAL Overall Architecture Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Language Gen. ROSETTA Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  6. Text I/O TTYServer Developed Resources Grammar Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Back-end (perl) RavenClawDialogTaskSpecification Language Gen. ROSETTA Templates Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  7. Text I/O TTYServer Development Time Grammar Parsing PHOENIX/HELIOS Dialog Manag. RAVENCLAW Back-end (perl) Back-end (perl) RavenClawDialogTaskSpecification Language Gen. ROSETTA Templates Total: 21:15h Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  8. RavenClaw Architecture • Captures all domain-specific dialog (task) logic with a hierarchical description • The authoring effort is focused entirely here Dialog Task (Specification) Domain-independent Dialog Engine • Manages dialog by executing the dialog task specification • Provides domain-independent conversational strategies Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  9. diagnostic chart have_fever general_feeling RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  10. diagnostic chart general_feeling have_fever RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  11. diagnostic chart general_feeling have_fever RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Welcome Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  12. diagnostic chart general_feeling have_fever RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Hi, this is Madeleine, the automated… Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  13. headache have_fever chart general_feeling diagnostic RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:Headache R: R: R: R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Hi, this is Madeleine, the automated… LoadSymptoms Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  14. headache have_fever chart general_feeling diagnostic RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:Headache R: R: R: R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Hi, this is Madeleine, the automated… Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  15. headache have_fever chart general_feeling diagnostic RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:Headache R: R: R: R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Hi, this is Madeleine, the automated… GeneralFeel Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  16. headache diagnostic general_feeling chart have_fever RavenClaw Architecture Madeleine I:Welcome E:LoadSymptoms GeneralFeel GeneralFeel Diagnose R:HowAreYou? I:Glad I:Glad I:Sorry I:Sorry Fever Travel R:Headache R: R: R: R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Hi, this is Madeleine, the automated… general_feeling: [good], [bad], [soso] How are you feeling today? general_feeling: [good], [bad], [soso] Not so good, I think I have a fever general_feeling: [good], [bad], [soso]have_fever: [fever]. ![yes], ![no]headache: [headache], ![yes], ![no]cough: [cough], ![yes], ![no]… … [soso](not so good)[fever](I think I have a fever) HowAreYou GeneralFeel GeneralFeel Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  17. Illustrated Features • Dynamic generation of dialog task structure • Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly • New symptoms – no DM changes • Dynamic dialog control policy • The order in which symptoms are addressed is controlled by the backend • Conversational skills Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  18. Illustrated Features • Dynamic generation of dialog task structure • Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly • New symptoms – no DM changes • Dynamic dialog control policy • The order in which symptoms are addressed is controlled by the backend • Conversational skills Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  19. Backend Decision Tree diagnostic have_fever chart general_feeling headache Dynamic Dialog Control … Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:Headache R: R: R: R:AskFever E:MeasureTemp I:InformFever Dialog Stack Expectation Agenda Hi, this is Madeleine, the automated… How are you today? Not so good, I think I have a headacheSorry to hear you’re not feeling so good,Tell me more about your symptoms… Do you have abdominal pain? Diagnose Madeleine Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  20. Illustrated Features • Dynamic generation of dialog task structure • Symptoms loaded from backend, appropriate structures to “talk about them” created on-the-fly • New symptoms – no DM changes • Dynamic dialog control policy • The order in which symptoms are addressed is controlled by the backend • Conversational skills Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  21. Conversational Skills • Corresponding agencies added automatically to the dialog task tree • Help • What Can I Say? • Repeat • Suspend / Resume • Start Over • Timeout handling (not illustrated) • Still need all the language generation prompts and grammar, but some of those are develop-once, too Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  22. Conclusion • Highlights • Set task posed no challenges to the framework • Easy to implement • Dynamic dialog structure and control • Automatic use of domain-independent conversational skills • Lowlights? • Toolkit perspective: how easy would it be for someone else to build it? • Asynchronous behaviors? (timing) • Couple of bugs / fixes (or is that a highlight?) • … Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  23. Demo Run Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  24. diagnostic headache have_fever general_feeling chart StateIndicators RavenClaw Grounding Madeleine I:Welcome E:LoadSymptoms GeneralFeel Diagnose R:HowAreYou? I:Glad I:Sorry Fever Travel R:Headache R: R: R: R:AskFever E:MeasureTemp I:InformFever Grounding Engine Strategies Madeleine: a RavenClaw exercise in the medical diagnosis domain…

  25. Other RavenClaw systems • LARRI – Language Assistant for Retrieval of Repair Information • RoomLine – Conference room reservation within SCS • Let’s Go! (BusLine) – Bus schedule information in Pittsburgh • TeamTalk – Command and control for a team of robots • Eureka – Dialog interface to a clustered web search engine (Vivisimo) Madeleine: a RavenClaw exercise in the medical diagnosis domain…

More Related