1 / 9

A Simple Embodied Dialog System NLP Final Project

A Simple Embodied Dialog System NLP Final Project. Angelo Cafaro 1 and Lorenzo Scagnetti 2 1 angelo08@ru.is Center for Analysis and Design of Intelligent Agents (CADIA) School of Computer Science, Reykjavik University – Iceland 2 lorenzos10@ru.is University of Camerino – Italy.

eadoin
Download Presentation

A Simple Embodied Dialog System NLP Final Project

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A Simple Embodied Dialog SystemNLP Final Project Angelo Cafaro1 and Lorenzo Scagnetti2 1angelo08@ru.is Center for Analysis and Design of Intelligent Agents (CADIA)School of Computer Science, Reykjavik University – Iceland 2lorenzos10@ru.is University of Camerino – Italy

  2. Scenario and Goals • Scenario: • People playing a Card Game in a bar: • Briscola: Italian card game; • Conversation during the game: chat; • Goals Selection of Non-VerbalBehavior chatting: • Set of Gestures; • Gazes;

  3. Approach (cont.)

  4. Approach (2 – cont.) • SituationalContext: • Discourse Model with Simple coreference resolution: • New and Evoked Discourse Entities; • KnowledgeBase (objects and characters in the scene); • Steps: • Tokenization; • Pos Tagging (Penn TreeBank PoS tagset); • SyntaxAnalysis (Noun Phrases, Verb Phrases and Pr eposition Phrases); • Coreference Resolution (Markers NEW and EVOKED Discourse Entities); • Information Structure: Rhematic and Thematic Part; • Heuristics  BML Output.

  5. Approach (3) • GameEvents: • People in a particular context (card game): • Turn Begin, Card Played, Match Rounds, etc… • Video, Observations and Annotation:

  6. Demo • Joint Project with VirtualEnvironments course. • We apologize…but we still have Work in Progress!!!

  7. Future Directions • Improved Discourse Model: • Gender and Numnber: Advanced Pos Tag set; • New Heuristics; • Selection of additional non-verbalbehaviors: • Facial Expressions; • Eyebrowns; • Postures; • …

  8. Questions ? ? ?

  9. Thanks for listening!!! • AngeloCafaro1 and LorenzoScagnetti2 • 1angelo08@ru.is • Center for Analysis and Design of Intelligent Agents (CADIA)School of Computer Science, Reykjavik University – Iceland • 2lorenzos10@ru.is • University of Camerino – Italy

More Related