1 / 72

Recognizing Partial Textual Entailment

This study explores recognizing faceted entailment using existing methods and lexical-syntactic inference techniques. The analysis involves assessing text entailment and extraction accuracy through a comprehensive student response analysis. Developed at Bar-Ilan University and Technische Universität Darmstadt, this research emphasizes understanding semantic relations in textual entailment tasks.

ijennings
Download Presentation

Recognizing Partial Textual Entailment

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Recognizing Partial Textual Entailment Omer LevyIdo Dagan Natural Language Processing Lab Bar-Ilan University TorstenZeschIrynaGurevych Ubiquitous Knowledge Processing Lab TechnischeUniversität Darmstadt

  2. Textual Entailment

  3. T: muscles move bones

  4. T: muscles move bonesH: muscles generate movement

  5. T: muscles move bonesH: muscles generate movement

  6. T: muscles move bonesH: the muscles’ main job is to move bones ?

  7. T: muscles move bonesH: the muscles’ main job is to move bones

  8. Complete Textual Entailment

  9. Complete Textual Entailment

  10. Complete Textual Entailment .Partial.

  11. Complete Textual Entailment .Partial. (Nielsen et al, 2009)

  12. T: muscles move bonesH: the muscles’ main job is to move bones

  13. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones

  14. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones

  15. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones Student Response Analysis

  16. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones Student Response Analysis Summarization Information Extraction

  17. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones Facets

  18. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones(main job, muscles)(muscles, move) (move, bones) Facets

  19. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones(main job, muscles) (muscles, move) (move, bones) Facets

  20. T: muscles move bones(main job of muscles) (muscles move) (bones are moved)H: the muscles’ main job is to move bones(main job, muscles) (muscles, move) (move, bones) Facets

  21. Facet: a pair of terms and their implied semantic relation.

  22. Facet: a pair of termsand their implied semantic relation. (move, bones)

  23. Facet: a pair of termsand their implied semantic relation. (move, bones) theme … is to move bones

  24. Recognizing Faceted Entailment

  25. T: muscles move bonesH: the muscles’ main job is to move bones RecognizingFacetedEntailment

  26. T: muscles move bonesH: the muscles’ main job is to move bones RecognizingFacetedEntailment

  27. T: muscles move bonesH: the muscles’ main job is to move bones RecognizingFacetedEntailment

  28. T: muscles move bonesH: the muscles’ main job is to move bones RecognizingFacetedEntailment

  29. What did we do?

  30. Approach: LeverageExisting Methods

  31. Approach: Leverage Existing Methods

  32. Exact Match P: 96%, R: 30%penicillincurespneumonia(penicillin, cure)Lexical Inference(penicillin, cure) pneumonia is treated by penicillinLexical-Syntactic Inference Approach: Leverage Existing Methods

  33. Exact Match P: 96%, R: 30%penicillincurespneumonia(penicillin, cure)Lexical Inference(penicillin, cure) pneumonia is treated by penicillinLexical-Syntactic Inference Approach: Leverage Existing Methods

  34. Exact Matchpenicillin cures pneumonia (penicillin, cure)Lexical Inference WordNetpneumonia is treated by penicillin(penicillin, cure)Lexical-Syntactic Inference Approach: Leverage Existing Methods

  35. Exact Matchpenicillin cures pneumonia (penicillin, cure)Lexical Inference WordNetpneumonia is treated by penicillin(penicillin, cure)Lexical-Syntactic Inference Approach: Leverage Existing Methods

  36. Exact Matchpenicillin cures pneumonia (penicillin, cure)Lexical Inferencepneumonia is treated by penicillin (penicillin, cure)Lexical-Syntactic Inference Approach: Leverage Existing Methods penicillin cures pneumonia pneumonia is treated by penicillin

  37. Bar-Ilan University Textual Entailment Engine(Stern and Dagan, 2011)

  38. BIUTEE

  39. BIUTEE T H cures penicillin pneumonia

  40. BIUTEE T H cures treated penicillin pneumonia pneumonia is by penicillin

  41. BIUTEE T H cures treated penicillin pneumonia pneumonia is by penicillin

  42. cures penicillin pneumonia

  43. cure treat (lexical) cures treats penicillin penicillin pneumonia pneumonia

  44. cure treat (lexical) cures treats treated active passive (syntactic) penicillin penicillin pneumonia pneumonia pneumonia is by penicillin

  45. Facets to Dependencies treated pneumonia is by penicillin

  46. Facets to Dependencies treated pneumonia is by penicillin

  47. BaselineBaseLexBaseSynMajority Decision Mechanisms Exact Match Exact Match OR Lexical Inference Exact Match OR Syntactic Inference Lexical Inference Exact Match OR AND Syntactic Inference

  48. BaselineBaseLexBaseSynMajority Decision Mechanisms Exact Match Exact Match OR Lexical Inference Exact Match OR Syntactic Inference Lexical Inference Exact Match OR AND Syntactic Inference

  49. BaselineBaseLexBaseSynMajority Decision Mechanisms Exact Match Exact Match OR WordNet Exact Match OR BIUTEE Lexical Inference Exact Match OR AND Syntactic Inference

  50. BaselineBaseLexBaseSynMajority Decision Mechanisms Exact Match Exact Match OR WordNet Exact Match OR BIUTEE WordNet Exact Match OR AND BIUTEE

More Related