70 likes | 157 Views
Evaluation of Relationships and Cause&Effect Questions. Co-chaired by John Prager, IBM & Eric Nyberg, CMU. Participating Entities. People Organizations Political Government Non-government Business Social/Recreational Countries (or other geographic entities) Commodities/Products/Services
E N D
Evaluation ofRelationships and Cause&EffectQuestions Co-chaired by John Prager, IBM & Eric Nyberg, CMU
Participating Entities • People • Organizations • Political • Government • Non-government • Business • Social/Recreational • Countries (or other geographic entities) • Commodities/Products/Services • Events • Natural/Artifical Processes
Meta-Types of Connection • Explicit mentions • In text • Actually, might be implicit • As predicates • Statistical • Inferred • a R b && b R’ c -> a R’’ c • Links are any of 3 kinds
Types of Connection • Family • Co-presence • Specific instances • Member_of • Trades_with • Borders • …
Kinds of R & C-E Questions • Specific yes-no • Is X a member of organization Y? • Missing link • What organization/country/… do X and Y both belong to? • Open/Generic yes-no • What is the relationship between X and Y? • Is X related to Y? • Causality Completion • What caused X? • What was/will be the result of Y?
What Happened • A lot of discussion! • Evaluation in general • Form of answer • Overlap with EELD • Make sure there is a distinction • Articulate the difference • Relationship questions or Cause&Effect questions? • Role of template-filling
Conclusions • Start with a set of questions that are representative of IC needs • Use new TREC corpus • Possibly relevant stories: • Kosovo • Middle East • India-Pakistan • etc.