1 / 78

Easy-First Coreference Resolution

This text discusses the task of coreference resolution, which involves identifying noun phrases that refer to the same real-world entity. It explores the challenges and various approaches to solving this inherently global task, including pairwise and global approaches. The Multi-Pass Sieve method is highlighted as a successful approach, utilizing incremental clustering and hand-specified rules to improve precision and recall.

ddonald
Download Presentation

Easy-First Coreference Resolution

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Easy-First Coreference Resolution VeselinStoyanov and Jason Eisner Johns Hopkins University

  2. Coreference Resolution • Given a peace of text, identify all noun phrases that refer to the same real-world entity

  3. Coreference Resolution • Given a peace of text, identify all noun phrases that refer to the same real-world entity Former Boxing Champion Mike Tyson revealed that he had caught Hollywood heartthrob Brad Pitt with his ex-wife Robin Givens. In an interview Tyson said that he was amidst the process of divorce from Givens in the late 1980s when he found her sleeping with the Hollywood star.

  4. Coreference Resolution • Given a peace of text, identify all noun phrases that refer to the same real-world entity Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  5. Coreference Resolution • Given a peace of text, identify all noun phrases that refer to the same real-world entity Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  6. Coreference Resolution • Typical pairwise approaches • But, inherently global task Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  7. Coreference Resolution • Inherently global task Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  8. Coreference Resolution • Inherently global task Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  9. Global Approaches to Coreference Resolution • A difficult search problem • Exponentially many possible clusterings • Recent approaches have been successful: • [Culotta et al., 2007] – train a global coherence measure; use greedy inference at test time • [Poon and Domingos, 2008] – use an unsupervised approach based on MLNs to enforce global properties

  10. A Different Approach • A Multi-Pass Sieve [Raghunathan et al., 2010] • Build coreference clusters incrementally • Applying sieves (hand-specified rules) of decreasing precision and increasing recall • Winner of the CoNLL-2011 shared task

  11. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  12. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  13. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match • Precise Constructs Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  14. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match • Precise Constructs Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  15. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match • Precise Constructs • Strict Head match Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  16. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match • Precise Constructs • Strict Head match Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  17. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match • Precise Constructs • Strict Head match …………. 7. Pronoun Matching Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  18. A Multi-Pass Sieve for Coreference Resolution [Raghunathan et al. 2010] • Sieves: • Exact match • Precise Constructs • Strict Head match …………. 7. Pronoun Matching Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  19. Easy-First Coreference Resolution • Use the same idea: • Greedily build clusters • Using more information for the less confident decisions • But learn automatically what constitutes an “easy” (confident) decision • Leads to empirical improvement over the Multi-Pass Sieve approach and a competitive baseline

  20. Easy-First Coreference Resolution • Incrementally and greedily build clusters • Using machine learning • Learn policy for the test time inference procedure

  21. Easy-First Coreference: Talk Overview • Test-Time Inference • Training Algorithm • Experimental results

  22. Test-time inference

  23. Test-Time Inference • Begin with each NP in a separate cluster Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  24. Test-Time Inference • Begin with each NP in a separate cluster Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Cluster 3 SemType: person Gender: male Number: single Names: NIL Cluster 3 SemType: person Gender: male Number: single Names: NIL Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  25. Test-Time Inference • Compute a feature vector for each pair of clusters Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  26. Test-Time Inference • Compute a feature vector for each pair of clusters SemTypeSame = False Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  27. Test-Time Inference • Compute a feature vector for each pair of clusters SemTypeSame = False SemTypeComp = True Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  28. Test-Time Inference • Compute a feature vector for each pair of clusters SemTypeSame = False SemTypeComp = True NumberSame = True Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  29. Test-Time Inference • Compute a feature vector for each pair of clusters SemTypeSame = False SemTypeComp = True NumberSame = True RoleAppositive = True Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  30. Test-Time Inference • Compute a feature vector for each pair of clusters SemTypeSame = False SemTypeComp = True NumberSame = True RoleAppositive = True SentDistance = 0 Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  31. Test-Time Inference • Compute a feature vector for each pair of clusters SemTypeSame = False SemTypeComp = True NumberSame = True RoleAppositive = True SentDistance = 0 Global features Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson Local features Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  32. Test-Time Inference • Compute a feature vector for each pair of clusters Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson f(joinij) Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  33. Test-Time Inference • Compute a weight for each join action Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson w.f(joinij) Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  34. Test-Time Inference • Compute a weight for each join action Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson weightij= w.f(joinij) Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  35. Test-Time Inference • Perform the action with the highest weight Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson aij=argmaxij w.f(joinij) Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  36. Test-Time Inference • Perform the action with the highest weight Cluster 1 SemType: uknwn Gender: uknwn Number: single Names: NIL Cluster 2 SemType: person Gender: male Number: single Names: Mike Tyson a12=argmaxij w.f(joinij) Former Boxing ChampionMike Tysonrevealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  37. Test-Time Inference • Perform the action with the highest weight Cluster 15 SemType: person Gender: male Number: single Names: Mike Tyson a12=argmaxij w.f(joinij) Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  38. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pitt with hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  39. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  40. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  41. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  42. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  43. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  44. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  45. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  46. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  47. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  48. Test-Time Inference • Perform the action with the highest weight Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  49. Test-Time Inference • Until the action with the highest weight is the special action HALT Former Boxing ChampionMike Tyson revealed that he had caught Hollywood heartthrobBrad Pittwith hisex-wifeRobin Givens. In an interviewTysonsaid that he was amidst the process of divorce from Givensin the late 1980s when he found her sleeping with the Hollywood star.

  50. Time complexity • Let n = the number of mentions in a document • At most n clusters at any time • s = number of joins performed by the algorithm • s<=n at most n joins before HALT (usually much less)

More Related