1 / 105

Lexical networks, lexical centrality, and text mining

Computational Linguistics And Information Retrieval @ Michigan. Lexical networks, lexical centrality, and text mining. Dragomir R. Radev Associate Professor University of Michigan CSE, SI, LING radev@umich.edu. The CLAIR gang. This talk is based on joint work with Vahed Qazvinian

erica
Download Presentation

Lexical networks, lexical centrality, and text mining

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Computational Linguistics And Information Retrieval @ Michigan Lexical networks, lexical centrality, and text mining Dragomir R. Radev Associate Professor University of Michigan CSE, SI, LING radev@umich.edu

  2. The CLAIR gang • This talk is based on joint work with • Vahed Qazvinian • Joshua Gerrish • With contributions by • Arzucan Özgür • Güneş Erkan • Ahmed Awadallah • Bryan Gibson • Thuy Vu • Xiaodong Shi • Mark Joseph • Sean Gerrish • Alejandro C de Baca • Jahna Otterbacher • Benjamin Nash • Alex Gonopolskiy

  3. Natural Language Processing

  4. Social data • Blog postings • News stories • Speeches in Congress • Query logs • Movie and book reviews • Scientific papers • Financial reports • Query logs • Encyclopedia entries • Email • Chat room discussions • Social networking sites

  5. Social data • Blog postings • News stories • Speeches in Congress • Query logs • Movie and book reviews • Scientific papers • Financial reports • Query logs • Encyclopedia entries • Email • Chat room discussions • Social networking sites WHAT DO ALL OF THESE HAVE IN COMMON?

  6. Natural language processing • Part of speech tagging • Prepositional phrase attachment • Parsing • Word sense disambiguation • Document indexing • Text summarization • Machine translation • Question answering • Information retrieval • Social network extraction • Topic modeling

  7. Talk outline • Lexical networks • Lexical centrality • Latent networks • Conclusion

  8. Networks

  9. Interleukin-2 receptor pathway protein interaction network (from HPRD). Peri et al., Nucleic Acids Res. 2004 January 1; 32(Database issue): D497–D501. doi: 10.1093/nar/gkh070.

  10. The New York Times May 21, 2005

  11. Lexical networks

  12. Lexical networks • A special case of networks where nodes are words or documents and edges link semantically related nodes • Other examples: • Words used in dictionary definitions • Names of people mentioned in the same story • Words that translate to the same word

  13. Semantic network

  14. Dependency network bought Meredith yesterday apples green

  15. Dependency network

  16. Lexical Centrality

  17. What happened? • Red Sox Are World Champs (again)

  18. How many ways to say it? Red Sox Win the World Series, More Titles Might Follow Back in the Red: World Series crown returns to Boston as Rockies hit the canvas Fans celebrate Red Sox win Rockies Vanish In Thin Air Police Arrest Dozens After Red Sox World Series Win Red Sox 4, Rockies 3 Boston Sweeps World Series Again Victory walk leads to dynasty talk Red Sox Win Baseball's World Series Title by Sweeping Rockies Boston enjoys sweep smell of success Sox sweep Rockies to win Series World Series: Red Sox sweep Rockies Red Sox cruise to World Series title Red Sox Are World Champs Boston sweep Colorado to win World Series Red Sox Sweep Colorado in World Series Red Sox Take World Series How sweep it is! Red Sox breeze to second World Series title Boston owners dedicate triumph to Red Sox Nation

  19. Boston lowers the broom We Are the Champions: Red Sox 4, Rockies 3 Sweep and red sox for everybody Two titles four years apart impossible to compare Red Sox cash in The Boston Red Sox swept the Colorado Rockies to win the World Series Red Sox "do little things" to win second title in four years World Series victory for Red Sox Boston reigns supreme Rockies' heads held high despite loss Rockies just failed to execute Boston Fans Fill Streets To Celebrate Series Sweep It's easy to embrace these Red Sox Young stars lead Red Sox to World Series title They spend money in Boston, but they win Boston fans celebrate World Series win; 37 arrests reported Soxcess started upstairs Boston sweep is complete Red Sox sweep 2007 World Series in Denver Rookies rise to occasion! Sox sweep World Series again Poor pitching, poorer hitting doom Rockies Red Sox top Rockies and sweep to second World Series championship ... Sweeping off to Boston Another in a Series of sweeps Putting an end to baseball as we've known it Red Sox Sweep Rockies to Capture Second Title in Four Years Red Sox accomplished the expected, unbelievable Rockies Find Being Good Isnt Enough Boston sweep-walks to title Red Sox play party crashers in Denver Unhappy ending for Colorado - MLB Sox on, Rocks off in sweeping win Timlin gets to ring up another one Red Sox complete World Series sweep Wild celebrations in Boston after World Series win Red Sox seal sweep of Rockies Red Sox Win World Series Sox are kings of diamond Rockies: Sweep, sweep, swept Red Sox sweep World Series Monsters of Beantown: Red Sox win Series Red Sox claim World Series glory How sweep it is Red Sox: Dynasty in the making Red Sox sweep upstart Rockies Boston Sweeps Colorado To Win World Series Red Sox sweep Rockies, take World Series What curse? Red Sox win Series again Red Sox Win the World Series, More Titles Might Follow Back in the Red: World Series crown returns to Boston as Rockies hit the canvas Fans celebrate Red Sox win Rockies Vanish In Thin Air Police Arrest Dozens After Red Sox World Series Win Red Sox 4, Rockies 3 Boston Sweeps World Series Again Victory walk leads to dynasty talk Red Sox Win Baseball's World Series Title by Sweeping Rockies Boston enjoys sweep smell of success Sox sweep Rockies to win Series World Series: Red Sox sweep Rockies Red Sox cruise to World Series title Red Sox Are World Champs Boston sweep Colorado to win World Series Red Sox Sweep Colorado in World Series Red Sox Take World Series How sweep it is! Red Sox breeze to second World Series title Boston owners dedicate triumph to Red Sox Nation Red Sox win World Series Short wait for bosox this time World Series: Red Sox complete sweep of Rockies It's Leap Year Boston Red Sox blank Rockies to clinch World Series Red Sox Sweep Rockies 4-3 In Game 4 Red Sox claim World Series title Boston Red Sox win World Series, lose image Sox sweep Rockies for 2nd title in 4 seasons Red Sox Complete Sweep Of Rockies For World Series Victory Red sox wrap up world series rout Rockies feel the pain, but not the shame Red Sox, tarnished for so long, now baseball's gold standard Red sox take title Boston Celebrates World Series Win Bad news AL, Red Sox built to last Boston sweeps it Heartbreak is history for Red Sox Fans Celebrate Red Sox World Series Win From cursed to charmed: Red Sox sweep World Series Red Sox Sweep Rockies To Win World Series Red Sox make Boston jump for joy, Series Champs Crowds fill streets after Red Sox win Papelbon, Timlin savoring Series win Red Sox scale the Rockies Even Sox fan losing passion for winning Rookies respond in first crack at the big time Red Sox Get 2nd World Series Sweep In 4 Years Red Sox looking like a dynasty Boston Red Sox are America's team Red Sox Win 2007 World Series Believing Pays Off! Sox World Series Champs Red Sox go from cursed to blessed

  20. List of topics • Red Sox • Sweep • World Series • Rockies • Celebrate • Boston • Colorado • Dynasty • 2007 • Four years • Second time • 4:3 score • Easy • Expectations • No curse • Young players • Timlin • not (baseball)

  21. LexRank – Centrality in Text Graphs Vertices Units of text (sentences or documents) Edges Pairwise similarity between text (tf-idf cosine or language model)

  22. LexRank – Centrality in Text Graphs Intuition LexRank score is propagated through edges Central vertices are those that are similar to other central vertices

  23. LexRank – Centrality in Text Graphs Recurrence Relation 0.3 0.1 0.9 0.3 s 0.5 0.8 Can guarantee solution by allowing “jump” probability d/N. 0.2 0.4 0.2

  24. 0.01718 Red Sox Win Baseball's World Series Title by Sweeping Rockies 0.01712 Red Sox Sweep Rockies To Win World Series 0.01647 World Series: Red Sox sweep Rockies 0.01630 Red Sox sweep Rockies, take World Series 0.01608 Red Sox 4, Rockies 3 Boston Sweeps World Series Again 0.01597 World Series: Red Sox complete sweep of Rockies 0.01584 Red Sox sweep World Series 0.01579 Red Sox Sweep Colorado in World Series 0.01573 Red Sox Complete Sweep Of Rockies For World Series Victory 0.01531 Red Sox complete World Series sweep ... 0.01057 Boston Red Sox blank Rockies to clinch World Series 0.01052 Red Sox: Dynasty in the making 0.01037 Sox sweep Rockies for 2nd title in 4 seasons 0.01034 Police Arrest Dozens After Red Sox World Series Win 0.01027 Rookies respond in first crack at the big time 0.01018 Rockies: Sweep, sweep, swept 0.01016 Sweeping off to Boston 0.01013 Rookies rise to occasion! 0.01012 Fans celebrate Red Sox win 0.01010 Short wait for bosox this time ... 0.00441 Sox are kings of diamond 0.00414 Rockies just failed to execute 0.00408 Rockies Find Being Good Isnt Enough 0.00407 Rockies' heads held high despite loss 0.00391 Boston lowers the broom 0.00390 Rockies Vanish In Thin Air 0.00390 Poor pitching, poorer hitting doom Rockies 0.00390 Rockies feel the pain, but not the shame 0.00375 Two titles four years apart impossible to compare 0.00362 Boston reigns supreme

  25. 0.01718 Red SoxWin Baseball's World Series Title by Sweeping Rockies 0.01712 Red Sox Sweep Rockies To Win World Series 0.01647 World Series: Red Sox sweep Rockies 0.01630 Red Sox sweep Rockies, take World Series 0.01608 Red Sox 4, Rockies 3 Boston Sweeps World Series Again 0.01597 World Series: Red Sox complete sweep of Rockies 0.01584 Red Sox sweepWorld Series 0.01579 Red Sox Sweep Colorado in World Series 0.01573 Red Sox Complete Sweep Of Rockies For World Series Victory 0.01531 Red Sox complete World Series sweep ... 0.01057 Boston Red Soxblank Rockies to clinch World Series 0.01052 Red Sox: Dynasty in the making 0.01037 Sox sweep Rockies for 2nd title in 4 seasons 0.01034 Police Arrest Dozens After Red Sox World Series Win 0.01027 Rookies respond in first crack at the big time 0.01018 Rockies: Sweep, sweep, swept 0.01016 Sweeping off to Boston 0.01013 Rookies rise to occasion! 0.01012 Fans celebrate Red Sox win 0.01010 Short wait for bosox this time ... 0.00441 Sox are kings of diamond 0.00414 Rockies just failed to execute 0.00408 Rockies Find Being Good Isnt Enough 0.00407 Rockies' heads held high despite loss 0.00391 Boston lowers the broom 0.00390 Rockies Vanish In Thin Air 0.00390 Poor pitching, poorer hitting doom Rockies 0.00390 Rockies feel the pain, but not the shame 0.00375 Two titles four years apart impossible to compare 0.00362 Boston reigns supreme

  26. NLP and network analysis

  27. Dependency parsing

  28. <root> <root> <root> <period> <period> <period> John John/likes John/likes/apples likes apples apples green green green <root> <root> <period> <root> John <period> likes apples John/likes/apples/green/<period> John/likes/apples/green green [McDonald et al. 2005]

  29. ... , sagte der Sprecher bei der Sitzung . ... , rief der Vorsitzende in der Sitzung . ... , warf in die Tasche aus der Ecke . C1: sagte, warf, rief C2: Sprecher, Vorsitzende, Tasche C3: in C4: der, die Part of speech tagging Word sense disambiguation Document indexing [Mihalcea et al 2004] [Mihalcea et al 2004] [Biemann 2006] Subjectivity analysis Semantic class induction Passage retrieval relevance inter-similarity Q [Pang and Lee 2004] [Widdows and Dorow 2002] [Otterbacher,Erkan,Radev05]

  30. MavenRank – Centrality in Speech Graphs Vertices Speech transcripts from a given topic Edges tf-idf cosine similarity (with threshold) Hypothesis Key speakers will have speeches with high centrality.

  31. MavenRank: Example Speech Scores 1 0.13 2 0.13 3 0.10 4 0.19 5 0.10 6 0.14 7 0.08 8 0.13 Speaker Scores (mean speech score) 1 0.12 2 0.15 3 0.12 Speaker 1 Speeches 3 2 4 Speaker 2 Speeches 1 5 6 8 7 Speaker 3 Speeches

  32. Joint work with Kevin Quinn, Burt Monroe, Michael Colaresi and Michael Crespin Gosnell Prize 2005

  33. Feature Extraction from Dependency Trees “The results demonstrated that KaiC interacts rhythmically with KaiA, KaiB, and SasA.” Path1: KaiC – nsubj – interacts – obj – SasA Path2: KaiC – nsubj – interacts – obj – SasA – conj_and – KaiA Path3: KaiC – nsubj – interacts – obj - SasA – conj_and – KaiB Path4: SasA – conj_and – KaiA Path5: SasA – conj_and – KaiB Path6: KaiA - prep_with - SasA – conj_and – KaiB

  34. Path Edit Kernel • Character–based --> modified as word-based • Minimum number of operations (insertion, deletion, or substitution of a single word) to transform the first string to the second • Ex: • 1. KaiC - subj - interacts - obj - SasA - conj- KaiA • 2. KaiC - subj - interacts - obj - SasA - conj – KaiA Edit distance = 2 (2 insertions) Normalize edit distance: divide to the length of the longer path • 2/7 = 0.286 Integrate SVM with path edit kernel • Higher performance than results reported so far in the literature

More Related