1 / 34

Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering

Incorporating Participant Reputation in Community-driven Question Answering Systems. Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering Lehigh University Bethlehem, PA USA. Liangjie Hong, Zaihan Yang and Brian D. Davison. Why

renee
Download Presentation

Liangjie Hong , Zaihan Yang and Brian D. Davison Computer Science and Engineering

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Incorporating Participant Reputation in Community-driven Question Answering Systems Liangjie Hong, Zaihan Yang and Brian D. Davison Computer Science and Engineering Lehigh University Bethlehem, PA USA

  2. Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? SIN August 2009

  3. Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? • naturallanguage vs. short queries SIN August 2009

  4. Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? • naturallanguage vs. short queries • best answers vs. relevance SIN August 2009

  5. Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? • naturallanguage vs. short queries • best answers vs. relevance • user interactions! SIN August 2009

  6. Liangjie Hong, Zaihan Yang and Brian D. Davison Why Community-driven Question & Answering ? • naturallanguage vs. short queries • best answers vs. relevance • user interactions! • 23 millions resolved questions! SIN August 2009

  7. Liangjie Hong, Zaihan Yang and Brian D. Davison SIN August 2009

  8. Liangjie Hong, Zaihan Yang and Brian D. Davison 1 – 10 of 17, 702 SIN August 2009

  9. Liangjie Hong, Zaihan Yang and Brian D. Davison Resolved Resolved Resolved SIN August 2009

  10. Liangjie Hong, Zaihan Yang and Brian D. Davison Earth Science & Geology Physics SIN August 2009

  11. Liangjie Hong, Zaihan Yang and Brian D. Davison Problems SIN August 2009

  12. Liangjie Hong, Zaihan Yang and Brian D. Davison Problems • same or similar questions • different category • different time SIN August 2009

  13. Liangjie Hong, Zaihan Yang and Brian D. Davison Problems • Read them all? • Trust them all? SIN August 2009

  14. Liangjie Hong, Zaihan Yang and Brian D. Davison Finding high quality answers SIN August 2009

  15. Liangjie Hong, Zaihan Yang and Brian D. Davison Finding high quality answers • content • user reputation SIN August 2009

  16. Liangjie Hong, Zaihan Yang and Brian D. Davison Finding high quality answers • content • user reputation SIN August 2009

  17. Liangjie Hong, Zaihan Yang and Brian D. Davison HITS-like scheme User Answerer User User User User Questioner User User SIN August 2009

  18. Liangjie Hong, Zaihan Yang and Brian D. Davison HITS-like scheme User • questioner - hub • answerer - authority User User User User User User SIN August 2009

  19. Liangjie Hong, Zaihan Yang and Brian D. Davison PageRank-like scheme User User User User User SIN August 2009

  20. Liangjie Hong, Zaihan Yang and Brian D. Davison PageRank-like scheme User User User User User • random jump ? SIN August 2009

  21. Liangjie Hong, Zaihan Yang and Brian D. Davison PageRank-like scheme User User User User SIN August 2009

  22. Liangjie Hong, Zaihan Yang and Brian D. Davison PageRank-like scheme User User User User • probability of interaction SIN August 2009

  23. Liangjie Hong, Zaihan Yang and Brian D. Davison Incorporating topics Profile User Profile User Profile User SIN August 2009

  24. Liangjie Hong, Zaihan Yang and Brian D. Davison Incorporating topics User User User SIN August 2009

  25. Liangjie Hong, Zaihan Yang and Brian D. Davison Incorporating topics User α -> stay 1- α -> jump topic User User SIN August 2009

  26. Liangjie Hong, Zaihan Yang and Brian D. Davison Incorporating topics User α -> stay 1- α -> jump topic d -> follow link 1-d -> random jump User User SIN August 2009

  27. Liangjie Hong, Zaihan Yang and Brian D. Davison Incorporating topics User α -> stay 1- α -> jump topic d -> follow link 1-d -> random jump User User SIN August 2009

  28. Liangjie Hong, Zaihan Yang and Brian D. Davison Other heuristics • Z-score • Linear combination SIN August 2009

  29. Liangjie Hong, Zaihan Yang and Brian D. Davison Dataset & Evaluation • Yahoo Answers! • 14,122 questions + 45,814 answers • 12,731 users • Strict & Relaxed • Precision@1, MRR, Precision@10, MAP • BM25 + User Reputation SIN August 2009

  30. Liangjie Hong, Zaihan Yang and Brian D. Davison Strict Evaluation SIN August 2009

  31. Liangjie Hong, Zaihan Yang and Brian D. Davison Relaxed Evaluation SIN August 2009

  32. Liangjie Hong, Zaihan Yang and Brian D. Davison Relaxed Evaluation SIN August 2009

  33. Liangjie Hong, Zaihan Yang and Brian D. Davison Conclusion • user reputation helps retrieval • topic modeling makes sense but… • question answering • link direction SIN August 2009

  34. Liangjie Hong, Zaihan Yang and Brian D. Davison Thank you! • Questions? • Contact Info: • Liangjie Hong • hongliangjie@lehigh.edu • WUME Laboratory • Computer Science and Engineering • Lehigh University • Bethlehem, PA 18015 USA SIN August 2009

More Related