1 / 19

Web Searching with Multiple Correct Answers

Web Searching with Multiple Correct Answers. Steve O’Hara, Google Inc., California Tom Bylander, Univ. of Texas San Antonio June 2 - 4, 2014, Thessaloniki, Greece Web Intelligence, Mining and Semantics. Factual Error Found On Internet!.

dolf
Download Presentation

Web Searching with Multiple Correct Answers

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Web Searching with Multiple Correct Answers Steve O’Hara, Google Inc., California Tom Bylander, Univ. of Texas San Antonio June 2 - 4, 2014, Thessaloniki, Greece Web Intelligence, Mining and Semantics

  2. Factual Error Found On Internet! “LONGMONT, CO—The Information Age was dealt a stunning blow Monday, when a factual error was discovered on the Internet. The error was found on TedsUltimateBradyBunch.com, a Brady Bunch fan site that incorrectly listed the show's debut year as 1968, not 1969.” http://www.theonion.com/articles/factual-error-found-on-internet,102/

  3. Factoid Questions • “What is the atomic mass of Copper?” • “What is the diameter of Pluto?”

  4. Select “Best” Answer What is the Diameter of Pluto? zoom The two candidate answers of 1400 miles receive the most Support The four candidate answers of 2274 km (1413 miles) give the most Support

  5. Numeric Correlation

  6. Motivating Questions • What is the population of New York City? • What is the area of Canada? • When did Elizabeth Taylor get married? • What is the capital of Bolivia? • Who coaches the Hoyas men’s basketball team?

  7. Numeric Hypothesis 100 300 400 400 200 497 99 398.6 300.9 301 500 403 500.1 601 600

  8. City Populations

  9. Some Candidate Answers(for the population of Akron, Ohio)

  10. Candidate Answer Distribution Target answers: 198,402 city, 701,456 MSA

  11. Abilene Results Target: 118,117 City and 166,416 MSA Baseline Score (0.668 + 0.002) / 2 0.335 Single Score (0.431/1 + 0.169/2) / 2 0.258 Paired Score (0.356 + 0.148) / 2 0.252 Combined Score (0.656 + 0.026) / 2 0.341

  12. City Population Results

  13. Multi-Valued Named Entities Anna Carl Dana Dan Bob Eve Ann Dana Carl Carl Eve Dana Eva Fred Fred

  14. Proper Name Matching • Adapt Levenshtein’s Algorithm to whole words • Count #insertions, #deletions and #changes • Instead of character matching, do whole word matching • Which uses regular Levenshtein’s edit distance • Handles typos • Handles middle names • Does not handle Bill / William

  15. Two Levels of Searches Search Movie Directors Movie Directors Directors and Stars Movie Stars Search Movie Stars

  16. Movie Target Answers

  17. GWTW Results Movie Directors Movie Stars

  18. Movie Results • Of 500 movies, 32 instances of co-occurring pairs • 23 additional correct answers • 5 duplicate correct answers • 4 incorrect answers:

  19. Is Wikipedia Always Right? “The number of factual errors shows just how unreliable it can be to use the online resource as a sole means of digging up information. Yet millions base everything from school homework to corporate presentations using facts and figures they have gleaned from the site. A study into, specifically, company information on the massively popular website discovered 60 per cent of articles had factual errors.” Source: www.dailymail.co.uk/sciencetech/article-2131458/Up-articles-Wikipedia-contain-factual-errors.html#ixzz2sDrWl4RH

More Related