1 / 38

Internet Resources Discovery (IRD)

Internet Resources Discovery (IRD). Meta-Search Engines (MSEs). Contents. Meta Search Engine (MSE) Why use several SEs? Highlighted MSEs Hebrew MSEs MSE comparison When to use MSE – pros and cons How to choose MSE?. Search Engines Generations. 1st Generation - Basic SEs:

didina
Download Presentation

Internet Resources Discovery (IRD)

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Internet Resources Discovery (IRD) Meta-Search Engines (MSEs)

  2. Contents • Meta Search Engine (MSE) • Why use several SEs? • Highlighted MSEs • Hebrew MSEs • MSE comparison • When to use MSE – pros and cons • How to choose MSE? T.Sharon-A.Frank

  3. Search Engines Generations • 1st Generation - Basic SEs: • 2nd Generation - Meta SEs: • 3rd Generation - Popularity SEs: T.Sharon-A.Frank

  4. 2nd Generation SEs - MetaSEs • Using several SEs in parallel. • The results are filtered, ranked and presented to the user as a uniformed list. • The ranking is a combination of the number of sources each page appeared in, and the ranking in each source. T.Sharon-A.Frank

  5. Meta SE is a Meta-Service • It doesn’t use an Index/database of its own. • It uses other external search services that provide the information necessary to fulfill user queries. T.Sharon-A.Frank

  6. Meta Search Engine Google · Yahoo ·Jeeves Ask About · LookSmart · OvertureFindWhat MetaCrawler Yahoo Web Crawler Open Text Lycos InfoSeek Inktomi Galaxy Excite T.Sharon-A.Frank

  7. Premises of a Meta SE • No single search is sufficient. • Problem in expressing the query. • Low quality references can be detected. T.Sharon-A.Frank

  8. Why use Several SEs? • Search Engines differ more than we think! T.Sharon-A.Frank

  9. Overlap between Google and Yahoo Source: Jux2 analysis of 500 top search terms, April 2004 http://www.jux2.com/stats.php T.Sharon-A.Frank

  10. Who Overlaps Whom? T.Sharon-A.Frank

  11. Try it yourself @ jux2 T.Sharon-A.Frank

  12. MSE - Motivation • The number and variety of SEs. • Each SE provides an incomplete snapshot of Web. • Users are forced to try and retry their queries across different SEs. • Each SE has its own interface. • Irrelevant, outdated or unavailable responses. • Each query is independent. • No individual customization. • The result is not homogenized. T.Sharon-A.Frank

  13. Problems of MSEs • No advanced search options. • Using the lowest common denominator. • Sponsored results from the SEs are not highlighted. T.Sharon-A.Frank

  14. Highlighted MSEs T.Sharon-A.Frank

  15. Mamma T.Sharon-A.Frank

  16. Dogpile T.Sharon-A.Frank

  17. Dogpile Advanced (1) T.Sharon-A.Frank

  18. Dogpile Advanced (2) T.Sharon-A.Frank

  19. Dogpile Advanced (3) T.Sharon-A.Frank

  20. Dogpile Advanced (4) T.Sharon-A.Frank

  21. Dogpile Preferences (1) T.Sharon-A.Frank

  22. Dogpile Preferences (2) T.Sharon-A.Frank

  23. Vivisimo • Vivísimo supports the most advanced features of the major search engines. • Need to just use Vivísimo syntax, which follows the most standard conventions. • Vivísimo translates your query into the corresponding syntax of each underlying search engine. • Also, Vivísimo only queries the search engines that support your chosen syntax. T.Sharon-A.Frank

  24. Vivisimo Advanced (1) T.Sharon-A.Frank

  25. Vivisimo Advanced (2) T.Sharon-A.Frank

  26. Clusty T.Sharon-A.Frank

  27. Ixquick (1) T.Sharon-A.Frank

  28. Ixquick (2) T.Sharon-A.Frank

  29. Ixquick (3) T.Sharon-A.Frank

  30. KartOO – Visual MSE T.Sharon-A.Frank

  31. MetaSEs in Hebrew T.Sharon-A.Frank

  32. When to use a MSE? • When single Basic-SE fails to provide good results. • One-stop shopping - prefer to search multiple SEs/sites at once to get blended ranked results (so as to save effort/time). • Searching for multi-faceted topics. • Want to get clustered results to focus search on the relevant keywords. • Looking for current events/news. T.Sharon-A.Frank

  33. MSE pros • Useful when you want to retrieve a relatively small number of relevant results. • An excellent choice for obscure topics. • A good option when you are not having luck finding what you want when you search. • Appropriate when you want to get an overall picture of what is available on the Web on your topic. T.Sharon-A.Frank

  34. MSE cons • Use is limited primarily to simple queries. • Little or no field searching is available. • Most services return a limited number of results that do not represent the total results from any source engine. • Sponsored results are not highlighted (even though probably not first). T.Sharon-A.Frank

  35. How to Choose your MetaSE • Search engines used • Operators supported • Special features • Speed • Presentation T.Sharon-A.Frank

  36. Meta-SEs Features Chart Red – not working T.Sharon-A.Frank

  37. Practical Recommendations • Use Ixquick for fast results and maximal syntax flexibility. • Use Vivisimo/Clusty (as a start) for Clustering and/or Hebrew. • Use Dogpile to include Google, date range, or spelling corrections. • Use none for non-MSE tasks (see MSE cons)… T.Sharon-A.Frank

  38. Bibliography • http://www.cs.washington.edu/homes/etzioni/papers/metacrawler.pdf • http://www.cs.washington.edu/homes/etzioni/papers/ieee-metacrawler.pdf • http://searchenginewatch.com/links/article.php/2156241 • http://vivisimo.com/advanced?form=Advanced • http://vivisimo.com/help.html • http://searchenginewatch.com/searchday/article.php/2226841 T.Sharon-A.Frank

More Related