1 / 41

Searching Intelligently: It’s No Longer a Nightmare

Searching Intelligently: It’s No Longer a Nightmare. Oregon Library Support Staff Division Gateways 2006 Conference. Today’s Goals – To Learn. How is the web indexed? Google in particular. Which tool to use? Search engines, directories, hidden web, listservs and online discussion groups.

Download Presentation

Searching Intelligently: It’s No Longer a Nightmare

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Searching Intelligently: It’s No Longer a Nightmare Oregon Library Support Staff Division Gateways 2006 Conference Bill G. Kelm - July 21, 2006

  2. Today’s Goals – To Learn • How is the web indexed? • Google in particular. • Which tool to use? • Search engines, directories, hidden web, listservs and online discussion groups. • Drawbacks and advantages of the Web. • Browser tips and research power tools. • Horizontal searching. Bill G. Kelm - July 21, 2006

  3. How Search Engines Work • Discovery and Database • User Search • Presentation and Ranking Source: http://www.webreference.com/content/search/ Bill G. Kelm - July 21, 2006

  4. Google Background • “Google's mission is to organize the world's information and make it universally accessible and useful.” • Google's founders Larry Page and Sergey Brin developed Google in a Stanford University dorm room and it is currently the world's largest search engine. Source: http://www.google.com/corporate/ Bill G. Kelm - July 21, 2006

  5. Google’s Discovery and Database • Google has programs called spiders (a.k.a. Google bots) constantly searching the web for new or updated web pages. • When a spider finds a new or updated page, it reads that entire page, reports back to Google, and then visits all of the other pages to which that new page links. Bill G. Kelm - July 21, 2006

  6. Google’s Cache • When the spider reports back to Google, it doesn’t just tell Google the new or updated page’s URL. • The spider also sends Google a complete copy of the entire Web page – HTML, text, images, etc. • Google then adds that page and all of its content to Google’s cache. Bill G. Kelm - July 21, 2006

  7. How Google Works • When you search for multiple keywords, Google first searches for all of your keywords as a phrase. • So, if your keywords are baseball spring training, any pages on which those words appear as a phrase receive a score of X. Bill G. Kelm - July 21, 2006

  8. Google – Adjacency • Google then measures the adjacency between your keywords and gives those pages a score of Y. • A page with “baseball spring training” next to each other gets a higher score than one with “baseball” and then “spring training” farther down the page. Bill G. Kelm - July 21, 2006

  9. Google - Weights • Then, Google measures the number of times your keywords appear on the page (the keywords’ “weights”) and gives those pages a score of Z. Bill G. Kelm - July 21, 2006

  10. Presentation & Ranking • Google takes • The phrase hits (the Xs), • The adjacency hits (the Ys), • The weights hits (the Zs), and • About 100 other secret variables • Throws out everything but the top 2,000 • Multiplies each remaining page’s individual score by it’s “PageRank” • And, finally, displays the top 1,000 in order. Bill G. Kelm - July 21, 2006

  11. Google – PageRank? • There is a premise in higher education that the importance of a research article can be judged by the number of citations to it from subsequent articles in the same field. • Google applies this premise to the Web: the importance of a Web page can be judged by the number of hyperlinks pointing to it from other pages. Bill G. Kelm - July 21, 2006

  12. Google Advanced & Tricks • Calculator • Define • ~, +, - • Advanced Searching • Finding Information on the Internet a Tutorial Bill G. Kelm - July 21, 2006

  13. My Favorite Quote: • “Focus on users and their tasks, not the technology.” – Jeff Johnson Bill G. Kelm - July 21, 2006

  14. When Searching the Web: • “Focus on your query, not the technology.” Bill G. Kelm - July 21, 2006

  15. Four tools: • Search Engines • Directories • Invisible Web (Deep Web) • Listservs and Online Discussion Groups Bill G. Kelm - July 21, 2006

  16. Which Tool to Use? • “It all Depends.” Bill G. Kelm - July 21, 2006

  17. When to use a Search Engine: • You are looking for the “Society of American Registered Architects.” • You have a specific phrase or unique keyword. Bill G. Kelm - July 21, 2006

  18. Which Search Engines are Used • Can you guess what percentage of people use the various search engines available? Bill G. Kelm - July 21, 2006

  19. Share of Searches 2005 Source: http://searchenginewatch.com/reports/article.php/2156451 Bill G. Kelm - July 21, 2006

  20. Rating Search Engines • Search Engine Watch • Search Engine Showdown Bill G. Kelm - July 21, 2006

  21. Problems With Search Engines: • Speed response eliminates some documents • Bias toward text • User expectation and skills • Costs of crawling • Metasearch engine: jux2 Bill G. Kelm - July 21, 2006

  22. When to Use a Directory: • “I’m looking for sites on American Architecture.” • Broad category • Early in your research • Opposing viewpoints Bill G. Kelm - July 21, 2006

  23. Sample Directories • Google Directory • Internet Scout Project • Internet Resources Columns • Targeted Directories:Classics Resources Bill G. Kelm - July 21, 2006

  24. Problems With Directories: • Small • Editorial policies • Timeliness • Charging for listing Bill G. Kelm - July 21, 2006

  25. Hidden/Invisible Web • Searchable databases • Excluded pages Bill G. Kelm - July 21, 2006

  26. When to use the Invisible Web: • “I’m looking for a list of architects in Baltimore.” • “I need a specific statistic on the death rate of women with heart disease in 2002.” • “I’m looking for information on a plane crash in Salem, OR in 1979.” Bill G. Kelm - July 21, 2006

  27. How to Find the Hidden Web • Google: • Databases + your topic • Searching general web directories • Librarians Index • Infomine Bill G. Kelm - July 21, 2006

  28. When to use a Listserv? • “If I’m looking for an opinion on a particular topic.” Bill G. Kelm - July 21, 2006

  29. How to Find a Listserv: • Tile.net • Google: “topic” and listserv • Google Groups Bill G. Kelm - July 21, 2006

  30. Browser Tips & Tools • Bookmarks (personal toolbars) • History • ConQuery (search plugins) • Journal Title List • Creative Commons • Open WorldCat via Google • Bookmarklets • Tabs, Tabs, Tabs Bill G. Kelm - July 21, 2006

  31. Horizontal Searching • Use the web in conjunction with library catalogs and databases. • Search the Web for titles of articles. • Locate more bibliographies that can be incorporated into new searches for books, journal articles, etc. • Search for authors from books and articles. Bill G. Kelm - July 21, 2006

  32. Horizontal Searching:Search a Library Database Bill G. Kelm - July 21, 2006

  33. Horizontal Searching:Search title of article on the Web Bill G. Kelm - July 21, 2006

  34. Horizontal Searching:Follow citations from Web site Bill G. Kelm - July 21, 2006

  35. Horizontal Searching:Search Book Title in the Library Catalog Bill G. Kelm - July 21, 2006

  36. Horizontal Searching:Follow subject headings from article Bill G. Kelm - July 21, 2006

  37. Horizontal Searching:Follow cited references / and search Bill G. Kelm - July 21, 2006

  38. Horizontal Searching:Organization Web sites and Official Reports Bill G. Kelm - July 21, 2006

  39. Horizontal Searching:Contact actual researchers on the topic Bill G. Kelm - July 21, 2006

  40. Wrap Up: • Know how the web is indexed and collected. • Choose the correct tool for your question. • Realize more than one tool may be needed. • Carefully evaluate whatever you find on the Web. • Think horizontally in searching: library databases, Web, bibliography, Web, library catalog, Web, reference book, Web… Bill G. Kelm - July 21, 2006

  41. Bibliography • Cohen Laura (2001) 10 tips for teaching how to surf the Web. American Libraries, 32, 44-46. • Sherman, C., Price, G. (2001). The Invisible Web: Uncovering Information Sources Search Engines Can't See. Medford, N.J.: Information Today, Inc. • Dale Vidmar’s: Horizontal Searching • Linda Goff’s: Googling to the Max Bill G. Kelm - July 21, 2006

More Related