1 / 34

Refining – Finding Words/expanding

Refining – Finding Words/expanding. Taly Sharon. taly@sharon-it.com sharont@alum.mit.edu. Contents. Expanding/Learning terms Categorization/Clustering engines Google Suggest SurfWax FocusWords When you don’t know where to start. Make Longer Queries. Average Search Terms per Query.

jalena
Download Presentation

Refining – Finding Words/expanding

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Refining – Finding Words/expanding Taly Sharon taly@sharon-it.com sharont@alum.mit.edu www.sharon-it.com

  2. Contents • Expanding/Learning terms • Categorization/Clustering engines • Google Suggest • SurfWax FocusWords • When you don’t know where to start www.sharon-it.com

  3. Make Longer Queries Average Search Terms per Query Overall Experienced • Yahoo • Harvest Digital www.sharon-it.com

  4. Adding Words • Holocaust 23,200,000 • holocaust memorial 836,000 • holocaust memorial budapest 42,300 • holocaust memorial budapest danube 4,910 • holocaust memorial budapest danube promenade 692 www.sharon-it.com

  5. Classification/Categorization • Classification: the process of deciding the appropriate category for a given document. • Examples: • deciding what newsgroup an article belongs to. • what folder an email message should be directed to. • what is the general topic of an essay. www.sharon-it.com

  6. Clustering • The process of automatically grouping documents. www.sharon-it.com

  7. Search Categorization/Clustering • The result documents are ordered according to categories. • The searcher can select the relevant category to display the related documents. • Examples: • Vivisimo/Clusty • Excite • Teoma • Exalead www.sharon-it.com

  8. Clusty www.sharon-it.com

  9. Excite www.sharon-it.com

  10. Ask www.sharon-it.com

  11. Exalead www.sharon-it.com

  12. Google Suggest • As you type – you get query suggestions and number of results per query. www.sharon-it.com

  13. Google Suggest (2) www.sharon-it.com

  14. Google Suggest www.sharon-it.com

  15. www.sharon-it.com

  16. Yahoo Search Assist www.sharon-it.com

  17. SurfWax FocusWords • SurfWax has an option “Focus” • This option invokes the FocusWords mechanism • You get suggestions to make your query: • Broader • Similar • Narrower • http://www.surfwax.com www.sharon-it.com

  18. SurfWax FocusWords www.sharon-it.com

  19. When you don’t know how to start • Reverse Dictionary • Glossaries and Dictionaries • Taxonomy/Folksonomy • Pearl Culturing • Analyzing pages • Finding similar pages • Google’s related: • Alexa www.alexa.com www.sharon-it.com

  20. Reverse Dictionary • OneLook reverse dictionary: http://www.onelook.com/reverse-dictionary.shtml • Example: “bird of prey” => raptor • Example: economical measure of a nation’s wealth => Gross Domestic Product www.sharon-it.com

  21. www.sharon-it.com

  22. Glossaries and Dictionaries • Google search: • <topic> • glossary OR thesaurus OR dictionary OR taxonomy • Example 1: agriculture glossary • http://www.cnie.org/nle/AgGlossary/AgGlossary.htm • http://www.cahe.nmsu.edu/news/aggloss.html • http://agriculture.house.gov/info/glossary.html • Example 2: agriculture thesaurus • http://agclass.nal.usda.gov/agt/agt.shtml • http://www.fao.org/aims/ag_intro.htm (multilingual) • http://www.glossarist.com • http://www.glossarist.com/glossaries/business/primary-industry/agriculture.asp www.sharon-it.com

  23. www.sharon-it.com

  24. Taxonomy/Folksonomy • Taxonomies • Found via directory search (example DMOZ): http://search.dmoz.org/cgi-bin/search?search=taxonomy • www.taxonomywarehouse.com (paid) • Folksonomy • Use tags in • Technorati www.technorati.com • Delicious www.del.icio.us www.sharon-it.com

  25. del.icio.us www.sharon-it.com

  26. del.icio.us www.sharon-it.com

  27. Pearl Culturing • What to do when you don’t have the category nor the right keywords? • Find one good relevant website • Look it up in directories • You will find: • the category/main keywords • authoritative websites • Useful search engine: Exalead www.sharon-it.com

  28. Analyze Pages • Distilling: what is problematic in a bad page? • what is wrong? Is there an interfering keyword/term appearing. • Remove interfering terms (using “-”). • Identifying clues and patterns in a good page. • Read the document, what are the clues? • Look for new keywords, word combinations and other things differentiating between it to non-authoritative documents. • Use frequency counter: • http://www.wordcounter.com/ • http://www.georgetown.edu/faculty/ballc/webtools/web_freqs.html www.sharon-it.com

  29. Frequency Counter www.sharon-it.com

  30. www.sharon-it.com

  31. Wordcounter www.sharon-it.com

  32. www.sharon-it.com

  33. References • http://hacks.oreilly.com/pub/ht/2 • www.batesinfo.com • http://www.searchtools.com/info/classifiers.html www.sharon-it.com

  34. Exercises • How are bad user interfaces called (hint: try Google suggest) • Reverse dictionary • Find relevant keywords for chemistry • What is the terminology for when menstruation stops? • How was the separation between the west and the soviet union called? • What are the related terms to Competitive Intelligence? • Check suggestions from Google Suggest for a query starting with biofuel. • Using SurfWax, learn options to focus or broaden the query: biodiesel. • Identify the most relevant terms in the website: www.uspto.gov • Identify the most relevant terms in the Biofuel Wikipedia entry http://en.wikipedia.org/wiki/Biofuel. • Search in Onelook reverse dictionary and in other glossaries terms: fuel, natural energy, geothermal, and other terms. Look at the results. www.sharon-it.com

More Related