1 / 19

Visualization in Text Information Retrieval

Visualization in Text Information Retrieval. Ben Houston Exocortex Technologies www.exocortex.org Zack Jacobson CAC. The Starting Goal. The Original Project Goal Can we come up with a graphical way of representing search results in a way that is superior to text only displays?

ezra
Download Presentation

Visualization in Text Information Retrieval

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Visualization in Text Information Retrieval Ben Houston Exocortex Technologies www.exocortex.org Zack Jacobson CAC

  2. The Starting Goal • The Original Project Goal Can we come up with a graphical way of representing search results in a way that is superior to text only displays? Other VITA project members: Els Goyette Olivier Dagenais Sarah Rosser

  3. A Text IR Interaction Model Query(s) User Interface IR SearchProxy Results DocumentCollection Browsing

  4. A Quantification of User Needs • Specific resource. • Has a particular book, web page in mind. • Specific information. • Needs a book on a particular subject matter which contains particular information. • Specific knowledge. • Needs to know about an unfamiliar subject matter.

  5. A Quantification of User Needs • Specific resource. • Specific information. • Specific knowledge. IR is good at these tasks.IMHO Visualization would be an unneeded hindrance. Maybe this is an opportunity here.There is a lot of information to shift through.

  6. Formalizing Knowledge Search • There is a hypothetical set of relevant documents which the user would like: Dr • The user attempts to get the set Dr through initially guess and refining a series of: q1, q2, … qn. • We can think of it as iterative evolutionary hill climber. • Serial sub goals of finding qn+1 such that P(Dr|qn+1) > P(Dr |qn) • Thus… How can we help the user maximize P(Dr|q) as quickly as possible?

  7. Don’t forget… popular IR problems. • Difficulty in formulating effective queries. • Average number of terms per query is about 1.5. • Words do not have a 1:1 mapping to semantic concepts. • Determining the relevance ranking of an individual document. • Going past just words. • How do you deal with 1 billion documents? • Did you know its more than doubling every year? • Databases/indices of + 500 GB each.

  8. Our efforts • 1st Try: Bar charts. (Even 3D bar charts!) • Naïve first attempts – we won’t mention those.  • 2nd Try: Concept-document clustering in a information space. • Two prototypes: NetViz & AutoViz, more should be developed.

  9. The Major “Neat” Features • Focus on concrete representation of the query. • Use data-mining techniques before visualization. • Visual summaries. • An active model for interaction. • Bridging the gaps between “serial” queries. • Widening / narrowing to get context.

  10. Location, Color, Size, Shape • Show each concept ina meaningful spatial relationships. • Show the specific results positioned in relation to the concepts.

  11. Display Intra-result Structure Clustering on implicit/latent trends

  12. Visual Document Summaries Instead of Lets show intra-documentconcept co-occurrence

  13. Exploring within a result set Highlighting and extracting subsets. Each document has a probability distribution amount the different clusters.

  14. Exploring outside a result set (Slightly Hypothetical) • Present three things to the user • Where the user is. (The City) • What is at the location the user is at. (The Sights) • What are related/nearby places. (The Highways) There is a mockup of this available on my website: www.exocortex.org/~ben/trendanalysis2.html

  15. Bridging Serial Queries • Instead of requiring a user to judge each query as a separate entity why not let a user see what changes in the results as they refine their query? • Currently we do serial searching with backtracking. • A potentiator for for non-serial methods of exploration in a (Bayesian) “concept space” network. • P(Dr|qn+1) > P(Dr |qn) P(Dr|f(qn+1,qn)) > P(Dr |f(qn))

  16. Widening / Narrowing Scope • Allowing for interactive narrowing or widening of the display by filtering on document relevance.

  17. Browser Integration… of course Seamless browserintegration. (hypothetical) Spawning of browsers.

  18. Results and Predictions “Ad hoc” Results • Extracting / presenting intra-result set structure is extremely effective. • There is value breaking free from serial queries. • Provide landmarks and easy exploratory interaction models. More worked Needed. ??? • The current browser interface is really limiting. • The underlying engine is more critical than visualizations. • Visual document summaries need more work. • Overactive (hyperactive) interfaces are hard to learn. • Ben’s Future of Text IR • Visualization is usually a fix for insufficient data-mining / algorithm techniques (in text IR). • Intra-result set clustering works in text only displays too. It will be integrated into existing text search engines. • The metaphor of exploring information space it become more popular.

  19. Hmm… Sturgeon tastes good. Want to try it? Download the prototypes!NetViz http://www.exocortex.org/netvizAutoViz http://www.exocortex.org/autoviz Comments? Email me! ben@exocortex.org

More Related