1 / 6

Searching with Lucene

Learn about Apache Lucene, a powerful information retrieval software library. Discover how Lucene enables indexing, ranking, and data-intensive computing algorithms like Pagerank, benefiting performance and scalability.

simpsont
Download Presentation

Searching with Lucene

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Searching with Lucene Chapter 2

  2. For discussion • Information retrieval • What is Lucene? • Code for indexer using Lucene • Pagerank algorithm

  3. Information Retrieval • Consider a collection of documents • You want to know what words are in each of the documents • Given a word you want to know which document it occurs • You want to know how many times a word occurs in document. • You want to rank documents according to count

  4. What is Lucene? • Apache Lucene is a free/open source information retrieval software library, originally created in Java by Doug Cutting. • It is supported by the Apache Software Foundation and is released under the Apache Software License • It does indexing at lightning speed. • Lucene experience lead to the development of Hadoop (by Doug Cutting).

  5. Why do need to study it? • But search is more than indexing: link analysis, click analysis, natural language processing, latent dirichlet allocation (LDA),…page rank,… • We are interested in data-intensive computing algorithm such as mapreduce and data structure such as Google file systems. • Algorithms we discuss in the context of Lucene could all be converted to data-intensive methods for improving performance and scalability.

  6. Pagerank algorithm

More Related