1 / 7

Team 12 - Šproty

Team 12 - Šproty. Indexovanie a  vyhľadávanie dokumentov Nástroj Lucene. Bc. Ľubomír Eľko. Triedy v Lucene. Document - represents a document in Lucene. Field - will contain a name for the section and the actual data.

ifeoma-young
Download Presentation

Team 12 - Šproty

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Team 12 - Šproty • Indexovanie • a  vyhľadávanie dokumentov • Nástroj Lucene Bc. Ľubomír Eľko

  2. Triedy v Lucene • Document - represents a document in Lucene. • Field - will contain a name for the section and the actual data. • Analyzer -an abstract class that used to provide an interface that will take a Document and turn it into tokens that can be indexed. SimpleAnalyzer, StopAnalyzer and StandardAnalyzer class. • IndexWriter - used to create and maintain indexes. • IndexSearcher - used to search through an index. • QueryParser - used to build a parser that can search through an index. • Query - an abstract class that contains the search criteria created by the QueryParser. • Hits - contains the Document objects that are returned by running the Query object against the index.

  3. Príklad vyhľadania Score ID Enter query or press 'Enter' to exit: projekt Searchingfor: projekt 2 totalmatchingdocuments 1. [11.doc] (0,16309) C:/Users/lubes.e/test/docs/o_nas.html Title: Sproty Team Page Author: team c.12 - sproty Keywords: sproty, fiit, java, prefuse, foaf, lucene Description: stranka timu c. 12 (sproty). tema: graficka podpora vyhladavania znalosti v dokumentoch. <title>Sproty Team Page</title> <meta name="author" content="Team c.12 - Sproty" /> <meta name="keywords" content="sproty, fiit, java, prefuse, foaf, lucene" /> <meta name="description" content="Stranka timu c. 12 (Sproty). Tema: Graficka podpora vyhladavania znalosti v dokumentoch." />

  4. Problémy I. • Čo keď metadáta chýbajú? Priority: • Riešenie – zapisovanie do metadát • Riešenie – šablóna a macro pri zavretí • Riešenie – vlastný parser - keywords - počítanie výskytov slov (najviac slov však bude typu „softvér“, „projekt“, atď., teda nulová inf. hodnota) - ale ako zistíme autora alebo názov? [Author: Einstein]

  5. Problémy II. • Diakritika • Konvertor textu do ASCII (prvých 127 znakov)trieda ASCIIFoldingFilter • Odstraňovanie diakritiky (Accentedcharacter) trieda ISOLatin1AccentFilter • PoužijemeASCIIFoldingFilternakoľko ISOLatin1AccentFilter sa • už neodporúča používať a v novej verzii Lucene sa už ani nebude • nachádzať.

  6. Problémy III. Analyzátor na SVK slová - existuje CzechAnalyzer – prispôsobenie na slovenčinu - používanie dvoch analyzátorov sa nedoporučuje! Ako zistiť či ide o SVK alebo ENG dokument? - prítomnosť smerodajných slov v texte Ako zistiť či ide o SVK alebo ENG query? - dá sa z jedného slova určiť o aký jazyk ide a teda aký analyzátor použiť? - „MySQL“, „network“, „index“, „server“, „opensource“, „problem“, „Einstein“

  7. Zdroje a odkazy Lucene – Wikipédia http://en.wikipedia.org/wiki/Lucene Lucene – Dokumentáciahttp://wiki.apache.org/lucene-java Introduction to Text Indexing with Apache Jakarta Lucene http://onjava.com/pub/a/onjava/2003/01/15/lucene.html The Lucene Search Engine - Adding search to your applications http://www.javaranch.com/journal/2004/04/Lucene.html Lucene – Howto accomplish simple tasks? http://wiki.apache.org/lucene-java/HowTo Lucene as a Ranking Enginehttp://www.wortcook.com/pdf/lucene-ranking.pdf

More Related