Evaluation of N-grams Conflation Approach in Text-based Information Retrieval

1. Evaluation of N-grams Conflation Approach in Text-based Information Retrieval Serge KosinovUniversity of Alberta, Computing Science Department, Edmonton, AB, Canada

2. N-gram Conflation Method Goalstudy a conflation method based on n-gram approach with some enhancements and evaluate its performance in textual information retrieval What is conflation good for?matching non-identical words that refer to the same principle concept Why is it important?Avoid problems of strong dependence of retrieval results on the exact wording of a user's query  account for richness and redundancy of the natural language

3. N-grams Method: Basic Idea * Subdivide words into N-grams - set of overlapping substrings of length NExample: N=2: (radio)  ( ra - ad - di - io )N=3: (radio)  ( rad - adi - dio ) * Treat as similar and group together words with identical N-gram structure

4. N-grams Method: Basic Idea (Continued)

5. Experiment Implementation * Pre-process text collections (remove stop words, punctuation, special characters, etc.) * Find the set of unique terms and compute their similarity matrix * Cluster this data and compute IDF-like correction multipliers for each N-gram * Process queries by replacing the terms that fit into obtained clusters with cluster ID both in document collections and in queries, then pick the best match via standard vector model representation

6. Computing Similarity Matrix

7. Clustering Data and Adjusting IDF * Clustering technique complete link agglomerative clustering (aka HCA)Example: C325 = {computer, computing, computer-based} * IDF-like adjustments of weightswij - weight of bigram Bj in term cluster Cibfij - frequency of bigram Bj in term cluster CiN - number of term clustersn - number of term clusters where bigram Bj occurs at least once

8. Processing Queries: Example Best match : cosine similarity coefficient betweendocument vector ( ... , C325, C487, Torvalds, ... )and query vector ( ... , C325, Torvalds, ... )

9. Experimental Results Text collections used: Results:3 point precision average (at 20, 50, 80 % recall)

10. Inverse Frequency Weights Effect Association of unseen query terms with clusters: * With IDF-like correction:consolidation  {console}editing  {editor, edition} * Without IDF-like correction :consolidation {condensation}editing {accrediting}

11. Individual Query Analysis Example * Other examples in which N-gram conflation outperforms other methods: criteria-criterion, exchange-interchange, system-subsystem, etc.

12. Conlusions and Directions for Further Study Advantages of N-gram conflation:* is a language-independent approach* tackles well misprints and orthographical errors * best gain for special form and compound words* enhanced with IDF-like correction performs better than traditional stemming (Porter, etc.) Disadvatages:* clusters have homophone noise * straightforward HCA impractical on large-scale datasets Prospects:* apply the method for more inflected languages* combine N-grams and Porter* enhance clustering routines