1 / 29

A summarization Journey

A summarization Journey . Search and Information Extraction Lab IIIT Hyderabad. Information Overload. Explosive growth of information on web Failure of information retrieval systems to satisfy user’s information need. Need for sophisticated information access solutions.

ziarre
Download Presentation

A summarization Journey

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. A summarization Journey Search and Information Extraction Lab IIIT Hyderabad

  2. Information Overload Explosive growth of information on web Failure of information retrieval systems to satisfy user’s information need Need for sophisticated information access solutions

  3. Summarization Summary is a condensed version of source document(s) having a recognizable genre : to give the reader an exact and concise idea of the contents of the source.

  4. Flavors of Summarization Comparative Guided Progressive Query Focused Code Opinion/ Sentiment Single document Personalized

  5. Extract Vs. Abstract Extract An extract is a summary consisting of entirely of material from the input text Abstract An abstract is a summary at least some of whose material is not present in the input. eg. paraphrases of content, subject of categories

  6. Towards Abstraction Abstractive • Guided Summarization • Code Summarization • Comparison Summarization Blog summarization Progressive Summarization Personalized , Cross Lingual Summarization Single Document, Query Focused Multi Document Summarization

  7. Technological Aspects

  8. Extractive Summarizers

  9. Query Focused Summarization • Documents should be ranked in order of probability of relevance to the request or information need, as calculated from whatever evidence is available to the system • Query Dependent ranking: Relevance Based Language models • Language models (PHAL) • Query Independent ranking: Sentence Prior

  10. RBLM is an IR approach that computes the conditional probabilities of relevance from document and query • PHAL- probabilistic extension to HAL spaces • HAL constructs dependencies of a term w on other terms based on their occurrence in its context in the corpus

  11. DUC Peformance 2006 38 systems participated in 2006 Significant difference between first two systems

  12. Extract vs. Abstract Summarization • We conducted a study (post TAC 2006) • Generated best possible extracts • Calculated the scores for these extracts • Evaluation with respect to the reference summaries

  13. Cross Lingual Summarization

  14. Cross Lingual Summarization • A bridge between CLIR and MT • Extended our mono-lingual summarization framework to a cross-lingual setting in RBLM framework • Designed a cross-lingual experimental setup using DUC 2005 dataset • Experiments were conducted for Telugu-English language pair • Comparison with mono-lingual baseline shows about 90% performance in ROUGE-SU4 and about 85% in ROUGE-2 f-measures

  15. Progressive Summarization • Emerging area of research in summarization • Summarization with a sense of prior knowledge • Introduced as “Update Summarization” at DUC 2007, TAC 2008, TAC 2009 • Generate a short summary of a set of newswire articles, under the assumption that the user has already read a given set of earlier articles. • To keep track of temporal news stories

  16. Key challenge • To detect information that is not only relevant but also new given the prior knowledge of reader • Relevant and new Vs • Non-Relevant and new Vs • Relevant and redundant

  17. Three level approach to Novelty Detection Sentence Scoring • Developing new features that capture novelty along with relevance of a sentence • NF, NW Ranking • Sentences are re ranked based on the amount of novelty it contains • ITSim, CoSim Summary Generation • A selected pool of sentences that contain novel facts. All remaining sentences are filtered out

  18. Evaluations • TAC 2008 Update Summarization data for training: 48 topics • Each topic divided into A, B with 10 documents • Summary for cluster A is normal summary and cluster B is update summary • TAC 2009 update Summarization for testing: 44 topics • Baseline summarizer generates summary by picking first 100 words of last document • Run1 – DFS + SL1 • Run2 – PHAL + KL

  19. Personalized Summarization • Perception of text differs with background of the reader • Need of incorporating user background in the summarization process • Summarization not only a function of input text but also the reader

  20. Web-based profile creation: Personal information available on web- a conference page, a project page, an online paper, or even in a Weblog. Estimate Model P(w/Mu) to incorporate user in sentence extraction process

  21. Opinion summarization Sentiment Analysis • User-generated-content is growing rapidly through blogs • Sentiment analysis provides better access to information Sentiment • Textual information on the Web can be categorized as facts and opinions • Computational study of opinions, sentiments in market perspective

  22. Optimization of sentiment in the summary to the maximum extent Sentiment summarization as a two stage classification problem at sentence level Polarity Estimation • Opinion/fact • Positive/Negative

  23. Semi Abstractive Summarizers

  24. Comparative summarization • Summaries for comparing multiples items belonging to a category • Category of “Mobile phones“ will have “Nokia”, “Black berry’ as its items • Comparative summaries provide the properties or facts common to these items and their corresponding values with respect to each item. • “Memory”, “Display”, “Battery Life”, Memory Battery Life

  25. Comparative Summaries Generation • Attribute Extraction • Find the attributes of the product class • Attribute Ranking • Rank the attributes according to importance in comparison • Summary Generation • Find the occurrence of attributes in various products

  26. Guided Summarization • Query Focused Summarization • User’s information need expressed as a query along with a narrative • Set of documents related to the topic • Goal is to produce a shot coherent summary focusing answer to the query • Guided Summarization • Each topic is classified into a set of predefined categories • Each category has a template of important aspects about the topic • Summary is expected to answer all the aspects of template while containing other relevant information

  27. Guided summarization • Encourage deeper linguistic and semantic analysis of the source documents instead of relying only on document word frequencies to select important concepts • Shares similarity with information extraction • Specific information from unstructured text is identified and consequently classified into a set of semantic labels (templates) • Makes information more suitable for other information processing tasks • A guided summarization system has to produce a readable summary encompassing all the information about the templates • Very few investigations exploring the potential of merging summarization with information extraction techniques

  28. Our approach • Building a domain model • Essential background knowledge for information extraction • Sentence Annotations • To identify sentences having answers to aspects of template • Concept Mining • To use semantic concepts instead of words to calculate sentence importance • Summary Extraction • Modification of summary extraction algorithm to adapt to the requirements using sentence annotations

  29. Thanks

More Related