1 / 31

Comparing Presentation Summaries: Slides vs. Reading vs. Listening

Comparing Presentation Summaries: Slides vs. Reading vs. Listening. Liwei He, Elizabeth Sanocki Anoop Gupta, Jonathan Grudin Collaboration and Multimedia Group Microsoft Research. Motivation. Multimedia presentations are being archived for on-demand access University courses

gilbert
Download Presentation

Comparing Presentation Summaries: Slides vs. Reading vs. Listening

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Comparing Presentation Summaries:Slides vs. Reading vs. Listening Liwei He, Elizabeth Sanocki Anoop Gupta, Jonathan Grudin Collaboration and Multimedia Group Microsoft Research

  2. Motivation • Multimedia presentations are being archived for on-demand access • University courses • Corporate training and seminars • Effective summarization and skimming can help users utilize time better

  3. Video Skimming Techniques • Time compression • 1.5 – 2.5 saving factor at most • Video summary • 2.5+ saving factor is possible

  4. Previous Summarization Study • Compared 4 video summary techniques • 1 by authors of the presentation • 3 by computer algorithms • Pre- and post quizzes and subjective ratings • More details in our paper in ACM Multimedia 99 • “Auto-Summarization of Audio-Video Presentations”

  5. Auto Summary Study Results • All four summaries improve quiz scores • Human-generated summary is significantly better than computers • No difference among computer-generated summaries • Overall, all are appreciated by subjects

  6. Questions Raised • What about other forms of summary? • Amount of information from slides? • Skimming text transcript vs. watching video? • Transcripts with key points highlighted vs. video summaries?

  7. Experimental Design (1) • 4 summarization techniques • PowerPoint slides only • Raw text transcripts • Transcripts with key points highlighted • Author-generated video summaries

  8. PowerPoint Slides Only

  9. Raw Text Transcript

  10. Text Transcript w/ Highlights

  11. Video Summary

  12. Experimental Design (2) • To compare summarization techniques • Objective measure: quiz score improvement before and after each summary • Subjective measure: user ratings • 4 talks chosen from Microsoft training site • Original presenters wrote quiz questions

  13. Four Presentations Used

  14. Experimental Design (3) • 24 Microsoft employees were subjects • 32 question pre-quiz • 4 summaries, each of a different type • 8 quiz questions after each summary • Summary types and talks are counter-balanced within each subject

  15. Quiz Score Improvement (1) • Plot by summary types

  16. Quiz Score Improvement (2) Video-summary > highlight-text ? p = 0.087

  17. Quiz Score Improvement (3) Highlight-text and video-summary are significantly better than (at p<0.001) slide-only and raw-text

  18. Quiz Score Improvement (4) Plot by presentations

  19. Four Presentations Used

  20. Subjective Ratings (1) Table by summarization techniques

  21. Subjective Ratings (2) Highlight-text and video-summary are significantly better than (at p=0.01) slide-only and raw-text

  22. Subjective Ratings (3) Highlight-text and video-summary are not significantly different (at p=0.05)

  23. Subjective Ratings (4) Raw-text, highlight-text, and video-summary are significantly better than (at p=0.05) slide-only

  24. User Comments • 13 out of 24 like video-summaries • “It is more enjoyable listening and seeing the presenter.” • 11 prefer highlighted transcripts • “I liked having the option of being able to get more detailed info when I need it.”

  25. Conclusions • Effective summary techniques are key • Slide-only does not work well for most talks • Authoring style makes a difference • Raw text transcript is hard to read • Human produced summaries work better

  26. Conclusions (cont.) • What to do? • For authors: tools to generate summaries • For users: interactive and intelligent video browser

  27. Compare with AutoSum Study (1) • Current study and auto summary study are comparable • 4 talks and quiz are the same • Both have author-generated summary • Slides are shown in all conditions for both • Evaluation methods are the same

  28. Compare with AutoSum Study (2) AutoSum Study Current Study

  29. Compare with AutoSum Study (3) Subject ratings (AutoSum vs. Current)

  30. Compare with AutoSum Study (4) A* in AutoSum consistently > A

  31. Compare with AutoSum Study (3) Slide-based summary (S) > slide only (SO)

More Related