1 / 11

Video Key Frame Extraction for image-based Applications

Video Key Frame Extraction for image-based Applications. Goals. Core partners : TUB (coord.), EPFL, TUD, QMUL Aims : Generation of tags and metadata (signal processing and/or users’ annotation) Keyframe extraction for image search engines

csteiner
Download Presentation

Video Key Frame Extraction for image-based Applications

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Video Key Frame Extraction for image-based Applications

  2. Goals Core partners: TUB (coord.), EPFL, TUD, QMUL Aims: • Generation of tags and metadata (signal processing and/or users’ annotation) • Keyframe extraction for image search engines • Video classification, clustering and summarization • Propagation of tags (object detection/ similarity)

  3. Database Preparation: • Setup database from unstructured channel “Travel” on YouTube.com • 100 videos + affiliated metadata (keywords, comments, user information etc.) • Annotation of shot boundaries (by TUD and TUB) Demos: www.nue.tu-berlin.de

  4. Youtube Downloader Tool also used by the IRP “Social Media Data Collection“

  5. Youtube Downloader Information also interesting for IRP “Social Media Data Collection“

  6. Overview • Integration of different expertise: • Image search engines, audio signal processing, video signal processing and text detection/ recognition

  7. Overview Video stream: Shot Subshot Subshot Key Frame • Temporal segmentation • Detection of hard cut, fade and dissolve • Subshot boundary detection • Special importance for single shot videos and for long shots • Detection of new visual content appearing through camera operations or undetected transitions. • Extraction of key frames • efficient key frame extraction as a handshake between existing image search engines and video domain

  8. Key Frame Extraction

  9. Key Frame Extraction

  10. Demo – Chapter Generation

  11. Demo – Storyboard-like Key Framing

More Related