1 / 16

Intelligent Semantic Access to Audiovisual Content

Intelligent Semantic Access to Audiovisual Content. Yannis Avrithis, Giorgos Stamou, Anastasios Delopoulos and Stefanos Kollias Image, Video and Multimedia Systems Laboratory Department of Electrical and Computer Engineering National Technical University of Athens. Conventional A/V Archives.

claus
Download Presentation

Intelligent Semantic Access to Audiovisual Content

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Intelligent Semantic Access to Audiovisual Content Yannis Avrithis, Giorgos Stamou, Anastasios Delopoulos and Stefanos Kollias Image, Video and Multimedia Systems Laboratory Department of Electrical and Computer Engineering National Technical University of Athens

  2. Conventional A/V Archives • Delicate or fragile media such as film, videotapes, slides, paper • difficult access, preview & reproduction • degradation / expensive conservation • Not computerized indexes/catalogues • slow & inconvenient search • Lack of standardized documentation • Local nature / isolated archives • multiple searches, physical presence

  3. Digitization of the Archives • Digital a/v material, digital storage • MPEG digital video & audio • preservation & reproduction is trivial • easy access & media distribution • Digital indexing, cataloguing & documentation • efficient search, visual preview • queries using keywords or "free" text

  4. Beyond Digitization... • A/V objects vs. frames (MPEG-4) • direct access to shots, frames or objects • Metadata • info about the a/v material • standardized annotation & documentation • Visual content based search (MPEG-7) • rich information, more efficient queries • search & retrieval at the level of objects

  5. The Proposed System

  6. Major Objectives • Offer unified semantic views to individual a/v archives • beyond the individual classification schemes & subject indexes of each archive • Personalize these views according to the profile of individual users • semantic interpretation heavily relies on the context which in turn depends on the specific profile.

  7. Unified Semantic Views • Individual a/v archives have different • thematic categories • detail of content description • support of a/v content based description • Centralized user access require either • re-building (common archiving schema) • mapping of queries to individual schemas • Mapping possible only at semantic level

  8. System Features • Adopts standard MPEG-7 features & descriptions for content-based access • Dynamically extracts high level semantic descriptions of a/v units • Enables queries at high semantic level • Communicates with custom a/v archives • Generates & updates user profiles • Employs user preferences for filtering

  9. System Architecture

  10. Information Model • Multimedia document DS’s • creation, media, usage, structure, access & navigation information • Data storage • encyclopaedia, index, user profiles, a/v archive profiles • Query / response between interfaces • Module communication • internal query / response, database access

  11. Modes of Operation • Query mode • query analysis & search engine • a/v classification & presentation filtering • Update mode • dynamic thematic categorization (DTC) • detection of events & composite objects (DECO) • encyclopaedia & user profile update

  12. Query Mode

  13. Query Mode • User query: semantic, metadata & visual specifications • Query analysis: interpretation, expansion & profiling • Search engine: index & archive query • A/v classification: user interests • Presentation filtering: user preferences

  14. Update Mode

  15. Update Mode • DTC: associate thematic categories to a/v units in index • DECO: detect & associate simple & composite semantic entities (objects, events, concepts etc.) to a/v units • Encyclopaedia update: entity relations thesaurus • User profile update: usage history user preferences

  16. Conclusions • Unified semantic views to individual a/v archives • Dynamic extraction of high level semantic descriptions • Queries at high semantic level • Personalized response according to user preferences • Conformance to MPEG-7

More Related