160 likes | 226 Views
1. Searching Annotated Broadcast Content on Mobile and Stationary Devices. Gabriella Kazai, Mounia Lalmas, Alan Pearmain and Marie-Luce Bourguet. Outline. SAVANT System Content Access System Metadata Search Engine IFA’03 demonstrator. SAVANT.
E N D
1 Searching Annotated Broadcast Content on Mobile and Stationary Devices Gabriella Kazai, Mounia Lalmas, Alan Pearmain and Marie-Luce Bourguet
Outline • SAVANT System • Content Access System • Metadata • Search Engine • IFA’03 demonstrator
SAVANT “Synchronised and scalable Audio Visual content Across NeTworks” “Develop broadcast and Internet technologies to allow end-users to access interrelated and synchronised multimedia content in an intelligent and transparent manner on stationary and mobile terminals and under varying network conditions.”
The SAVANT System Content Delivery Content Access Content Creationand Annotation Linear content(MPEG-2) Switching decision Stationary STB Interactive content(MPEG-4, HTML, 3D, games, etc.) IP network DVB delivery network Metadata(MPEG-7, MPEG-21, TV-Anytime) Portable Mobile
Content PresentationEngine Storage Manager Content Access System STB Client Service System User Manager Content/Service Adaptation Engine Service DescriptionManager Search Engine Access Control(SAVANT Xlet) MHP IP DVB
Content PresentationEngine Storage Manager Content Access System STB Client Service System User Manager Content/Service Adaptation Engine Service DescriptionManager Search Engine Access Control(SAVANT Xlet) Retrieval Filtering MHP Recommendation IP DVB
Metadata • TV-Anytime: Programme level (service) • MPEG-7: Media stream level (content) • MPEG-21: User preferences, terminal capabilities, network characteristics
HTML MPEG-2 MPEG-21 MPEG-4 MPEG-21 MPEG-7 MPEG-7 MPEG-21 Digital Item MPEG-21 Digital Item Metadata TV-Anytime
Search Engine • Indexing the Metadata • Query Processing • Relevance-based Ranking Retrieval Filtering Recommendation
Indexing • MPEG-7 and TV-Anytime • Stop-word removal, stemming • Statistical probabilistic framework • tf • idf • Content in context (Title, Synopsis, Segment, etc.) • Aggregation
Query Processing • Manually entered query • Natural language or XPath • User profile • User’s interests • Manual and automatic • Explicit and implicit learning • MPEG-7, TV-Anytime • Query indexing
Ranking • Probabilistic framework • Content and context matching • Filtering based on MPEG-21 0.71 user_profile(irak, user1)0.53 user_profile(economics, user1)0.80 user_profile(irakkonflikt, user1) Content index 0.965359 (topic,tid_Irak-Konflikt,user1)0.502604 (ni,ts20030624_1700_1,user1)0.402404 (aci,aci_ts20030624_1700_1_3,user1)0.214276 (aci,aci_as20030624_1800_3_2,user1)0.209376 (ni,ba20030624_1930_1,user1)
IFA’03 Demonstrator “Berlin International Broadcast Fair” • News scenario • Recommendation • at service-component level • Two predefined profiles
Thank you! • References: • Scalable and Personalised Broadcast Services.J. Bywater, M-L. Bourguet, G. Kazai, M. Lalmas and A. Pearmain. Proceedings of the European Conference on Interactive Television (ECIT): Enhancing the Experience, Brighton, UK, March 2004. • Using Metadata to Provide Scalable Broadcast and Internet Content and ServicesG. Kazai, M. Lalmas, M-L. Bourguet and A. Pearmain Proceedings of the 4th European Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS 2003), London, April 2003. http://www.ist-savant.org/