260 likes | 401 Views
LYU9904 Presentation. Multi-Model Digital Video Library. Supervisor: Prof. Michael Lyu. Jacky Ma. Team members:. Joan Chung. Presentation Outline. Project Aims Introduction of Digital Video Library Introduction of Our Work Considerations and Approach Design and Implementation
E N D
LYU9904 Presentation Multi-Model Digital Video Library Supervisor: Prof. Michael Lyu Jacky Ma Team members: Joan Chung
Presentation Outline • Project Aims • Introduction of Digital Video Library • Introduction of Our Work • Considerations and Approach • Design and Implementation • Future Plans
Project Aims • Learn different issues about DVL • existing such as Informedia(TM) done by CMU • Implement a small-scale model • Client interface for playback of media • Process data source/user queries in Chinese • Web Integration
Introduction of Digital Video Library • Functions of a DVL • Why Digital Video Library? • Issues about DVL • Techniques Addressing DVL Issues
Functions of a DVL • Storage and play back of video resources • Online access of video resources • Search of useful information through the vast data collections • Retrieval of the most relevant selections
Why Digital Video Library? • Digital data • easy to process in an automated way • takes advantage of the Internet • Multimedia content • more attractive • for education, training, sports and entertainment • Library management • An organized way of retrieval media contents
Issues about DVL • Building Video Databases • Indexing the Video Contents • Breaking the Video into Segments • Retrieving Video
Building Video Database • Extremely large space requirement • Choosing a video format • Online access of video resources
Indexing the Video Contents • Inaccessibility of information in video • Limitation of text-base descriptions • Tedious manual process • Cinematic information is complex to describe
Breaking the Video into Segments • Video paragraphing • Alternate representation of video • Text tile • Text abstract • Full-text transcript • Representative single image • “Skim” video
Retrieving Video • Three principle for searching • Let user to skim the video object quickly with their interest • Adjust the size of video • Identify of desired video among multiple returned results • Ways to achieve • Small size of video returned • Information visualization
Techniques Addressing DVL Issues • Speech Analysis • Speech recognition technology generates transcript • Pauses and silence in audio help paragraphing • Image Analysis • Detect significant changes in weighted color histogram • Interpret camera motion • Natural Language Processing • Query processing • Retrieval
Our Work • Focus and Target • Programming Environment • Design and Implementation • System Consideration • System Design • System Implementation • Future Plans
Focus and Target • Divide the project into modules that can be implemented in stages • digital video preparation • video playback • user query • web-integration
Programming Environment • Platform • Java as programming language • JMF API to present time-base media
Why use Java? • Platform independence • Network ready • International appeal • Easy to build GUI • JMF API for video playback • Disadvantages?
Presenting Time-Base Media with JMF • What is JMF? • Java Media Framework Application Programming Interface • Incorporating media data into Java • The high level architecture • Similar to traditional VCR • Data Source • Pull data-source and Push data-source • Media Presentation • Programmed or Interactive controls
Design and Implementation • System Consideration • System Design • System Implementation
System Consideration • User Perspective • User friendly • Other system component are transparent • Server Program • Robust, reliable • Network Issue • Video Collections
System Implementation • Library Preparation • Server Program • Client Program
Future Plans • Java-applet Client Program • Semi-auto Timestamp Editing Tools • Searching and Indexing Capability • Other Possible Extensions • Automatically derived transcripts • Language processing of queries and transcripts • Content-based Image Manipulation