260 likes | 462 Views
Multimedia Communications EG 371. Dr Matt Roach Lecture 7 Video taxonomy. Video material is expanding. Customers expectations Volumes of video Dimitrova’99 14 years, Single supplier Petabyte, 1024 terabytes, 2 50 bytes Advances Internet, video phones Production Distribution.
E N D
Multimedia CommunicationsEG 371 Dr Matt Roach Lecture 7 Video taxonomy Multimedia communications EG 371 Dr Matt Roach
Video material is expanding • Customers expectations • Volumes of video • Dimitrova’99 • 14 years, Single supplier • Petabyte, 1024 terabytes, 250 bytes • Advances • Internet, video phones • Production • Distribution Multimedia communications EG 371 Dr Matt Roach
Video management Multimedia communications EG 371 Dr Matt Roach
Automatic video management • How do we automatically classify video • Extremely difficult task • Broadcast video • Broad domain, narrow domain • Classification hierarchy • Top down, bottom up Multimedia communications EG 371 Dr Matt Roach
Broadcast video Multimedia communications EG 371 Dr Matt Roach
Information within a video • Cognitive • News • News reporter • Trevor McDonald • News report • Robbery • Money $ • Heathrow • Get away van • Describe or summarise the content of the clip Multimedia communications EG 371 Dr Matt Roach
Information within a video • Formative • Pattern, shape, form • Colour statistics • % skin colour • Spatial textures • Global motion Multimedia communications EG 371 Dr Matt Roach
Semantic gap lack of coincidence between formative and cognitive information • How to reduce? Multimedia communications EG 371 Dr Matt Roach
Video taxonomy Multimedia communications EG 371 Dr Matt Roach
Video taxonomy Multimedia communications EG 371 Dr Matt Roach
Video taxonomy Multimedia communications EG 371 Dr Matt Roach
Semantic content Multimedia communications EG 371 Dr Matt Roach
Automatic classification • Highest level of classification • Broad content • Fischer, MMCE’95 • Lienhart, IEEE MCS’97 • Liu, IEEE MMSP’98 • Truong, ICPR’00 • Dimitrova, ECSP’00 • Sadlier, ICEIS’00 Multimedia communications EG 371 Dr Matt Roach
Genre change Genre change ta tb Multimedia communications EG 371 Dr Matt Roach
Automatic classification • Defined by objects • Inter-actions • Inter-relations • Haering, IEEE MCS’99 • Hunts in wildlife • Yow, ACCV’95 • Goals in soccer Multimedia communications EG 371 Dr Matt Roach
Event change Multimedia communications EG 371 Dr Matt Roach
Automatic classification • Face • Brand, IEEE ICIP’01 • Torres, Pattern Recognition ’02 • Dimitrova, ECSP’00 • Genre • Word • Ball, goal Strike first Goal Multimedia communications EG 371 Dr Matt Roach
Semantic content Multimedia communications EG 371 Dr Matt Roach
Editing effects Multimedia communications EG 371 Dr Matt Roach
Scene and shot changes Multimedia communications EG 371 Dr Matt Roach
Taxonomy compression Multimedia communications EG 371 Dr Matt Roach
Video taxonomy Multimedia communications EG 371 Dr Matt Roach
Discussion • What other elements could be added to the taxonomy • What are the relationships between today's lecture and compression • Bit rates • Design concerns • Any questions? Multimedia communications EG 371 Dr Matt Roach