270 likes | 394 Views
MSR Cambridge Vision Group. Editing Images Editing videos Live video Recognising objects Remote collaboration. Images and videos as first-class objects. MS Research Cambridge (MSRC) -- Machine Learning and Perception Group. Vacation fantasy.
E N D
MSR Cambridge Vision Group • Editing Images • Editing videos • Live video • Recognising objects • Remote collaboration
Images and videos as first-class objects MS Research Cambridge (MSRC) -- Machine Learning and Perception Group
Patchworks • Inpainting: smooth completion over small gaps, but slow • PatchWork: similar (a bit less smooth) to Inpainting, but fast... PatchWorks Inpainting
Filling in large Holes • Inpainting: does not work • Resynthesizer (Gimp): 2’45’’ (computation) • Clone (PictureIt): 5’ (hand-labor) • PatchWork: 10’’ (computation) Clone Resynthesizer PatchWorks
Demo: • Patchworks/Grabcut
From still images ... to video • Research challenge: analysing movement • Reacting to people • Making personal video manageable
Why is visual search hard? What the computer sees What you see
Cartoon collection -- Daimler-Benz ++
Tracking motion with a cartoon “flip-book” • Application of (award winning) MSRC work on visual tracking
Stereo webcam conventional camera - zoomed out conventional camera - zoomed in Smart Framing - start Smart Framing - continue
i2i project Prize-winning technology
General object class recognition Learned visual dictionary - underlies image/video search - object sensitive image editing Machine Learning: Object recognition
Image segmentation applications to colonoscopy joint project (TCI) with U. Oxford Stereo imaging surgical visualisation, Papworth hospital Video tracking - echocardiographic analysis - joint PhD (ESI) with U. Oxford People: Andrew Blake, Antonio Criminisi, Carsten Rother, Victor Lempitsky. Medical Imaging Interests at MSRC
Summary: MSRC Vision/Graphics • Images and videos: first-class citizens of the desktop • Image processing accessible for all users • Video: communication, remote collaboration, medicine • Research feeding into video and graphics products