240 likes | 369 Views
WEIZMANN INSTITUTE OF SCIENCE. COGSCI 2013. Learning to Perceive Coherent Objects. Nimrod Dorfman , Daniel Harari , Shimon Ullman Weizmann Institute of Science. Object segregation is learned. Even basic Gestalt cues are initially missing [Schmidt et al. 1986 ]. 5 months.
E N D
WEIZMANN INSTITUTE OF SCIENCE COGSCI 2013 Learning to PerceiveCoherent Objects Nimrod Dorfman, Daniel Harari, Shimon Ullman Weizmann Institute of Science
Object segregation is learned Even basic Gestalt cues are initially missing [Schmidt et al. 1986] 5 months
We propose a computational model: • Explain the first steps of learning • Based on psychophysical findings • Computationally tested on videos
It all begins with motion Motion
It all begins with motion Grouping by common motion precedes figural goodness [Spelke 1990 - review] Motion discontinuities provide an early cue for occlusion boundaries [Granrud et al. 1984]
Our model Motion-based segregation Boundary General Accurate Noisy Incomplete Motion discontinuities Common motion Global Object-specific Complete Inaccurate Local occlusion boundaries Object form Static segregation
Intensity edges? Boundary
Occlusion cues Boundary T-junctions Convexity Extremal edges [Ghose & Palmer 2010]
Familiar object Global
Moving object Motion
Moving object Motion Figure Ground Unknown
Motion Boundary Global
Good examples Boundary Need many examples for good results (1000+)
Prediction Boundary Figure or Ground? Figure or Ground? Novel object, novel background 78% success Using 100,000 training examples
Entire image Boundary Figure Background
Learning an object Global Standard object recognition algorithm Learns local features and their relative locations
Detection Global
Combining information sources Boundary Accurate Noisy & Incomplete Global Complete Inaccurate Combined
More complex algorithms Default GrabCut With segregation cue [Rother et al. 2004]
Summary • Static segregation is learned from motion • Two simple mechanisms: Boundary Motion discontinuities Occlusion boundaries (Need a rich library, including extremal edges) Global Common motion Object form • These mechanisms work in synergy • This is enough to get started, adult segregation is much more complex
Thank You!