200 likes | 305 Views
Optical Snow and the Aperture Problem. Richard Mann School of Computer Science University of Waterloo. Michael Langer School of Computer Science McGill U niversity. Optical flow. J.J. Gibson, The Senses Considered As Perceptual Systems, 1966. Layered motion.
E N D
Optical Snow and the Aperture Problem Richard Mann School of Computer Science University of Waterloo Michael Langer School of Computer Science McGill University
Optical flow J.J. Gibson, The Senses Considered As Perceptual Systems, 1966
Layered motion e.g. occlusions, transparency
Motion beyond layers e.g. falling snow
“Optical Snow” Lateral egomotion in a 3D cluttered scene
Overview of Talk • background: - Fourier analysis of optical snow - how to estimate direction of optical snow? (Langer and Mann, ICCV ’01)
Overview of Talk • background: - Fourier analysis of optical snow - how to estimate direction of optical snow? (Langer and Mann, ICCV ’01) • new stuff: - aperture problem
Fourier analysis of image translation (Watson & Ahumada ’85) f t t f y f x If image patch is translating with velocity(v , v ) then all power lies on a plane: x y v f + v f + f = 0 x x y y t
Optical Snow Image velocities are (αv , αv ) x y
Fourier analysis of optical snow f t f t “bowtie” f x αv f +αv f + f = 0 x x y y t
Bowtie of falling spheres f t f Θ
Bowtie of bush f t f Θ
Q: How to compute motion direction ?A: rotate a wedge and measure power Minimum of power in wedge occurs when wedge is aligned with the bowtie.
Computing the direction of motion minimum of power motion direction The motion direction is perpendicular to the direction of minimum of power.
Aperture Problem “normal” direction Vertically falling cylinders appear to move in normal direction.
Aperture Problem “normal” direction (max of power) true motion direction
Aperture problem ? falling ellipsoids same power but random phase
Summary • Optical snow: a new motion category • Fourier-based method for detecting direction of motion • Analysis of aperture problem