1 / 23

Optical Snow and the Aperture Problem

Optical Snow and the Aperture Problem. Michael Langer Richard Mann School of Computer Science School of Computer Science McGill U. U. Waterloo. Optical snow. e.g. falling snow. Optical snow. Optical snow.

gilon
Download Presentation

Optical Snow and the Aperture Problem

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Optical Snow and the Aperture Problem Michael Langer Richard Mann School of Computer Science School of Computer Science McGill U. U. Waterloo

  2. Optical snow e.g. falling snow

  3. Optical snow

  4. Optical snow Egomotion in a 3D cluttered scene

  5. Optical snow

  6. Relevance to “Heading” Human observers can judge their direction of heading through a “3D cloud of dots”. (W. Warren and others) However, it is unclear how. Computational models assume accurate velocity estimates can be computed. (see Langer and Mann, ECVP ’01, ICCV ’01)

  7. Overview of Talk • Fourier model of image motion • Distributed codes in the brain (V1) • “Aperture problem”

  8. Fourier model of image translation (Watson & Ahumada ’85) f t t f y f x v f + v f + f = 0 x x y y t

  9. Optical Snow Image velocities are (αv , αv ) x y

  10. Fourier model of optical snow f t f t “bowtie” f x αv f +αv f + f = 0 x x y y t

  11. Example of bowtie in power spectrum bush image sequence

  12. Overview of Talk • Fourier model of image motion • Distributed codes in the brain (V1) • “Aperture problem”

  13. Oriented, directionally tuned cells in V1. What about the brain ? f t f y f x

  14. f t f y f x Oriented, directionally tuned cells in V1. What about the brain ?

  15. f t f y f x Image translation (v , v ) x y f t t f y f x (see Heeger ’87, Yuille and Grzywacz ’90, Simoncelli and Heeger ‘97)

  16. Optical snow (αv , αv ) x y f f t t f y f y f f x x

  17. Overview of Talk • Fourier model of image motion • Distributed codes in the brain (V1) • “Aperture problem”

  18. The Aperture Problem • Perceived motion of a line • is in “normal” direction. • Problem can be resolved • if endpoints or corners • are visible.

  19. Aperture problem ? yes

  20. Aperture problem ? no

  21. Aperture problem ? ? Falling ellipsoids with random phase spectrum.

  22. Open problems • How do dominant spatial orientations affect perceived direction(s) of motion ? • How do T-junctions, perspective, etc. affect perception of optical snow ? • Computational models ?

  23. Aperture problem f f t t f y f y f f x x

More Related