1 / 81

Optical Flow

Optical Flow. Optical Flow. Brightness Constancy The Aperture problem Regularization Lucas-Kanade Coarse-to-fine Parametric motion models Direct depth SSD tracking Robust flow Textured motion. Optical Flow: Where do pixels move to?. Motion is a basic cue.

mjeffries
Download Presentation

Optical Flow

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Optical Flow

  2. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

  3. Optical Flow:Where do pixels move to?

  4. Motion is a basic cue Motion can be the only cue for segmentation

  5. Applications • tracking • structure from motion • motion segmentation • stabilization • compression • mosaicing • …

  6. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

  7. Definition of optical flow OPTICAL FLOW = apparent motion of brightness patterns Ideally, the optical flow is the projection of the three-dimensional velocity vectors on the image 

  8. Caution required ! Two examples : 1. Uniform, rotating sphere  O.F. = 0 2. No motion, but changing lighting  O.F.  0 

  9. Mathematical formulation I (x,y,t) = brightness at (x,y) at time t Brightness constancy assumption: Optical flow constraint equation : 

  10. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

  11. The aperture problem 1 equation in 2 unknowns 

  12. The Aperture Problem 0

  13. What is Optical Flow, anyway? • Estimate of observed projected motion field • Not always well defined! • Compare: • Motion Field (or Scene Flow) projection of 3-D motion field • Normal Flow observed tangent motion • Optical Flow apparent motion of the brightness pattern (hopefully equal to motion field) • Consider Barber pole illusion

  14. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

  15. Horn & Schunck algorithm Additional smoothness constraint : besides OF constraint equation term minimize es+ec 

  16. so the Euler-Lagrange equations are is the Laplacian operator Horn & Schunck The Euler-Lagrange equations : In our case , 

  17. Horn & Schunck Remarks : 1. Coupled PDEs solved using iterative methods and finite differences 2. More than two frames allow a better estimation of It 3. Information spreads from corner-type patterns 

  19. Horn & Schunck, remarks 1. Errors at boundaries 2. Example of regularization (selection principle for the solution of ill-posed problems) 

  20. Results of an enhanced system

  21. Structure from motion with OF

  22. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

  23. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

  24. Optical Flow • Brightness Constancy • The Aperture problem • Regularization • Lucas-Kanade • Coarse-to-fine • Parametric motion models • Direct depth • SSD tracking • Robust flow • Textured motion

More Related