1 / 88

Background Subtraction

Background Subtraction. Purpose of Background Subtraction. Reduce problem set for further processing Only process part of picture that contains the relevant information Segment the image into foreground and background Add a virtual background. Encountered Problems. Lighting Shadows

rnewbern
Download Presentation

Background Subtraction

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Background Subtraction

  2. Purpose of Background Subtraction • Reduce problem set for further processing • Only process part of picture that contains the relevant information • Segment the image into foreground and background • Add a virtual background

  3. Encountered Problems • Lighting • Shadows • Gradual/Sudden illumination changes • Camouflage • Moving objects • Foreground aperture • Foreground object becomes motionless

  4. Lighting and Shadows • Weight the luminance with other characteristics • Depth of object • Region/Frame information • Adjust the background model with time • Store a history of previous backgrounds

  5. Widely Used

  6. Simple Approach

  7. Frame Differencing The accuracy of this approach is dependent on speed of movement in the scene. Faster movements may require higher thresholds

  8. Frame Differencing This approach will only work for cases where all foreground pixels are moving and all background pixels are static.

  9. Mean Filter where N is the number of preceding images taken for averaging. This averaging refers to averaging corresponding pixels in the given images. N would depend on the video speed (number of images per second in the video) and the amount of movement in the video.

  10. Mean Filter

  11. Median Filter Nathan Johnson

  12. Median Filter Nathan Johnson

  13. Advantages & Shortcomings

  14. Advantages & Shortcomings

  15. Adaptive Background Mixture Models

  16. Normal Gaussian Distribution As a result, a pixel, once it has become foreground, can only become background again when the intensity value gets close to what it was before turning foreground. This method, however, has several issues: It only works if all pixels are initially background pixels (or foreground pixels are annotated as such).

  17. Running Gaussian Average • The pdf of every pixel is characterized by mean and variance. • In order to initialize variance, we can, for example, use the variance in x and y from a small window around each pixel. • Note that background may change over time (e.g. due to illumination changes or non-static background objects). To accommodate for that change, at every frame , every pixel's mean and variance must be updated

  18. Algorithm Overview If a pixel is categorized as foreground for a too long period of time, the background intensity in that location might have changed (because illumination has changed etc.). As a result, once the foreground object is gone, the new background intensity might not be recognized as such anymore.

  19. Mixture Model

  20. Mixture Model Nathan Johnson

  21. Model Adaptation Nathan Johnson

  22. Background Model Estimation

  23. Background Model Estimation Nathan Johnson

  24. Advantages Vs Shortcomings

  25. Relevant papers Nathan Johnson

  26. Summary

  27. Selectivity

  28. Selectivity

  29. Limitations (Selectivity) Nathan Johnson

  30. Kernel Density Estimators Kernel density estimation is a fundamental data smoothing problem where inferences about the population are made, based on a finite samples. Kernel density estimates are closely related to histograms, but can be endowed with properties such as smoothness or continuity by using a suitable kernell.

  31. Mean- Shift Based Estimation

  32. Mean Shift Based Estimation Mean shift is a procedure for locating the maxima of density function from given discrete data sampled density function. The simplest such algorithm would create a confidence map in the new image based on the color histogram of the object in the previous image, and use mean shift to find the peak of a confidence map near the object's old position. The confidence map is a probability density function on the new image, assigning each pixel of the new image a probability, which is the probability of the pixel color occurring in the object in the previous image.

  33. Problems & Solutions

  34. Eigen Backgrounds • The method uses the difference between input image and the reconstructed background image to detect foreground objects based on eigenvalue decomposition. • Foreground regions are represented in the reconstructed image using eigenbackground. • As the principle components of a scene are its background in general, the eigenbackgrounds that are used to reconstruct the background depict the characteristics of background.

  35. Eigen- backgrounds

  36. Spatial Correlation Nathan Johnson

  37. Binary Morphology • Binary Morphological techniques probe an image with a small shape or template called a structuring element. • The structuring element is positioned at all possible locations in the image and it is compared with the corresponding neighbourhood of pixels. • Some operations test whether the element "fits" within the neighbourhood, while others test whether it "hits" or intersects the neighbourhood.

  38. Summary Nathan Johnson

  39. Summary Nathan Johnson

  40. Definition of Motion Detection • Action of sensing physical movement in a give area • Motion can be detected by measuring change in speed or vector of an object

  41. Motion Detection Goals of motion detection • Identify moving objects • Detection of unusual activity patterns • Computing trajectories of moving objects Applications of motion detection • Indoor/outdoor security • Real time crime detection • Traffic monitoring Many intelligent video analysis systems are based on motion detection.

  42. Two Approaches to Motion Detection • Optical Flow • Compute motion within region or the frame as a whole • Change detection • Detect objects within a scene • Track object across a number of frames

  43. Background Subtraction • Uses a reference background image for comparison purposes. • Current image (containing target object) is compared to reference image pixel by pixel. • Places where there are differences are detected and classified as moving objects. Motivation: simple difference of two images shows moving objects

  44. a. Original scene b. Same scene later Subtraction of scene a from scene b Subtracted image with threshold of 100

  45. Model the background and subtract to obtain object mask Filter to remove noise Group adjacent pixels to obtain objects Track objects between frames to develop trajectories Static Scene Object Detection and Tracking

  46. Background Modelling

  47. Background Model

  48. After Background Filtering…

  49. Approaches to Background Modeling • Background Subtraction • Statistical Methods(e.g., Gaussian Mixture Model,Stauffer and Grimson 2000) Background Subtraction: • Construct a background image B as average of few images • For each actual frame I, classify individual pixels as foreground if |B-I| > T (threshold) • Clean noisy pixels

More Related