1 / 38

Object Tracking, Trajectory Analysis and Event Detection in Intelligent Video Systems

This paper discusses the motivation, techniques, and challenges in object tracking, trajectory analysis, and event detection for intelligent video systems.

kalinowski
Download Presentation

Object Tracking, Trajectory Analysis and Event Detection in Intelligent Video Systems

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. Object Tracking, Trajectory Analysis and Event Detection in Intelligent Video Systems Student: Hsu-Yung Cheng Advisor: Jenq-Neng Hwang, Professor Department of Electrical Engineering University of Washington

  2. Outlines • Motivation • Object Tracking • Trajectory Analysis • Event Detection • Conclusions and Future Work

  3. Motivation • Advantage of Video-based systems • Being able to capture a large variety of information • Relatively inexpensive • Easier to install, operate, and maintain • Applications • Security surveillance • Home care surveillance • Intelligent transportation systems • There is an urgent need for intelligent video systems to replace human operators to monitor the areas under surveillance.

  4. System Modules for Intelligent Event Detection Systems

  5. Challenges for Robust Tracking • Segmentation errors • Change of lighting conditions • Shadows • Occlusion

  6. Inter-Object Occlusion

  7. Initial Occlusion

  8. Background Occlusion

  9. Proposed Tracking Mechanism

  10. Background Estimation and Updating • Based on Gaussian mixture models [Stauffer 1999] • Model the recent history of each pixel by a mixture of K Gaussian distributions. • Every pixel value is checked among the existing K Gaussian distributions for a match. • Update the weights for the K distributions and the parameters of the matched distribution • The kth Gaussian is ranked by ( ) • The top-ranked Gaussians are selected as the background models. • Pixel values that belong to background models are accumulated and averaged as the background image. • The background image is updated for every certain interval of time.

  11. Moving Object Segmentation • Based on background subtraction • Fourth order moment [S. Colonnese et al. Proc. of SPIE 2003] • Thresholding

  12. Kalman Filter • Kalman filters are modeled on a Markov chain built on linear operators perturbed by Gaussian noises. At time k, each target has state , where and observation (measurement) , where Kalman, R. E. "A New Approach to Linear Filtering and Prediction Problems,“ Transactions of the ASME - Journal of Basic Engineering Vol. 82: pp. 35-45, 1960.

  13. Kalman Filter Phases Predict Updated State Estimate Predicted State Observed Measurements Update

  14. Kalman Filter Phases Update Phase Predict Phase • Updated State Estimate • Predicted State • Updated Estimate Covariance • Kalman Gain • Predicted Estimate • Covariance • Innovation Covariance • Innovation (Measurement) Residual

  15. Constructing MeasurementCandidate List

  16. Searching for measurement candidate representation points • Search for q1 and q2 in the two nxn windows centered around p1and p2, respectively. • Compute the dissimilarities between the target object and the potential measurement candidates.

  17. Data Association • To associate measurements with targets when performing updates • Nearest Neighbor Data Association For all the measurement in the validation gate of a target, select the nearest measurement. • Probabilistic Data Association (PDA) • Joint Probabilistic Data Association (JPDA)

  18. denotes the event that the j th measurement belongs to that target. Combined (Weighted) Innovation Probabilistic Data Association Consider a single target independently of others y2 x y1 y3 Y . Bar-Shalom and E. Tse, “Tracking in a cluttered environment with probabilistic data association,”Automatica, vol. 11, pp. 451-460, Sept. 1975.

  19. Modified PDA for Video Object Tracking • To handle video objects (regions), incorporate the following factor when computing • Similarity measure: cross correlation function

  20. Experimental Videos

  21. Vehicle Tracking Results 1

  22. Vehicle Tracking Results 2

  23. Human Tracking Results

  24. Object Tracking Statistics Occluded Object Tracking Success Rate: 0.855

  25. Trajectory Analysis Class 1 Class 3 Class 5 Class 2 Class 6 Class 4

  26. Trajectory Smoothing • Sample the trajectory • Perform cubic spline interpolation

  27. Angle Feature Extraction Relative Angle Absolute Angle

  28. Hidden Markov Model • N states Si , i=1,…, N • Transition probability aij • Initial probabilitypi • Observation symbol probabilitybj(k) • A complete model l=(A,B,P) • A={aij} • B={bjk} • P={pi}

  29. Example of HMM Observation sequence O = { walk, bike, bus, bus, bike, walk, … }

  30. Three Problems in HMM • Givenl, compute the probability that O is generated by this model How likely did O happen at this place? • Givenl, find the most likely sequence of hidden states that could have generatedO How did the weather change day-by-day? • Given a set of O, learn the most likely l Train the parameters of the HMM forward-backward algorithm Viterbi algorithm Baum-Welch algorithm

  31. Left-to-right HMM for Trajectory Classification

  32. K-means Clustering of Feature Points

  33. Number of Training and Test sequences Video for both training and testing Video for testing only

  34. Trajectory Classification Statistics

  35. Anomalous Trajectories

  36. Event Detection • Type I Events • Simple rule-based decision logic • Entering a dangerous region • Stopping in the scene • Driving on the road shoulder • Type II Events • Based on trajectory classification results via HMM using angle features • Illegal U-turns or left turns • Anomalous trajectories • Type III Events • Based on trajectory classification results via HMM using speed features • Speed change

  37. Conclusions and Future Works • Tracking • Kalman filtering for prediction • Modified PDA for data association • Basic Events • Simple rule-based decision logic • HMM • Higher Level Events • Combining basic events • More flexible models

More Related