90 likes | 251 Views
Motion Segmentation in Forward Motion Video. Nick Hirsch: Progress Report. Overview of the Technique. Track Features (SIFT). Determine Direction of Tracked Points. Update FoE. Compare Tracks to FoE Direction Field. Transform Tracks and Relative Error into Feature Space. Cluster
E N D
Motion Segmentation in Forward Motion Video Nick Hirsch: Progress Report
Overview of the Technique Track Features (SIFT) Determine Direction of Tracked Points Update FoE Compare Tracks to FoE Direction Field Transform Tracks and Relative Error into Feature Space Cluster (Mean-Shift) Identify Moving vs. Stationary Cluster Segment Image Pixels (MAP-MRF)
Recent Progress • Added RANSAC code to improve FoE estimate • Read the Motion Segmentation literature • There’s no good solution to Motion Segmentation when there’s a perspective transformation • Coded up Mean-shift clustering • Tweaked KLT tracker settings • Futile • Integrated SIFT code into codebase
Reasons for canning KLT • Tracks weren’t accurate enough under certain conditions
Next Steps • Continue hacking until satisfied with tracks • Determine a good feature space • Cluster • Tweak • Repeat • Add image registration code to remove global movements due to camera shake (robustify)