1 / 24

Summary : Depth discontinuities by pixel-to-pixel stereo

Summary : Depth discontinuities by pixel-to-pixel stereo. Jeong Kanghun CRV (Computer & Robot Vision) Lab. Index of paper. Introduction Stereo formulation Cost function Occlusion penalty and match reward Pixel dissimilarity Hard constraints

aiko-woodard
Download Presentation

Summary : Depth discontinuities by pixel-to-pixel stereo

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Summary : Depth discontinuities by pixel-to-pixel stereo Jeong Kanghun CRV (Computer & Robot Vision) Lab.

  2. Index of paper • Introduction • Stereo formulation • Cost function • Occlusion penalty and match reward • Pixel dissimilarity • Hard constraints • Intensity variation accompanies depth discontinuities • Constraints related to search • Searching along epipolarscanlines • Two dual optimal algorithms • A faster algorithm • Propagating information between scanlines • Experimental results • Comparison with previous work • Conclusion

  3. Abstract • The algorithm matches individual pixels in corresponding scanline pairs • Allowing occluded pixel to remain unmatched, then propagates the information between scanlines by means of a fast postprocessor. • 1. 5 microseconds per pixel per disparity on a workstation.

  4. 1. Introduction • A method for detecting depth discontinuities from a stereo pair of images. • Disparity map • Postprocessing step propagates information between the scanlines to refine the disparity map and the depth discontinuities. • The image sampling problem is overcome by using a measure of pixel dissimilarity that is insensitive to sampling • The algorithm handles large untextured regions which present a challenge to many existing stereo algorithms • Unlikely search nodes are pruned to reduce dramatically the running time of dynamic programming

  5. 2. Stereo formulation • IL (x), IR (y) are images of the same scene point. (Throughout this paper, x denotes a pixel in the left scanline, while y denotes a pixel in the right scanline.) • Unmatched pixels are occluded. • Disparity : = • The depth-discontinuity pixels are labelled as those pixels that border a change of at least two levels of disparity and that lie on the far object.

  6. 2. Stereo formulation(cont.)

  7. 2.1 Cost function • N is number of occlusion (not the number of occluded pixels). • M is matched pixel. • Kocc : 25 • Kr : 5 Constant occlusion penalty Constant match reward Dissimilarity between pixels

  8. 2.2.2 Pixel dissimilarity • We propose instead to use the linearly interpolated intensity functions surrounding two pixels to measure their dissimilarity, in a method that is provably insensitive to sampling • IRand ILincident upon two corresponding scanlines of the left and right cameras, respectively. chosen as the pixels whose dissimilarity is to be measured the linearly interpolated function between the sample points of the right scanline.

  9. 2.2.2 Pixel dissimilarity(cont.) • The dissimilarity between the pixels is computed as the minimum of this quantity and its symmetric counterpart • definition of d is symmetrical.

  10. 2.2.2 Pixel dissimilarity(cont.) Imin and Imax

  11. 2.2.2 Pixel dissimilarity(cont.) • The quantity d is insensitive to sampling in the sense that, without noise or other distortions. • d(xi , yi) = 0 whenever yi is the closest sampling point to the y value corresponding to xi.

  12. 2.2 Hard constraints • All match sequences to satisfy certain constraints. • The second set facilitates a systematic, efficient search.

  13. 2.2.1 Intensity variation accompanies depth discontinuities • For a scene to be artificially altered by placing a textured background. • Namely that intensity variation accompanies depth discontinuities (Think of it as a weak intensity edge) • Intensity variation occurring at a depth discontinuity (as the result of an intensity difference between the near object and the far object) • The same disparity as the near object (on next slide)

  14. 2.2.2 Constraints related to search If (x, y) is a match, either x + 1 or y + 1 must be matched.

  15. 3. Searching along epipolar scanlines • To find the optimal match sequence by conducting an exhaustive search. • X corresponds to an occluded pixel

  16. 3.1 Two dual optimal algorithms • Fig. 5b and Fig. 5c Matched pixels

  17. 3.2 A faster algorithm • The running time would not be reduced because of the difficulty in determining whether there is a lower-cost match above or to the left of another match.

  18. 4. Propagating information between scanlines • We have devised a method for postprocessing the disparity map by propagating reliable disparity values into regions of unreliable disparity values. • Each pixel is assigned a level of reliability

  19. 5. Experimental Result • Slightly defocused of 10 mm • It is important to note that even in principle this problem can never be eliminated completely. • The algorithm is heavily dependent upon local information. • Using size of 630 X 480 images. • The maximum disparity is set 14.

  20. Conclusion • Detecting depth discontinuities is an important problem that is rarely emphasized in stereo matching. • The algorithm is fast and able to compute disparities and depth discontinuities in some situations where previous algorithms would fail.

  21. Figure 8 : Result

  22. Q & A

More Related