An Interactive Background Blurring Mechanism and Its Applications

1. An Interactive Background Blurring Mechanism and Its Applications NTU CSIE 互動式背景模糊

2. Introduction • Privacy Preserving Original image Our system

3. Segmentations • Shallow focus result • Input image • Depth Map • Object Segmentation • Depth Map Generation • Image Defocus • Lazy Snapping • Perspective Box • Camera Settings • Alpha Matting • Defocus Blur • Pop-up Card • Face Detection

4. Experimental Result • Defocus blur method proposed in the system comparing with other blur filter results Deep focus Shallow focus

5. Experimental Result • Defocus blur method proposed in the system comparing with other blur filter results Gaussian blur Defocus blur Defocus blur + Bokeh

6. Experimental Result

7. Observation • with / without depth variation in the background Real photograph taken by DSLR

8. Experimental Result • with / without depth variation in the background Depth variation Original photograph Result after post-processing Depth fixed

9. Applications -Partial Viewing

11. Applications - Image Transition at Photo Browser

13. END THANK YOU

14. Method • Segment • Lazy snapping • Mean shift • Alpha matting • Face detection Lazy Snapping. ACM Trans. On Graphics 2004. Mean Shift: A Robust Approach Toward Feature Space Analysis. PAMI 2002. A Bayesian Approach to Digital Matting. CVPR 2001.

15. Segmentations • Shallow focus result • Input image • Depth Map • Object Segmentation • Depth Map Generation • Image Defocus • Lazy Snapping • Perspective Box • Camera Settings • Alpha Matting • Defocus Blur • Pop-up Card • Face Detection

16. Method • Depth map • Perspective Box • Vanish point • Rear wall Tour Into the Picture: Using a spidery mesh user interface to make animation from a single image. SIGGRAPH 1997

17. Segmentations • Shallow focus result • Input image • Depth Map • Object Segmentation • Depth Map Generation • Image Defocus • Lazy Snapping • Perspective Box • Camera Settings • Alpha Matting • Defocus Blur • Pop-up Card • Face Detection

18. (a) (b) ub vb ub vb b b d d u v u v Method Depth Map Segment Map Camera setting • Image defocus • Blur circle diameter Aperture size Focal length of the lens Distance of focus Blur circle diameter

19. Method • Defocus blur • bokeh

20. Method • Defocus blur

21. Method • Near-by object case Focus on the flower Focus on the flower

22. Experimental Result • Near-by object case Interpolation result Without inpainting

23. Method Blur circle diameter Objects in front of the focus Objects behind the focus • Near-by object case Blur shape as alpha map Text synthesis inpainting Defocus Blur Defocus Blur Interpolation by alpha map Shallow focus image

24. Q&A

25. END THANK YOU

26. Introduction • Depth of field Focus plane Photo plane Out of focus – blur range Real light Depth of field Circle of Confusion - Readability range

27. Introduction • Shallow focus Photo plane Real world

28. Introduction • Shallow focus • Highlight the subject by softening background diffusion Shallow focus by DSLR NIKON D90(2008) Deep focus by DC NIKON E4300 (2003)

29. Outline • Introduction • Method • Object Segmentation • Depth Map Generation • Image Defocus • Experimental Result • Applications • Conclusion