Unfolding an Indoor Origami World

1. Unfolding an Indoor Origami World David Fouhey, Abhinav Gupta, Martial Hebert

4. Local Evidence Hoiem et al. 2005, Saxena et al. 2005, Fouhey et al. 2013, etc.

5. Constraints

6. Constraints for Single Image 3D Local Smoothness Low Level, Generic Hoiem et al. 2005, Saxenaet al. 2005, 2008, Munoz et al., 2009, etc.

7. Constraints for Single Image 3D Local Smoothness Low Level, Generic Hoiem et al. 2005, Saxenaet al. 2005, 2008, Munoz et al., 2009, etc.

8. Constraints for Single Image 3D Low Level, Generic High Level, Physical

9. Constraints for Single Image 3D Local Smoothness Low Level, Generic High Level, Physical Coughlan and Yuille2000, etc.

10. Constraints for Single Image 3D Local Smoothness Low Level, Generic High Level, Physical Hedau et al. 2009, Del Pero et al., 2011, Wang et al., 2012, Schwing et al. 2012, etc.

11. Constraints for Single Image 3D Local Smoothness Low Level, Generic High Level, Physical Lee et al. 2010, Xiao et al. 2012, Zhao et al. 2013, Schwing et al., 2013, etc.

12. Constraints for Single Image 3D Low Level, Generic High Level, Physical

13. Mid-level in the Past Huffman 71, Clowes 71, Kanade 80, 81 Sugihara 86, Malik 87, etc.

14. Our Mid-Level Constraints

15. This Work Input: Single Image Output: Discrete Scene Parse

16. Overview Parameterization Formulation Experimental Results

17. Overview Parameterization Formulation Experimental Results

18. Parameterization

19. Parameterization vp2 vp3 vp1 VP Estimator from Hedau et al., 2009

20. Parameterization Two VPs give grid cell

21. Encoding Surface Normals

22. Encoding Surface Normals

23. Encoding Surface Normals

24. Encoding Surface Normals x1,…, x400 x401,…, x800 x801,…, x1200

25. Related Parameterizations vp2 x4 vp3 vp1 x2 x3 x1 Hedau et al., 2009; Wang et al. 2010, Schwing et al., 2012, 2013

26. Overview Parameterization Formulation Experimental Results

27. Parameterization

28. Formulation

29. Unaries

30. Unaries Any 3D Evidence High c Low c

31. Unaries Local: Data-Driven 3D Primitives Input 3D Primitive Bank … Fouhey, Gupta, Hebert, 2013

32. Unaries Global: Cuboid Fit + Clutter Mask Input Clutter Mask Predicted Walls Hedau, Hoiem, Forsyth, 2009

33. Binaries

34. Convex/Concave Constraints Convex (+) Concave (-)

35. Convex/Concave Constraints Detected Concave (-)

36. Convex/Concave Constraints Detected Concave (-)

37. Convex/Concave Constraints Detected Concave (-)

38. Convex/Concave Constraints Detected Concave (-)

39. Convex/Concave Constraints Detected Concave (-)

40. Detecting Convex/Concave Use 3DP to Transfer Discontinuities Input 3D Primitive Bank … Ground-Truth Discontinuities similar to Gupta, Arbelaez, Malik, 2013 3DP from Fouhey, Gupta, Hebert, 2013

41. Smoothness

42. Constraints

43. Solving the Model

44. Overview Parameterization Formulation Experimental Results

45. Dataset NYU Depth v2: 795 Train, 654 Test

46. Qualitative Results

47. Qualitative Results

48. Qualitative Results

49. Qualitative Results

50. Surface Connection Graphs Convex Concave