1 / 21

Single-view Modeling: Comparing Heights and Measuring Camera Height

Learn how to compare heights in single-view modeling, measure camera height without a ruler, and estimate camera parameters using direct linear calibration and nonlinear optimization techniques.

sshowalter
Download Presentation

Single-view Modeling: Comparing Heights and Measuring Camera Height

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. CS6670: Computer Vision Noah Snavely Lecture 16: Single-view modeling, Part 2

  2. Comparing heights Vanishing Point

  3. Measuring height 5.4 5 Camera height 4 3.3 3 2.8 2 1 How high is the camera?

  4. Measuring height without a ruler Z C ground plane • Compute Z from image measurements • Need more than vanishing points to do this

  5. The cross ratio • A Projective Invariant • Something that does not change under projective transformations (including perspective projection) The cross-ratio of 4 collinear points P4 P3 P2 P1 • Can permute the point ordering • 4! = 24 different orders (but only 6 distinct values) • This is the fundamental invariant of projective geometry

  6. scene cross ratio C image cross ratio Measuring height  T (top of object) t r R (reference point) H b R B (bottom of object) vZ ground plane scene points represented as image points as

  7. Measuring height t v H image cross ratio vz r t0 vx vy H R b0 b

  8. v t1 b0 b1 Measuring height vz r t0 vanishing line (horizon) t0 vx vy m0 b • What if the point on the ground plane b0 is not known? • Here the guy is standing on the box, height of box is known • Use one side of the box to help find b0 as shown above

  9. 3D Modeling from a photograph St. Jerome in his Study, H. Steenwick

  10. 3D Modeling from a photograph

  11. 3D Modeling from a photograph Flagellation, Piero della Francesca

  12. 3D Modeling from a photograph video by Antonio Criminisi

  13. 3D Modeling from a photograph

  14. Camera calibration • Goal: estimate the camera parameters • Version 1: solve for projection matrix • Version 2: solve for camera parameters separately • intrinsics (focal length, principle point, pixel size) • extrinsics (rotation angles, translation) • radial distortion

  15. = = similarly, π v , π v 2 Y 3 Z Vanishing points and projection matrix = vx (X vanishing point) Not So Fast! We only know v’s up to a scale factor • Can fully specify by providing 3 reference points

  16. Calibration using a reference object • Place a known object in the scene • identify correspondence between image and scene • compute mapping from scene to image • Issues • must know geometry very accurately • must know 3D->2D correspondence

  17. Chromaglyphs Courtesy of Bruce Culbertson, HP Labs http://www.hpl.hp.com/personal/Bruce_Culbertson/ibr98/chromagl.htm

  18. Estimating the projection matrix • Place a known object in the scene • identify correspondence between image and scene • compute mapping from scene to image

  19. Direct linear calibration

  20. Direct linear calibration • Can solve for mij by linear least squares • use eigenvector trick that we used for homographies

  21. Direct linear calibration • Advantage: • Very simple to formulate and solve • Disadvantages: • Doesn’t tell you the camera parameters • Doesn’t model radial distortion • Hard to impose constraints (e.g., known f) • Doesn’t minimize the right error function • For these reasons, nonlinear methods are preferred • Define error function E between projected 3D points and image positions • E is nonlinear function of intrinsics, extrinsics, radial distortion • Minimize E using nonlinear optimization techniques

More Related