330 likes | 692 Views
Computer Vision . Geometric Camera Models and Camera Calibration. Coordinate Systems. Let O be the origin of a 3D coordinate system spanned by the unit vectors i, j, and k orthogonal to each other. i. P. O. k. j. Coordinate vector. Homogeneous Coordinates. n. H. P. O.
E N D
Computer Vision Geometric Camera Models and Camera Calibration
Coordinate Systems • Let O be the origin of a 3D coordinate system spanned by the unit vectors i, j, and k orthogonal to each other. i P O k j Coordinate vector
Homogeneous Coordinates n H P O Homogeneous coordinates
Coordinate System Changes • Translation
Coordinate System Changes • Rotation where Exercise: Write the rotation matrix for a 2D coordinate system.
Coordinate System Changes • Rotation + Translation In homogeneous coordinates Rigid transformation matrix
Perspective Projection • Perspective projection equations
Intrinsic Camera Parameters Perspective projection
Intrinsic Camera Parameters We need take into account the dimensions of the pixels. CCD sensor array
Intrinsic Camera Parameters The center of the sensor chip may not coincide with the pinhole center.
Intrinsic Camera Parameters The camera coordinate system may be skewed due to some manufacturing error.
Intrinsic Camera Parameters In homogeneous coordinates These five parameters are known as intrinsic parameters
Intrinsic Camera Parameters In a simpler notation: With respect to the camera coordinate system
Extrinsic Camera Parameters • Translation and rotation of the camera frame with respect to the world frame In homogeneous coordinates Using , we get
Combine Intrinsic & Extrinsic Parameters We can further simplify to 3x4 matrix with 11 degrees of freedom: 5 intrinsic, 3 rotation, and 3 translation parameters.
Camera Calibration • Camera’s intrinsic and extrinsic parameters are found using a setup with known positions in some fixed world coordinate system.
Camera Calibration Y Z X courtesy of B. Wilburn
Camera Calibration • Mathematically, we are given n points • We want to find M and where
Camera Calibration • We can write
Camera Calibration • Scale and subtract last row from first and second rows to get
Camera Calibration • Write in matrix form for n points to get Let m34=1; that is, scale the projection matrix by m34.
Camera Calibration • The least square solution of is • From the matrix M, we can find the intrinsic and extrinsic parameters.
Camera Calibration • Consider the case where skew angle is 90. Since we set m34=1, we need to take that into account at the end. Notice that Since R is a rotation matrix, Therefore,
Camera Calibration • We get See Forsyth & Ponce for details and skew-angle case.
Applications First-down line courtesy of Sportvision
Applications Virtual advertising courtesy of Princeton Video Image
P Pl Pr Yr p p r l Yl Xl Zl Zr fl fr Ol Or R, T Xr Parameters of a Stereo System • Intrinsic Parameters • Characterize the transformation from camera to pixel coordinate systems of each camera • Focal length, image center, aspect ratio • Extrinsic parameters • Describe the relative position and orientation of the two cameras • Rotation matrix R and translation vector T
Calibrated Camera Essential matrix
Uncalibrated Camera Fundamental matrix