EE 638: Principles of Digital Color Imaging Systems

1. EE 638: Principles ofDigital Color Imaging Systems Lecture 18: Digital Camera Characterization and Calibration

2. Image Capture Devices Papers/theses covering these materials can be found in the references under “Capture” • Image Capture Devices: • Scanners • Camera • Camera: • Sensor array technologies • CCD (Charge Coupled Device) • CID (Charge Injection Device) • CMOS (Complementary Metal Oxide Semiconductor) Sensor Array CCD from a HP digital camera

3. CCD • Phase I Exposure • CMOS & CID Line Registers All detectors have a certain identical sensitivity 1 pixel y address Detector x address

4. Camera (single chip) • Single chip • CCD • CMOS • CID • Sensor response • Coat cells with three different filter materials How do we get a full resolution array of RGB samples at each pixel? Note that for the blue channel, we want a filter that absorbs the medium and long wavelengths, and transmits the short (blue) wavelengths. Corresponds to trichromatic sensor

5. Camera (single chip) • Single chip • CCD • CMOS • CID • Sensor response • Coat cells with three different filter materials Demosaic to get full resolution R, G, B Inverse problem Corresponds to trichromatic sensor

6. Camera (cont.) • Three chips • Foveon sensor R sensor • More expensive, • but do get full resolution • no demosaicing, • do have to worry • about registration G sensor Bean-splitter B sensor incident light • More expensive, • but get full resolution • No registration issues • but have cross-talk • & efficiency issues Layered Chip

7. Sensor Output • “Linear” proportional to photon count similar to CRT monitor model. • Camera models exist that provide “raw” output. NLR A/D NLG A/D NLB A/D Gamma correction

8. To determine nonlinearities, have to perform device characterization. • Set-up: illumination Target Target camera This is very similar to process used to determine nonlinearities for a scanner, except that scanner and X-Rite DTP 70 provide their own illumination, which can be more carefully controlled. Colorimeter

10. To determine nonlinearities NLR, NLG, NLB, need a special facility of stimuli. (Target illuminant) • Let be the spectral stimulus of the i-th patch. • Want • then k— doesn’t depend on i l— doesn’t depend on i

11. Caveat Full colorant Rc Halftoned Target Kodak Q60 and Macbeth Color Checker targets are not printed, and therefore do not suffer from halftoning issues. paper white Sensor pixels Fraction of patch covered by colorant Fraction of patch not covered by colorant

12. -1 • Remainder of camera characterization requires finding T: • 1) 2) NLR -1 NLG -1 NLB

13. Normal approach for finding T is to measure large set of patches & perform linear regression. illumination Target Target camera NL Colorimeter Regression

14. Summary • 1) Typically can get < accuracy for displays (monitors) because we only need visual independence of primaries. • 2) For capture, have to have sensor response span HVS, i.e. there must exist a 3x3 matrix B such that • No.2 is much more restrictive than No.1 •  Above procedure will typically yield ~ (average error = ?)

15. To do better, could use double exposure where illuminant is charged between exposures, or we place a filter over the lens for the second exposure. • This delves into an area sometimes known as Hi-Fi (High Fidelity) Color or Spectral Color. We will talk about this later in the course. • Another interesting and recently very popular topic related to camera characterization and calibration is high dynamic range (HDR) imaging. We may talk about this later in the semester.