110 likes | 207 Views
Modelling, calibration and correction of nonlinear illumination-dependent fixed pattern noise in logarithmic CMOS image sensors. Dileepan Joseph and Steve Collins Department of Engineering Science University of Oxford, England. Outline. Logarithmic image sensors Pixel modelling
E N D
Modelling, calibration and correction of nonlinear illumination-dependent fixed pattern noise in logarithmic CMOS image sensors Dileepan Joseph and Steve Collins Department of Engineering Science University of Oxford, England
Outline • Logarithmic image sensors • Pixel modelling • Fixed pattern noise (FPN) • Sensor calibration • Image correction • Summary and conclusions IMTC, Budapest (IEEE)
Logarithmic image sensors • CMOS versus CCD image sensors • Electronics placed on same die as pixels • Cost, power consumption, size, weight • Quantum efficiency, yield, price pressure • Logarithmic versus linear pixels • Continuous sensing, random access • High dynamic range, low bit rate • Resolution, sensitivity, frame rate IMTC, Budapest (IEEE)
Physical model Abstract model Pixel modelling IMTC, Budapest (IEEE)
Fixed pattern noise (FPN) • Offset (aj) variation (1 j N pixels) • Offset and gain (bj) variation • Offset, gain and bias (cj) variation IMTC, Budapest (IEEE)
Sensor calibration • Calibrate the sensor with images yij of M uniform illuminances xi (e.g. white paper) • Extract parameters by minimising the mean square error IMTC, Budapest (IEEE)
Sensor calibration cont’d • Calibration error is 3.9, 1.9 and 0.9 for one, two and three parameter models • Calibration error versus illuminance differs markedly IMTC, Budapest (IEEE)
Image correction • Left to right: original plus one, two and three parameter FPN corrected images • Top to bottom: apertures of 1.8, 4, 8 and 16 f-stops • Inter-scene plus intra-scene dynamic range equals 67 dB IMTC, Budapest (IEEE)
Image correction cont’d IMTC, Budapest (IEEE)
Summary and conclusions • Physical and abstract pixel model • Offset, gain, bias and error • Parameter variation causes FPN • Calibration with uniform illuminance • Results indicate FPN is nonlinear • FPN correction is necessary • Digital correction of images • More robust analogue circuits IMTC, Budapest (IEEE)
Acknowledgements • Many thanks to the Natural Sciences and Engineering Research Council of Canada and the Engineering and Physical Sciences Research Council of Britain for their generous support. IMTC, Budapest (IEEE)