1 / 31

Automatic Correction of Saturated Regions in Photographs using Cross-Channel Correlation

Automatic Correction of Saturated Regions in Photographs using Cross-Channel Correlation. Syed Zain Masood, Jiejie Zhu & Marshall F. Tappen. University of Central Florida (UCF) Orlando, FL, USA. Introduction. What is Saturation ? Caused by over-exposure

cheche
Download Presentation

Automatic Correction of Saturated Regions in Photographs using Cross-Channel Correlation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Automatic Correction of Saturated Regions in Photographs using Cross-Channel Correlation Syed Zain Masood, Jiejie Zhu & Marshall F. Tappen University of Central Florida (UCF) Orlando, FL, USA

  2. Introduction • What is Saturation ? • Caused by over-exposure • Sensor incorrectly responds at its maximum value • Incorrect camera exposure settings main cause of saturation • Undesirable artifacts

  3. Saturation-free Image • Example De-saturated Saturated

  4. Motivation • Motivation • Causes loss of data • Visually unpleasant • Recapturing not always a solution

  5. Color Channel Saturation • For most cases, only 1 or 2 channels are saturated Green Red Blue

  6. Images are locally smooth except across edges Smoothness Constraint

  7. Cross-Channel Ratios • Cross-channel ratios are locally smooth 1-pixel vertical shift 3-pixel horizontal shift 5-pixel diagonal shift

  8. Fundamentals • Estimate cross-channel ratios using smoothness prior. • Use cross-channel correlation plus smoothness constraint in recovering true color values for saturated pixels.

  9. Recovery Method • Two step method • Step 1: Recover cross-channel ratios • Estimate the color channel ratios for saturated pixels • Step 2: Recover color channel values • Using the true cross-channel ratios calculated in step 1, estimate the correct responses for saturated color channels

  10. Step 1: Estimating Cross-Channel Ratios • Recovering cross-channel ratios • Saturated color channel ratio estimated using local smoothness constraint. • Unsaturated color channel ratio close to observed • Quadratic cost function used • Solution obtained using classical energy minimization method

  11. Step 1: Constraints • Smoothness constraint for estimating ratios involving saturated channels • Ratio between unsaturated channels close to observed Weight function (Similar to Levin’s Colorization) • Constraints Color Channel Ratio e.g. Red/Green Original Color Channel Ratio e.g. Red/Green

  12. Weight function (Similar to Levin’s Colorization) 0 if pixel ‘p’ saturated, 1 otherwise Estimated Color Channel ratio at pixel ‘p’ Observed Color Channel ratio at pixel ‘p’ Estimated Color Channel ratio at pixel ‘q’ Step 1: Cost Function • Cost function:

  13. Step 1: Example • Example • Red:Green ratio Saturated ratio Ground Truth ratio Recovered ratio

  14. Step 2: Estimating Color Values • Estimating Color Values • Partially Saturated Pixels: Cross-channel ratios used to estimate color values • Totally Saturated Pixels: Estimated using the local smoothness constraint • Unsaturated color values close to observed • Quadratic cost function used • Solution obtained using classical energy minimization • For simplicity, recovery of Red channel shown.

  15. Observed Red value at pixel ‘p’ Step 2: Constraints • Constraints • Partially Saturated: Values estimated using cross-channel ratios • Totally Saturated: Est. using local smoothness • Unsaturated values close to observed Red:Green at pixel ‘p’ Red:Blue at pixel ‘p’

  16. Color ratio Red:Green at pixel ‘p’ Color ratio Red:Blue at pixel ‘p’ Observed Red value at pixel ‘p’ ‘1’ if at pixel ‘p’: Red is saturated Green is unsaturated ‘1’ if at pixel ‘p’: Red is saturated Blue is unsaturated ‘1’ if at pixel ‘p’: Red is unsaturated ‘1’ if at pixel ‘p’: All channels saturated Step 2: Cost Function • Cost function: Red value at pixel ‘q’ in N(p)

  17. Experiments & Results • System evaluated both quantitatively and qualitatively • Comparison against pixel-wise scaling and Levin’s colorization demonstrated. • 3x3 neighborhood window used • Image size typically 500x400 or less • Matlab built-in least square solver used

  18. Limitations • Handling totally saturated pixels in a significant portion of the image

  19. Quantitative Analysis • Auto-exposure bracketing feature in modern SLR cameras used • Obtained two identical images with different exposure settings • The brighter image is saturated while the darker is the ground truth

  20. Quantitative Analysis Saturated image Ground truth image Recovered image

  21. Quantitative Analysis Comparison of saturated region (forehead) Quantitative comparison

  22. Comparison with Baseline Methods • Baseline Methods • Pixel-wise non-linearity • Levin’s Colorization • We would show that comparable saturation-free results cannot be achieved by the above techniques.

  23. Comparison: Pixel-wise Non-linearity Pixel-wise non-linearity Our method Saturated image

  24. Comparison: Levin’s Colorization Colorization Our method Saturated image

  25. Non-face Images

  26. Results Saturated De-saturated

  27. Results Saturated De-saturated

  28. Results Saturated De-saturated

  29. Results Saturated De-saturated

  30. Results Saturated De-saturated

  31. Q & A

More Related