1 / 46

Applied Perception in Graphics

Applied Perception in Graphics. Erik Reinhard University of Central Florida reinhard@cs.ucf.edu. Computer Graphics. Produce computer generated imagery that cannot be distinguished from real scenes Do this in real-time. Trends in Computer Graphics. Greater realism Scene complexity

todd-hinton
Download Presentation

Applied Perception in Graphics

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Applied Perception in Graphics Erik Reinhard University of Central Florida reinhard@cs.ucf.edu

  2. Computer Graphics • Produce computer generated imagery that cannot be distinguished from real scenes • Do this in real-time

  3. Trends in Computer Graphics • Greater realism • Scene complexity • Lighting simulations • Faster rendering • Faster hardware • Better algorithms • Together: still too slow and unrealistic

  4. Algorithm design • Largely opportunistic • Computer graphics is a maturing field • Hence, a more directed approach is needed

  5. Long Term Strategy • Understand the differences between natural and computer generated scenes • Understand the Human Visual System and how it perceives images • Apply this knowledge to motivate graphics algorithms

  6. This Presentation (1) Reinhard et. al., “Color Transfer between Images”, IEEE CG&A, Sept. 2001.

  7. This Presentation(2) Reinhard et. al., “Photographic Tone Reproduction for Digital Images, SIGGRAPH 2002.

  8. Introduction The Human Visual System is evolved to look at natural images Natural Random

  9. Human Visual System

  10. Retina

  11. Color Processing Rod and Cone pigments

  12. Color Processing Cone output is logarithmic Color opponent space

  13. Image Statistics • Ruderman’s work on color statistics: • Principal Components Analysis (PCA) on colors of natural image ensembles • Axes have meaning: color opponents (luminance, red-green and yellow-blue)

  14. Color Processing Summary • Human Visual System expects images with natural characteristics (not just color) • Color opponent space has decorrelated axes (but in practice close to independent) • Color space is logarithmic (compact and symmetric data representation) • Independent processing along each axis should be possible  Application

  15. Lab Color Space Convert RGB triplets to LMS cone space Take logarithm Rotate axes

  16. Color Transfer • Make one image look like another • For both images: • Transfer to new color space • Compute mean and standard deviation along each color axis • Shift and scale the target image to have the same statistics as the source image

  17. Why not use RGB space? Input images Output images RGB Lab

  18. Color Transfer Example

  19. Color Transfer Example

  20. Color Transfer Example

  21. Color Processing Summary • Changing the statistics along each axis independently allows one image to resemble a second image • If the composition of the images is very unequal, an approach using small swatches may be used successfully

  22. Tone Reproduction

  23. Tone Reproduction

  24. Global vs. Local • Global • Scale each pixel according to a fixed curve • Key issue: shape of curve • Local • Scale each pixel by a curve that is modulated by a local average • Key issue: size of local neighborhood

  25. Global Operators Ward Tumblin Ferwerda

  26. Global Operators Ward Tumblin Ferwerda

  27. Local Operator Pattanaik

  28. Spatial Processing • Circularly symmetric receptive fields • Centre-surround mechanisms • Laplacian of Gaussian • Difference of Gaussians • Blommaert • Scale space model

  29. Scale Space (Histogram Equalized Images)

  30. Tone Reproduction Idea • Modify existing global operator to be a local operator, e.g. Greg Ward’s • Use spatial processing to determine a local adaptation level for each pixel

  31. Blommaert Brightness Model Gaussian filter Neural response Center/surround Brightness

  32. Brightness

  33. Scale Selection Alternatives How large should a local neighborhood be? Mean value Thresholded

  34. Mean Value

  35. Thresholded

  36. Tone-mapping Local adaptation Greg Ward’s tone-mapping with local adaptation

  37. Results • Good results, but something odd about scale selection: • For most pixels, a large scale was selected • Implication: a simpler algorithm should be possible

  38. Simplify Algorithm Greg Ward’s tone-mapping with local adaptation Simplify Fix overall lightness of image

  39. Global Operator Results Our method Ward

  40. Global Operator Results Our method Ward

  41. Global  Local Global operator Local operator

  42. Local Operator Results Global Local

  43. Local Operator Results Global Local Pattanaik

  44. Summary • Knowledge of the Human Visual System can help solve engineering problems • Color and spatial processing investigated • Direct applications shown

  45. Future Work This presentation

  46. Acknowledgments • Thanks to my collaborators: Peter Shirley, Jim Ferwerda, Mike Stark, Mikhael Ashikhmin, Bruce Gooch, Tom Troscianko • This work sponsored by NSF grants 97-96136, 97-31859, 98-18344, 99-78099 and by the DOE AVTC/VIEWS

More Related