520 likes | 775 Views
Color2Gray: Salience-Preserving Color Removal. Amy Gooch Sven Olsen Jack Tumblin Bruce Gooch Northwestern University. Grayscale. Color. New Algorithm. Color Space. Volume of displayable CIE L*a*b* Colors. Isoluminant Colors. Color. Grayscale. Converting to Grayscale…. In Color Space
E N D
Color2Gray: Salience-Preserving Color Removal Amy GoochSven OlsenJack TumblinBruce Gooch Northwestern University
Grayscale Color New Algorithm
Color Space Volume of displayable CIE L*a*b* Colors
Isoluminant Colors Color Grayscale
Converting to Grayscale… • In Color Space • Linear • Nonlinear • In Image Space • Pixels (RGB) • Using colors in the image • Different gray for different color • Relative difference • Using colors in the image and their position in image space • Colors can map to same gray…..
Traditional Methods: Luminance Channels Problem can not be solved by simply switching to a different space CIE CAM 97 Photoshop LAB CIE XYZ YCrCb
Simple Linear Mapping Luminance Axis
Luminance Axis Principal Component Analysis (PCA)
Contemporaneous Research • Rasche et al. [2005, IEEE CG&A and EG] Color Image Luminance Only Rasche et al.'s Method
Goals • Dimensionality Reduction • From tristimulus values to single channel Loss of information • Maintain salient features in color image • Human perception
Challenge 2:Dimension and Size Reduction 120, 120 100 0 -120, -120
Challenge 3:Many Color2Gray Solutions Original . . .
color2gray L1 + e1,2 L2 1 2 L1 + e1,2 L2 + e2,1 L2 + e2,1 L1 L1 L1 L1 L2 L2 L2 Algorithm Intuition Look at DC i = 1, j = 2 luminance Look at DC
Algorithm Overview • Convert to Perceptually Uniform Space • CIE L*a*b* • Adjust g to incorporate both luminance and chrominance differences • Initialize image, g, with L channel • For every pixel • Compute Luminance distance • Compute Chrominance distance dij
Color2Grey Algorithm Optimization: minSS ( (gi - gj) - di,j)2 i+m i j=i-m
Parameters Map chromatic difference to increases or decreases in luminance values m : Radius of neighboring pixels a : Max chrominance offset q :
m : Neighborhood Size • = 300o a = 10 m = 2 m = 16 • = entire image • = 49o a = 10
m : Neighborhood Size m = 16 • = entire image
a: Chromatic variation maps to luminance variation a -a crunch(x) = a * tanh(x/a) a = 5 a = 10 a = 25
Perceptual Distance DLij = Li - Lj • Luminance Distance: • Chrominance Distance: ||DCij|| Problem: ||DCij|| is unsigned
Map chromatic difference to increases or decreases in luminance values +b* C2 -a* +a* Color Space C1
+Db* Color Difference Space +DC1,2 vq= (cos q, sin q) + - vq q -Da* +Da* + - sign(||DCi,j||) = sign(DCi,j .vq ) -Db*
q = 45 q = 225 Photoshop Grayscale
q = 135 q = 45 q = 0 Grayscale
How to CombineChrominance and Luminance dij = DLij (Luminance)
How to CombineChrominance and Luminance (Luminance) if |DLij| > ||DCij|| DLij dij = ||DCij|| (Chrominance)
a -a crunch(x) = a * tanh(x/a) How to CombineChrominance and Luminance DLij if |DLij| > crunch(||DCij||) d (a)ij = crunch(||DCij||)
Grayscale . . . How to CombineChrominance and Luminance DLij if |DLij| > crunch(||DCij||) d(a,q)ij = if DCij . nq ≥ 0 crunch(||DCij||) otherwise crunch(-||DCij||)
Color2Grey Algorithm Optimization: minSS ( (gi - gj) - di,j)2 i+m i j=i-m If dij == DL then ideal image is g Otherwise, selectively modulated by DCij
Color2Gray + Color Results Photoshop Gray Original Color2Gray
Original PhotoshopGray Color2Gray Color2Gray+Color
Original Photoshop Gray Color2Gray
Original PhotoshopGrey Color2Grey
Implementation Performance • Image of size S x S • O(m2 S2) or O(S4) for full neighborhood case • 12.7s 100x100 image • 65.6s 150x150 image • 204.0s 200x200 image • GPU implementation • O(S2) ideal, really O(S3) • 2.8s 100x100 • 9.7s 150x150 • 25.7s 200x200 Athlon 64 3200 CPU NVIDIA GeForce GT6800
Future Work • Faster • Multiscale • Animations/Video • Smarter • Remove need to specify q • Image complexity measures
Validate "Salience Preserving" Original PhotoshopGrey Color2Grey
Validate "Salience Preserving" Original PhotoshopGray Color2Gray
Thank you www.color2gray.info • SIGGRAPH Reviewers • NSF • Helen and Robert J. Piros Fellowship • Northwestern Graphics Group • MidGraph2004 Participants • especially Feng Liu • (sorry I spelled your name wrong in the acknowledgements)
Original Color2Gray Color2Gray+Color
Original Color2Gray Color2Gray+Color
Color2Gray Original Color2Gray+Color
Original Photoshop Gray Color2Gray
Original Color2Gray Color2Gray+Color
Original Photoshop Gray Color2Gray
Original Color2Gray Color2Gray+Color
Rasche et al. Photoshop Grayscale
Rasche et al. Photoshop Grayscale