650 likes | 787 Views
Probabilistic Color-by-Numbers: Suggesting Pattern Colorizations Using Factor Graphs. Sharon Lin, Daniel Ritchie, Matthew Fisher, Pat Hanrahan. Colored Patterns Are Everywhere. Flickr : Rowena of the Rants. Coloring Patterns Can Be Challenging. Hard to mentally visualize coloring.
E N D
Probabilistic Color-by-Numbers: Suggesting Pattern Colorizations Using Factor Graphs Sharon Lin, Daniel Ritchie, Matthew Fisher, Pat Hanrahan
Colored Patterns Are Everywhere Flickr: Rowena of the Rants
Coloring Patterns Can Be Challenging • Hard to mentally visualize coloring Template by COLOURLover Any Palacios
Coloring Patterns Can Be Challenging • Difficult to explore other options Such as:
Suggest Pattern Colorizations to Facilitate the Process User preferences ? Input Template Output Suggested Colorings
Suggest Pattern Colorizations to Facilitate the Process User preferences • Suggest diverse colorings • Allow refinement • Accommodate stylistic preferences ? Input Template Output Suggested Colorings
Pattern Template Anatomy Color Groups Colored Template COLOURLovers Nickity Split & ivy21
Related Work: Color Compatibility • What combinations of colors do people find appealing? (Goethe 1810; Itten 1974; Matsuda 1995; Cohen-Or et Al 2006)
Related Work: Color Compatibility • What combinations of colors do people find appealing? Low compatibility High compatibility (O’Donovan et al. 2011)
Color Compatibility for Patterns 3.74 3.70 3.75 3.67 “loud” background leaves blending into background What about personal preferences? Need to take into account 2D arrangement Template by COLOURLoverjilbert
Look at Examples for Guidance COLOURLoversAlineDam, Any Palacios, wondercake, bhsav
Example-Based Color Suggestion Examples (optional) user constraints … Model Suggester Input Template Output Suggested Colorings COLOURLoversAlineDam, Any Palacios, wondercake, bhsav
Can Change Style Based on Examples Examples (optional) user constraints … Model Suggester Input Template Output Suggested Colorings COLOURLoversAlineDam, Any Palacios, praxicalidocious, bhsav
Dataset: COLOURLovers • Many patterns available: • Collected 8200 from 82 artists • For our tests: • Trained on up to 913 patterns
Scoring a Coloring Unary Factors
Scoring a Coloring Good
Scoring a Coloring ? ? Poor ?
Scoring a Coloring Pairwise Factors
Scoring a Coloring Global Color Compatibility [O’Donovan et al. 2011] Color Theme:
Scoring a Coloring Global Color Compatibility [O’Donovan et al. 2011] Color Theme:
Scoring a Coloring Color Theme:
Modeling Unary Color Factors Property of Region’s Color Features of Region’s Shape • Lightness • Saturation • Name Saliency [Heer & Stone 2012] …
Modeling Unary Color Factors Property of Region’s Color Features of Region’s Shape • Size • Elongation • Centrality …
Learning Factor Distributions Learner Saturation Size = Predictor Elongation Centrality 0.8 … 0.92 Distribution =
Learning Factor Distributions 0 1 Lightness
Learning Factor Distributions 0.2 0.7 0.1 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 0.2 0.7 0.1 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 1 0.2 0.7 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 1 0.2 0.7 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 1 2 0.7 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 1 2 0.7 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 7 1 2 … Lightness 0 1 2 3 4 5 7 8 9 6
Learning Factor Distributions 7 1 2 … ? Classifier 1 Lightness 0 1 2 3 4 5 7 8 9 6 0
Learning Factor Distributions 7 1 2 … ? Classifier 1 0 1 0 Lightness
Learning Factor Distributions 7 1 2 … ? Classifier 1 0 1 1 0 Lightness [Charpiat et al. 2008]
Scoring a Coloring (Revisited) Pairwise Factors Unary Factors Global Color Compatibility [O’Donovan et al. 2011]
Scoring a Coloring (Revisited) Score = Product of Factors (Factor Graph)
Generating Coloring Suggestions • Metropolis Hastings (MH) • Parallel Tempering • Maximum Marginal Relevance ACCEPT ACCEPT REJECT
Refinement: Hard Constraints Unconstrained Flower Stem Color =
Style Simulation Light Dark Bold Mellow