Image Quilting for Texture Synthesis and Transfer

Image Quilting for Texture Synthesis and Transfer Alexei A. Efros William T. Freeman

Outline • Previous Work • Image Quilting • Texture Transfer • Conclusion

p Efros & Leung ’99 non-parametric sampling • Pixel Based method • Good Results • Very Slow Input image Synthesizing a pixel

Chaos Mosaic [Xu, Guo & Shum, ‘00] • Process: 1) tile input image; 2) pick random blocks and place them in random locations 3) Smooth edges input idea result Used in Lapped Textures [Praun et.al,’00]

Chaos Mosaic [Xu, Guo & Shum, ‘00] • Does not work for structured textures input result

Image Quilting • Uses the method of taking blocks of the input image, but, instead of randomly placing the blocks, it finds a set of best matches. • The matches are found by calculating the error between two overlapping blocks. • Last it finds the best cut between overlapping sections of all the blocks.

Three Methods Image Quilting uses the minimum error boundary cut method.

2 _ = overlap error min. error boundary Minimal error boundary overlapping blocks vertical boundary

Failures (Chernobyl Harvest)

Texture Transfer • Takes a source texture and pastes its onto the target object.

Source correspondence image Target correspondence image Source texture Target image

Conclusion • Image quilting is a simple method that works well. • The method is also much faster than previous pixel based methods.

Questions ?

Image Quilting for Texture Synthesis and Transfer