370 likes | 494 Views
Binary Shading using Geometry and Appearance. Bert Buchholz Tamy Boubekeur Doug DeCarlo Marc Alexa Telecom ParisTech – CNRS Rutgers University TU Berlin Computer Graphics Forum Vol. 29, N. 6, 2010 Presented at Eurographics 2011.
E N D
BinaryShadingusingGeometry and Appearance Bert BuchholzTamyBoubekeur Doug DeCarlo Marc Alexa Telecom ParisTech – CNRS RutgersUniversity TU Berlin Computer Graphics Forum Vol. 29, N. 6, 2010 PresentedatEurographics 2011
BinaryDrawing Depictingscenesusing 2 colors
BinaryRendering Geometry Camera 3D Scene Conversion Reflectance Lighting
RelatedWork Half-Toning [Floyd and Steinberg 1976] [Ostromoukhov and Hersch 1995] • Image Binarization • [Mould and Kaplan 2008] • Local shadingoperators • [Vergne 2008] • Line Drawing • [DeCarlo 2003][Judd 2007]
Analysis Per-pixel decision Contradictory criteria Geometry enhancement Low shading depiction power • Variational Rendering Model
VariationalBinaryShading • Deferred shading framework • Rendering data structured as a ST image graph • Edges energies derived from geometry and appearance • Final rendering as a min cut in the image graph
DeferredShading Generate a set of arrays (render buffers) • GeometricProperties • AppearanceProperties Rasterization Ray Tracing
Graph construction Standard Source-to-Sink Image Graph {V,E} Image Pixels Source (white) Sink (black) Image Connectivity Edges to Source Edges to SInk
Appearance Contribution to the Graph • Through terminal weights on • AppearanceinitiateB/W segmentation • Experimentsusing : • Diffuse component • Specular component • Headlight component • Ambient Occlusion/Accessibilitycomponent Terminal Weights
Appearance Graph Terms Global to local feature control using spatial averages Support size Local term: Sign:locallylighter or darker Weightedcombination to the global measure.
Global versus Local Thresholding Global Local
Geometry Contribution to the Graph • Modelledwithneighboredgeweights • Tailorsanisotropic, non-local B/W diffusion • Redistributes B/W values to enhancegeometricfeatures • Based on: • Viewdepth values • Viewdependentcurvature, estimated as screenspace normal derivatives [Judd 2007] Unit surface normal gatheredat Geodesic distance on the Gauss sphere
GeometricTerm Local curvaturenormalization: Support size Yieldsneighbor edgeweights:
Geometry Contribution Modulation Small components are successively connected
Graph Minimum Cut • Max Flow Min Cut Theorem • Shortest split path in the graph →Feature size control through graph energy • Separate the graph in two components • Boykov and Kolmogorov implementation [2004]
Cut performance • Rendering buffers canbe speed up usingrasterization • Measured on a Core2Duo 1.83GHz (single thread)
BinaryShading • Global to local features • Appearance & geometry depiction • Large variety of style • Interactive control
Comparison to Line Drawing BinaryShading Line Drawing
Combinationwith Line Drawing RGBN Picture Rendering [Toler-Franklin 2007]
Comparison to Thresholding Binary Rendering Diffuse Component Thresholding Thresholding Over Gaussian Filtering
Comparison to Image Binarization (b,e) equivalent to [Mould and Kaplan 2008]
On-goingwork Interactive control
Interactive Control • Solution 1: slider-based, for experts • Accurate control • « Toomuch » control for novice users • Solution 2: painting interface
Paint Interface • Supervised sparse B/W contraints • Derive the graph energy structure
Animation Works most of the time but… … most of straightforward solutions have some temporal coherencyfailure cases.
K-colorRendering • Extend to multi-label cuts • Alternative energy minimizer • Lloyd relaxation/k-means • Mean Shift • k-Component cut • Vector Rendering
BinaryShading as a Single Cut • Global solution • Local to global control • Appearance vs geometry control • High level control • For automaticbinarydrawingfrom 3D Scenes, decals, cut-out, etc…
Thankyou BinaryShadingUsingGeometry and Appearance. Bert Buchholz, TamyBoubekeur, Doug DeCarlo and Marc Alexa Computer Graphics Forum Vol. 29, Nb. 6, 2010 PresentedatEurographics 2011