1 / 22

SIGGRAPH Asia 2011 Preview Seminar - Material Editing -

SIGGRAPH Asia 2011 Preview Seminar - Material Editing -. Yoshihiro Kanamori 2011 Nov. 25. Material Editing. Material Matting Daniel Lepage , Jason Lawrence (University of Virginia ) Physically-Based Interactive Bi-Scale Material Design

ketan
Download Presentation

SIGGRAPH Asia 2011 Preview Seminar - Material Editing -

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. SIGGRAPH Asia 2011 Preview Seminar- Material Editing - Yoshihiro Kanamori 2011 Nov. 25

  2. Material Editing • Material Matting • Daniel Lepage, Jason Lawrence (University of Virginia) • Physically-Based Interactive Bi-Scale Material Design • Hongzhi Wu, Julie Dorsey, Holly Rushmeier (Yale University) • AppGen: Interactive Material Modeling from a Single Image • Yue Dong (Tsinghua University), Xin Tong (Microsoft Research Asia), Fabio Pellacini (Dartmouth College / apienza University of Rome), BainingGuo (Microsoft Research Asia) • AppWarp: Retargeting Measured Materials by Appearance-space Warping • Xiaobo An (Dartmouth College), Xin Tong (Microsoft Research Asia), Jonathan Denning, Fabio Pellacini (Dartmouth College / apienza University of Rome)

  3. Material Editing • Material Matting • Daniel Lepage, Jason Lawrence (University of Virginia) • Physically-Based Interactive Bi-Scale Material Design • Hongzhi Wu, Julie Dorsey, Holly Rushmeier (Yale University) • AppGen: Interactive Material Modeling from a Single Image • Yue Dong (Tsinghua University), Xin Tong (Microsoft Research Asia), Fabio Pellacini (Dartmouth College / apienza University of Rome), BainingGuo (Microsoft Research Asia) • AppWarp: Retargeting Measured Materials by Appearance-space Warping • Xiaobo An (Dartmouth College), Xin Tong (Microsoft Research Asia), Jonathan Denning, Fabio Pellacini (Dartmouth College / apienza University of Rome)

  4. Material Matting • Given Spatially-Varying BRDFs (SVBRDFs), separates them into foreground (F) / background (B) layers, and allows editing Input SVBRDF and separation Edited components and recomposited SVBRDF

  5. Matting? • Standard matting equation • Many methods exist for image matting • This method peels apart SVBRDF V as layers Li one by one • Extracted regions are completed by texture synthesis

  6. Overview • Interactive system • Users draws scribbles to support separation, like recent image matting methods

  7. Formulation • Based on a Bayesian approach, i.e., Maximum A Posteriori (MAP) estimate • Take –log( ), and for α minimize • Likewise, for F and B

  8. Material Editing • Material Matting • Daniel Lepage, Jason Lawrence (University of Virginia) • Physically-Based Interactive Bi-Scale Material Design • Hongzhi Wu, Julie Dorsey, Holly Rushmeier (Yale University) • AppGen: Interactive Material Modeling from a Single Image • Yue Dong (Tsinghua University), Xin Tong (Microsoft Research Asia), Fabio Pellacini (Dartmouth College / apienza University of Rome), BainingGuo (Microsoft Research Asia) • AppWarp: Retargeting Measured Materials by Appearance-space Warping • Xiaobo An (Dartmouth College), Xin Tong (Microsoft Research Asia), Jonathan Denning, Fabio Pellacini (Dartmouth College / apienza University of Rome)

  9. Physically-Based Interactive Bi-Scale Material Design • Not available now (coming soon)

  10. Material Editing • Material Matting • Daniel Lepage, Jason Lawrence (University of Virginia) • Physically-Based Interactive Bi-Scale Material Design • Hongzhi Wu, Julie Dorsey, Holly Rushmeier (Yale University) • AppGen: Interactive Material Modeling from a Single Image • Yue Dong (Tsinghua University), Xin Tong (Microsoft Research Asia), Fabio Pellacini (Dartmouth College / apienza University of Rome), BainingGuo (Microsoft Research Asia) • AppWarp: Retargeting Measured Materials by Appearance-space Warping • Xiaobo An (Dartmouth College), Xin Tong (Microsoft Research Asia), Jonathan Denning, Fabio Pellacini (Dartmouth College / apienza University of Rome)

  11. AppGen: Interactive Material Modeling from a Single Image • Extracts {specular/diffuse/roughness components, height field, and normal map} from a single image, for relighting applications • Contribution: proposal of the whole system • Technically, diffuse extraction and normal map construction are improved

  12. FYI: Bitmap2Material • Similar commercial tool by allegorithmic

  13. Overview • Highlight/shadow removal • Simple thresholding for image intensities • Diffuse shading separation • Just like Intrinsic Images[Bousseau et al. 2009] • but different formulation, better results • Normal reconstruction • Shape from shading→height field→normal estimate • Specular assignment • User assigns preset BRDFs (Ward model)

  14. Comparisons • Diffuse shading separation • Fewer user inputs than[Bousseau et al. 2009] • Normal reconstruction • Better resultsthan others

  15. Failure Cases • See Figure 13 W/ strong geometric structures W/ large regions of highlights Grayscale image, where the albedo only has grayscale variations fails to separate the black text from shading variations and generates artifacts in the normal map

  16. Material Editing • Material Matting • Daniel Lepage, Jason Lawrence (University of Virginia) • Physically-Based Interactive Bi-Scale Material Design • Hongzhi Wu, Julie Dorsey, Holly Rushmeier (Yale University) • AppGen: Interactive Material Modeling from a Single Image • Yue Dong (Tsinghua University), Xin Tong (Microsoft Research Asia), Fabio Pellacini (Dartmouth College / apienza University of Rome), BainingGuo (Microsoft Research Asia) • AppWarp: Retargeting Measured Materials by Appearance-space Warping • Xiaobo An (Dartmouth College), Xin Tong (Microsoft Research Asia), Jonathan Denning, Fabio Pellacini (Dartmouth College / apienza University of Rome)

  17. AppWarp: Retargeting Measured Materials by Appearance-space Warping • Given measured materials (w/ SVBRDFs), the appearance of a source material is retargeted to that of a template material • Just like color transfer

  18. Overview • Calculates the distance between each pair of BRDF samples [Pellacini and Lawrence 2007] • Embeds the samples into low-dimensional (two or three) appearance space using multidimensional scaling (MDS) • Warp the appearance space using Moving Least Squares (MLS) Warping [Schaefer et al. 2006] • Affine transformation only, w/ 2k-10k control points

  19. Multidimensional Scaling (MDS)? • Given pair-wise distances between samples(dissimilarity matrix) • Calculate positions of N-dimensional samples {xi} so that the distances are preserved

More Related