Affiliation:
1. ETH Zurich, Zurich, Switzerland
2. Adobe Research and University of Virginia, Charlottesville, VA
3. Adobe Research
Abstract
Editing materials in photos opens up numerous opportunities like turning an unappealing dirt ground into luscious grass and creating a comfortable wool sweater in place of a cheap t-shirt. However, such edits are challenging. Approaches such as 3D rendering and BTF rendering can represent virtually everything, but they are also data intensive and computationally expensive, which makes user interaction difficult. Leaner methods such as texture synthesis are more easily controllable by artists, but also more limited in the range of materials that they handle, for example, grass and wool are typically problematic because of their non-Lambertian reflectance and numerous self-occlusions. We propose a new approach for editing of complex materials in photographs. We extend the texture-by-numbers approach with ideas from texture interpolation. The inputs to our method are coarse user annotation maps that specify the desired output, such as the local scale of the material and the illumination direction. Our algorithm then synthesizes the output from a discrete set of annotated exemplars. A key component of our method is that it can cope with missing data, interpolating information from the available exemplars when needed. This enables production of satisfying results involving materials with complex appearance variations such as foliage, carpet, and fabric from only one or a couple of exemplar photographs.
Funder
ERC Starting Grant iModel
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Graphics and Computer-Aided Design
Reference33 articles.
1. PatchMatch
2. J. T.
Barron
and
J.
Malik
.
2012
. Color constancy intrinsic images and shape estimation. In Proceedings of the European Conference on Computer Vision (ECCV'12). A. W. Fitzgibbon S. Lazebnik P. Perona Y. Sato and C. Schmid Eds. Lecture Notes in Computer Science vol.
7575 Springer 57--70. 10.1007/978-3-642-33765-9_5 J. T. Barron and J. Malik. 2012. Color constancy intrinsic images and shape estimation. In Proceedings of the European Conference on Computer Vision (ECCV'12). A. W. Fitzgibbon S. Lazebnik P. Perona Y. Sato and C. Schmid Eds. Lecture Notes in Computer Science vol. 7575 Springer 57--70. 10.1007/978-3-642-33765-9_5
3. Fourier Analysis of the 2D Screened Poisson Equation for Gradient Domain Problems
Cited by
23 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. NeuBTF: Neural fields for BTF encoding and transfer;Computers & Graphics;2023-08
2. Diffusion Image Analogies;Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Proceedings;2023-07-23
3. Color Transfer;Synthesis Lectures on Visual Computing: Computer Graphics, Animation, Computational Photography and Imaging;2023
4. Gradient Terrain Authoring;Computer Graphics Forum;2022-05
5. Inpainting at Modern Camera Resolution by Guided PatchMatch with Auto-curation;Lecture Notes in Computer Science;2022