Affiliation:
1. Nara Institute of Science and Technology (NAIST)
2. The University of Tokyo
3. Microsoft
Abstract
Layered surface objects represented by decorated tomb murals and watercolors are in danger of deterioration and damage. To address these dangers, it is necessary to analyze the pigments’ thickness and mixing ratio and record the current status. This paper proposes an unsupervised autoencoder model for thickness and mixing ratio estimation. The input of our autoencoder is spectral data of layered surface objects. Our autoencoder is unique, to our knowledge, in that the decoder part uses a physical model, the Kubelka–Munk model. Since we use the Kubelka–Munk model for the decoder, latent variables in the middle layer can be interpretable as the pigment thickness and mixing ratio. We conducted a quantitative evaluation using synthetic data and confirmed that our autoencoder provides a highly accurate estimation. We measured an object with layered surface pigments for qualitative evaluation and confirmed that our method is valid in an actual environment. We also present the superiority of our unsupervised autoencoder over supervised learning.
Subject
Computer Vision and Pattern Recognition,Atomic and Molecular Physics, and Optics,Electronic, Optical and Magnetic Materials
Reference30 articles.
1. Estimating optical properties of layered surfaces using the spider model;Morimoto,2010
2. Estimating Pigment Concentrations from Spectral Images Using an Encoder‐Decoder Neural Network
3. Deep multispectral painting reproduction via multi-layer, custom-ink printing
4. Kato H. Beker D. Morariu M. Ando T. Matsuoka T. Kehl W. Gaidon A. , “ Differentiable rendering: A survey ,” arXiv , arXiv:2006.12057 ( 2020 ).
Cited by
2 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献