Abstract
AbstractDue to the rapid development of the generative adversarial networks (GANs) and convolution neural networks (CNN), increasing attention is being paid to face synthesis. In this paper, we address the new and challenging task of facial sketch-to-image synthesis with multiple controllable attributes. To achieve this goal, first, we propose a new attribute classification loss to ensure that the synthesized face image with the facial attributes, which the users desire to have. Second, we employ the reconstruction loss to synthesize the facial texture and structure information. Third, the adversarial loss is used to encourage visual authenticity. By incorporating above losses into a unified framework, our proposed method not only can achieve high-quality sketch-to-image translation, but also allow the users control the facial attributes of synthesized image. Extensive experiments show that user-provided facial attribute information effectively controls the process of facial sketch-to-image translation.
Funder
the National Key R&D Program
Publisher
Springer Science and Business Media LLC
Subject
Electrical and Electronic Engineering,Information Systems,Signal Processing
Reference47 articles.
1. Q. Liu, X. Tang, H. Jin, H. Lu, and S. Ma. A nonlinear approach for face sketch synthesis and recognition. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 1005–1010. IEEE, 2005.
2. N. Wang, D. Tao, X. Gao, X. Li, J. Li, A comprehensive survey to face hallucination. International journal of computer vision 106(1), 9–30 (2014)
3. H. Kazemi, M. Iranmanesh, A. Dabouei, et al., Facial attributes guided deep sketch-to-photo synthesis[C]// 2018 IEEE Winter Applications of Computer Vision Workshops (WACVW). IEEE Computer Society (2018)
4. C. Peng, X. Gao, N. Wang, J. Li, Superpixel-based face sketch–photo synthesis. IEEE Transactions on Circuits and Systems for Video Technology 27(2), 288–299 (2017)
5. M. Song, C. Chen, J. Bu, T. Sha, Image-based facial sketch-to-photo synthesis via online coupled dictionary learning. Information Sciences 193, 233–246 (2012)
Cited by
16 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献