Affiliation:
1. Department of Computer Science and Engineering, Christ University, Bangalore, India.
Abstract
The representation of facial features in three-dimensional space plays a pivotal role in various applications such as facial recognition, virtual reality, and digital entertainment. However, achieving high-fidelity reconstructions from two-dimensional facial images remains a challenging task, particularly in preserving fine texture details. This research addresses this problem by proposing a novel approach that leverages a combination of advanced techniques, including Resnet, Flame model, Bi-FPN, and a differential render architecture. The primary objective of this study is to enhance texture details in reconstructed 3D facial images. The integration of Bi-FPN (Bi-directional Feature Pyramid Network) enhances feature extraction and fusion across multiple scales, facilitating the preservation of texture details across different regions of the face. The objective is to accurately represent facial features from 2D images in three-dimensional space. By combining these methods, the proposed framework achieves significant improvements in preserving fine texture details and overall facial structure. Experimental results demonstrate the effectiveness of the approach, suggesting its potential for various applications such as virtual try-on and facial animation.
Reference21 articles.
1. G. Sanil, K. Prakash, S. Prabhu, V. C. Nayak, and S. Sengupta, “2D-3D Facial Image Analysis for Identification of Facial Features Using Machine Learning Algorithms With Hyper-Parameter Optimization for Forensics Applications,” IEEE Access, vol. 11, pp. 82521–82538, 2023, doi: 10.1109/access.2023.3298443.
2. D. Zeng, Q. Zhao, S. Long, and J. Li, “Examplar coherent 3D face reconstruction from forensic mugshot database,” Image and Vision Computing, vol. 58, pp. 193–203, Feb. 2017, doi: 10.1016/j.imavis.2016.03.001.
3. W. N. Widanagamaachchi and A. T. Dharmaratne, “3D Face Reconstruction from 2D Images,” 2008 Digital Image Computing: Techniques and Applications, 2008, doi: 10.1109/dicta.2008.83.
4. Liu, F., Zeng, D., Li, J., Zhao, Q.: Cascaded regressor based 3D face reconstruction from a single arbitrary view image. arXiv preprint (2015), arXiv:1509.06161.
5. E. Richardson, M. Sela, and R. Kimmel, “3D Face Reconstruction by Learning from Synthetic Data,” 2016 Fourth International Conference on 3D Vision (3DV), Oct. 2016, doi: 10.1109/3dv.2016.56.