Artificial Intelligence–Based Modeling Can Predict Face Shape Based on Underlying Craniomaxillofacial Bone

Abstract

Reconstructing facial deformities is often challenging due to the complex 3-dimensional (3D) anatomy of the craniomaxillofacial skeleton and overlying soft tissue structures. Bilateral injuries cannot benefit from mirroring techniques and as such preinjury information (eg, 2D pictures or 3D imaging) may be utilized to determine or estimate the desired 3D face shape. When patient-specific information is not available, other options such as statistical shape models may be employed; however, these models require registration to a consistent orientation which may be challenging. Artificial intelligence (AI) has been used to identify facial features and generate highly realistic simulated faces. As such, it was hypothesized that AI can be used to predict 3D face shape by learning its relationship with the underlying bone surface anatomy in a subject-specific manner. An automated image processing and AI modeling workflow using a modified 3D UNet was generated to estimate 3D face shape using the underlying bone geometry and additional metadata (eg, body mass index and age) obtained from 5 publicly available computed tomography imaging datasets. Visually, the trained models provided a reasonable prediction of the contour and geometry of the facial tissues. The pipeline achieved a validation dice=0.89 when trained on the combined 5 datasets, with the highest dice=0.925 achieved with the single HNSCC dataset. Estimated predefect facial geometry may ultimately be used to aid preoperative craniomaxillofacial surgical planning, providing geometries for intraoperative templates, guides, navigation, molds, and forming tools. Automated face shape prediction may additionally be useful in forensic studies to aid in the identification of unknown skull remains.