ONIX: An X‐ray deep‐learning tool for 3D reconstructions from sparse views

Abstract

AbstractTime‐resolved three‐dimensional (3D) X‐ray imaging techniques rely on obtaining 3D information for each time point and are crucial for materials‐science applications in academia and industry. Standard 3D X‐ray imaging techniques like tomography and confocal microscopy access 3D information by scanning the sample with respect to the X‐ray source. However, the scanning process limits the temporal resolution when studying dynamics and is not feasible for many materials‐science applications, such as cell‐wall rupture of metallic foams. Alternatives to obtaining 3D information when scanning is not possible are X‐ray stereoscopy and multi‐projection imaging, but these approaches suffer from limited volumetric information as they only acquire a very small number of views or projections compared to traditional 3D scanning techniques. Here, we present optimized neural implicit X‐ray imaging (ONIX), a deep‐learning algorithm capable of retrieving a continuous 3D object representation from only a small and limited set of sparse projections. ONIX is based on an accurate differentiable model of the physics of X‐ray propagation. It generalizes across different instances of similar samples to overcome the limited volumetric information provided by limited sparse views. We demonstrate the capabilities of ONIX compared to state‐of‐the‐art tomographic reconstruction algorithms by applying it to simulated and experimental datasets, where a maximum of eight projections are acquired. ONIX, although it does not have access to any volumetric information, outperforms unsupervised reconstruction algorithms, which reconstruct using single instances without generalization over different instances. We anticipate that ONIX will become a crucial tool for the X‐ray community by (i) enabling the study of fast dynamics not possible today when implemented together with X‐ray multi‐projection imaging and (ii) enhancing the volumetric information and capabilities of X‐ray stereoscopic imaging.