Author:
Yamazaki Yusuke,Harandi Ali,Muramatsu Mayu,Viardin Alexandre,Apel Markus,Brepols Tim,Reese Stefanie,Rezaei Shahed
Abstract
AbstractWe propose a novel finite element-based physics-informed operator learning framework that allows for predicting spatiotemporal dynamics governed by partial differential equations (PDEs). The Galerkin discretized weak formulation is employed to incorporate physics into the loss function, termed finite operator learning (FOL), along with the implicit Euler time integration scheme for temporal discretization. A transient thermal conduction problem is considered to benchmark the performance, where FOL takes a temperature field at the current time step as input and predicts a temperature field at the next time step. Upon training, the network successfully predicts the temperature evolution over time for any initial temperature field at high accuracy compared to the solution by the finite element method (FEM) even with a heterogeneous thermal conductivity and arbitrary geometry. The advantages of FOL can be summarized as follows: First, the training is performed in an unsupervised manner, avoiding the need for large data prepared from costly simulations or experiments. Instead, random temperature patterns generated by the Gaussian random process and the Fourier series, combined with constant temperature fields, are used as training data to cover possible temperature cases. Additionally, shape functions and backward difference approximation are exploited for the domain discretization, resulting in a purely algebraic equation. This enhances training efficiency, as one avoids time-consuming automatic differentiation in optimizing weights and biases while accepting possible discretization errors. Finally, thanks to the interpolation power of FEM, any arbitrary geometry with heterogeneous microstructure can be handled with FOL, which is crucial to addressing various engineering application scenarios.
Funder
Japan Society for the Promotion of Science
Deutsche Forschungsgemeinschaft
Publisher
Springer Science and Business Media LLC
Reference80 articles.
1. Gupta A, Anpalagan A, Guan L, Khwaja AS (2021) Deep learning for object detection and scene perception in self-driving cars: survey, challenges, and open issues. Array 10:100057
2. Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12:2493–2537
3. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems 25
4. Karniadakis GE, Kevrekidis IG, Lu L, Perdikaris P, Wang S, Yang L (2021) Physics-informed machine learning. Nat Rev Phys 3(6):422–440
5. Liang L, Liu M, Martin C, Sun W (2018) A deep learning approach to estimate stress distribution: a fast and accurate surrogate of finite-element analysis. J R Soc Interface 15(138):20170844