Abstract
The scientific machine learning (SciML) field has introduced a new class of models called physics-informed neural networks (PINNs). These models incorporate domain-specific knowledge as soft constraints on a loss function and use machine learning techniques to train the model. Although PINN models have shown promising results for simple problems, they are prone to failure when moderate level of complexities are added to the problems. We demonstrate that the existing baseline models, in particular PINN and evolutionary sampling (Evo), are unable to capture the solution to differential equations with convection, reaction, and diffusion operators when the imposed initial condition is non-trivial. We then propose a promising solution to address these types of failure modes. This approach involves coupling Curriculum learning with the baseline models, where the network first trains on PDEs with simple initial conditions and is progressively exposed to more complex initial conditions. Our results show that we can reduce the error by 1 – 2 orders of magnitude with our proposed method compared to regular PINN and Evo.
Publisher
Science Research Publishers
Reference51 articles.
1. Acharya N. et al. Instability analysis of poiseuille flow between two parallel walls partially obstructed by porous surfaces. In APS Division of Fluid Dynamics Meeting Abstracts, 2019, pp. NP05-140.
2. Ainsworth M., Dong J., 2021. Galerkin neural networks: a framework for approximating variational equations with error control. SIAM J. Sci. Comput., 43, A2474-A2501. https://doi.org/10.1137/20M1366587
3. Aygün A. Physics informed neural networks for computational fluid dynamics. Middle East Technical University, Master's thesis, 2023.
4. Batra R. et al. Emerging Materials Intelligence Ecosystems Propelled by Machine Learning. Nature Reviews. Materials, 2021, 6(8), 655-678. https://doi.org/10.1038/s41578-020-00255-y
5. Beck C., Hutzenthaler M., Jentzen A., Kuckuck B.J., 2020. An overview on deep learning-based approximation methods for partial differential equations.