On the Use of Symmetries in Building Surrogate Models

Abstract

When simulations are expensive and multiple realizations are necessary, as is the case in uncertainty propagation, statistical inference, and optimization, surrogate models can achieve accurate predictions at low computational cost. In this paper, we explore options for improving the accuracy of a surrogate if the modeled phenomenon presents symmetries. These symmetries allow us to obtain free information and, therefore, the possibility of more accurate predictions. We present an analytical example along with a physical example that has parametric symmetries. Although imposing parametric symmetries in surrogate models seems to be a trivial matter, there is not a single way to do it and, furthermore, the achieved accuracy might vary. We present four different ways of using symmetry in surrogate models. Three of them are straightforward, but the fourth is original and based on an optimization of the subset of points used. The performance of the options was compared with 100 random designs of experiments (DoEs) where symmetries were not imposed. We found that each of the options to include symmetries performed the best in one or more of the studied cases and, in all cases, the errors obtained imposing symmetries were substantially smaller than the worst cases among the 100. We explore the options for using symmetries in two surrogates that present different challenges and opportunities: Kriging and linear regression. Kriging is often used as a black box; therefore, we consider approaches to include the symmetries without changes in the main code. On the other hand, since linear regression is often built by the user; owing to its simplicity, we consider also approaches that modify the linear regression basis functions to impose the symmetries.