Leveraging uncertainty estimates and derivative information in Gaussian process regression for efficient collection and use of molecular simulation data

Abstract

We introduce Gaussian Process Regression (GPR) as an enhanced method of thermodynamic extrapolation and interpolation. The heteroscedastic GPR models that we introduce automatically weight provided information by its estimated uncertainty, allowing for the incorporation of highly uncertain, high-order derivative information. By the linearity of the derivative operator, GPR models naturally handle derivative information and, with appropriate likelihood models that incorporate heterogeneous uncertainties, are able to identify estimates of functions for which the provided observations and derivatives are inconsistent due to the sampling bias that is common in molecular simulations. Since we utilize kernels that form complete bases on the function space to be learned, the estimated uncertainty in the model takes into account that of the functional form itself, in contrast to polynomial interpolation, which explicitly assumes the functional form to be fixed. We apply GPR models to a variety of data sources and assess various active learning strategies, identifying when specific options will be most useful. Our active-learning data collection based on GPR models incorporating derivative information is finally applied to tracing vapor–liquid equilibrium for a single-component Lennard-Jones fluid, which we show represents a powerful generalization to previous extrapolation strategies and Gibbs–Duhem integration. A suite of tools implementing these methods is provided at https://github.com/usnistgov/thermo-extrap.