Approximating Solutions of the Chemical Master Equation using Neural Networks

Abstract

AbstractThe Chemical Master Equation (CME) provides an accurate description of stochastic biochemical reaction networks in well-mixed conditions, but it cannot be solved analytically for most systems of practical interest. While Monte Carlo methods provide a principled means to probe the system dynamics, their high computational cost can render the estimation of molecule number distributions and other numerical tasks infeasible due to the large number of repeated simulations typically required. In this paper we aim to leverage the representational power of neural networks to approximate the solutions of the CME and propose a framework for Neural Estimation of Stochastic Simulations for Inference and Exploration (Nessie). Our approach is based on training a neural network to learn the distributions predicted by the CME from a relatively small number of stochastic simulations, thereby accelerating computationally intensive tasks such as parameter exploration and inference. We show on biologically relevant examples that simple neural networks with one hidden layer are able to capture highly complex distributions across parameter space. We provide a detailed discussion of the neural network implementation and code for easy reproducibility.