Affiliation:
1. Department of Mathematical Sciences, University of Bath , Claverton Down, Bath BA2 7AY, U.K
Abstract
Summary
Sequential Monte Carlo methods are typically not straightforward to implement on parallel architectures. This is because standard resampling schemes involve communication between all particles. The $$\alpha$$-sequential Monte Carlo method was proposed recently as a potential solution to this that limits communication between particles. This limited communication is controlled through a sequence of stochastic matrices known as $$\alpha$$ matrices. We study the influence of the communication structure on the convergence and stability properties of the resulting algorithms. In particular, we quantitatively show that the mixing properties of the $$\alpha$$ matrices play an important role in the stability properties of the algorithm. Moreover, we prove that one can ensure good mixing properties by using randomized communication structures where each particle only communicates with a few neighbouring particles. The resulting algorithms converge at the usual Monte Carlo rate. This leads to efficient versions of distributed sequential Monte Carlo.
Publisher
Oxford University Press (OUP)
Subject
Applied Mathematics,Statistics, Probability and Uncertainty,General Agricultural and Biological Sciences,Agricultural and Biological Sciences (miscellaneous),General Mathematics,Statistics and Probability
Reference42 articles.
1. Distributed stochastic gradient MCMC;Ahn,;Proc. 31st Int. Conf. Machine Learning,2014
2. Eigenvalues and expanders;Alon,;Combinatorica,1986
3. Particle Markov chain Monte Carlo methods;Andrieu,;J. R. Statist. Soc.,2010
4. The pseudo-marginal approach for efficient Monte Carlo computations;Andrieu,;Ann. Statist.,2009
5. On the stability of sequential Monte Carlo methods in high dimensions;Beskos,;Ann. Appl. Prob.,2014