Split Hamiltonian Monte Carlo revisited

Abstract

AbstractWe study Hamiltonian Monte Carlo (HMC) samplers based on splitting the Hamiltonian H as $$H_0(\theta ,p)+U_1(\theta )$$ H 0 ( θ , p ) + U 1 ( θ ) , where $$H_0$$ H 0 is quadratic and $$U_1$$ U 1 small. We show that, in general, such samplers suffer from stepsize stability restrictions similar to those of algorithms based on the standard leapfrog integrator. The restrictions may be circumvented by preconditioning the dynamics. Numerical experiments show that, when the $$H_0(\theta ,p)+U_1(\theta )$$ H 0 ( θ , p ) + U 1 ( θ ) splitting is combined with preconditioning, it is possible to construct samplers far more efficient than standard leapfrog HMC.