2012
NeurIPS
NeurIPS 2012
MCMC for continuous-time discrete-state systems
Abstract
We propose a simple and novel framework for MCMC inference in continuous-time discrete-state systems with pure jump trajectories. We construct an exact MCMC sampler for such systems by alternately sampling a random discretization of time given a trajectory of the system, and then a new trajectory given the discretization. The first step can be performed efficiently using properties of the Poisson process, while the second step can avail of discrete-time MCMC techniques based on the forward-backward algorithm. We compare our approach to particle MCMC and a uniformization-based sampler, and show its advantages.
🌉
Interdisciplinary Bridge
- Artificial Intelligence and Mathematics & Optimization
🐣
Hot Topic Early Bird
- posterior sampling
Authors
Topics
Machine Learning > Optimization & Theory > Bayesian Inference
Machine Learning > Optimization & Theory > Stochastic Processes
Mathematics & Optimization > Mathematics > Probability
Mathematics & Optimization > Mathematics > Statistics
Mathematics & Optimization > Optimization > Stochastic Methods
Machine Learning > Optimization & Theory > Stochastic Methods
Artificial Intelligence > Bayesian & Probabilistic > Bayesian Inference
Mathematics & Optimization > Probability > Stochastic Processes
Machine Learning > Bayesian & Probabilistic > Markov Chain Monte Carlo
Keywords
stochastic processes
bayesian inference
posterior sampling
markov chain monte carlo
poisson process
jump processes
particle mcmc
continuous time systems
exact mcmc sampling
discrete state systems
forward-backward algorithm
particle markov chain monte carlo
continuous-time system
discrete-state system