Description
Book SynopsisThis book provides a general introduction to Sequential Monte Carlo (SMC) methods, also known as particle filters. These methods have become a staple for the sequential analysis of data in such diverse fields as signal processing, epidemiology, machine learning, population ecology, quantitative finance, and robotics.
The coverage is comprehensive, ranging from the underlying theory to computational implementation, methodology, and diverse applications in various areas of science. This is achieved by describing SMC algorithms as particular cases of a general framework, which involves concepts such as Feynman-Kac distributions, and tools such as importance sampling and resampling. This general framework is used consistently throughout the book.
Extensive coverage is provided on sequential learning (filtering, smoothing) of state-space (hidden Markov) models, as this remains an important application of SMC methods. More recent applications, such as parameter estimation of these models (through e.g. particle Markov chain Monte Carlo techniques) and the simulation of challenging probability distributions (in e.g. Bayesian inference or rare-event problems), are also discussed.
The book may be used either as a graduate text on Sequential Monte Carlo methods and state-space modeling, or as a general reference work on the area. Each chapter includes a set of exercises for self-study, a comprehensive bibliography, and a “Python corner,” which discusses the practical implementation of the methods covered. In addition, the book comes with an open source Python library, which implements all the algorithms described in the book, and contains all the programs that were used to perform the numerical experiments.
Trade Review“The authors have written a comprehensive broad-audience treatment of sequential Monte Carlo (SMC) methods, covering all its major and diverse applications. … The book is structured as an advanced Ph.D.-level textbook.” (Michael Ludkovski, Mathematical Reviews, May, 2022)
Table of Contents1 Preface.- 2 Introduction to state-space models.- 3 Beyond state-space models.- 4 Introduction to Markov processes.- 5 Feynman-Kac models: definition, properties and recursions.- 6 Finite state-spaces and hidden Markov models.- 7 Linear-Gaussian state-space models.- 8 Importance sampling.- 9 Importance resampling.- 10 Particle filtering.- 11 Convergence and stability of particle filters.- 12 Particle smoothing.- 13 Sequential quasi-Monte Carlo.- 14 Maximum likelihood estimation of state-space models.- 15 Markov chain Monte Carlo.- 16 Bayesian estimation of state-space models and particle MCMC.- 17 SMC samplers.- 18 SMC2, sequential inference in state-space models.- 19 Advanced topics and open problems.
