Description
Book SynopsisOffers a systematic and detailed treatment of the numerical solution of Markov chains. This book explores various aspects of numerically computing solutions of Markov chains, especially when the state is huge. It examines many different numerical computing methods - direct, single-and multi-vector iterative, and projection methods.
Trade Review"The book contains very rich material which is the result of long-term research in this field. No other book is known to the reviewer that treats this subject in such detail... The book excellently reflects the great experience that the author has in the theory of Markov chains, matrix algebra, numerics and informatics. He ... richly illustrates the book with numerous examples, flow-charts, pictures and even computer screen copies."--Mathematical Reviews
Table of Contents* Markov Chains * Direct Methods * Iterative Methods * Projection Methods * Block Hessenberg Matrices * Decompositional Methods * LI-Cyclic Markov Chains * Transient Solutions * Stochastic Automata Networks * Software