{"product_id":"markov-decision-processes-9780471727828","title":"Markov Decision Processes","description":"\u003cb\u003eBook Synopsis\u003c\/b\u003e\u003cbr\u003eThis book is an up-to-date, unified and rigorous treatment of theoretical, computational and applied research on Markov decision process models. The concentration of the book is on infinite-horizon discrete-time models, and it also discusses arbitrary state spaces, finite-horizon and continuous-time discrete-state models.\u003cbr\u003e\u003cbr\u003e\u003cb\u003eTable of Contents\u003c\/b\u003e\u003cbr\u003ePreface.  \u003cp\u003e1. Introduction.\u003c\/p\u003e \u003cp\u003e2. Model Formulation.\u003c\/p\u003e \u003cp\u003e3. Examples.\u003c\/p\u003e \u003cp\u003e4. Finite-Horizon Markov Decision Processes.\u003c\/p\u003e \u003cp\u003e5. Infinite-Horizon Models: Foundations.\u003c\/p\u003e \u003cp\u003e6. Discounted Markov Decision Problems.\u003c\/p\u003e \u003cp\u003e7. The Expected Total-Reward. Criterion.\u003c\/p\u003e \u003cp\u003e8. Average Reward and Related Criteria.\u003c\/p\u003e \u003cp\u003e9. The Average Reward Criterion-Multichain and Communicating Models.\u003c\/p\u003e \u003cp\u003e10. Sensitive Discount Optimality.\u003c\/p\u003e \u003cp\u003e11. Continuous-Time Models.\u003c\/p\u003e \u003cp\u003eAfterword.\u003c\/p\u003e \u003cp\u003eNotation.\u003c\/p\u003e \u003cp\u003eAppendix A. Markov Chains.\u003c\/p\u003e \u003cp\u003eAppendix B. Semicontinuous Functions.\u003c\/p\u003e \u003cp\u003eAppendix C. Normed Linear Spaces.\u003c\/p\u003e \u003cp\u003eAppendix D. Linear Programming.\u003c\/p\u003e \u003cp\u003eBibliography.\u003c\/p\u003e \u003cp\u003eIndex.\u003c\/p\u003e","brand":"John Wiley \u0026 Sons Inc","offers":[{"title":"Default Title","offer_id":49402662977879,"sku":"9780471727828","price":116.96,"currency_code":"GBP","in_stock":true}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/0817\/1739\/5799\/files\/9780471727828.jpg?v=1730481158","url":"https:\/\/bookcurl.com\/products\/markov-decision-processes-9780471727828","provider":"Book Curl","version":"1.0","type":"link"}