CHAPTER XI. Markovian Decision Processes

Chapters in this book

1. Frontmatter i
2. Introduction vii
3. Contents xiii
4. CHAPTER I. One-dimensional Allocation Processes 1
5. CHAPTER II. Multidimensional Allocation Processes 39
6. CHAPTER III. One-dimensional Smoothing and Scheduling Processes 103
7. CHAPTER IV. Optimal Search Techniques 152
8. CHAPTER V. Dynamic Programming and the Calculus of Variations 180
9. CHAPTER VI. Optimal Trajectories 207
10. CHAPTER VII. Multistage Production Processes Utilizing Complexes of Industries 234
11. CHAPTER VIII. Feedback Control Processes 245
12. CHAPTER IX. Computational Results for Feedback Control Processes 275
13. CHAPTER X. Linear Equations and Quadratic Criteria 285
14. CHAPTER XI. Markovian Decision Processes 297
15. CHAPTER XII. Numerical Analysis 322
16. Appendix I. On a Transcendental Curve 337
17. Appendix II. A New Approach to the Duality Theory of Mathematical Programming 340
18. Appendix III. A Computational Technique Based on Successive Approximations in Policy Space 348
19. Appendix IV. On a New Functional Transform in Analysis: The Maximum Transform 354
20. Appendix V. The RAND Johnniac Computer 357
21. Name Index 359
22. Subject Index 362