CHAPTER XI. MARKOVIAN DECISION PROCESSES

Chapters in this book

1. Frontmatter i
2. PREFACE vii
3. CONTENTS ix
4. INTRODUCTION 1
5. CHAPTER I. FEEDBACK CONTROL AND THE CALCULUS OF VARIATIONS 13
6. CHAPTER II. DYNAMICAL SYSTEMS AND TRANSFORMATIONS 41
7. CHAPTER III. MULTISTAGE DECISION PROCESSES AND DYNAMIC PROGRAMMING 51
8. CHAPTER IV. DYNAMIC PROGRAMMING AND THE CALCULUS OF VARIATIONS 61
9. CHAPTER V. COMPUTATIONAL ASPECTS OF DYNAMIC PROGRAMMING 85
10. CHAPTER VI. THE LAGRANGE MULTIPLIER 100
11. CHAPTER VII. TWO-POINT BOUNDARY VALUE PROBLEMS 111
12. CHAPTER VIII. SEQUENTIAL MACHINES AND THE SYNTHESIS OF LOGICAL SYSTEMS 119
13. CHAPTER IX. UNCERTAINTY AND RANDOM PROCESSES 129
14. CHAPTER X. STOCHASTIC CONTROL PROCESSES 152
15. CHAPTER XI. MARKOVIAN DECISION PROCESSES 160
16. CHAPTER XII. QUASILINEARIZATION 167
17. CHAPTER XIII. STOCHASTIC LEARNING MODELS 176
18. CHAPTER XIV. THE THEORY OF GAMES AND PURSUIT PROCESSES 180
19. CHAPTER XV. ADAPTIVE PROCESSES 194
20. CHAPTER XVI. ADAPTIVE CONTROL PROCESSES 203
21. CHAPTER XVII. SOME ASPECTS OF COMMUNICATION THEORY 219
22. CHAPTER XVIII. SUCCESSIVE APPROXIMATIONS 232
23. INDEX 251
24. Backmatter 257