Chapters in this book

1. Frontmatter C
2. Contents vii
3. Preface and Acknowledgments xv
4. 1. Markov Chains 1
5. 2. Direct Methods 61
6. 3. Iterative Methods 121
7. 4. Projection Methods 177
8. 5. Block Hessenberg Matrices and Solution by Recursion 231
9. 6. Decompositional Methods 285
10. 7. P- Cyclic Markov Chains 343
11. 8. Transient Solutions 407
12. 9. Stochastic Automata Networks 463
13. 10. Software 491
14. Bibliography 513
15. Index 529