For the best experience, please enable Javascript
x
Warning - This version of Internet Explorer is out of date. It has known security flaws and may not display all features of this website correctly. Please consider updating this browser.

Dynamic Probabilistic Systems, Volume II: Semi-Markov and Decision Processes

Dynamic Probabilistic Systems, Volume II: Semi-Markov and Decision Processes

By: Ronald A. Howard

  • Reg. Price › $29.95
  • eBook
  • Sale Price › $23.96
  • Paperback + eBook
  • Reg. Price › $32.95
  • Share this book:
  • Share on Google+

This book is an integrated work published in two volumes. The first volume treats the basic Markov process and its variants; the second, semi-Markov and decision processes. Its intent is to equip readers to formulate, analyze, and evaluate simple and advanced Markov models of systems, ranging from genetics and space engineering to marketing. More than a collection of techniques, it constitutes a guide to the consistent application of the fundamental principles of probability and linear system theory.
Author Ronald A. Howard, Professor of Management Science and Engineering at Stanford University, continues his treatment from Volume I with surveys of the discrete- and continuous-time semi-Markov processes, continuous-time Markov processes, and the optimization procedure of dynamic programming. The final chapter reviews the preceding material, focusing on the decision processes with discussions of decision structure, value and policy iteration, and examples of infinite duration and transient processes. Volume II concludes with an appendix listing the properties of congruent matrix multiplication.

Reprint of the John Wiley & Sons, New York, 1971 edition.
AvailabilityUsually ships in 24 to 48 hours
ISBN 100486458725
ISBN 139780486458724
Author/EditorRonald A. Howard
Page Count576
Dimensions6 1/8 x 9 1/4

You might also Like...

Product Review

<--!Google Universal Analytics Code!-->
Out of Stock Notification:
Coming Soon: