This book is an integrated work published in two volumes. The first volume treats the basic Markov process and its variants; the second, semi-Markov and decision processes. It equips readers to formulate, analyze, and evaluate simple and advanced Markov models of systems, ranging from genetics to space engineering to marketing. 1971 edition. Reprint of the John Wiley & Sons, New York, 1971 edition.
Dynamic Probabilistic Systems, Volume II: Semi-Markov and Decision Processes by Ronald A. Howard An integrated work in two volumes, this text teaches readers to formulate, analyze, and evaluate Markov models. The first volume treats the basic process; the second, semi-Markov and decision processes. 1971 edition.
Probability: Elements of the Mathematical Theory by C. R. Heathcote Text deals with basic notions of probablity spaces, random variables, distribution and generating functions, joint distributions and the convergence properties of sequences of random variables. Over 250 exercises with solutions.
