## Computational ProbabilityWinfried K. Grassmann Springer Science & Business Media, 2000 - 490 pages Great advances have been made in recent years in the field of computational probability. In particular, the state of the art - as it relates to queuing systems, stochastic Petri-nets and systems dealing with reliability - has benefited significantly from these advances. The objective of this book is to make these topics accessible to researchers, graduate students, and practitioners. Great care was taken to make the exposition as clear as possible. Every line in the book has been evaluated, and changes have been made whenever it was felt that the initial exposition was not clear enough for the intended readership. The work of major research scholars in this field comprises the individual chapters of Computational Probability. The first chapter describes, in nonmathematical terms, the challenges in computational probability. Chapter 2 describes the methodologies available for obtaining the transition matrices for Markov chains, with particular emphasis on stochastic Petri-nets. Chapter 3 discusses how to find transient probabilities and transient rewards for these Markov chains. The next two chapters indicate how to find steady-state probabilities for Markov chains with a finite number of states. Both direct and iterative methods are described in Chapter 4. Details of these methods are given in Chapter 5. Chapters 6 and 7 deal with infinite-state Markov chains, which occur frequently in queueing, because there are times one does not want to set a bound for all queues. Chapter 8 deals with transforms, in particular Laplace transforms. The work of Ward Whitt and his collaborators, who have recently developed a number of numerical methods for Laplace transform inversions, is emphasized in this chapter. Finally, if one wants to optimize a system, one way to do the optimization is through Markov decision making, described in Chapter 9. Markov modeling has found applications in many areas, three of which are described in detail: Chapter 10 analyzes discrete-time queues, Chapter 11 describes networks of queues, and Chapter 12 deals with reliability theory. |

### Contents

COMPUTATIONAL PROBABILITY CHALLENGES AND LIMITATIONS | 1 |

TOOLS FOR FORMULATING MARKOV MODELS | 11 |

TRANSIENT SOLUTIONS FOR MARKOV CHAINS | 43 |

NUMERICAL METHODS FOR COMPUTING STATIONARY DISTRIBUTIONS OF FINITE IRREDUCIBLE MARKOV CHAINS | 81 |

STOCHASTIC AUTOMATA NETWORKS | 111 |

MATRIX ANALYTIC METHODS | 151 |

USE OF CHARACTERISTIC ROOTS FOR SOLVING INFINITE STATE MARKOV CHAINS | 203 |

AN INTRODUCTION TO NUMERICAL TRANSFORM INVERSION AND ITS APPLICATION TO PROBABILITY MODELS | 255 |

OPTIMAL CONTROL OF MARKOV CHAINS | 323 |

ON NUMERICAL COMPUTATIONS OF SOME DISCRETETIME QUEUES | 363 |

THE PRODUCT FORM TOOL FOR QUEUEING NETWORKS | 407 |

TECHNIQUES FOR SYSTEM DEPENDABILITY EVALUATION | 443 |

Index | 479 |

### Other editions - View all

### Common terms and phrases

A₁ Abate and Whitt algorithm analysis analytic apply approach approximation arrival automaton balance equations block bounds calculate Chaudhry Choudhury Ciardo closed unit disk consider continuous-time convergence corresponding CTMC defined denote dependability diagonal Dijk discrete discrete-time eigenvalues elements Euler summation evaluated example exponential factor finite G/M/1 type Markov Gail given Grassmann Hence IEEE integral interval irreducible Laplace transform linear Markov chain Markovian multiple N₁ n₂ Neuts normalization constant numerical inversion Numerical Solution obtained open unit disk Operations Research optimal parameters Performance Petri nets positive recurrent probability vector problem product form queueing networks Queueing Systems Queueing Theory reward roots Rouché's Theorem scalar Section server solving Souza e Silva space station balance stationary policy steady-state Stewart stochastic process synchronizing events techniques tensor product Theorem transient transition matrix transition probabilities Trivedi type Markov chain unit circle zeros

### Popular passages

Page 477 - Delhi in 1982, and MS and Ph.D. degrees in Computer Science from the University of California at Berkeley in 1984 and 1989 respectively.

Page 477 - He is currently an Associate Professor in the Department of Computer Science and Information Engineering, National Taiwan University.

Page 477 - The Center for Advanced Computer Studies University of Southwestern Louisiana Lafayette, LA...