Elements of the Theory of Markov Processes and Their Applications

Elements of the Theory of Markov Processes and Their Applications
Author: A. T. Bharucha-Reid
Publisher: Courier Corporation
Total Pages: 485
Release: 2012-04-26
Genre: Mathematics
ISBN: 0486150356

This graduate-level text and reference in probability, with numerous applications to several fields of science, presents nonmeasure-theoretic introduction to theory of Markov processes. The work also covers mathematical models based on the theory, employed in various applied fields. Prerequisites are a knowledge of elementary probability theory, mathematical statistics, and analysis. Appendixes. Bibliographies. 1960 edition.

The Elements of Stochastic Processes with Applications to the Natural Sciences

The Elements of Stochastic Processes with Applications to the Natural Sciences
Author: Norman T. J. Bailey
Publisher: John Wiley & Sons
Total Pages: 268
Release: 1991-01-16
Genre: Mathematics
ISBN: 9780471523680

Develops an introductory and relatively simple account of the theory and application of the evolutionary type of stochastic process. Professor Bailey adopts the heuristic approach of applied mathematics and develops both theoretical principles and applied techniques simultaneously.

Finite Markov Processes and Their Applications

Finite Markov Processes and Their Applications
Author: Marius Iosifescu
Publisher: Courier Corporation
Total Pages: 305
Release: 2014-07-01
Genre: Mathematics
ISBN: 0486150585

A self-contained treatment of finite Markov chains and processes, this text covers both theory and applications. Author Marius Iosifescu, vice president of the Romanian Academy and director of its Center for Mathematical Statistics, begins with a review of relevant aspects of probability theory and linear algebra. Experienced readers may start with the second chapter, a treatment of fundamental concepts of homogeneous finite Markov chain theory that offers examples of applicable models. The text advances to studies of two basic types of homogeneous finite Markov chains: absorbing and ergodic chains. A complete study of the general properties of homogeneous chains follows. Succeeding chapters examine the fundamental role of homogeneous infinite Markov chains in mathematical modeling employed in the fields of psychology and genetics; the basics of nonhomogeneous finite Markov chain theory; and a study of Markovian dependence in continuous time, which constitutes an elementary introduction to the study of continuous parameter stochastic processes.

Markov Processes

Markov Processes
Author: Daniel T. Gillespie
Publisher: Gulf Professional Publishing
Total Pages: 600
Release: 1992
Genre: Mathematics
ISBN: 9780122839559

Markov process theory provides a mathematical framework for analyzing the elements of randomness that are involved in most real-world dynamical processes. This introductory text, which requires an understanding of ordinary calculus, develops the concepts and results of random variable theory.

Markov-modulated Processes & Semiregenerative Phenomena

Markov-modulated Processes & Semiregenerative Phenomena
Author: Ant¢nio Pacheco
Publisher: World Scientific
Total Pages: 237
Release: 2009
Genre: Mathematics
ISBN: 9812793186

The book presents a coherent treatment of Markov random walks and Markov additive processes together with their applications. Part I provides the foundations of these stochastic processes underpinned by a solid theoretical framework based on Semiregenerative phenomena. Part II presents some applications to queueing and storage systems.

Markov Processes and Related Problems of Analysis

Markov Processes and Related Problems of Analysis
Author: Evgeniĭ Borisovich Dynkin
Publisher: Cambridge University Press
Total Pages: 325
Release: 1982-09-23
Genre: Mathematics
ISBN: 0521285127

The theory of Markov Processes has become a powerful tool in partial differential equations and potential theory with important applications to physics. Professor Dynkin has made many profound contributions to the subject and in this volume are collected several of his most important expository and survey articles. The content of these articles has not been covered in any monograph as yet. This account is accessible to graduate students in mathematics and operations research and will be welcomed by all those interested in stochastic processes and their applications.