Fluctuations in Markov Processes

Fluctuations in Markov Processes
Author: Tomasz Komorowski
Publisher: Springer Science & Business Media
Total Pages: 494
Release: 2012-07-05
Genre: Mathematics
ISBN: 364229880X

The present volume contains the most advanced theories on the martingale approach to central limit theorems. Using the time symmetry properties of the Markov processes, the book develops the techniques that allow us to deal with infinite dimensional models that appear in statistical mechanics and engineering (interacting particle systems, homogenization in random environments, and diffusion in turbulent flows, to mention just a few applications). The first part contains a detailed exposition of the method, and can be used as a text for graduate courses. The second concerns application to exclusion processes, in which the duality methods are fully exploited. The third part is about the homogenization of diffusions in random fields, including passive tracers in turbulent flows (including the superdiffusive behavior). There are no other books in the mathematical literature that deal with this kind of approach to the problem of the central limit theorem. Hence, this volume meets the demand for a monograph on this powerful approach, now widely used in many areas of probability and mathematical physics. The book also covers the connections with and application to hydrodynamic limits and homogenization theory, so besides probability researchers it will also be of interest also to mathematical physicists and analysts.

Fluctuations of Lévy Processes with Applications

Fluctuations of Lévy Processes with Applications
Author: Andreas E. Kyprianou
Publisher: Springer Science & Business Media
Total Pages: 461
Release: 2014-01-09
Genre: Mathematics
ISBN: 3642376320

Lévy processes are the natural continuous-time analogue of random walks and form a rich class of stochastic processes around which a robust mathematical theory exists. Their application appears in the theory of many areas of classical and modern stochastic processes including storage models, renewal processes, insurance risk models, optimal stopping problems, mathematical finance, continuous-state branching processes and positive self-similar Markov processes. This textbook is based on a series of graduate courses concerning the theory and application of Lévy processes from the perspective of their path fluctuations. Central to the presentation is the decomposition of paths in terms of excursions from the running maximum as well as an understanding of short- and long-term behaviour. The book aims to be mathematically rigorous while still providing an intuitive feel for underlying principles. The results and applications often focus on the case of Lévy processes with jumps in only one direction, for which recent theoretical advances have yielded a higher degree of mathematical tractability. The second edition additionally addresses recent developments in the potential analysis of subordinators, Wiener-Hopf theory, the theory of scale functions and their application to ruin theory, as well as including an extensive overview of the classical and modern theory of positive self-similar Markov processes. Each chapter has a comprehensive set of exercises.

Markov Processes

Markov Processes
Author: Daniel T. Gillespie
Publisher: Elsevier
Total Pages: 590
Release: 1991-12-02
Genre: Mathematics
ISBN: 0080918379

Markov process theory is basically an extension of ordinary calculus to accommodate functions whos time evolutions are not entirely deterministic. It is a subject that is becoming increasingly important for many fields of science. This book develops the single-variable theory of both continuous and jump Markov processes in a way that should appeal especially to physicists and chemists at the senior and graduate level. - A self-contained, prgamatic exposition of the needed elements of random variable theory - Logically integrated derviations of the Chapman-Kolmogorov equation, the Kramers-Moyal equations, the Fokker-Planck equations, the Langevin equation, the master equations, and the moment equations - Detailed exposition of Monte Carlo simulation methods, with plots of many numerical examples - Clear treatments of first passages, first exits, and stable state fluctuations and transitions - Carefully drawn applications to Brownian motion, molecular diffusion, and chemical kinetics

Stochastic Processes in Physics and Chemistry

Stochastic Processes in Physics and Chemistry
Author: N.G. Van Kampen
Publisher: Elsevier
Total Pages: 482
Release: 1992-11-20
Genre: Science
ISBN: 0080571387

This new edition of Van Kampen's standard work has been completely revised and updated. Three major changes have also been made. The Langevin equation receives more attention in a separate chapter in which non-Gaussian and colored noise are introduced. Another additional chapter contains old and new material on first-passage times and related subjects which lay the foundation for the chapter on unstable systems. Finally a completely new chapter has been written on the quantum mechanical foundations of noise. The references have also been expanded and updated.

Continuous-Time Markov Chains and Applications

Continuous-Time Markov Chains and Applications
Author: G. George Yin
Publisher: Springer Science & Business Media
Total Pages: 442
Release: 2012-11-14
Genre: Mathematics
ISBN: 1461443466

This book gives a systematic treatment of singularly perturbed systems that naturally arise in control and optimization, queueing networks, manufacturing systems, and financial engineering. It presents results on asymptotic expansions of solutions of Komogorov forward and backward equations, properties of functional occupation measures, exponential upper bounds, and functional limit results for Markov chains with weak and strong interactions. To bridge the gap between theory and applications, a large portion of the book is devoted to applications in controlled dynamic systems, production planning, and numerical methods for controlled Markovian systems with large-scale and complex structures in the real-world problems. This second edition has been updated throughout and includes two new chapters on asymptotic expansions of solutions for backward equations and hybrid LQG problems. The chapters on analytic and probabilistic properties of two-time-scale Markov chains have been almost completely rewritten and the notation has been streamlined and simplified. This book is written for applied mathematicians, engineers, operations researchers, and applied scientists. Selected material from the book can also be used for a one semester advanced graduate-level course in applied probability and stochastic processes.

Markov Chains

Markov Chains
Author: Kai Lai Chung
Publisher: Springer Science & Business Media
Total Pages: 312
Release: 2012-12-06
Genre: Mathematics
ISBN: 3642620159

From the reviews: J. Neveu, 1962 in Zentralblatt fr Mathematik, 92. Band Heft 2, p. 343: "Ce livre crit par l'un des plus minents spcialistes en la matire, est un expos trs dtaill de la thorie des processus de Markov dfinis sur un espace dnombrable d'tats et homognes dans le temps (chaines stationnaires de Markov)." N. Jain, 2008 in Selected Works of Kai Lai Chung, edited by Farid AitSahlia (University of Florida, USA), Elton Hsu (Northwestern University, USA), & Ruth Williams (University of California-San Diego, USA), Chapter 1, p. 15: "This monograph deals with countable state Markov chains in both discrete time (Part I) and continuous time (Part II). ... Much of Kai Lai's fundamental work in the field is included in this monograph. Here, for the first time, Kai Lai gave a systematic exposition of the subject which includes classification of states, ratio ergodic theorems, and limit theorems for functionals of the chain."

Elements of the Theory of Markov Processes and Their Applications

Elements of the Theory of Markov Processes and Their Applications
Author: A. T. Bharucha-Reid
Publisher: Courier Corporation
Total Pages: 485
Release: 2012-04-26
Genre: Mathematics
ISBN: 0486150356

This graduate-level text and reference in probability, with numerous applications to several fields of science, presents nonmeasure-theoretic introduction to theory of Markov processes. The work also covers mathematical models based on the theory, employed in various applied fields. Prerequisites are a knowledge of elementary probability theory, mathematical statistics, and analysis. Appendixes. Bibliographies. 1960 edition.

Stochastic Processes in Physics and Chemistry

Stochastic Processes in Physics and Chemistry
Author: N.G. Van Kampen
Publisher: Elsevier
Total Pages: 481
Release: 2011-08-30
Genre: Science
ISBN: 0080475361

The third edition of Van Kampen's standard work has been revised and updated. The main difference with the second edition is that the contrived application of the quantum master equation in section 6 of chapter XVII has been replaced with a satisfactory treatment of quantum fluctuations. Apart from that throughout the text corrections have been made and a number of references to later developments have been included. From the recent textbooks the following are the most relevant.C.W.Gardiner, Quantum Optics (Springer, Berlin 1991)D.T. Gillespie, Markov Processes (Academic Press, San Diego 1992)W.T. Coffey, Yu.P.Kalmykov, and J.T.Waldron, The Langevin Equation (2nd edition, World Scientific, 2004) - Comprehensive coverage of fluctuations and stochastic methods for describing them - A must for students and researchers in applied mathematics, physics and physical chemistry

Generated Dynamics of Markov and Quantum Processes

Generated Dynamics of Markov and Quantum Processes
Author: Martin Janßen
Publisher: Springer
Total Pages: 236
Release: 2016-04-28
Genre: Science
ISBN: 3662496968

This book presents Markov and quantum processes as two sides of a coin called generated stochastic processes. It deals with quantum processes as reversible stochastic processes generated by one-step unitary operators, while Markov processes are irreversible stochastic processes generated by one-step stochastic operators. The characteristic feature of quantum processes are oscillations, interference, lots of stationary states in bounded systems and possible asymptotic stationary scattering states in open systems, while the characteristic feature of Markov processes are relaxations to a single stationary state. Quantum processes apply to systems where all variables, that control reversibility, are taken as relevant variables, while Markov processes emerge when some of those variables cannot be followed and are thus irrelevant for the dynamic description. Their absence renders the dynamic irreversible. A further aim is to demonstrate that almost any subdiscipline of theoretical physics can conceptually be put into the context of generated stochastic processes. Classical mechanics and classical field theory are deterministic processes which emerge when fluctuations in relevant variables are negligible. Quantum mechanics and quantum field theory consider genuine quantum processes. Equilibrium and non-equilibrium statistics apply to the regime where relaxing Markov processes emerge from quantum processes by omission of a large number of uncontrollable variables. Systems with many variables often self-organize in such a way that only a few slow variables can serve as relevant variables. Symmetries and topological classes are essential in identifying such relevant variables. The third aim of this book is to provide conceptually general methods of solutions which can serve as starting points to find relevant variables as to apply best-practice approximation methods. Such methods are available through generating functionals. The potential reader is a graduate student who has heard already a course in quantum theory and equilibrium statistical physics including the mathematics of spectral analysis (eigenvalues, eigenvectors, Fourier and Laplace transformation). The reader should be open for a unifying look on several topics.

Markov Processes

Markov Processes
Author: James R. Kirkwood
Publisher: CRC Press
Total Pages: 336
Release: 2015-02-09
Genre: Business & Economics
ISBN: 1482240742

Clear, rigorous, and intuitive, Markov Processes provides a bridge from an undergraduate probability course to a course in stochastic processes and also as a reference for those that want to see detailed proofs of the theorems of Markov processes. It contains copious computational examples that motivate and illustrate the theorems. The text is desi