Mathematical Aspects of Mixing Times in Markov Chains

Mathematical Aspects of Mixing Times in Markov Chains
Author: Ravi R. Montenegro
Publisher: Now Publishers Inc
Total Pages: 133
Release: 2006
Genre: Computers
ISBN: 1933019298

Mathematical Aspects of Mixing Times in Markov Chains is a comprehensive, well-written review of the subject that will be of interest to researchers and students in computer and mathematical sciences.

Introduction to Markov Chains

Introduction to Markov Chains
Author: Ehrhard Behrends
Publisher: Vieweg+Teubner Verlag
Total Pages: 237
Release: 2014-07-08
Genre: Mathematics
ISBN: 3322901572

Besides the investigation of general chains the book contains chapters which are concerned with eigenvalue techniques, conductance, stopping times, the strong Markov property, couplings, strong uniform times, Markov chains on arbitrary finite groups (including a crash-course in harmonic analysis), random generation and counting, Markov random fields, Gibbs fields, the Metropolis sampler, and simulated annealing. With 170 exercises.

Markov Chains and Stochastic Stability

Markov Chains and Stochastic Stability
Author: Sean Meyn
Publisher: Cambridge University Press
Total Pages: 623
Release: 2009-04-02
Genre: Mathematics
ISBN: 0521731828

New up-to-date edition of this influential classic on Markov chains in general state spaces. Proofs are rigorous and concise, the range of applications is broad and knowledgeable, and key ideas are accessible to practitioners with limited mathematical background. New commentary by Sean Meyn, including updated references, reflects developments since 1996.

Essentials of Stochastic Processes

Essentials of Stochastic Processes
Author: Richard Durrett
Publisher: Springer
Total Pages: 282
Release: 2016-11-07
Genre: Mathematics
ISBN: 3319456148

Building upon the previous editions, this textbook is a first course in stochastic processes taken by undergraduate and graduate students (MS and PhD students from math, statistics, economics, computer science, engineering, and finance departments) who have had a course in probability theory. It covers Markov chains in discrete and continuous time, Poisson processes, renewal processes, martingales, and option pricing. One can only learn a subject by seeing it in action, so there are a large number of examples and more than 300 carefully chosen exercises to deepen the reader’s understanding. Drawing from teaching experience and student feedback, there are many new examples and problems with solutions that use TI-83 to eliminate the tedious details of solving linear equations by hand, and the collection of exercises is much improved, with many more biological examples. Originally included in previous editions, material too advanced for this first course in stochastic processes has been eliminated while treatment of other topics useful for applications has been expanded. In addition, the ordering of topics has been improved; for example, the difficult subject of martingales is delayed until its usefulness can be applied in the treatment of mathematical finance.

Non-negative Matrices and Markov Chains

Non-negative Matrices and Markov Chains
Author: E. Seneta
Publisher: Springer Science & Business Media
Total Pages: 295
Release: 2006-07-02
Genre: Mathematics
ISBN: 0387327924

Since its inception by Perron and Frobenius, the theory of non-negative matrices has developed enormously and is now being used and extended in applied fields of study as diverse as probability theory, numerical analysis, demography, mathematical economics, and dynamic programming, while its development is still proceeding rapidly as a branch of pure mathematics in its own right. While there are books which cover this or that aspect of the theory, it is nevertheless not uncommon for workers in one or another branch of its development to be unaware of what is known in other branches, even though there is often formal overlap. One of the purposes of this book is to relate several aspects of the theory, insofar as this is possible. The author hopes that the book will be useful to mathematicians; but in particular to the workers in applied fields, so the mathematics has been kept as simple as could be managed. The mathematical requisites for reading it are: some knowledge of real-variable theory, and matrix theory; and a little knowledge of complex-variable; the emphasis is on real-variable methods. (There is only one part of the book, the second part of 55.5, which is of rather specialist interest, and requires deeper knowledge.) Appendices provide brief expositions of those areas of mathematics needed which may be less g- erally known to the average reader.

Markov Chains

Markov Chains
Author: Pierre Bremaud
Publisher: Springer Science & Business Media
Total Pages: 456
Release: 2013-03-09
Genre: Mathematics
ISBN: 1475731248

Primarily an introduction to the theory of stochastic processes at the undergraduate or beginning graduate level, the primary objective of this book is to initiate students in the art of stochastic modelling. However it is motivated by significant applications and progressively brings the student to the borders of contemporary research. Examples are from a wide range of domains, including operations research and electrical engineering. Researchers and students in these areas as well as in physics, biology and the social sciences will find this book of interest.

Sensitivity Analysis: Matrix Methods in Demography and Ecology

Sensitivity Analysis: Matrix Methods in Demography and Ecology
Author: Hal Caswell
Publisher: Springer
Total Pages: 308
Release: 2019-04-02
Genre: Social Science
ISBN: 3030105342

This open access book shows how to use sensitivity analysis in demography. It presents new methods for individuals, cohorts, and populations, with applications to humans, other animals, and plants. The analyses are based on matrix formulations of age-classified, stage-classified, and multistate population models. Methods are presented for linear and nonlinear, deterministic and stochastic, and time-invariant and time-varying cases. Readers will discover results on the sensitivity of statistics of longevity, life disparity, occupancy times, the net reproductive rate, and statistics of Markov chain models in demography. They will also see applications of sensitivity analysis to population growth rates, stable population structures, reproductive value, equilibria under immigration and nonlinearity, and population cycles. Individual stochasticity is a theme throughout, with a focus that goes beyond expected values to include variances in demographic outcomes. The calculations are easily and accurately implemented in matrix-oriented programming languages such as Matlab or R. Sensitivity analysis will help readers create models to predict the effect of future changes, to evaluate policy effects, and to identify possible evolutionary responses to the environment. Complete with many examples of the application, the book will be of interest to researchers and graduate students in human demography and population biology. The material will also appeal to those in mathematical biology and applied mathematics.

Probability on Trees and Networks

Probability on Trees and Networks
Author: Russell Lyons
Publisher: Cambridge University Press
Total Pages: 1023
Release: 2017-01-20
Genre: Mathematics
ISBN: 1316785335

Starting around the late 1950s, several research communities began relating the geometry of graphs to stochastic processes on these graphs. This book, twenty years in the making, ties together research in the field, encompassing work on percolation, isoperimetric inequalities, eigenvalues, transition probabilities, and random walks. Written by two leading researchers, the text emphasizes intuition, while giving complete proofs and more than 850 exercises. Many recent developments, in which the authors have played a leading role, are discussed, including percolation on trees and Cayley graphs, uniform spanning forests, the mass-transport technique, and connections on random walks on graphs to embedding in Hilbert space. This state-of-the-art account of probability on networks will be indispensable for graduate students and researchers alike.

Combinatorial Stochastic Processes

Combinatorial Stochastic Processes
Author: Jim Pitman
Publisher: Springer Science & Business Media
Total Pages: 257
Release: 2006-05-11
Genre: Mathematics
ISBN: 354030990X

The purpose of this text is to bring graduate students specializing in probability theory to current research topics at the interface of combinatorics and stochastic processes. There is particular focus on the theory of random combinatorial structures such as partitions, permutations, trees, forests, and mappings, and connections between the asymptotic theory of enumeration of such structures and the theory of stochastic processes like Brownian motion and Poisson processes.

Counting, Sampling and Integrating: Algorithms and Complexity

Counting, Sampling and Integrating: Algorithms and Complexity
Author: Mark Jerrum
Publisher: Birkhäuser
Total Pages: 120
Release: 2012-12-06
Genre: Mathematics
ISBN: 3034880057

The subject of these notes is counting and related topics, viewed from a computational perspective. A major theme of the book is the idea of accumulating information about a set of combinatorial structures by performing a random walk on those structures. These notes will be of value not only to teachers of postgraduate courses on these topics, but also to established researchers. For the first time this body of knowledge has been brought together in a single volume.