Approximation Methods in Probability Theory

Approximation Methods in Probability Theory
Author: Vydas Čekanavičius
Publisher: Springer
Total Pages: 283
Release: 2016-06-16
Genre: Mathematics
ISBN: 3319340727

This book presents a wide range of well-known and less common methods used for estimating the accuracy of probabilistic approximations, including the Esseen type inversion formulas, the Stein method as well as the methods of convolutions and triangle function. Emphasising the correct usage of the methods presented, each step required for the proofs is examined in detail. As a result, this textbook provides valuable tools for proving approximation theorems. While Approximation Methods in Probability Theory will appeal to everyone interested in limit theorems of probability theory, the book is particularly aimed at graduate students who have completed a standard intermediate course in probability theory. Furthermore, experienced researchers wanting to enlarge their toolkit will also find this book useful.

Normal Approximation by Stein’s Method

Normal Approximation by Stein’s Method
Author: Louis H.Y. Chen
Publisher: Springer Science & Business Media
Total Pages: 411
Release: 2010-10-13
Genre: Mathematics
ISBN: 3642150071

Since its introduction in 1972, Stein’s method has offered a completely novel way of evaluating the quality of normal approximations. Through its characterizing equation approach, it is able to provide approximation error bounds in a wide variety of situations, even in the presence of complicated dependence. Use of the method thus opens the door to the analysis of random phenomena arising in areas including statistics, physics, and molecular biology. Though Stein's method for normal approximation is now mature, the literature has so far lacked a complete self contained treatment. This volume contains thorough coverage of the method’s fundamentals, includes a large number of recent developments in both theory and applications, and will help accelerate the appreciation, understanding, and use of Stein's method by providing the reader with the tools needed to apply it in new situations. It addresses researchers as well as graduate students in Probability, Statistics and Combinatorics.

Stochastic Approximation Methods for Constrained and Unconstrained Systems

Stochastic Approximation Methods for Constrained and Unconstrained Systems
Author: H.J. Kushner
Publisher: Springer Science & Business Media
Total Pages: 273
Release: 2012-12-06
Genre: Mathematics
ISBN: 1468493523

The book deals with a powerful and convenient approach to a great variety of types of problems of the recursive monte-carlo or stochastic approximation type. Such recu- sive algorithms occur frequently in stochastic and adaptive control and optimization theory and in statistical esti- tion theory. Typically, a sequence {X } of estimates of a n parameter is obtained by means of some recursive statistical th st procedure. The n estimate is some function of the n_l estimate and of some new observational data, and the aim is to study the convergence, rate of convergence, and the pa- metric dependence and other qualitative properties of the - gorithms. In this sense, the theory is a statistical version of recursive numerical analysis. The approach taken involves the use of relatively simple compactness methods. Most standard results for Kiefer-Wolfowitz and Robbins-Monro like methods are extended considerably. Constrained and unconstrained problems are treated, as is the rate of convergence problem. While the basic method is rather simple, it can be elaborated to allow a broad and deep coverage of stochastic approximation like problems. The approach, relating algorithm behavior to qualitative properties of deterministic or stochastic differ ential equations, has advantages in algorithm conceptualiza tion and design. It is often possible to obtain an intuitive understanding of algorithm behavior or qualitative dependence upon parameters, etc., without getting involved in a great deal of deta~l.

Approximation Theory and Methods

Approximation Theory and Methods
Author: M. J. D. Powell
Publisher: Cambridge University Press
Total Pages: 356
Release: 1981-03-31
Genre: Mathematics
ISBN: 9780521295147

Most functions that occur in mathematics cannot be used directly in computer calculations. Instead they are approximated by manageable functions such as polynomials and piecewise polynomials. The general theory of the subject and its application to polynomial approximation are classical, but piecewise polynomials have become far more useful during the last twenty years. Thus many important theoretical properties have been found recently and many new techniques for the automatic calculation of approximations to prescribed accuracy have been developed. This book gives a thorough and coherent introduction to the theory that is the basis of current approximation methods. Professor Powell describes and analyses the main techniques of calculation supplying sufficient motivation throughout the book to make it accessible to scientists and engineers who require approximation methods for practical needs. Because the book is based on a course of lectures to third-year undergraduates in mathematics at Cambridge University, sufficient attention is given to theory to make it highly suitable as a mathematical textbook at undergraduate or postgraduate level.

Analysis and Approximation of Rare Events

Analysis and Approximation of Rare Events
Author: Amarjit Budhiraja
Publisher: Springer
Total Pages: 577
Release: 2019-08-10
Genre: Mathematics
ISBN: 1493995790

This book presents broadly applicable methods for the large deviation and moderate deviation analysis of discrete and continuous time stochastic systems. A feature of the book is the systematic use of variational representations for quantities of interest such as normalized logarithms of probabilities and expected values. By characterizing a large deviation principle in terms of Laplace asymptotics, one converts the proof of large deviation limits into the convergence of variational representations. These features are illustrated though their application to a broad range of discrete and continuous time models, including stochastic partial differential equations, processes with discontinuous statistics, occupancy models, and many others. The tools used in the large deviation analysis also turn out to be useful in understanding Monte Carlo schemes for the numerical approximation of the same probabilities and expected values. This connection is illustrated through the design and analysis of importance sampling and splitting schemes for rare event estimation. The book assumes a solid background in weak convergence of probability measures and stochastic analysis, and is suitable for advanced graduate students, postdocs and researchers.

Stochastic Approximation

Stochastic Approximation
Author: M. T. Wasan
Publisher: Cambridge University Press
Total Pages: 220
Release: 2004-06-03
Genre: Mathematics
ISBN: 9780521604857

A rigorous mathematical treatment of the technique for studying the properties of an experimental situation.

Approximation Theory and Approximation Practice, Extended Edition

Approximation Theory and Approximation Practice, Extended Edition
Author: Lloyd N. Trefethen
Publisher: SIAM
Total Pages: 377
Release: 2019-01-01
Genre: Mathematics
ISBN: 1611975948

This is a textbook on classical polynomial and rational approximation theory for the twenty-first century. Aimed at advanced undergraduates and graduate students across all of applied mathematics, it uses MATLAB to teach the field’s most important ideas and results. Approximation Theory and Approximation Practice, Extended Edition differs fundamentally from other works on approximation theory in a number of ways: its emphasis is on topics close to numerical algorithms; concepts are illustrated with Chebfun; and each chapter is a PUBLISHable MATLAB M-file, available online. The book centers on theorems and methods for analytic functions, which appear so often in applications, rather than on functions at the edge of discontinuity with their seductive theoretical challenges. Original sources are cited rather than textbooks, and each item in the bibliography is accompanied by an editorial comment. In addition, each chapter has a collection of exercises, which span a wide range from mathematical theory to Chebfun-based numerical experimentation. This textbook is appropriate for advanced undergraduate or graduate students who have an understanding of numerical analysis and complex analysis. It is also appropriate for seasoned mathematicians who use MATLAB.

Fundamentals of Approximation Theory

Fundamentals of Approximation Theory
Author: Hrushikesh Narhar Mhaskar
Publisher: CRC Press
Total Pages: 580
Release: 2000
Genre: Mathematics
ISBN: 9780849309397

The field of approximation theory has become so vast that it intersects with every other branch of analysis and plays an increasingly important role in applications in the applied sciences and engineering. Fundamentals of Approximation Theory presents a systematic, in-depth treatment of some basic topics in approximation theory designed to emphasize the rich connections of the subject with other areas of study. With an approach that moves smoothly from the very concrete to more and more abstract levels, this text provides an outstanding blend of classical and abstract topics. The first five chapters present the core of information that readers need to begin research in this domain. The final three chapters the authors devote to special topics-splined functions, orthogonal polynomials, and best approximation in normed linear spaces- that illustrate how the core material applies in other contexts and expose readers to the use of complex analytic methods in approximation theory. Each chapter contains problems of varying difficulty, including some drawn from contemporary research. Perfect for an introductory graduate-level class, Fundamentals of Approximation Theory also contains enough advanced material to serve more specialized courses at the doctoral level and to interest scientists and engineers.

Advanced Mean Field Methods

Advanced Mean Field Methods
Author: Manfred Opper
Publisher: MIT Press
Total Pages: 300
Release: 2001
Genre: Computers
ISBN: 9780262150545

This book covers the theoretical foundations of advanced mean field methods, explores the relation between the different approaches, examines the quality of the approximation obtained, and demonstrates their application to various areas of probabilistic modeling. A major problem in modern probabilistic modeling is the huge computational complexity involved in typical calculations with multivariate probability distributions when the number of random variables is large. Because exact computations are infeasible in such cases and Monte Carlo sampling techniques may reach their limits, there is a need for methods that allow for efficient approximate computations. One of the simplest approximations is based on the mean field method, which has a long history in statistical physics. The method is widely used, particularly in the growing field of graphical models. Researchers from disciplines such as statistical physics, computer science, and mathematical statistics are studying ways to improve this and related methods and are exploring novel application areas. Leading approaches include the variational approach, which goes beyond factorizable distributions to achieve systematic improvements; the TAP (Thouless-Anderson-Palmer) approach, which incorporates correlations by including effective reaction terms in the mean field theory; and the more general methods of graphical models. Bringing together ideas and techniques from these diverse disciplines, this book covers the theoretical foundations of advanced mean field methods, explores the relation between the different approaches, examines the quality of the approximation obtained, and demonstrates their application to various areas of probabilistic modeling.