Probability and Simulation

Probability and Simulation
Author: Giray Ökten
Publisher: Springer Nature
Total Pages: 152
Release: 2020-10-15
Genre: Mathematics
ISBN: 3030560708

This undergraduate textbook presents an inquiry-based learning course in stochastic models and computing designed to serve as a first course in probability. Its modular structure complements a traditional lecture format, introducing new topics chapter by chapter with accompanying projects for group collaboration. The text addresses probability axioms leading to Bayes’ theorem, discrete and continuous random variables, Markov chains, and Brownian motion, as well as applications including randomized algorithms, randomized surveys, Benford’s law, and Monte Carlo methods. Adopting a unique application-driven approach to better study probability in action, the book emphasizes data, simulation, and games to strengthen reader insight and intuition while proving theorems. Additionally, the text incorporates codes and exercises in the Julia programming language to further promote a hands-on focus in modelling. Students should have prior knowledge of single variable calculus. Giray Ökten received his PhD from Claremont Graduate University. He has held academic positions at University of Alaska Fairbanks, Ball State University, and Florida State University. He received a Fulbright U.S. Scholar award in 2015. He is the author of an open access textbook in numerical analysis, First Semester in Numerical Analysis with Julia, published by Florida State University Libraries, and a co-author of a children’s math book, The Mathematical Investigations of Dr. O and Arya, published by Tumblehome. His research interests include Monte Carlo methods and computational finance.

Introduction to Probability Simulation and Gibbs Sampling with R

Introduction to Probability Simulation and Gibbs Sampling with R
Author: Eric A. Suess
Publisher: Springer Science & Business Media
Total Pages: 318
Release: 2010-05-27
Genre: Mathematics
ISBN: 0387687653

The first seven chapters use R for probability simulation and computation, including random number generation, numerical and Monte Carlo integration, and finding limiting distributions of Markov Chains with both discrete and continuous states. Applications include coverage probabilities of binomial confidence intervals, estimation of disease prevalence from screening tests, parallel redundancy for improved reliability of systems, and various kinds of genetic modeling. These initial chapters can be used for a non-Bayesian course in the simulation of applied probability models and Markov Chains. Chapters 8 through 10 give a brief introduction to Bayesian estimation and illustrate the use of Gibbs samplers to find posterior distributions and interval estimates, including some examples in which traditional methods do not give satisfactory results. WinBUGS software is introduced with a detailed explanation of its interface and examples of its use for Gibbs sampling for Bayesian estimation. No previous experience using R is required. An appendix introduces R, and complete R code is included for almost all computational examples and problems (along with comments and explanations). Noteworthy features of the book are its intuitive approach, presenting ideas with examples from biostatistics, reliability, and other fields; its large number of figures; and its extraordinarily large number of problems (about a third of the pages), ranging from simple drill to presentation of additional topics. Hints and answers are provided for many of the problems. These features make the book ideal for students of statistics at the senior undergraduate and at the beginning graduate levels.

Understanding Probability

Understanding Probability
Author: Henk Tijms
Publisher: Cambridge University Press
Total Pages: 407
Release: 2007-07-26
Genre: Mathematics
ISBN: 1139465457

In this fully revised second edition of Understanding Probability, the reader can learn about the world of probability in an informal way. The author demystifies the law of large numbers, betting systems, random walks, the bootstrap, rare events, the central limit theorem, the Bayesian approach and more. This second edition has wider coverage, more explanations and examples and exercises, and a new chapter introducing Markov chains, making it a great choice for a first probability course. But its easy-going style makes it just as valuable if you want to learn about the subject on your own, and high school algebra is really all the mathematical background you need.

Simulation and the Monte Carlo Method

Simulation and the Monte Carlo Method
Author: Reuven Y. Rubinstein
Publisher: John Wiley & Sons
Total Pages: 470
Release: 2016-10-21
Genre: Mathematics
ISBN: 1118632389

This accessible new edition explores the major topics in Monte Carlo simulation that have arisen over the past 30 years and presents a sound foundation for problem solving Simulation and the Monte Carlo Method, Third Edition reflects the latest developments in the field and presents a fully updated and comprehensive account of the state-of-the-art theory, methods and applications that have emerged in Monte Carlo simulation since the publication of the classic First Edition over more than a quarter of a century ago. While maintaining its accessible and intuitive approach, this revised edition features a wealth of up-to-date information that facilitates a deeper understanding of problem solving across a wide array of subject areas, such as engineering, statistics, computer science, mathematics, and the physical and life sciences. The book begins with a modernized introduction that addresses the basic concepts of probability, Markov processes, and convex optimization. Subsequent chapters discuss the dramatic changes that have occurred in the field of the Monte Carlo method, with coverage of many modern topics including: Markov Chain Monte Carlo, variance reduction techniques such as importance (re-)sampling, and the transform likelihood ratio method, the score function method for sensitivity analysis, the stochastic approximation method and the stochastic counter-part method for Monte Carlo optimization, the cross-entropy method for rare events estimation and combinatorial optimization, and application of Monte Carlo techniques for counting problems. An extensive range of exercises is provided at the end of each chapter, as well as a generous sampling of applied examples. The Third Edition features a new chapter on the highly versatile splitting method, with applications to rare-event estimation, counting, sampling, and optimization. A second new chapter introduces the stochastic enumeration method, which is a new fast sequential Monte Carlo method for tree search. In addition, the Third Edition features new material on: • Random number generation, including multiple-recursive generators and the Mersenne Twister • Simulation of Gaussian processes, Brownian motion, and diffusion processes • Multilevel Monte Carlo method • New enhancements of the cross-entropy (CE) method, including the “improved” CE method, which uses sampling from the zero-variance distribution to find the optimal importance sampling parameters • Over 100 algorithms in modern pseudo code with flow control • Over 25 new exercises Simulation and the Monte Carlo Method, Third Edition is an excellent text for upper-undergraduate and beginning graduate courses in stochastic simulation and Monte Carlo techniques. The book also serves as a valuable reference for professionals who would like to achieve a more formal understanding of the Monte Carlo method. Reuven Y. Rubinstein, DSc, was Professor Emeritus in the Faculty of Industrial Engineering and Management at Technion-Israel Institute of Technology. He served as a consultant at numerous large-scale organizations, such as IBM, Motorola, and NEC. The author of over 100 articles and six books, Dr. Rubinstein was also the inventor of the popular score-function method in simulation analysis and generic cross-entropy methods for combinatorial optimization and counting. Dirk P. Kroese, PhD, is a Professor of Mathematics and Statistics in the School of Mathematics and Physics of The University of Queensland, Australia. He has published over 100 articles and four books in a wide range of areas in applied probability and statistics, including Monte Carlo methods, cross-entropy, randomized algorithms, tele-traffic c theory, reliability, computational statistics, applied probability, and stochastic modeling.

Simulation

Simulation
Author: Sheldon M. Ross
Publisher: Academic Press
Total Pages: 326
Release: 2012-10-22
Genre: Computers
ISBN: 0124158250

"In formulating a stochastic model to describe a real phenomenon, it used to be that one compromised between choosing a model that is a realistic replica of the actual situation and choosing one whose mathematical analysis is tractable. That is, there did not seem to be any payoff in choosing a model that faithfully conformed to the phenomenon under study if it were not possible to mathematically analyze that model. Similar considerations have led to the concentration on asymptotic or steady-state results as opposed to the more useful ones on transient time. However, the relatively recent advent of fast and inexpensive computational power has opened up another approach--namely, to try to model the phenomenon as faithfully as possible and then to rely on a simulation study to analyze it"--

Probability, Markov Chains, Queues, and Simulation

Probability, Markov Chains, Queues, and Simulation
Author: William J. Stewart
Publisher: Princeton University Press
Total Pages: 777
Release: 2009-07-06
Genre: Mathematics
ISBN: 1400832810

Probability, Markov Chains, Queues, and Simulation provides a modern and authoritative treatment of the mathematical processes that underlie performance modeling. The detailed explanations of mathematical derivations and numerous illustrative examples make this textbook readily accessible to graduate and advanced undergraduate students taking courses in which stochastic processes play a fundamental role. The textbook is relevant to a wide variety of fields, including computer science, engineering, operations research, statistics, and mathematics. The textbook looks at the fundamentals of probability theory, from the basic concepts of set-based probability, through probability distributions, to bounds, limit theorems, and the laws of large numbers. Discrete and continuous-time Markov chains are analyzed from a theoretical and computational point of view. Topics include the Chapman-Kolmogorov equations; irreducibility; the potential, fundamental, and reachability matrices; random walk problems; reversibility; renewal processes; and the numerical computation of stationary and transient distributions. The M/M/1 queue and its extensions to more general birth-death processes are analyzed in detail, as are queues with phase-type arrival and service processes. The M/G/1 and G/M/1 queues are solved using embedded Markov chains; the busy period, residual service time, and priority scheduling are treated. Open and closed queueing networks are analyzed. The final part of the book addresses the mathematical basis of simulation. Each chapter of the textbook concludes with an extensive set of exercises. An instructor's solution manual, in which all exercises are completely worked out, is also available (to professors only). Numerous examples illuminate the mathematical theories Carefully detailed explanations of mathematical derivations guarantee a valuable pedagogical approach Each chapter concludes with an extensive set of exercises

Stochastic Simulation

Stochastic Simulation
Author: Brian D. Ripley
Publisher: John Wiley & Sons
Total Pages: 258
Release: 2009-09-25
Genre: Mathematics
ISBN: 0470317388

WILEY-INTERSCIENCE PAPERBACK SERIES The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. ". . .this is a very competently written and useful addition to the statistical literature; a book every statistician should look at and that many should study!" —Short Book Reviews, International Statistical Institute ". . .reading this book was an enjoyable learning experience. The suggestions and recommendations on the methods [make] this book an excellent reference for anyone interested in simulation. With its compact structure and good coverage of material, it [is] an excellent textbook for a simulation course." —Technometrics ". . .this work is an excellent comprehensive guide to simulation methods, written by a very competent author. It is especially recommended for those users of simulation methods who want more than a 'cook book'. " —Mathematics Abstracts This book is a comprehensive guide to simulation methods with explicit recommendations of methods and algorithms. It covers both the technical aspects of the subject, such as the generation of random numbers, non-uniform random variates and stochastic processes, and the use of simulation. Supported by the relevant mathematical theory, the text contains a great deal of unpublished research material, including coverage of the analysis of shift-register generators, sensitivity analysis of normal variate generators, analysis of simulation output, and more.

Discrete Choice Methods with Simulation

Discrete Choice Methods with Simulation
Author: Kenneth Train
Publisher: Cambridge University Press
Total Pages: 399
Release: 2009-07-06
Genre: Business & Economics
ISBN: 0521766559

This book describes the new generation of discrete choice methods, focusing on the many advances that are made possible by simulation. Researchers use these statistical methods to examine the choices that consumers, households, firms, and other agents make. Each of the major models is covered: logit, generalized extreme value, or GEV (including nested and cross-nested logits), probit, and mixed logit, plus a variety of specifications that build on these basics. Simulation-assisted estimation procedures are investigated and compared, including maximum stimulated likelihood, method of simulated moments, and method of simulated scores. Procedures for drawing from densities are described, including variance reduction techniques such as anithetics and Halton draws. Recent advances in Bayesian procedures are explored, including the use of the Metropolis-Hastings algorithm and its variant Gibbs sampling. The second edition adds chapters on endogeneity and expectation-maximization (EM) algorithms. No other book incorporates all these fields, which have arisen in the past 25 years. The procedures are applicable in many fields, including energy, transportation, environmental studies, health, labor, and marketing.

Stochastic Simulation and Monte Carlo Methods

Stochastic Simulation and Monte Carlo Methods
Author: Carl Graham
Publisher: Springer Science & Business Media
Total Pages: 264
Release: 2013-07-16
Genre: Mathematics
ISBN: 3642393632

In various scientific and industrial fields, stochastic simulations are taking on a new importance. This is due to the increasing power of computers and practitioners’ aim to simulate more and more complex systems, and thus use random parameters as well as random noises to model the parametric uncertainties and the lack of knowledge on the physics of these systems. The error analysis of these computations is a highly complex mathematical undertaking. Approaching these issues, the authors present stochastic numerical methods and prove accurate convergence rate estimates in terms of their numerical parameters (number of simulations, time discretization steps). As a result, the book is a self-contained and rigorous study of the numerical methods within a theoretical framework. After briefly reviewing the basics, the authors first introduce fundamental notions in stochastic calculus and continuous-time martingale theory, then develop the analysis of pure-jump Markov processes, Poisson processes, and stochastic differential equations. In particular, they review the essential properties of Itô integrals and prove fundamental results on the probabilistic analysis of parabolic partial differential equations. These results in turn provide the basis for developing stochastic numerical methods, both from an algorithmic and theoretical point of view. The book combines advanced mathematical tools, theoretical analysis of stochastic numerical methods, and practical issues at a high level, so as to provide optimal results on the accuracy of Monte Carlo simulations of stochastic processes. It is intended for master and Ph.D. students in the field of stochastic processes and their numerical applications, as well as for physicists, biologists, economists and other professionals working with stochastic simulations, who will benefit from the ability to reliably estimate and control the accuracy of their simulations.

Geostatistics Tróia '92

Geostatistics Tróia '92
Author: A.O. Soares
Publisher: Springer Science & Business Media
Total Pages: 1097
Release: 2012-12-06
Genre: Science
ISBN: 940111739X

The contributions in this book were presented at the Fourth International Geostatistics Congress held in Tróia, Portugal, in September 1992. They provide a comprehensive account of the current state of the art of geostatistics, including recent theoretical developments and new applications. In particular, readers will find descriptions and applications of the more recent methods of stochastic simulation together with data integration techniques applied to the modelling of hydrocabon reservoirs. In other fields there are stationary and non-stationary geostatistical applications to geology, climatology, pollution control, soil science, hydrology and human sciences. The papers also provide an insight into new trends in geostatistics particularly the increasing interaction with many other scientific disciplines. This book is a significant reference work for practitioners of geostatistics both in academia and industry.