The EM Algorithm and Extensions

The EM Algorithm and Extensions
Author: Geoffrey J. McLachlan
Publisher: John Wiley & Sons
Total Pages: 399
Release: 2007-11-09
Genre: Mathematics
ISBN: 0470191600

The only single-source——now completely updated and revised——to offer a unified treatment of the theory, methodology, and applications of the EM algorithm Complete with updates that capture developments from the past decade, The EM Algorithm and Extensions, Second Edition successfully provides a basic understanding of the EM algorithm by describing its inception, implementation, and applicability in numerous statistical contexts. In conjunction with the fundamentals of the topic, the authors discuss convergence issues and computation of standard errors, and, in addition, unveil many parallels and connections between the EM algorithm and Markov chain Monte Carlo algorithms. Thorough discussions on the complexities and drawbacks that arise from the basic EM algorithm, such as slow convergence and lack of an in-built procedure to compute the covariance matrix of parameter estimates, are also presented. While the general philosophy of the First Edition has been maintained, this timely new edition has been updated, revised, and expanded to include: New chapters on Monte Carlo versions of the EM algorithm and generalizations of the EM algorithm New results on convergence, including convergence of the EM algorithm in constrained parameter spaces Expanded discussion of standard error computation methods, such as methods for categorical data and methods based on numerical differentiation Coverage of the interval EM, which locates all stationary points in a designated region of the parameter space Exploration of the EM algorithm's relationship with the Gibbs sampler and other Markov chain Monte Carlo methods Plentiful pedagogical elements—chapter introductions, lists of examples, author and subject indices, computer-drawn graphics, and a related Web site The EM Algorithm and Extensions, Second Edition serves as an excellent text for graduate-level statistics students and is also a comprehensive resource for theoreticians, practitioners, and researchers in the social and physical sciences who would like to extend their knowledge of the EM algorithm.

The EM Algorithm and Related Statistical Models

The EM Algorithm and Related Statistical Models
Author: Michiko Watanabe
Publisher: CRC Press
Total Pages: 214
Release: 2003-10-15
Genre: Mathematics
ISBN: 0824757025

Exploring the application and formulation of the EM algorithm, The EM Algorithm and Related Statistical Models offers a valuable method for constructing statistical models when only incomplete information is available, and proposes specific estimation algorithms for solutions to incomplete data problems. The text covers current topics including statistical models with latent variables, as well as neural network models, and Markov Chain Monte Carlo methods. It describes software resources valuable for the processing of the EM algorithm with incomplete data and for general analysis of latent structure models of categorical data, and studies accelerated versions of the EM algorithm.

Discriminant Analysis and Statistical Pattern Recognition

Discriminant Analysis and Statistical Pattern Recognition
Author: Geoffrey McLachlan
Publisher: John Wiley & Sons
Total Pages: 526
Release: 2005-02-25
Genre: Mathematics
ISBN: 0471725285

The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. "For both applied and theoretical statisticians as well as investigators working in the many areas in which relevant use can be made of discriminant techniques, this monograph provides a modern, comprehensive, and systematic account of discriminant analysis, with the focus on the more recent advances in the field." –SciTech Book News ". . . a very useful source of information for any researcher working in discriminant analysis and pattern recognition." –Computational Statistics Discriminant Analysis and Statistical Pattern Recognition provides a systematic account of the subject. While the focus is on practical considerations, both theoretical and practical issues are explored. Among the advances covered are regularized discriminant analysis and bootstrap-based assessment of the performance of a sample-based discriminant rule, and extensions of discriminant analysis motivated by problems in statistical image analysis. The accompanying bibliography contains over 1,200 references.

The Collected Works of Geoffrey J. McLachlan

The Collected Works of Geoffrey J. McLachlan
Author: Geoffrey McLachlan
Publisher: Wiley
Total Pages: 0
Release: 2009-06-09
Genre: Mathematics
ISBN: 9780470556054

This set features: The EM Algorithm and Extensions, Second Edition by Geoffrey J. McLachlan, Thriyambakam Krishnan (978-0-471-20170-0), Analyzing Microarray Gene Expression Data by Geoffrey J. McLachlan, Kim-Anh Do, Christophe Ambroise (978-0-471-22616-1), and Discriminant Analysis and Statistical Pattern Recognition by Geoffrey J. McLachlan (978-0-471-69115-0)

Learning in Graphical Models

Learning in Graphical Models
Author: M.I. Jordan
Publisher: Springer Science & Business Media
Total Pages: 658
Release: 2012-12-06
Genre: Computers
ISBN: 9401150141

In the past decade, a number of different research communities within the computational sciences have studied learning in networks, starting from a number of different points of view. There has been substantial progress in these different communities and surprising convergence has developed between the formalisms. The awareness of this convergence and the growing interest of researchers in understanding the essential unity of the subject underlies the current volume. Two research communities which have used graphical or network formalisms to particular advantage are the belief network community and the neural network community. Belief networks arose within computer science and statistics and were developed with an emphasis on prior knowledge and exact probabilistic calculations. Neural networks arose within electrical engineering, physics and neuroscience and have emphasised pattern recognition and systems modelling problems. This volume draws together researchers from these two communities and presents both kinds of networks as instances of a general unified graphical formalism. The book focuses on probabilistic methods for learning and inference in graphical models, algorithm analysis and design, theory and applications. Exact methods, sampling methods and variational methods are discussed in detail. Audience: A wide cross-section of computationally oriented researchers, including computer scientists, statisticians, electrical engineers, physicists and neuroscientists.

Data Analysis and Applications 4

Data Analysis and Applications 4
Author: Andreas Makrides
Publisher: John Wiley & Sons
Total Pages: 241
Release: 2020-04-09
Genre: Mathematics
ISBN: 111972158X

Data analysis as an area of importance has grown exponentially, especially during the past couple of decades. This can be attributed to a rapidly growing computer industry and the wide applicability of computational techniques, in conjunction with new advances of analytic tools. This being the case, the need for literature that addresses this is self-evident. New publications are appearing, covering the need for information from all fields of science and engineering, thanks to the universal relevance of data analysis and statistics packages. This book is a collective work by a number of leading scientists, analysts, engineers, mathematicians and statisticians who have been working at the forefront of data analysis. The chapters included in this volume represent a cross-section of current concerns and research interests in these scientific areas. The material is divided into three parts: Financial Data Analysis and Methods, Statistics and Stochastic Data Analysis and Methods, and Demographic Methods and Data Analysis- providing the reader with both theoretical and applied information on data analysis methods, models and techniques and appropriate applications.

Finite Mixture Models

Finite Mixture Models
Author: Geoffrey McLachlan
Publisher: John Wiley & Sons
Total Pages: 419
Release: 2004-03-22
Genre: Mathematics
ISBN: 047165406X

An up-to-date, comprehensive account of major issues in finitemixture modeling This volume provides an up-to-date account of the theory andapplications of modeling via finite mixture distributions. With anemphasis on the applications of mixture models in both mainstreamanalysis and other areas such as unsupervised pattern recognition,speech recognition, and medical imaging, the book describes theformulations of the finite mixture approach, details itsmethodology, discusses aspects of its implementation, andillustrates its application in many common statisticalcontexts. Major issues discussed in this book include identifiabilityproblems, actual fitting of finite mixtures through use of the EMalgorithm, properties of the maximum likelihood estimators soobtained, assessment of the number of components to be used in themixture, and the applicability of asymptotic theory in providing abasis for the solutions to some of these problems. The author alsoconsiders how the EM algorithm can be scaled to handle the fittingof mixture models to very large databases, as in data miningapplications. This comprehensive, practical guide: * Provides more than 800 references-40% published since 1995 * Includes an appendix listing available mixture software * Links statistical literature with machine learning and patternrecognition literature * Contains more than 100 helpful graphs, charts, and tables Finite Mixture Models is an important resource for both applied andtheoretical statisticians as well as for researchers in the manyareas in which finite mixture models can be used to analyze data.

Handbook of Mathematical Methods in Imaging

Handbook of Mathematical Methods in Imaging
Author: Otmar Scherzer
Publisher: Springer Science & Business Media
Total Pages: 1626
Release: 2010-11-23
Genre: Mathematics
ISBN: 0387929193

The Handbook of Mathematical Methods in Imaging provides a comprehensive treatment of the mathematical techniques used in imaging science. The material is grouped into two central themes, namely, Inverse Problems (Algorithmic Reconstruction) and Signal and Image Processing. Each section within the themes covers applications (modeling), mathematics, numerical methods (using a case example) and open questions. Written by experts in the area, the presentation is mathematically rigorous. The entries are cross-referenced for easy navigation through connected topics. Available in both print and electronic forms, the handbook is enhanced by more than 150 illustrations and an extended bibliography. It will benefit students, scientists and researchers in applied mathematics. Engineers and computer scientists working in imaging will also find this handbook useful.