Maximum Likelihood Estimation and Inference

Maximum Likelihood Estimation and Inference
Author: Russell B. Millar
Publisher: John Wiley & Sons
Total Pages: 286
Release: 2011-07-26
Genre: Mathematics
ISBN: 1119977711

This book takes a fresh look at the popular and well-established method of maximum likelihood for statistical estimation and inference. It begins with an intuitive introduction to the concepts and background of likelihood, and moves through to the latest developments in maximum likelihood methodology, including general latent variable models and new material for the practical implementation of integrated likelihood using the free ADMB software. Fundamental issues of statistical inference are also examined, with a presentation of some of the philosophical debates underlying the choice of statistical paradigm. Key features: Provides an accessible introduction to pragmatic maximum likelihood modelling. Covers more advanced topics, including general forms of latent variable models (including non-linear and non-normal mixed-effects and state-space models) and the use of maximum likelihood variants, such as estimating equations, conditional likelihood, restricted likelihood and integrated likelihood. Adopts a practical approach, with a focus on providing the relevant tools required by researchers and practitioners who collect and analyze real data. Presents numerous examples and case studies across a wide range of applications including medicine, biology and ecology. Features applications from a range of disciplines, with implementation in R, SAS and/or ADMB. Provides all program code and software extensions on a supporting website. Confines supporting theory to the final chapters to maintain a readable and pragmatic focus of the preceding chapters. This book is not just an accessible and practical text about maximum likelihood, it is a comprehensive guide to modern maximum likelihood estimation and inference. It will be of interest to readers of all levels, from novice to expert. It will be of great benefit to researchers, and to students of statistics from senior undergraduate to graduate level. For use as a course text, exercises are provided at the end of each chapter.

Econometric Modelling with Time Series

Econometric Modelling with Time Series
Author: Vance Martin
Publisher: Cambridge University Press
Total Pages: 925
Release: 2013
Genre: Business & Economics
ISBN: 0521139813

"Maximum likelihood estimation is a general method for estimating the parameters of econometric models from observed data. The principle of maximum likelihood plays a central role in the exposition of this book, since a number of estimators used in econometrics can be derived within this framework. Examples include ordinary least squares, generalized least squares and full-information maximum likelihood. In deriving the maximum likelihood estimator, a key concept is the joint probability density function (pdf) of the observed random variables, yt. Maximum likelihood estimation requires that the following conditions are satisfied. (1) The form of the joint pdf of yt is known. (2) The specification of the moments of the joint pdf are known. (3) The joint pdf can be evaluated for all values of the parameters, 9. Parts ONE and TWO of this book deal with models in which all these conditions are satisfied. Part THREE investigates models in which these conditions are not satisfied and considers four important cases. First, if the distribution of yt is misspecified, resulting in both conditions 1 and 2 being violated, estimation is by quasi-maximum likelihood (Chapter 9). Second, if condition 1 is not satisfied, a generalized method of moments estimator (Chapter 10) is required. Third, if condition 2 is not satisfied, estimation relies on nonparametric methods (Chapter 11). Fourth, if condition 3 is violated, simulation-based estimation methods are used (Chapter 12). 1.2 Motivating Examples To highlight the role of probability distributions in maximum likelihood estimation, this section emphasizes the link between observed sample data and 4 The Maximum Likelihood Principle the probability distribution from which they are drawn"-- publisher.

Small Sample Size Solutions

Small Sample Size Solutions
Author: Rens van de Schoot
Publisher: Routledge
Total Pages: 270
Release: 2020-02-13
Genre: Psychology
ISBN: 1000760944

Researchers often have difficulties collecting enough data to test their hypotheses, either because target groups are small or hard to access, or because data collection entails prohibitive costs. Such obstacles may result in data sets that are too small for the complexity of the statistical model needed to answer the research question. This unique book provides guidelines and tools for implementing solutions to issues that arise in small sample research. Each chapter illustrates statistical methods that allow researchers to apply the optimal statistical model for their research question when the sample is too small. This essential book will enable social and behavioral science researchers to test their hypotheses even when the statistical model required for answering their research question is too complex for the sample sizes they can collect. The statistical models in the book range from the estimation of a population mean to models with latent variables and nested observations, and solutions include both classical and Bayesian methods. All proposed solutions are described in steps researchers can implement with their own data and are accompanied with annotated syntax in R. The methods described in this book will be useful for researchers across the social and behavioral sciences, ranging from medical sciences and epidemiology to psychology, marketing, and economics.

Maximum Likelihood Estimation for Sample Surveys

Maximum Likelihood Estimation for Sample Surveys
Author: Raymond L. Chambers
Publisher: CRC Press
Total Pages: 393
Release: 2012-05-02
Genre: Mathematics
ISBN: 1584886323

Sample surveys provide data used by researchers in a large range of disciplines to analyze important relationships using well-established and widely used likelihood methods. The methods used to select samples often result in the sample differing in important ways from the target population and standard application of likelihood methods can lead to biased and inefficient estimates. Maximum Likelihood Estimation for Sample Surveys presents an overview of likelihood methods for the analysis of sample survey data that account for the selection methods used, and includes all necessary background material on likelihood inference. It covers a range of data types, including multilevel data, and is illustrated by many worked examples using tractable and widely used models. It also discusses more advanced topics, such as combining data, non-response, and informative sampling. The book presents and develops a likelihood approach for fitting models to sample survey data. It explores and explains how the approach works in tractable though widely used models for which we can make considerable analytic progress. For less tractable models numerical methods are ultimately needed to compute the score and information functions and to compute the maximum likelihood estimates of the model parameters. For these models, the book shows what has to be done conceptually to develop analyses to the point that numerical methods can be applied. Designed for statisticians who are interested in the general theory of statistics, Maximum Likelihood Estimation for Sample Surveys is also aimed at statisticians focused on fitting models to sample survey data, as well as researchers who study relationships among variables and whose sources of data include surveys.

Maximum Likelihood Estimation with Stata, Fourth Edition

Maximum Likelihood Estimation with Stata, Fourth Edition
Author: William Gould
Publisher: Stata Press
Total Pages: 352
Release: 2010-10-27
Genre: Mathematics
ISBN: 9781597180788

Maximum Likelihood Estimation with Stata, Fourth Edition is written for researchers in all disciplines who need to compute maximum likelihood estimators that are not available as prepackaged routines. Readers are presumed to be familiar with Stata, but no special programming skills are assumed except in the last few chapters, which detail how to add a new estimation command to Stata. The book begins with an introduction to the theory of maximum likelihood estimation with particular attention on the practical implications for applied work. Individual chapters then describe in detail each of the four types of likelihood evaluator programs and provide numerous examples, such as logit and probit regression, Weibull regression, random-effects linear regression, and the Cox proportional hazards model. Later chapters and appendixes provide additional details about the ml command, provide checklists to follow when writing evaluators, and show how to write your own estimation commands.

Spatial Capture-Recapture

Spatial Capture-Recapture
Author: J. Andrew Royle
Publisher: Academic Press
Total Pages: 609
Release: 2013-08-27
Genre: Science
ISBN: 012407152X

Spatial Capture-Recapture provides a comprehensive how-to manual with detailed examples of spatial capture-recapture models based on current technology and knowledge. Spatial Capture-Recapture provides you with an extensive step-by-step analysis of many data sets using different software implementations. The authors' approach is practical – it embraces Bayesian and classical inference strategies to give the reader different options to get the job done. In addition, Spatial Capture-Recapture provides data sets, sample code and computing scripts in an R package. - Comprehensive reference on revolutionary new methods in ecology makes this the first and only book on the topic - Every methodological element has a detailed worked example with a code template, allowing you to learn by example - Includes an R package that contains all computer code and data sets on companion website

A Course in Econometrics

A Course in Econometrics
Author: Arthur Stanley Goldberger
Publisher: Harvard University Press
Total Pages: 430
Release: 1991
Genre: Business & Economics
ISBN: 9780674175440

This text prepares first-year graduate students and advanced undergraduates for empirical research in economics, and also equips them for specialization in econometric theory, business, and sociology. A Course in Econometrics is likely to be the text most thoroughly attuned to the needs of your students. Derived from the course taught by Arthur S. Goldberger at the University of Wisconsin-Madison and at Stanford University, it is specifically designed for use over two semesters, offers students the most thorough grounding in introductory statistical inference, and offers a substantial amount of interpretive material. The text brims with insights, strikes a balance between rigor and intuition, and provokes students to form their own critical opinions. A Course in Econometrics thoroughly covers the fundamentals--classical regression and simultaneous equations--and offers clear and logical explorations of asymptotic theory and nonlinear regression. To accommodate students with various levels of preparation, the text opens with a thorough review of statistical concepts and methods, then proceeds to the regression model and its variants. Bold subheadings introduce and highlight key concepts throughout each chapter. Each chapter concludes with a set of exercises specifically designed to reinforce and extend the material covered. Many of the exercises include real microdata analyses, and all are ideally suited to use as homework and test questions.

Targeted Learning

Targeted Learning
Author: Mark J. van der Laan
Publisher: Springer Science & Business Media
Total Pages: 628
Release: 2011-06-17
Genre: Mathematics
ISBN: 1441997822

The statistics profession is at a unique point in history. The need for valid statistical tools is greater than ever; data sets are massive, often measuring hundreds of thousands of measurements for a single subject. The field is ready to move towards clear objective benchmarks under which tools can be evaluated. Targeted learning allows (1) the full generalization and utilization of cross-validation as an estimator selection tool so that the subjective choices made by humans are now made by the machine, and (2) targeting the fitting of the probability distribution of the data toward the target parameter representing the scientific question of interest. This book is aimed at both statisticians and applied researchers interested in causal inference and general effect estimation for observational and experimental data. Part I is an accessible introduction to super learning and the targeted maximum likelihood estimator, including related concepts necessary to understand and apply these methods. Parts II-IX handle complex data structures and topics applied researchers will immediately recognize from their own research, including time-to-event outcomes, direct and indirect effects, positivity violations, case-control studies, censored data, longitudinal data, and genomic studies.