Target Estimation and Adjustment Weighting for Survey Nonresponse and Sampling Bias

Target Estimation and Adjustment Weighting for Survey Nonresponse and Sampling Bias
Author: Devin Caughey
Publisher: Cambridge University Press
Total Pages: 98
Release: 2020-10-22
Genre: Political Science
ISBN: 1108889700

We elaborate a general workflow of weighting-based survey inference, decomposing it into two main tasks. The first is the estimation of population targets from one or more sources of auxiliary information. The second is the construction of weights that calibrate the survey sample to the population targets. We emphasize that these tasks are predicated on models of the measurement, sampling, and nonresponse process whose assumptions cannot be fully tested. After describing this workflow in abstract terms, we then describe in detail how it can be applied to the analysis of historical and contemporary opinion polls. We also discuss extensions of the basic workflow, particularly inference for causal quantities and multilevel regression and poststratification.

Nonresponse in Social Science Surveys

Nonresponse in Social Science Surveys
Author: National Research Council
Publisher: National Academies Press
Total Pages: 167
Release: 2013-10-26
Genre: Social Science
ISBN: 0309272475

For many household surveys in the United States, responses rates have been steadily declining for at least the past two decades. A similar decline in survey response can be observed in all wealthy countries. Efforts to raise response rates have used such strategies as monetary incentives or repeated attempts to contact sample members and obtain completed interviews, but these strategies increase the costs of surveys. This review addresses the core issues regarding survey nonresponse. It considers why response rates are declining and what that means for the accuracy of survey results. These trends are of particular concern for the social science community, which is heavily invested in obtaining information from household surveys. The evidence to date makes it apparent that current trends in nonresponse, if not arrested, threaten to undermine the potential of household surveys to elicit information that assists in understanding social and economic issues. The trends also threaten to weaken the validity of inferences drawn from estimates based on those surveys. High nonresponse rates create the potential or risk for bias in estimates and affect survey design, data collection, estimation, and analysis. The survey community is painfully aware of these trends and has responded aggressively to these threats. The interview modes employed by surveys in the public and private sectors have proliferated as new technologies and methods have emerged and matured. To the traditional trio of mail, telephone, and face-to-face surveys have been added interactive voice response (IVR), audio computer-assisted self-interviewing (ACASI), web surveys, and a number of hybrid methods. Similarly, a growing research agenda has emerged in the past decade or so focused on seeking solutions to various aspects of the problem of survey nonresponse; the potential solutions that have been considered range from better training and deployment of interviewers to more use of incentives, better use of the information collected in the data collection, and increased use of auxiliary information from other sources in survey design and data collection. Nonresponse in Social Science Surveys: A Research Agenda also documents the increased use of information collected in the survey process in nonresponse adjustment.

Practical Tools for Designing and Weighting Survey Samples

Practical Tools for Designing and Weighting Survey Samples
Author: Richard Valliant
Publisher: Springer
Total Pages: 787
Release: 2018-10-12
Genre: Social Science
ISBN: 3319936328

The goal of this book is to put an array of tools at the fingertips of students, practitioners, and researchers by explaining approaches long used by survey statisticians, illustrating how existing software can be used to solve survey problems, and developing some specialized software where needed. This volume serves at least three audiences: (1) students of applied sampling techniques; 2) practicing survey statisticians applying concepts learned in theoretical or applied sampling courses; and (3) social scientists and other survey practitioners who design, select, and weight survey samples. The text thoroughly covers fundamental aspects of survey sampling, such as sample size calculation (with examples for both single- and multi-stage sample design) and weight computation, accompanied by software examples to facilitate implementation. Features include step-by-step instructions for calculating survey weights, extensive real-world examples and applications, and representative programming code in R, SAS, and other packages. Since the publication of the first edition in 2013, there have been important developments in making inferences from nonprobability samples, in address-based sampling (ABS), and in the application of machine learning techniques for survey estimation. New to this revised and expanded edition: • Details on new functions in the PracTools package • Additional machine learning methods to form weighting classes • New coverage of nonlinear optimization algorithms for sample allocation • Reflecting effects of multiple weighting steps (nonresponse and calibration) on standard errors • A new chapter on nonprobability sampling • Additional examples, exercises, and updated references throughout Richard Valliant, PhD, is Research Professor Emeritus at the Institute for Social Research at the University of Michigan and at the Joint Program in Survey Methodology at the University of Maryland. He is a Fellow of the American Statistical Association, an elected member of the International Statistical Institute, and has been an Associate Editor of the Journal of the American Statistical Association, Journal of Official Statistics, and Survey Methodology. Jill A. Dever, PhD, is Senior Research Statistician at RTI International in Washington, DC. She is a Fellow of the American Statistical Association, Associate Editor for Survey Methodology and the Journal of Official Statistics, and an Assistant Research Professor in the Joint Program in Survey Methodology at the University of Maryland. She has served on several panels for the National Academy of Sciences and as a task force member for the American Association of Public Opinion Research’s report on nonprobability sampling. Frauke Kreuter, PhD, is Professor and Director of the Joint Program in Survey Methodology at the University of Maryland, Professor of Statistics and Methodology at the University of Mannheim, and Head of the Statistical Methods Research Department at the Institute for Employment Research (IAB) in Nürnberg, Germany. She is a Fellow of the American Statistical Association and has been Associate Editor of the Journal of the Royal Statistical Society, Journal of Official Statistics, Sociological Methods and Research, Survey Research Methods, Public Opinion Quarterly, American Sociological Review, and the Stata Journal. She is founder of the International Program for Survey and Data Science and co-founder of the Coleridge Initiative.

Encyclopedia of Survey Research Methods

Encyclopedia of Survey Research Methods
Author: Paul J. Lavrakas
Publisher: SAGE Publications
Total Pages: 1073
Release: 2008-09-12
Genre: Social Science
ISBN: 150631788X

To the uninformed, surveys appear to be an easy type of research to design and conduct, but when students and professionals delve deeper, they encounter the vast complexities that the range and practice of survey methods present. To complicate matters, technology has rapidly affected the way surveys can be conducted; today, surveys are conducted via cell phone, the Internet, email, interactive voice response, and other technology-based modes. Thus, students, researchers, and professionals need both a comprehensive understanding of these complexities and a revised set of tools to meet the challenges. In conjunction with top survey researchers around the world and with Nielsen Media Research serving as the corporate sponsor, the Encyclopedia of Survey Research Methods presents state-of-the-art information and methodological examples from the field of survey research. Although there are other "how-to" guides and references texts on survey research, none is as comprehensive as this Encyclopedia, and none presents the material in such a focused and approachable manner. With more than 600 entries, this resource uses a Total Survey Error perspective that considers all aspects of possible survey error from a cost-benefit standpoint. Key Features Covers all major facets of survey research methodology, from selecting the sample design and the sampling frame, designing and pretesting the questionnaire, data collection, and data coding, to the thorny issues surrounding diminishing response rates, confidentiality, privacy, informed consent and other ethical issues, data weighting, and data analyses Presents a Reader′s Guide to organize entries around themes or specific topics and easily guide users to areas of interest Offers cross-referenced terms, a brief listing of Further Readings, and stable Web site URLs following most entries The Encyclopedia of Survey Research Methods is specifically written to appeal to beginning, intermediate, and advanced students, practitioners, researchers, consultants, and consumers of survey-based information.

Survey Nonresponse

Survey Nonresponse
Author: Robert M. Groves
Publisher: Wiley-Interscience
Total Pages: 528
Release: 2002
Genre: Business & Economics
ISBN:

This volume offers coverage of research in the field of survey nonresponse, the primary threat to the statistical integrity of surveys. This book was written in conjunction with the International Conference on Survey Nonresponse, October 1999.

Population-Based Survey Experiments

Population-Based Survey Experiments
Author: Diana C. Mutz
Publisher: Princeton University Press
Total Pages: 194
Release: 2011-07-05
Genre: Social Science
ISBN: 1400840481

Population-based survey experiments have become an invaluable tool for social scientists struggling to generalize laboratory-based results, and for survey researchers besieged by uncertainties about causality. Thanks to technological advances in recent years, experiments can now be administered to random samples of the population to which a theory applies. Yet until now, there was no self-contained resource for social scientists seeking a concise and accessible overview of this methodology, its strengths and weaknesses, and the unique challenges it poses for implementation and analysis. Drawing on examples from across the social sciences, this book covers everything you need to know to plan, implement, and analyze the results of population-based survey experiments. But it is more than just a "how to" manual. This lively book challenges conventional wisdom about internal and external validity, showing why strong causal claims need not come at the expense of external validity, and how it is now possible to execute experiments remotely using large-scale population samples. Designed for social scientists across the disciplines, Population-Based Survey Experiments provides the first complete introduction to this methodology. Offers the most comprehensive treatment of the subject Features a wealth of examples and practical advice Reexamines issues of internal and external validity Can be used in conjunction with downloadable data from ExperimentCentral.org for design and analysis exercises in the classroom

Survey Weights

Survey Weights
Author: Richard Valliant
Publisher:
Total Pages: 183
Release: 2018
Genre: Population
ISBN: 9781597182607

Survey Weights: A Step-by-Step Guide to Calculation is the first guide geared toward Stata users that systematically covers the major steps taken in creating survey weights. These weights are used to project a sample to some larger population and can be computed for either probability or nonprobability samples. Sample designs can range from simple, single-stage samples to more complex, multistage samples, each of which may use specialized steps in weighting to account for selection probabilities, nonresponse, inaccurate coverage of a population by a sample, and auxiliary data to improve precision and compensate for coverage errors. The authors provide many examples with Stata code.

Handbook of Nonresponse in Household Surveys

Handbook of Nonresponse in Household Surveys
Author: Jelke Bethlehem
Publisher: John Wiley & Sons
Total Pages: 384
Release: 2011-04-27
Genre: Mathematics
ISBN: 1118102223

A comprehensive, one-stop guide to identifying, reducing, and managing nonresponse in household surveys Nonresponse and its impact on the sample selection mechanism of a survey is a common problem that often arises while collecting survey data. Handbook of Nonresponse in Household Surveys is a complete guide to handling the nonresponse problem, outlining statistical methods and techniques for improving response rates and correcting response data. The authors begin with an introduction to the nonresponse problem along with basic concepts and definitions. Subsequent chapters present current theories and methods that enable survey researchers to skillfully account for nonresponse in their research. Exploring the latest developments in the field, the book also features: An introduction to the R-indicator as an indicator of survey quality Discussion of the different causes of nonresponse Extensive treatment of the selection and use of auxiliary information Best practices for re-approaching nonrespondents An overview of advanced nonresponse correction techniques Coverage of adaptive survey design Throughout the book, the treatment of each topic is presented in a uniform fashion. Following an introduction, each chapter presents the key theories and formulas underlying the topic and then illustrates common applications. Discussion concludes with a summary of the main concepts as well as a glossary of key terms and a set of exercises that allows readers to test their comprehension of the presented material. Examples using real survey data are provided, and a related website features additional data sets, which can be easily analyzed using Stata® or SPSS® software. Handbook of Nonresponse in Household Surveys is an essential reference for survey researchers working in the fields of business, economics, government, and the social sciences who gather, analyze, and draw results from data. It is also a suitable supplement for courses on survey methods at the upper-undergraduate and graduate levels.

Applied Survey Methods

Applied Survey Methods
Author: Jelke Bethlehem
Publisher: John Wiley & Sons
Total Pages: 394
Release: 2009-05-20
Genre: Mathematics
ISBN: 0470494980

A complete, hands-on guide to the use of statistical methods for obtaining reliable and practical survey research Applied Survey Methods provides a comprehensive outline of the complete survey process, from design to publication. Filling a gap in the current literature, this one-of-a-kind book describes both the theory and practical applications of survey research with an emphasis on the statistical aspects of survey methods. The book begins with a brief historic overview of survey research methods followed by a discussion that details the needed first steps for carrying out a survey, including the definition of a target population, the selection of a sampling frame, and the outline of a questionnaire with several examples that include common errors to avoid in the wording of questions. Throughout the book, the author provides an accessible discussion on the methodological problems that are associated with the survey process, outlining real data and examples while also providing insight on the future of survey research. Chapter coverage explores the various aspects of the survey process and the accompanying numerical techniques, including: Simple and composite sampling designs Estimators Data collection and editing The quality of results The non-response problem Weighting adjustments and methods Disclosure control The final chapter addresses the growing popularity of Web surveys, and the associated methodological problems are discussed, including solutions to common pitfalls. Exercises are provided throughout with selected answers included at the end of the book, while a related Web site features additional solutions to exercises and a downloadable demo version of the Blaise system of computer-assisted interviewing. Access to the freely available SimSam software is also available on the related Web site and provides readers with the tools needed to simulate samples from finite populations as well as visualize the effects of sample size, non-response, and the use of different estimation procedures. Applied Survey Methods is an excellent book for courses on survey research and non-response in surveys at the upper-undergraduate and graduate levels. It is also a useful reference for practicing statisticians and survey methodologists who work in both government and private research sectors.

Non-response Adjustment In Survey Sampling Using Auxiliary Information

Non-response Adjustment In Survey Sampling Using Auxiliary Information
Author: Monika Devi
Publisher: LAP Lambert Academic Publishing
Total Pages: 60
Release: 2015-09-02
Genre:
ISBN: 9783659777486

Non-response is a source of error in surveys that appears when part of the data to be collected are not observed. It has the potential to bias significantly the results of the survey and, consequently, to prevent valid inference.Non-response reduces the sample size, and therefore increases the variance of estimators, leading to larger margins of error.A more serious effect of non-response is that it can be selective. This occurs if, due to non-response, specific groups are under- or over-represented in the survey. To say it in other word: estimates are significantly too high or too low.There are statistical procedures to overcome non-response bias using auxiliary information.In this book, some estimators have been proposed for the estimation of population mean using auxiliary information under non-response. The relative efficiencies of proposed estimators are illustrated with two real populations.