Introduction to Many-Facet Rasch Measurement

Introduction to Many-Facet Rasch Measurement
Author: Thomas Eckes
Publisher: Peter Lang Copyright AG - Ipsuk
Total Pages: 0
Release: 2023-04-28
Genre:
ISBN: 9783631903049

Human ratings are subject to various forms of error and bias. Since the early days of performance assessment, this problem has been sizeable and persistent. For example, expert raters evaluating the quality of an essay, an oral communication, or a work sample, often come up with different ratings for the very same performance. In cases like this, assessment outcomes largely depend upon which raters happen to provide the rating, posing a threat to the validity and fairness of the assessment. This book provides an introduction to a psychometric approach that establishes a coherent framework for drawing reliable, valid, and fair inferences from rater-mediated assessments, thus answering the problem of inevitably fallible human ratings: many-facet Rasch measurement (MFRM). Throughout the book, sample data taken from a writing performance assessment are used to illustrate key concepts, theoretical foundations, and analytic procedures, stimulating the readers to adopt the MFRM approach in their current or future professional context.

Rasch Measurement Theory Analysis in R

Rasch Measurement Theory Analysis in R
Author: Stefanie Wind
Publisher: CRC Press
Total Pages: 327
Release: 2022-06-07
Genre: Mathematics
ISBN: 1000587762

Rasch Measurement Theory Analysis in R provides researchers and practitioners with a step-by-step guide for conducting Rasch measurement theory analyses using R. It includes theoretical introductions to major Rasch measurement principles and techniques, demonstrations of analyses using several R packages that contain Rasch measurement functions, and sample interpretations of results. Features: Accessible to users with relatively little experience with R programming Reproducible data analysis examples that can be modified to accommodate users’ own data Accompanying e-book website with links to additional resources and R code updates as needed Features dichotomous and polytomous (rating scale) Rasch models that can be applied to data from a wide range of disciplines This book is designed for graduate students, researchers, and practitioners across the social, health, and behavioral sciences who have a basic familiarity with Rasch measurement theory and with R. Readers will learn how to use existing R packages to conduct a variety of analyses related to Rasch measurement theory, including evaluating data for adherence to measurement requirements, applying the dichotomous, Rating Scale, Partial Credit, and Many-Facet Rasch models, examining data for evidence of differential item functioning, and considering potential interpretations of results from such analyses.

Fairness, Justice and Language Assessment

Fairness, Justice and Language Assessment
Author: Tim McNamara
Publisher: Oxford University Press
Total Pages: 272
Release: 2019-02-21
Genre: Study Aids
ISBN: 0194016943

This book has two goals, each related to the validity of language assessment. The first goal is to explore the difference between fairness and justice in language assessment. The authors distinguish internal and external dimensions of the equitable and just treatment of individuals taking language tests which are used as gatekeeping devices to determine access to education and employment, immigrant status, citizenship, and other rights. The second goal is to show how the extent of test fairness can be demonstrated and improved using the tools of psychometrics, in particular the models collectively known as Rasch measurement. “This book will have an enormous impact on the field of language assessment. Using Rasch analysis models to explore and identify sources of unfairness, the authors make a compelling case for fairness in the design and implementation of language assessment instruments and for justice in the interpretation and use of test results. A real strength of the book is that it guides readers through analytical techniques in an accessible way.” Dan Douglas, Professor Emeritus, Applied Linguistics Program, Iowa State University.

Applying the Rasch Model

Applying the Rasch Model
Author: Trevor G. Bond
Publisher: Psychology Press
Total Pages: 358
Release: 2013-11-05
Genre: Education
ISBN: 1135602646

Written in an accessible style, this book facilitates a deep understanding of the Rasch model. Authors Bond and Fox review the crucial properties of the Rasch model and demonstrate its use with a wide range of examples including the measurement of educational achievement, human development, attitudes, and medical rehabilitation. A glossary and numerous illustrations further aid the reader's understanding. The authors demonstrate how to apply Rasch analysis and prepare readers to perform their own analyses and interpret the results. Updated throughout, highlights of the Second Edition include: a new CD that features an introductory version of the latest Winsteps program and the data files for the book’s examples, preprogrammed to run using Winsteps; a new chapter on invariance that highlights the parallels between physical and human science measurement; a new appendix on analyzing data to help those new to Rasch analysis; more explanation of the key concepts and item characteristic curves; a new empirical example with data sets demonstrates the many facets of the Rasch model and other new examples; and an increased focus on issues related to unidimensionality, multidimensionality, and the Rasch factor analysis of residuals. Applying the Rasch Model is intended for researchers and practitioners in psychology, especially developmental psychologists, education, health care, medical rehabilitation, business, government, and those interested in measuring attitude, ability, and/or performance. The book is an excellent text for use in courses on advanced research methods, measurement, or quantitative analysis. Significant knowledge of statistics is not required.

Psychometrics

Psychometrics
Author: R. Michael Furr
Publisher: SAGE Publications
Total Pages: 681
Release: 2017-11-17
Genre: Psychology
ISBN: 1506339875

Using a meaning-based approach that emphasizes the “why” over the “how to,” Psychometrics: An Introduction provides thorough coverage of fundamental issues in psychological measurement. Author R. Michael Furr discusses traditional psychometric perspectives and issues including reliability, validity, dimensionality, test bias, and response bias as well as advanced procedures and perspectives including item response theory and generalizability theory. The substantially updated Third Edition includes broader and more in-depth coverage with new references, a glossary summarizing over 200 key terms, and expanded suggested readings consisting of highly relevant papers to enhance the book’s overall accessibility, scope, and usability.

A Course in Rasch Measurement Theory

A Course in Rasch Measurement Theory
Author: David Andrich
Publisher: Springer
Total Pages: 478
Release: 2019-07-15
Genre: Education
ISBN: 9811374961

This book applies Rasch measurement theory to the fields of education, psychology, sociology, marketing and health outcomes in order to measure various social constructs. The chief focus is on first principles of both the theory and its applications. Because software is readily available to carry out analyses of real data, numerous small examples are provided in the book. The software used in these examples, and which is helpful in working through the text, is RUMM2030 (Rasch unidimensional models for measurement). The book’s main goals are to equip researchers with the confidence they need in order to be in control of the analysis and interpretation of data, and to make professional rather than primarily statistical decisions mechanically. Because statistical principles are necessarily involved, reviews of the requisite statistics are provided in the Appendix. The content is based on courses that have been taught both online and in intensive form for over two decades. Although first principles are emphasised, much of the book is based on research conducted by the two authors and their colleagues.

Best Practices in Quantitative Methods

Best Practices in Quantitative Methods
Author: Jason W. Osborne
Publisher: SAGE
Total Pages: 609
Release: 2008
Genre: Social Science
ISBN: 1412940656

The contributors to Best Practices in Quantitative Methods envision quantitative methods in the 21st century, identify the best practices, and, where possible, demonstrate the superiority of their recommendations empirically. Editor Jason W. Osborne designed this book with the goal of providing readers with the most effective, evidence-based, modern quantitative methods and quantitative data analysis across the social and behavioral sciences. The text is divided into five main sections covering select best practices in Measurement, Research Design, Basics of Data Analysis, Quantitative Methods, and Advanced Quantitative Methods. Each chapter contains a current and expansive review of the literature, a case for best practices in terms of method, outcomes, inferences, etc., and broad-ranging examples along with any empirical evidence to show why certain techniques are better. Key Features: Describes important implicit knowledge to readers: The chapters in this volume explain the important details of seemingly mundane aspects of quantitative research, making them accessible to readers and demonstrating why it is important to pay attention to these details. Compares and contrasts analytic techniques: The book examines instances where there are multiple options for doing things, and make recommendations as to what is the "best" choice—or choices, as what is best often depends on the circumstances. Offers new procedures to update and explicate traditional techniques: The featured scholars present and explain new options for data analysis, discussing the advantages and disadvantages of the new procedures in depth, describing how to perform them, and demonstrating their use. Intended Audience: Representing the vanguard of research methods for the 21st century, this book is an invaluable resource for graduate students and researchers who want a comprehensive, authoritative resource for practical and sound advice from leading experts in quantitative methods.

Constructing Measures

Constructing Measures
Author: Mark Wilson
Publisher: Routledge
Total Pages: 236
Release: 2004-12-13
Genre: Education
ISBN: 1135618046

Constructing Measures introduces a way to understand the advantages and disadvantages of measurement instruments, how to use such instruments, and how to apply these methods to develop new instruments or adapt old ones. The book is organized around the steps taken while constructing an instrument. It opens with a summary of the constructive steps involved. Each step is then expanded on in the next four chapters. These chapters develop the "building blocks" that make up an instrument--the construct map, the design plan for the items, the outcome space, and the statistical measurement model. The next three chapters focus on quality control. They rely heavily on the calibrated construct map and review how to check if scores are operating consistently and how to evaluate the reliability and validity evidence. The book introduces a variety of item formats, including multiple-choice, open-ended, and performance items; projects; portfolios; Likert and Guttman items; behavioral observations; and interview protocols. Each chapter includes an overview of the key concepts, related resources for further investigation and exercises and activities. Some chapters feature appendices that describe parts of the instrument development process in more detail, numerical manipulations used in the text, and/or data results. A variety of examples from the behavioral and social sciences and education including achievement and performance testing; attitude measures; health measures, and general sociological scales, demonstrate the application of the material. An accompanying downloadable resources feature control files, output, and a data set to allow readers to compute the text's exercises and create new analyses and case archives based on the book's examples so the reader can work through the entire development of an instrument. Constructing Measures is an ideal text or supplement in courses on item, test, or instrument development, measurement, item response theory, or rasch analysis taught in a variety of departments including education and psychology. The book also appeals to those who develop instruments, including industrial/organizational, educational, and school psychologists, health outcomes researchers, program evaluators, and sociological measurers. Knowledge of basic descriptive statistics and elementary regression is recommended.