Test Validity

Test Validity
Author: Howard Wainer
Publisher: Routledge
Total Pages: 289
Release: 2013-07-04
Genre: Education
ISBN: 1136564527

Technological and theoretical changes over the past decade have altered the way we think about test validity. This book addresses the present and future concerns raised by these developments. Topics discussed include: * the validity of computerized testing * the validity of testing for specialized populations (e.g., minorities, the handicapped) and * new analytic tools to study and measure validity

Frontiers of Test Validity Theory

Frontiers of Test Validity Theory
Author: Keith A. Markus
Publisher: Routledge
Total Pages: 360
Release: 2013-06-19
Genre: Psychology
ISBN: 1135055866

This book examines test validity in the behavioral, social, and educational sciences by exploring three fundamental problems: measurement, causation and meaning. Psychometric and philosophical perspectives receive attention along with unresolved issues. The authors explore how measurement is conceived from both the classical and modern perspectives. The importance of understanding the underlying concepts as well as the practical challenges of test construction and use receive emphasis throughout. The book summarizes the current state of the test validity theory field. Necessary background on test theory and statistics is presented as a conceptual overview where needed. Each chapter begins with an overview of key material reviewed in previous chapters, concludes with a list of suggested readings, and features boxes with examples that connect theory to practice. These examples reflect actual situations that occurred in psychology, education, and other disciplines in the US and around the globe, bringing theory to life. Critical thinking questions related to the boxed material engage and challenge readers. A few examples include: What is the difference between intelligence and IQ? Can people disagree on issues of value but agree on issues of test validity? Is it possible to ask the same question in two different languages? The first part of the book contrasts theories of measurement as applied to the validity of behavioral science measures.The next part considers causal theories of measurement in relation to alternatives such as behavior domain sampling, and then unpacks the causal approach in terms of alternative theories of causation.The final section explores the meaning and interpretation of test scores as it applies to test validity. Each set of chapters opens with a review of the key theories and literature and concludes with a review of related open questions in test validity theory. Researchers, practitioners and policy makers interested in test validity or developing tests appreciate the book's cutting edge review of test validity. The book also serves as a supplement in graduate or advanced undergraduate courses on test validity, psychometrics, testing or measurement taught in psychology, education, sociology, social work, political science, business, criminal justice and other fields. The book does not assume a background in measurement.

Validity

Validity
Author: Gregory J. Cizek
Publisher: Taylor & Francis
Total Pages: 207
Release: 2020-02-25
Genre: Education
ISBN: 1000039692

Validity is a clear, substantive introduction to the two most fundamental aspects of defensible testing practice: understanding test score meaning and justifying test score use. Driven by evidence-based and consensus-grounded measurement theory, principles, and terminology, this book addresses the most common questions of applied validation, the quality of test information, and the usefulness of test results. Concise yet comprehensive, this volume’s integrated framework is ideal for graduate courses on assessment, testing, psychometrics, and research methods as well as for credentialing organizations, licensure and certification entities, education agencies, and test publishers.

Validity Argument in Language Testing

Validity Argument in Language Testing
Author: Carol A. Chapelle
Publisher: Cambridge University Press
Total Pages: 371
Release: 2021-01-21
Genre: Language Arts & Disciplines
ISBN: 110860238X

Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.

Building a Validity Argument for the Test of English as a Foreign LanguageTM

Building a Validity Argument for the Test of English as a Foreign LanguageTM
Author: Carol A. Chapelle
Publisher: Routledge
Total Pages: 437
Release: 2011-04-06
Genre: Education
ISBN: 1135602859

The Test of English as a Foreign Language TM (TOEFL®) is used by more universities worldwide than any other test to assess English language proficiency for academic admission and placement decisions, and to guide English language instruction. This landmark volume provides a detailed description and analysis of Educational Testing Service’s research and development efforts to develop a major revision of the TOEFL® test. The result is a book that serves as a case study of test design drawing upon theory in the complex domain of English language proficiency while attempting to meet standards of educational measurement. Building a Validity Argument for the Test of English as a Foreign LanguageTM is distinctive in its attempt to develop a coherent story of the rationale for a test or its revision, explain the research and development process, and provide the results of the validation process. Through its treatment of one test, it expands on and tests principles and approaches to educational measurement, providing an in-depth, integrated perspective on the overall process of test revision. Moreover, because the conceptual foundation and history are presented alongside the empirical studies and validity argument, these sometimes disparate areas are presented in a way that demonstrates their connections – an approach which represents a departure from, or extension of, conventional materials on test revision. This volume is particularly relevant for professionals and graduate students in educational measurement, applied linguistics, and second language acquisition as well as anyone interested in assessment issues.

Psychological Testing in the Service of Disability Determination

Psychological Testing in the Service of Disability Determination
Author: Institute of Medicine
Publisher: National Academies Press
Total Pages: 233
Release: 2015-06-29
Genre: Medical
ISBN: 0309370930

The United States Social Security Administration (SSA) administers two disability programs: Social Security Disability Insurance (SSDI), for disabled individuals, and their dependent family members, who have worked and contributed to the Social Security trust funds, and Supplemental Security Income (SSSI), which is a means-tested program based on income and financial assets for adults aged 65 years or older and disabled adults and children. Both programs require that claimants have a disability and meet specific medical criteria in order to qualify for benefits. SSA establishes the presence of a medically-determined impairment in individuals with mental disorders other than intellectual disability through the use of standard diagnostic criteria, which include symptoms and signs. These impairments are established largely on reports of signs and symptoms of impairment and functional limitation. Psychological Testing in the Service of Disability Determination considers the use of psychological tests in evaluating disability claims submitted to the SSA. This report critically reviews selected psychological tests, including symptom validity tests, that could contribute to SSA disability determinations. The report discusses the possible uses of such tests and their contribution to disability determinations. Psychological Testing in the Service of Disability Determination discusses testing norms, qualifications for administration of tests, administration of tests, and reporting results. The recommendations of this report will help SSA improve the consistency and accuracy of disability determination in certain cases.

Advancing Human Assessment

Advancing Human Assessment
Author: Randy E. Bennett
Publisher: Springer
Total Pages: 717
Release: 2017-10-17
Genre: Education
ISBN: 3319586890

This book is open access under a CC BY-NC 2.5 license.​​ This book describes the extensive contributions made toward the advancement of human assessment by scientists from one of the world’s leading research institutions, Educational Testing Service. The book’s four major sections detail research and development in measurement and statistics, education policy analysis and evaluation, scientific psychology, and validity. Many of the developments presented have become de-facto standards in educational and psychological measurement, including in item response theory (IRT), linking and equating, differential item functioning (DIF), and educational surveys like the National Assessment of Educational Progress (NAEP), the Programme of international Student Assessment (PISA), the Progress of International Reading Literacy Study (PIRLS) and the Trends in Mathematics and Science Study (TIMSS). In addition to its comprehensive coverage of contributions to the theory and methodology of educational and psychological measurement and statistics, the book gives significant attention to ETS work in cognitive, personality, developmental, and social psychology, and to education policy analysis and program evaluation. The chapter authors are long-standing experts who provide broad coverage and thoughtful insights that build upon decades of experience in research and best practices for measurement, evaluation, scientific psychology, and education policy analysis. Opening with a chapter on the genesis of ETS and closing with a synthesis of the enormously diverse set of contributions made over its 70-year history, the book is a useful resource for all interested in the improvement of human assessment.

Language Testing and Validation

Language Testing and Validation
Author: C. Weir
Publisher: Springer
Total Pages: 309
Release: 2004-11-22
Genre: Education
ISBN: 023051457X

Tests for the measurement of language abilities must be constructed according to a coherent validity framework based on the latest developments in theory and practice. This innovative book, by a world authority on language testing, deals with all key aspects of language test design and implementation. It provides a road map to effective testing based on the latest approaches to test validation. A book for all MA students in Applied Linguistics or TESOL, and for professional language teachers

Adverse Impact and Test Validation

Adverse Impact and Test Validation
Author: Dan Biddle
Publisher: Routledge
Total Pages: 153
Release: 2017-05-15
Genre: Business & Economics
ISBN: 135196061X

Adverse impact analyses and test validation promote social justice and equity. Employers who unknowingly use invalid tests or recruitment procedures that have an adverse impact are reducing minority and/or female representation in their workforce, unfairly screening out qualified workers and (worst of all) just plain discriminating. Dan Biddle's Adverse Impact and Test Validation provides you with analyses that allow you to identify which of your selection procedures have adverse impact. The validation steps will help you decide whether to keep the selection procedure (because it's valid), change it, or stop using it altogether. This second edition contains new material on using multiple regression to evaluate pay practices and provides step-by-step instructions for using SPSS or Excel for evaluating your company's pay practices for possible inequities. New content on how to define "Internet applicants" and set up defensible Basic Qualifications (BQs) for online recruiting will help employers ensure compliance with EEO regulations and screen in qualified applicants. Specific guidelines for developing and validating written job knowledge tests, such as those used for police and fire promotional testing, have also been included in this new edition. The downloadable resources include tools (which may be used on a trial evaluation basis) describing several of the functions described in the book, including Adverse Impact Toolkit®, Test Validation and Analysis Program® (TVAP®), Guidelines Oriented Job Analysis® (GOJA®) Manual, and Content Validity Checklists. This highly pragmatic guide goes beyond the concepts, theories and ideas behind adverse impact and test validation. It not only explains what to do but crucially, also shows you how to do it. The second edition has been expanded to include two brand new chapters with a new Appendix and comes with new editions of the accompanying software. As a means of protecting your organization from litigation, damage to employee relations and to your corporate reputation, Adverse Impact and Test Validation is a 'must-have' purchase for human resource professionals, testing and recruitment specialists.

Building a Validity Argument for a Listening Test of Academic Proficiency

Building a Validity Argument for a Listening Test of Academic Proficiency
Author: Vahid Aryadoust
Publisher: Cambridge Scholars Publishing
Total Pages: 325
Release: 2013-07-26
Genre: Foreign Language Study
ISBN: 1443850934

Over the years, various approaches to validation have emerged in psychological and educational assessment research, which can be classified into traditional approaches and modern approaches. Traditional approaches view validity as a multicomponential concept including, for example, content, construct, and predictive validity, while modern approaches conceptualize it as a unitary concept evaluated through argumentation. Drawing on the modern approach, this book builds a validity argument for an International English Language Testing System (IELTS) listening test sample. The book provides some insights into the listening sub-skills that the test engages, the psychometric dimensionality of the test, variables that predict item difficulty parameters, bias across age, nationality, test experience, and gender, as well as predictive-referenced evidence of validity. A variety of techniques including the Rasch model and structural equation modelling are used to answer the research questions and to build a validity argument framework; this argument organizes the thematically related findings into a coherent treatment of the validity of the listening test. The book presents the first treatment of validity argument and related analytical tools in one volume and maps the psychometric/statistical analysis tools onto the validity argument framework. It also provides an extensive literature review of listening comprehension, validation, and psychometric modeling and proposes both methods for developing and validating self-assessment instruments and novel approaches to improving the quality of language assessments.