Reproducibility and Replicability in Science

Reproducibility and Replicability in Science
Author: National Academies of Sciences, Engineering, and Medicine
Publisher: National Academies Press
Total Pages: 257
Release: 2019-10-20
Genre: Science
ISBN: 0309486165

One of the pathways by which the scientific community confirms the validity of a new scientific discovery is by repeating the research that produced it. When a scientific effort fails to independently confirm the computations or results of a previous study, some fear that it may be a symptom of a lack of rigor in science, while others argue that such an observed inconsistency can be an important precursor to new discovery. Concerns about reproducibility and replicability have been expressed in both scientific and popular media. As these concerns came to light, Congress requested that the National Academies of Sciences, Engineering, and Medicine conduct a study to assess the extent of issues related to reproducibility and replicability and to offer recommendations for improving rigor and transparency in scientific research. Reproducibility and Replicability in Science defines reproducibility and replicability and examines the factors that may lead to non-reproducibility and non-replicability in research. Unlike the typical expectation of reproducibility between two computations, expectations about replicability are more nuanced, and in some cases a lack of replicability can aid the process of scientific discovery. This report provides recommendations to researchers, academic institutions, journals, and funders on steps they can take to improve reproducibility and replicability in science.

Biophysical Measurement in Experimental Social Science Research

Biophysical Measurement in Experimental Social Science Research
Author: Gigi Foster
Publisher: Academic Press
Total Pages: 362
Release: 2019-02-08
Genre: Business & Economics
ISBN: 0128130938

Biophysical Measurement in Experimental Social Science Research is an ideal primer for the experimental social scientist wishing to update their knowledge and skillset in the area of laboratory-based biophysical measurement. Many behavioral laboratories across the globe have acquired increasingly sophisticated biophysical measurement equipment, sometimes for particular research projects or for financial or institutional reasons. Yet the expertise required to use this technology and integrate the measures it can generate on human subjects into successful social science research endeavors is often scarce and concentrated amongst a small minority of researchers. This book aims to open the door to wider and more productive use of biophysical measurement in laboratory-based experimental social science research. Suitable for doctoral students through to established researchers, the volume presents examples of the successful integration of biophysical measures into analyses of human behavior, discussions of the academic and practical limitations of laboratory-based biophysical measurement, and hands-on guidance about how different biophysical measurement devices are used. A foreword and concluding chapters comprehensively synthesize and compare biophysical measurement options, address academic, ethical and practical matters, and address the broader historical and scientific context. Research chapters demonstrate the academic potential of biophysical measurement ranging fully across galvanic skin response, heart rate monitoring, eye tracking and direct neurological measurements. An extended Appendix showcases specific examples of device adoption in experimental social science lab settings. - Demonstrates the strengths and limitations of different tools, in terms of both research objectives and practicality - Provides hands-on guidance for device usage and data integration and assessment - Compares and contrasts the use of different biophysical data options for different research objectives and in different disciplines

Measuring Racial Discrimination

Measuring Racial Discrimination
Author: National Research Council
Publisher: National Academies Press
Total Pages: 335
Release: 2004-07-24
Genre: Social Science
ISBN: 0309091268

Many racial and ethnic groups in the United States, including blacks, Hispanics, Asians, American Indians, and others, have historically faced severe discriminationâ€"pervasive and open denial of civil, social, political, educational, and economic opportunities. Today, large differences among racial and ethnic groups continue to exist in employment, income and wealth, housing, education, criminal justice, health, and other areas. While many factors may contribute to such differences, their size and extent suggest that various forms of discriminatory treatment persist in U.S. society and serve to undercut the achievement of equal opportunity. Measuring Racial Discrimination considers the definition of race and racial discrimination, reviews the existing techniques used to measure racial discrimination, and identifies new tools and areas for future research. The book conducts a thorough evaluation of current methodologies for a wide range of circumstances in which racial discrimination may occur, and makes recommendations on how to better assess the presence and effects of discrimination.

Advances in Experimental Political Science

Advances in Experimental Political Science
Author: James N. Druckman
Publisher: Cambridge University Press
Total Pages: 671
Release: 2021-04
Genre: Political Science
ISBN: 1108478506

Novel collection of essays addressing contemporary trends in political science, covering a broad array of methodological and substantive topics.

Experimental and Quasi-Experimental Designs for Research

Experimental and Quasi-Experimental Designs for Research
Author: Donald T. Campbell
Publisher: Ravenio Books
Total Pages: 172
Release: 2015-09-03
Genre: Psychology
ISBN:

We shall examine the validity of 16 experimental designs against 12 common threats to valid inference. By experiment we refer to that portion of research in which variables are manipulated and their effects upon other variables observed. It is well to distinguish the particular role of this chapter. It is not a chapter on experimental design in the Fisher (1925, 1935) tradition, in which an experimenter having complete mastery can schedule treatments and measurements for optimal statistical efficiency, with complexity of design emerging only from that goal of efficiency. Insofar as the designs discussed in the present chapter become complex, it is because of the intransigency of the environment: because, that is, of the experimenter’s lack of complete control.

Developing a Protocol for Observational Comparative Effectiveness Research: A User's Guide

Developing a Protocol for Observational Comparative Effectiveness Research: A User's Guide
Author: Agency for Health Care Research and Quality (U.S.)
Publisher: Government Printing Office
Total Pages: 236
Release: 2013-02-21
Genre: Medical
ISBN: 1587634236

This User’s Guide is a resource for investigators and stakeholders who develop and review observational comparative effectiveness research protocols. It explains how to (1) identify key considerations and best practices for research design; (2) build a protocol based on these standards and best practices; and (3) judge the adequacy and completeness of a protocol. Eleven chapters cover all aspects of research design, including: developing study objectives, defining and refining study questions, addressing the heterogeneity of treatment effect, characterizing exposure, selecting a comparator, defining and measuring outcomes, and identifying optimal data sources. Checklists of guidance and key considerations for protocols are provided at the end of each chapter. The User’s Guide was created by researchers affiliated with AHRQ’s Effective Health Care Program, particularly those who participated in AHRQ’s DEcIDE (Developing Evidence to Inform Decisions About Effectiveness) program. Chapters were subject to multiple internal and external independent reviews. More more information, please consult the Agency website: www.effectivehealthcare.ahrq.gov)

Introductory Business Statistics 2e

Introductory Business Statistics 2e
Author: Alexander Holmes
Publisher:
Total Pages: 1801
Release: 2023-12-13
Genre: Business & Economics
ISBN:

Introductory Business Statistics 2e aligns with the topics and objectives of the typical one-semester statistics course for business, economics, and related majors. The text provides detailed and supportive explanations and extensive step-by-step walkthroughs. The author places a significant emphasis on the development and practical application of formulas so that students have a deeper understanding of their interpretation and application of data. Problems and exercises are largely centered on business topics, though other applications are provided in order to increase relevance and showcase the critical role of statistics in a number of fields and real-world contexts. The second edition retains the organization of the original text. Based on extensive feedback from adopters and students, the revision focused on improving currency and relevance, particularly in examples and problems. This is an adaptation of Introductory Business Statistics 2e by OpenStax. You can access the textbook as pdf for free at openstax.org. Minor editorial changes were made to ensure a better ebook reading experience. Textbook content produced by OpenStax is licensed under a Creative Commons Attribution 4.0 International License.

Design and Analysis of Clinical Experiments

Design and Analysis of Clinical Experiments
Author: Joseph L. Fleiss
Publisher: John Wiley & Sons
Total Pages: 458
Release: 2011-01-25
Genre: Mathematics
ISBN: 1118031172

First published in 1986, this unique reference to clinical experimentation remains just as relevant today. Focusing on the principles of design and analysis of studies on human subjects, this book utilizes and integrates both modern and classical designs. Coverage is limited to experimental comparisons of treatments, or in other words, clinical studies in which treatments are assigned to subjects at random.

Encyclopedia of Research Design

Encyclopedia of Research Design
Author: Neil J. Salkind
Publisher: SAGE
Total Pages: 1779
Release: 2010-06-22
Genre: Philosophy
ISBN: 1412961270

"Comprising more than 500 entries, the Encyclopedia of Research Design explains how to make decisions about research design, undertake research projects in an ethical manner, interpret and draw valid inferences from data, and evaluate experiment design strategies and results. Two additional features carry this encyclopedia far above other works in the field: bibliographic entries devoted to significant articles in the history of research design and reviews of contemporary tools, such as software and statistical procedures, used to analyze results. It covers the spectrum of research design strategies, from material presented in introductory classes to topics necessary in graduate research; it addresses cross- and multidisciplinary research needs, with many examples drawn from the social and behavioral sciences, neurosciences, and biomedical and life sciences; it provides summaries of advantages and disadvantages of often-used strategies; and it uses hundreds of sample tables, figures, and equations based on real-life cases."--Publisher's description.