Signal Detection Theory and ROC Analysis in Psychology and Diagnostics

Signal Detection Theory and ROC Analysis in Psychology and Diagnostics
Author: John A. Swets
Publisher: Psychology Press
Total Pages: 333
Release: 2014-02-25
Genre: Psychology
ISBN: 1317779711

Signal detection theory--as developed in electrical engineering and based on statistical decision theory--was first applied to human sensory discrimination 40 years ago. The theoretical intent was to provide a valid model of the discrimination process; the methodological intent was to provide reliable measures of discrimination acuity in specific sensory tasks. An analytic method of detection theory, called the relative operating characteristic (ROC), can isolate the effect of the placement of the decision criterion, which may be variable and idiosyncratic, so that a pure measure of intrinsic discrimination acuity is obtained. For the past 20 years, ROC analysis has also been used to measure the discrimination acuity or inherent accuracy of a broad range of practical diagnostic systems. It was widely adopted by methodologists in the field of information retrieval, is increasingly used in weather forecasting, and is the generally preferred method in clinical medicine, primarily in radiology. This book attends to both themes, ROC analysis in the psychology laboratory and in practical diagnostic settings, and to their essential unity. The focus of this book is on detection and recognition as fundamental tasks that underlie most complex behaviors. As defined here, they serve to distinguish between two alternative, confusable stimulus categories, which may be perceptual or cognitive categories in the psychology laboratory, or different states of the world in practical diagnostic tasks. This book on signal detection theory in psychology was written by one of the developers of the theory, who co-authored with D.M. Green the classic work published in this area in 1966 (reprinted in 1974 and 1988). This volume reviews the history of the theory in engineering, statistics, and psychology, leading to the separate measurement of the two independent factors in all discrimination tasks, discrimination acuity and decision criterion. It extends the previous book to show how in several areas of psychology--in vigilance and memory--what had been thought to be discrimination effects were, in reality, effects of a changing criterion. The book shows that data plotted in terms of the relative operating characteristic have essentially the same form across the wide range of discrimination tasks in psychology. It develops the implications of this ROC form for measures of discrimination acuity, pointing up the valid ones and identifying several common, but invalid, ones. The area under the binormal ROC is seen to be supported by the data; the popular measures d' and percent correct are not. An appendix describes the best, current programs for fitting ROCs and estimating their parameters, indices, and standard errors. The application of ROC analysis to diagnostic tasks is also described. Diagnostic accuracy in a wide range of tasks can be expressed in terms of the ROC area index. Choosing the appropriate decision criterion for a given diagnostic setting--rather than considering some single criterion to be natural and fixed--has a major impact on the efficacy of a diagnostic process or system. Illustrated here by separate chapters are diagnostic systems in radiology, information retrieval, aptitude testing, survey research, and environments in which imminent dangerous conditions must be detected. Data from weather forecasting, blood testing, and polygraph lie detection are also reported. One of these chapters describes a general approach to enhancing the accuracy of diagnostic systems.

The Cognitive Neuroscience of Metacognition

The Cognitive Neuroscience of Metacognition
Author: Stephen M. Fleming
Publisher: Springer Science & Business Media
Total Pages: 398
Release: 2014-01-31
Genre: Science
ISBN: 364245190X

Metacognition is the capacity to reflect upon and evaluate cognition and behaviour. Long of interest to philosophers and psychologists, metacognition has recently become the target of research in the cognitive neurosciences. By combining brain imaging, computational modeling, neuropsychology and insights from psychiatry, the present book offers a picture of the metacognitive functions of the brain. Chapters cover the definition and measurement of metacognition in humans and non-human animals, the computational underpinnings of metacognitive judgments the cognitive neuroscience of self-monitoring ranging from confidence to error-monitoring and neuropsychiatric studies of disorders of metacognition. This book provides an invaluable overview of a rapidly emerging and important field within cognitive neuroscience.

Signal Detection Theory and Psychophysics

Signal Detection Theory and Psychophysics
Author: David Marvin Green
Publisher: Peninsula Pub
Total Pages: 505
Release: 1988-01
Genre: Psychology
ISBN: 9780932146236

The book summarizes the application of signal detection theory to the analysis an measurement of humn observer's sensor sysem. The theory provides a way to analyze what had been called the threshold or sensory limen, the basic unit of all discrimination studies, whether human or animal. The book outlines the theory of statisical decision making and its application to a variety of common psychophysical processes. It shows how signal detection theory can be used to separate sensory and decision aspects of responses in dicrimination. The concepts of the ideal observer and energy detector are presented and compared with human auditory detection data. Signal detection theory is appliced to a variety of other substanditive problemsin sensory psychology. Signal Detection Theory and Psychology is an invaluable book for psychologists dealing with sensory perception, especailly auditory, for psychologists studying discrimination in other cognitivie processes, and for human factor engineers dealing with man/machine interfaces.

Detection Theory

Detection Theory
Author: Neil A. Macmillan
Publisher: Psychology Press
Total Pages: 599
Release: 2004-09-22
Genre: Psychology
ISBN: 1135634564

Detection Theory is an introduction to one of the most important tools for analysis of data where choices must be made and performance is not perfect. Originally developed for evaluation of electronic detection, detection theory was adopted by psychologists as a way to understand sensory decision making, then embraced by students of human memory. It has since been utilized in areas as diverse as animal behavior and X-ray diagnosis. This book covers the basic principles of detection theory, with separate initial chapters on measuring detection and evaluating decision criteria. Some other features include: *complete tools for application, including flowcharts, tables, pointers, and software; *student-friendly language; *complete coverage of content area, including both one-dimensional and multidimensional models; *separate, systematic coverage of sensitivity and response bias measurement; *integrated treatment of threshold and nonparametric approaches; *an organized, tutorial level introduction to multidimensional detection theory; *popular discrimination paradigms presented as applications of multidimensional detection theory; and *a new chapter on ideal observers and an updated chapter on adaptive threshold measurement. This up-to-date summary of signal detection theory is both a self-contained reference work for users and a readable text for graduate students and other researchers learning the material either in courses or on their own.

An Introduction to Signal Detection and Estimation

An Introduction to Signal Detection and Estimation
Author: H. Vincent Poor
Publisher: Springer Science & Business Media
Total Pages: 558
Release: 2013-06-29
Genre: Technology & Engineering
ISBN: 1475738633

The purpose of this book is to introduce the reader to the basic theory of signal detection and estimation. It is assumed that the reader has a working knowledge of applied probabil ity and random processes such as that taught in a typical first-semester graduate engineering course on these subjects. This material is covered, for example, in the book by Wong (1983) in this series. More advanced concepts in these areas are introduced where needed, primarily in Chapters VI and VII, where continuous-time problems are treated. This book is adapted from a one-semester, second-tier graduate course taught at the University of Illinois. However, this material can also be used for a shorter or first-tier course by restricting coverage to Chapters I through V, which for the most part can be read with a background of only the basics of applied probability, including random vectors and conditional expectations. Sufficient background for the latter option is given for exam pIe in the book by Thomas (1986), also in this series.

The Handbook of Medical Image Perception and Techniques

The Handbook of Medical Image Perception and Techniques
Author: Ehsan Samei
Publisher: Cambridge University Press
Total Pages: 1478
Release: 2018-12-13
Genre: Science
ISBN: 1108168817

A state-of-the-art review of key topics in medical image perception science and practice, including associated techniques, illustrations and examples. This second edition contains extensive updates and substantial new content. Written by key figures in the field, it covers a wide range of topics including signal detection, image interpretation and advanced image analysis (e.g. deep learning) techniques for interpretive and computational perception. It provides an overview of the key techniques of medical image perception and observer performance research, and includes examples and applications across clinical disciplines including radiology, pathology and oncology. A final chapter discusses the future prospects of medical image perception and assesses upcoming challenges and possibilities, enabling readers to identify new areas for research. Written for both newcomers to the field and experienced researchers and clinicians, this book provides a comprehensive reference for those interested in medical image perception as means to advance knowledge and improve human health.

Intelligence Analysis

Intelligence Analysis
Author: National Research Council
Publisher: National Academies Press
Total Pages: 352
Release: 2011-03-08
Genre: Social Science
ISBN: 0309210925

The U.S. intelligence community (IC) is a complex human enterprise whose success depends on how well the people in it perform their work. Although often aided by sophisticated technologies, these people ultimately rely on their own intellect to identify, synthesize, and communicate the information on which the nation's security depends. The IC's success depends on having trained, motivated, and thoughtful people working within organizations able to understand, value, and coordinate their capabilities. Intelligence Analysis provides up-to-date scientific guidance for the intelligence community (IC) so that it might improve individual and group judgments, communication between analysts, and analytic processes. The papers in this volume provide the detailed evidentiary base for the National Research Council's report, Intelligence Analysis for Tomorrow: Advances from the Behavioral and Social Sciences. The opening chapter focuses on the structure, missions, operations, and characteristics of the IC while the following 12 papers provide in-depth reviews of key topics in three areas: analytic methods, analysts, and organizations. Informed by the IC's unique missions and constraints, each paper documents the latest advancements of the relevant science and is a stand-alone resource for the IC's leadership and workforce. The collection allows readers to focus on one area of interest (analytic methods, analysts, or organizations) or even one particular aspect of a category. As a collection, the volume provides a broad perspective of the issues involved in making difficult decisions, which is at the heart of intelligence analysis.

Signal Detection Theory and ROC Analysis in Psychology and Diagnostics

Signal Detection Theory and ROC Analysis in Psychology and Diagnostics
Author: John A. Swets
Publisher: Psychology Press
Total Pages: 325
Release: 2014-02-25
Genre: Psychology
ISBN: 131777972X

Signal detection theory--as developed in electrical engineering and based on statistical decision theory--was first applied to human sensory discrimination 40 years ago. The theoretical intent was to provide a valid model of the discrimination process; the methodological intent was to provide reliable measures of discrimination acuity in specific sensory tasks. An analytic method of detection theory, called the relative operating characteristic (ROC), can isolate the effect of the placement of the decision criterion, which may be variable and idiosyncratic, so that a pure measure of intrinsic discrimination acuity is obtained. For the past 20 years, ROC analysis has also been used to measure the discrimination acuity or inherent accuracy of a broad range of practical diagnostic systems. It was widely adopted by methodologists in the field of information retrieval, is increasingly used in weather forecasting, and is the generally preferred method in clinical medicine, primarily in radiology. This book attends to both themes, ROC analysis in the psychology laboratory and in practical diagnostic settings, and to their essential unity. The focus of this book is on detection and recognition as fundamental tasks that underlie most complex behaviors. As defined here, they serve to distinguish between two alternative, confusable stimulus categories, which may be perceptual or cognitive categories in the psychology laboratory, or different states of the world in practical diagnostic tasks. This book on signal detection theory in psychology was written by one of the developers of the theory, who co-authored with D.M. Green the classic work published in this area in 1966 (reprinted in 1974 and 1988). This volume reviews the history of the theory in engineering, statistics, and psychology, leading to the separate measurement of the two independent factors in all discrimination tasks, discrimination acuity and decision criterion. It extends the previous book to show how in several areas of psychology--in vigilance and memory--what had been thought to be discrimination effects were, in reality, effects of a changing criterion. The book shows that data plotted in terms of the relative operating characteristic have essentially the same form across the wide range of discrimination tasks in psychology. It develops the implications of this ROC form for measures of discrimination acuity, pointing up the valid ones and identifying several common, but invalid, ones. The area under the binormal ROC is seen to be supported by the data; the popular measures d' and percent correct are not. An appendix describes the best, current programs for fitting ROCs and estimating their parameters, indices, and standard errors. The application of ROC analysis to diagnostic tasks is also described. Diagnostic accuracy in a wide range of tasks can be expressed in terms of the ROC area index. Choosing the appropriate decision criterion for a given diagnostic setting--rather than considering some single criterion to be natural and fixed--has a major impact on the efficacy of a diagnostic process or system. Illustrated here by separate chapters are diagnostic systems in radiology, information retrieval, aptitude testing, survey research, and environments in which imminent dangerous conditions must be detected. Data from weather forecasting, blood testing, and polygraph lie detection are also reported. One of these chapters describes a general approach to enhancing the accuracy of diagnostic systems.