Multisensory and sensorimotor interactions in speech perception

Multisensory and sensorimotor interactions in speech perception
Author: Kaisa Tiippana
Publisher: Frontiers Media SA
Total Pages: 265
Release: 2015-06-26
Genre: Psychology
ISBN: 2889195481

Speech is multisensory since it is perceived through several senses. Audition is the most important one as speech is mostly heard. The role of vision has long been acknowledged since many articulatory gestures can be seen on the talker's face. Sometimes speech can even be felt by touching the face. The best-known multisensory illusion is the McGurk effect, where incongruent visual articulation changes the auditory percept. The interest in the McGurk effect arises from a major general question in multisensory research: How is information from different senses combined? Despite decades of research, a conclusive explanation for the illusion remains elusive. This is a good demonstration of the challenges in the study of multisensory integration. Speech is special in many ways. It is the main means of human communication, and a manifestation of a unique language system. It is a signal with which all humans have a lot of experience. We are exposed to it from birth, and learn it through development in face-to-face contact with others. It is a signal that we can both perceive and produce. The role of the motor system in speech perception has been debated for a long time. Despite very active current research, it is still unclear to which extent, and in which role, the motor system is involved in speech perception. Recent evidence shows that brain areas involved in speech production are activated during listening to speech and watching a talker's articulatory gestures. Speaking involves coordination of articulatory movements and monitoring their auditory and somatosensory consequences. How do auditory, visual, somatosensory, and motor brain areas interact during speech perception? How do these sensorimotor interactions contribute to speech perception? It is surprising that despite a vast amount of research, the secrets of speech perception have not yet been solved. The multisensory and sensorimotor approaches provide new opportunities in solving them. Contributions to the research topic are encouraged for a wide spectrum of research on speech perception in multisensory and sensorimotor contexts, including novel experimental findings ranging from psychophysics to brain imaging, theories and models, reviews and opinions.

Multisensory Development

Multisensory Development
Author: Andrew J. Bremner
Publisher: Oxford University Press
Total Pages: 393
Release: 2012-06-21
Genre: Medical
ISBN: 0199586055

We perceive and understand our environment using many sensory systems-vision, touch, hearing, taste, smell, and proprioception. These multiple sensory modalities give us complementary sources of information about the environment. This book explores how we develop the ability to integrate our senses.

Multisensory Processes

Multisensory Processes
Author: Adrian Kuo Ching Lee
Publisher:
Total Pages:
Release: 2019
Genre: PSYCHOLOGY
ISBN: 9783030104603

Auditory behavior, perception, and cognition are all shaped by information from other sensory systems. This volume examines this multi-sensory view of auditory function at levels of analysis ranging from the single neuron to neuroimaging in human clinical populations. Visual Influence on Auditory Perception Adrian K.C. Lee and Mark T. Wallace Cue Combination within a Bayesian Framework David Alais and David Burr Toward a Model of Auditory-Visual Speech Intelligibility Ken W. Grant and Joshua G. W. Bernstein An Object-based Interpretation of Audiovisual Processing Adrian K.C. Lee, Ross K. Maddox, and Jennifer K. Bizley Hearing in a "Moving" Visual World: Coordinate Transformations Along the Auditory Pathway Shawn M. Willett, Jennifer M. Groh, Ross K. Maddox Multisensory Processing in the Auditory Cortex Andrew J. King, Amy Hammond-Kenny, Fernando R. Nodal Audiovisual Integration in the Primate Prefrontal Cortex Bethany Plakke and Lizabeth M. Romanski Using Multisensory Integration to Understand Human Auditory Cortex Michael S. Beauchamp Combining Voice and Face Content in the Primate Temporal Lobe Catherine Perrodin and Christopher I. Petkov Neural Network Dynamics and Audiovisual Integration Julian Keil and Daniel Senkowski Cross-Modal Learning in the Auditory System Patrick Bruns and Brigitte Röder Multisensory Processing Differences in Individuals with Autism Spectrum Disorder Sarah H. Baum Miller, Mark T. Wallace Adrian K.C. Lee is Associate Professor in the Department of Speech & Hearing Sciences and the Institute for Learning and Brain Sciences at the University of Washington, Seattle Mark T. Wallace is the Louise B McGavock Endowed Chair and Professor in the Departments of Hearing and Speech Sciences, Psychiatry, Psychology and Director of the Vanderbilt Brain Institute at Vanderbilt University, Nashville Allison B. Coffin is Associate Professor in the Department of Integrative Physiology and Neuroscience at Washington State University, Vancouver, WA Arthur N. Popper is Professor Emeritus and research professor in the Department of Biology at the University of Maryland, College Park Richard R. Fay is Distinguished Research Professor of Psychology at Loyola University, Chicago.

The New Handbook of Multisensory Processing

The New Handbook of Multisensory Processing
Author: Barry E. Stein
Publisher: MIT Press
Total Pages: 841
Release: 2012-06-01
Genre: Science
ISBN: 0262017121

The major reference work for a rapidly advancing field synthesizes central themes, reports on current findings, and offers a blueprint for future research. Scientists' attempts to understand the physiology underlying our apprehension of the physical world was long dominated by a focus on the individual senses. The 1980s saw the beginning of systematic efforts to examine interactions among different sensory modalities at the level of the single neuron. And by the end of the 1990s, a recognizable and multidisciplinary field of "multisensory processes" had emerged. More recently, studies involving both human and nonhuman subjects have focused on relationships among multisensory neuronal ensembles and their behavioral, perceptual, and cognitive correlates. The New Handbook of Multisensory Processing synthesizes the central themes in this rapidly developing area, reports on current findings, and offers a blueprint for future research. The contributions, all of them written for this volume by leading experts, reflect the evolution and current state of the field. This handbook does more than simply review the field. Each of the volume's eleven sections broadly surveys a major topic, and each begins with a substantive and thought-provoking commentary by the section editor that identifies the major issues being explored, describes their treatment in the chapters that follow, and sets these findings within the context of the existing body of knowledge. Together, the commentaries and chapters provide an invaluable guide to areas of general agreement, unresolved issues, and topics that remain to be explored in this fast-moving field.

The Neural Bases of Multisensory Processes

The Neural Bases of Multisensory Processes
Author: Micah M. Murray
Publisher: CRC Press
Total Pages: 786
Release: 2011-08-25
Genre: Medical
ISBN: 1439812195

It has become accepted in the neuroscience community that perception and performance are quintessentially multisensory by nature. Using the full palette of modern brain imaging and neuroscience methods, The Neural Bases of Multisensory Processes details current understanding in the neural bases for these phenomena as studied across species, stages

Audiovisual Speech Processing

Audiovisual Speech Processing
Author: Gérard Bailly
Publisher: Cambridge University Press
Total Pages: 507
Release: 2012-04-26
Genre: Computers
ISBN: 1107006821

This book presents a complete overview of all aspects of audiovisual speech including perception, production, brain processing and technology.

Multisensory Development

Multisensory Development
Author: Andrew J. Bremner
Publisher: OUP Oxford
Total Pages: 393
Release: 2012-06-21
Genre: Psychology
ISBN: 0191627585

We perceive and understand our environment using many sensory systems-vision, touch, hearing, taste, smell, and proprioception. These multiple sensory modalities not only give us complementary sources of information about the environment but also an understanding that is richer and more complex than one modality alone could achieve. As adults, we integrate the multiple signals from these sense organs into unified functional representations. However, the ease with which we accomplish this feat belies its computational complexity. Not only do the senses convey information about the environment in different neural codes, but the relationship between the senses frequently changes when, for example, the body changes posture (e.g. when the eyes move in their sockets), or indeed shape, when the body grows across development. These computational problems prompt an important question which represents the key focus of this book: How do we develop the ability to integrate the senses? While there is a considerable literature on the development of single senses, such as vision or hearing, few books have considered the development of all our senses, and more importantly, how they develop the ability to work with each other. This book is unique in exploring this extraordinary feat of human nature - how we develop the ability to integrate our senses. It will be an important book for all those in the fields of cognitive and developmental neuroscience.

Sensory Cue Integration

Sensory Cue Integration
Author: Julia Trommershauser
Publisher: Oxford University Press
Total Pages: 461
Release: 2011-09-21
Genre: Psychology
ISBN: 019987476X

This book is concerned with sensory cue integration both within and between sensory modalities, and focuses on the emerging way of thinking about cue combination in terms of uncertainty. These probabilistic approaches derive from the realization that our sensors are noisy and moreover are often affected by ambiguity. For example, mechanoreceptor outputs are variable and they cannot distinguish if a perceived force is caused by the weight of an object or by force we are producing ourselves. The probabilistic approaches elaborated in this book aim at formalizing the uncertainty of cues. They describe cue combination as the nervous system's attempt to minimize uncertainty in its estimates and to choose successful actions. Some computational approaches described in the chapters of this book are concerned with the application of such statistical ideas to real-world cue-combination problems. Others ask how uncertainty may be represented in the nervous system and used for cue combination. Importantly, across behavioral, electrophysiological and theoretical approaches, Bayesian statistics is emerging as a common language in which cue-combination problems can be expressed.

Brain Mapping

Brain Mapping
Author:
Publisher: Academic Press
Total Pages: 2668
Release: 2015-02-14
Genre: Science
ISBN: 0123973163

Brain Mapping: A Comprehensive Reference, Three Volume Set offers foundational information for students and researchers across neuroscience. With over 300 articles and a media rich environment, this resource provides exhaustive coverage of the methods and systems involved in brain mapping, fully links the data to disease (presenting side by side maps of healthy and diseased brains for direct comparisons), and offers data sets and fully annotated color images. Each entry is built on a layered approach of the content – basic information for those new to the area and more detailed material for experienced readers. Edited and authored by the leading experts in the field, this work offers the most reputable, easily searchable content with cross referencing across articles, a one-stop reference for students, researchers and teaching faculty. Broad overview of neuroimaging concepts with applications across the neurosciences and biomedical research Fully annotated color images and videos for best comprehension of concepts Layered content for readers of different levels of expertise Easily searchable entries for quick access of reputable information Live reference links to ScienceDirect, Scopus and PubMed

Neural Organization

Neural Organization
Author: Michael A. Arbib
Publisher: MIT Press
Total Pages: 442
Release: 1998
Genre: Medical
ISBN: 9780262011594

In Neural Organization, Arbib, Erdi, and Szentagothai integrate structural, functional, and dynamical approaches to the interaction of brain models and neurobiologcal experiments. Both structure-based "bottom-up" and function- based "top-down" models offer coherent concepts by which to evaluate the experimental data. The goal of this book is to point out the advantages of a multidisciplinary, multistrategied approach to the brain.Part I of Neural Organization provides a detailed introduction to each of the three areas of structure, function, and dynamics. Structure refers to the anatomical aspects of the brain and the relations between different brain regions. Function refers to skills and behaviors, which are explained by means of functional schemas and biologically based neural networks. Dynamics refers to the use of a mathematical framework to analyze the temporal change of neural activities and synaptic connectivities that underlie brain development and plasticity--in terms of both detailed single-cell models and large-scale network models.In part II, the authors show how their systematic approach can be used to analyze specific parts of the nervous system--the olfactory system, hippocampus, thalamus, cerebral cortex, cerebellum, and basal ganglia--as well as to integrate data from the study of brain regions, functional models, and the dynamics of neural networks. In conclusion, they offer a plan for the use of their methods in the development of cognitive neuroscience."