Scalable Immersive Audio for Virtual Environments

Scalable Immersive Audio for Virtual Environments
Author: Mirza Beig
Publisher:
Total Pages: 0
Release: 2018
Genre:
ISBN:

This thesis discusses the history of game sound and how it developed to become increasingly more immersive and realistic by accounting for the spatial aspects of sound. It then compares several 3D sound technologies before continuing on to present a custom spatial sound system that uses the highly parallel nature of modern graphics processing units (GPUs) to process large amounts of data for simulated sound propagation. In a real-time virtual reality game environment, the system is able to handle dynamic geometry and movable sound sources in full 3D at interactive rates. To test the implementation, I developed a VR-compatible video game for desktop and mobile platforms with an emphasis on play-by-sound gameplay mechanics. Results demonstrated low overhead on all devices tested when used with the appropriate pathfinding backend (CPU/GPU). Additional testing yielded that the GPU part of the system is capable of processing several thousand 3D paths at interactive rates.

Immersive Projection Technology and Virtual Environments 2001

Immersive Projection Technology and Virtual Environments 2001
Author: B. Fröhlich
Publisher: Springer Science & Business Media
Total Pages: 294
Release: 2012-12-06
Genre: Computers
ISBN: 3709162211

17 papers report on the latest scientific advances in the fields of immersive projection technology and virtual environments. The main topics included here are human computer interaction (user interfaces, interaction techniques), software developments (virtual environment applications, rendering techniques), and input/output devices.

New Realities in Audio

New Realities in Audio
Author: Stephan Schütze
Publisher: CRC Press
Total Pages: 565
Release: 2018-01-29
Genre: Computers
ISBN: 1351727435

The new realities are here. Virtual and Augmented realities and 360 video technologies are rapidly entering our homes and office spaces. Good quality audio has always been important to the user experience, but in the new realities, it is more than important, it’s essential. If the audio doesn’t work, the immersion of the experience fails and the cracks in the new reality start to show. This practical guide helps you navigate the challenges and pitfalls of designing audio for these new realities. This technology is different from anything we’ve seen before and requires an entirely new approach; this book will introduce the broad concepts you need to know before delving into the practical detail you need. Key Features This book covers audio for all types of new reality technology. At the moment, VR and 360 video are getting a lot of press, but in a few years we will be hearing a lot more about Augmented and Mixed reality technologies as well. A practical guide to creating, designing and implementing audio for this new technology by a leading sound design and implementation expert. Conceptual explanations address the new approaches necessary to designing effective audio for the new realities. Real-world examples and analysis of what does and does not work including detailed case study discussions.

Physically Based Real-Time Auralization of Interactive Virtual Environments

Physically Based Real-Time Auralization of Interactive Virtual Environments
Author: Dirk Schröder
Publisher: Logos Verlag Berlin GmbH
Total Pages: 227
Release: 2011
Genre: Computers
ISBN: 3832530312

Analogous to visualization, the auralization of virtual environments describes the simulation of sound propagation inside enclosures where methods of Geometrical Acoustics are mostly applied for a high-quality synthesis of aural stimuli that go along with a certain realistic behavior. In the course of this thesis, the design and implementation of the real-time room acoustics simulation software RAVEN will be described, which is a vital part of the implemented 3D sound-rendering system of RWTH Aachen University's immersive Virtual Reality system. RAVEN relies on present-day knowledge of room acoustical simulation techniques and enables a physically accurate auralization of sound propagation in complex environments including important wave effects such as sound scattering, airborne sound insulation between rooms and sound diffraction. Despite this realistic sound field rendering, not only spatially distributed and freely movable sound sources and receivers are supported at runtime but also modifications and manipulations of the environment itself. All major features are evaluated by investigating both the overall accuracy of the room acoustics simulation and the performance of implemented algorithms, and possibilities for further simulation optimizations are identified by assessing empirical studies of subjects operating in immersive environments

Echoes of Other Worlds: Sound in Virtual Reality

Echoes of Other Worlds: Sound in Virtual Reality
Author: Tom A. Garner
Publisher: Springer
Total Pages: 384
Release: 2017-09-01
Genre: Social Science
ISBN: 3319657089

This book explores the nature and importance of sound in virtual reality (VR). Approaching the subject from a holistic perspective, the book delivers an emergent framework of VR sound. This framework brings together numerous elements that collectively determine the nature of sound in VR; from various aspects of VR technology, to the physiological and psychological complexities of the user, to the wider technological, historical and sociocultural issues. Garner asks, amongst other things: what is the meaning of sound? How have fictional visions of VR shaped our expectations for present technology? How can VR sound hope to evoke the desired responses for such an infinitely heterogeneous user base? This book if for those with an interest in sound and VR, who wish to learn more about the great complexities of the subject and discover the contemporary issues from which future VR will surely advance.

Immersive Sound

Immersive Sound
Author: Agnieszka Roginska
Publisher: Taylor & Francis
Total Pages: 676
Release: 2017-10-17
Genre: Technology & Engineering
ISBN: 1317480104

Immersive Sound: The Art and Science of Binaural and Multi-Channel Audio provides a comprehensive guide to multi-channel sound. With contributions from leading recording engineers, researchers, and industry experts, Immersive Sound includes an in-depth description of the physics and psychoacoustics of spatial audio as well as practical applications. Chapters include the history of 3D sound, binaural reproduction over headphones and loudspeakers, stereo, surround sound, height channels, object-based audio, soundfield (ambisonics), wavefield synthesis, and multi-channel mixing techniques. Knowledge of the development, theory, and practice of spatial and multi-channel sound is essential to those advancing the research and applications in the rapidly evolving fields of 3D sound recording, augmented and virtual reality, gaming, film sound, music production, and post-production.

Sonic Interactions in Virtual Environments

Sonic Interactions in Virtual Environments
Author: Michele Geronazzo
Publisher: Springer Nature
Total Pages: 437
Release: 2022-10-13
Genre: Computers
ISBN: 303104021X

This open access book tackles the design of 3D spatial interactions in an audio-centered and audio-first perspective, providing the fundamental notions related to the creation and evaluation of immersive sonic experiences. The key elements that enhance the sensation of place in a virtual environment (VE) are: Immersive audio: the computational aspects of the acoustical-space properties of Virutal Reality (VR) technologies Sonic interaction: the human-computer interplay through auditory feedback in VE VR systems: naturally support multimodal integration, impacting different application domains Sonic Interactions in Virtual Environments will feature state-of-the-art research on real-time auralization, sonic interaction design in VR, quality of the experience in multimodal scenarios, and applications. Contributors and editors include interdisciplinary experts from the fields of computer science, engineering, acoustics, psychology, design, humanities, and beyond. Their mission is to shape an emerging new field of study at the intersection of sonic interaction design and immersive media, embracing an archipelago of existing research spread in different audio communities and to increase among the VR communities, researchers, and practitioners, the awareness of the importance of sonic elements when designing immersive environments.