3D sound and 3D image interactions: a review of audio-visual depth perception

Berry, J; Roberts, D; Holliman, NS

doi:10.1117/12.2047771

3D sound and 3D image interactions: a review of audio-visual depth perception

Lookup NU author(s): Professor Nick Holliman ORCiD

Downloads

Accepted version [.pdf]

Licence

This is the authors' accepted manuscript of a conference proceedings (inc. abstract) that has been published in its final definitive form by SPIE, 2014.

For re-use rights please refer to the publisher's terms and conditions.

Abstract

The design and application of 3D stereoscopic displays and images have been subject to much research over several years. 3D (or spatial) sound systems became widely available comparatively recently, so have not been studied to the same extent. Both 3D displays and sound systems markedly improve depth perception by conveying extra depth cues to the audience. There is currently considerable interest in the integration of 3D video and 3D audio, suggesting it is timely to review depth perception for 3D audio-visual display systems. When the brain combines conflicting auditory and visual cues, some interesting effects can be found in the final percept that may be of interest to display and content designers. We begin with an overview of both visual and auditory depth perception, before focusing upon the cross-modal effects applicable in audio-visual depth perception.