Simultaneous perception of visual and auditory events in a virtual-reality environment-Effects of binocular disparity and motion parallax-

Accession number;06A0857857
Title;Simultaneous perception of visual and auditory events in a virtual-reality environment-Effects of binocular disparity and motion parallax-
Author; KOBIKI HISASHI (Graduate School of Engineering, Toyohashi Univ. Technol., JPN) SHIGEMASU HIROAKI (Toyohashi Univ. of Technol.) KITAZAKI MICHITERU (Toyohashi Univ. of Technol.)
Journal Title;IEIC Technical Report (Institute of Electronics, Information and Communication Engineers)
Journal Code:S0532B
ISSN:0913-5685
VOL.106;NO.234(MVE2006 43-62);PAGE.73-77(2006)
Figure&Table&Reference;FIG.3, REF.5
Pub. Country;Japan
Language;Japanese
Abstract;Since the speed of sound is much slower than light, we sometimes hear a sound later than an accompanying light event (eg. thunder and lightning at a far distance). Sugita and Suzuki (2003) reported that our brain coordinates a sound and its accompanying light to be perceived simultaneously within about 20 m distance. In other words, the light accompanied with physically delayed sound is perceived simultaneously with the sound. We varied depth cues (binocular disparity and motion parallax) in a virtual reality environment, and measured the physical delay at which a light and a sound were perceived simultaneously. In results, we did not find sound-light coordination without binocular disparity or motion parallax, but found it with both cues. It is suggested that binocular disparity and motion parallax are effective for sound-light coordination for simultaneity perception of cross-modal event, and they induce perceptual reality in cross-modal space. (author abst.)