Reaction times in multisensory localization tasks

Yi Zhou, Colton Clayton

Research output: Chapter in Book/Report/Conference proceedingConference contribution


The encoding of space between the visual and auditory systems does not always align. For foveal species like humans and monkeys, the visual field is restricted to frontal space, whereas the auditory field is panoramic, covering the entire surrounding space. Sensitivity to sounds coming from the rear brought by spatial hearing is critical for avoiding unseen dangers. Our recent study shows that, in humans, vision's influence on auditory perception can extend to unseen rear space (Montagne and Zhou, 2018). The present study further investigates the effects of visual stimulation on reaction times when listeners localize an auditory target presented from the front or rear. Experiments are designed to survey two types of reaction times simultaneously: (1) choice reaction time for pushing a button to indicate the perceived front or back location of a sound; (2) saccade reaction time by listeners shifting their gaze to indicate the lateral direction of a perceived sound source. Our results show domain-specific effects of visual capture on both types of reaction times, and support our previous findings that audio-visual interactions are not limited by the spatial rule of proximity.

Original languageEnglish (US)
Title of host publicationProceedings of the 23rd International Congress on Acoustics
Subtitle of host publicationIntegrating 4th EAA Euroregio 2019
EditorsMartin Ochmann, Vorlander Michael, Janina Fels
PublisherInternational Commission for Acoustics (ICA)
Number of pages7
ISBN (Electronic)9783939296157
StatePublished - 2019
Event23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019 - Aachen, Germany
Duration: Sep 9 2019Sep 23 2019

Publication series

NameProceedings of the International Congress on Acoustics
ISSN (Print)2226-7808
ISSN (Electronic)2415-1599


Conference23rd International Congress on Acoustics: Integrating 4th EAA Euroregio, ICA 2019


  • Multisensory
  • Reaction Time
  • Sound Source Localization

ASJC Scopus subject areas

  • Mechanical Engineering
  • Acoustics and Ultrasonics


Dive into the research topics of 'Reaction times in multisensory localization tasks'. Together they form a unique fingerprint.

Cite this