Search engine for discovering works of Art, research articles, and books related to Art and Culture
ShareThis
Javascript must be enabled to continue!

Re-weighting of Sound Localization Cues by Audiovisual Training

View through CrossRef
Abstract Sound localization requires the integration in the brain of auditory spatial cues generated by interactions with the external ears, head and body. Perceptual learning studies have shown that the relative weighting of these cues can change in a context-dependent fashion if their relative reliability is altered. One factor that may influence this process is vision, which tends to dominate localization judgments when both modalities are present and induces a recalibration of auditory space if they become misaligned. It is not known, however, whether vision can alter the weighting of individual auditory localization cues. Using non-individualized head-related transfer functions, we measured changes in subjects’ sound localization biases and binaural localization cue weights after ~55 minutes of training on an audiovisual spatial oddball task. Four different configurations of spatial congruence between visual and auditory cues (interaural time differences (ITDs) and frequency-dependent interaural level differences (interaural level spectra, ILS) were used. When visual cues were spatially congruent with both auditory spatial cues, we observed an improvement in sound localization, as shown by a reduction in the variance of subjects’ localization biases, which was accompanied by an up-weighting of the more salient ILS cue. However, if the position of either one of the auditory cues was randomized during training, no overall improvement in sound localization occurred. Nevertheless, the spatial gain of whichever cue was matched with vision increased, with different effects observed on the gain for the randomized cue depending on whether ITDs or ILS were matched with vision. As a result, we observed a similar up-weighting in ILS when this cue alone was matched with vision, but no overall change in binaural cue weighting when ITDs corresponded to the visual cues and ILS were randomized. Consistently misaligning both cues with vision produced the ventriloquism aftereffect, i.e., a corresponding shift in auditory localization bias, without affecting the variability of the subjects’ sound localization judgments, and no overall change in binaural cue weighting. These data show that visual contextual information can invoke a reweighting of auditory localization cues, although concomitant improvements in sound localization are only likely to accompany training with fully congruent audiovisual information.
Title: Re-weighting of Sound Localization Cues by Audiovisual Training
Description:
Abstract Sound localization requires the integration in the brain of auditory spatial cues generated by interactions with the external ears, head and body.
Perceptual learning studies have shown that the relative weighting of these cues can change in a context-dependent fashion if their relative reliability is altered.
One factor that may influence this process is vision, which tends to dominate localization judgments when both modalities are present and induces a recalibration of auditory space if they become misaligned.
It is not known, however, whether vision can alter the weighting of individual auditory localization cues.
Using non-individualized head-related transfer functions, we measured changes in subjects’ sound localization biases and binaural localization cue weights after ~55 minutes of training on an audiovisual spatial oddball task.
Four different configurations of spatial congruence between visual and auditory cues (interaural time differences (ITDs) and frequency-dependent interaural level differences (interaural level spectra, ILS) were used.
When visual cues were spatially congruent with both auditory spatial cues, we observed an improvement in sound localization, as shown by a reduction in the variance of subjects’ localization biases, which was accompanied by an up-weighting of the more salient ILS cue.
However, if the position of either one of the auditory cues was randomized during training, no overall improvement in sound localization occurred.
Nevertheless, the spatial gain of whichever cue was matched with vision increased, with different effects observed on the gain for the randomized cue depending on whether ITDs or ILS were matched with vision.
As a result, we observed a similar up-weighting in ILS when this cue alone was matched with vision, but no overall change in binaural cue weighting when ITDs corresponded to the visual cues and ILS were randomized.
Consistently misaligning both cues with vision produced the ventriloquism aftereffect, i.
e.
, a corresponding shift in auditory localization bias, without affecting the variability of the subjects’ sound localization judgments, and no overall change in binaural cue weighting.
These data show that visual contextual information can invoke a reweighting of auditory localization cues, although concomitant improvements in sound localization are only likely to accompany training with fully congruent audiovisual information.

Related Results

Vocational and business training to improve women's labour market outcomes in low- and middle-income countries: a systematic review
Vocational and business training to improve women's labour market outcomes in low- and middle-income countries: a systematic review
This Campbell systematic review examines the impact of vocational and business training targeted at women in low- and middle-income countries. The review summarises evidence from t...
Audiovisual translation and media accessibility training in the EMT network
Audiovisual translation and media accessibility training in the EMT network
The increase in demand for the localisation of audiovisual media content has led to increased incorporation of audiovisual translation and accessibility modules into university cur...
On sound localization cues in the median plane
On sound localization cues in the median plane
In order to make it clear which is more important for sound localization in the median plane, SP cues (spectral cues) or ID cues (interaural difference cues), two localization test...
Indoor Localization System Based on RSSI-APIT Algorithm
Indoor Localization System Based on RSSI-APIT Algorithm
An indoor localization system based on the RSSI-APIT algorithm is designed in this study. Integrated RSSI (received signal strength indication) and non-ranging APIT (approximate pe...
Using background noise to improve sound localization following simulated hearing loss
Using background noise to improve sound localization following simulated hearing loss
Abstract Many listening abilities become more difficult in noisy environments, particularly following hearing loss. Sound localization can be disrupted even if targ...
The Search for Resonance
The Search for Resonance
ABSTRACT V.1 - "THE SEARCH FOR RESONANCE" - OCTOBER 2018 «The Search for Resonance» by Per Martinsen, Research Fellow, UiT The Arctic University of Norway, Faculty of Fine Arts I...

Back to Top