Interaural spectral asymmetry and sensitivity to interaural time differences

Listeners' ability to discriminate interaural time difference (ITD) changes in low-frequency noise was determined as a function of differences in the noise spectra delivered to each ear. An ITD was applied to Gaussian noise, which was bandpass filtered using identical high-pass, but different low-pass cutoff frequencies across ears. Thus, one frequency region was dichotic, and a higher-frequency region monotic. ITD thresholds increased as bandwidth to one ear (i.e., monotic bandwidth) increased, despite the fact that the region of interaural spectral overlap remained constant. Results suggest that listeners can process ITD differences when the spectra at two ears are moderately different.     

The dominant role of low-frequency interaural time differences in sound localization.

Two experiments are described in which listeners judge the apparent directions of virtual sound sources-headphone-presented sounds that are processed in order to simulate free-field sounds. Previous results suggest that when the cues to sound direction are preserved by the simulation, the apparent directions of virtual sources are nearly the same as the apparent directions of real free-field sources. In the experiments reported here, the interaural phase relations in the processing algorithms are manipulated in order to produce stimuli in which the interaural time difference cues signal one direction and interaural intensity and pinna cues signal another direction. The apparent directions of these conflicting cue stimuli almost always follow the interaural time cue, as long as the wideband stimuli include low frequencies. With low frequencies removed from the stimuli, the dominance of interaural time difference disappears, and apparent direction is determined primarily by interaural intensity difference and pinna cues.     

Localization of sound in rooms

This paper is concerned with the localization of sources of sounds by human listeners in rooms. It presents the results of source-identification experiments designed to determine whether the ability to localize sound in a room depends upon the room acoustics, and how it depends upon the nature of the source signal. The experiments indicate that the localization of impulsive sounds, with strong attack transients, is independent of the room reverberation time, though it may depend upon the room geometry. For sounds without attack transients, localization improves monotonically with the spectral density of the source. Localization of continuous broadband noise does depend upon room reverberation time, and we propose the concept of direct signal to reverberant noise ratio to study that effect. Source identification experiments reveal certain localization biases, invisible to minimum-audible-angle experiments, and of uncertain origin. Appendices to this paper develop the statistics of the source-identification paradigm and show how they relate to the minimum audible angle.     

Binaural masking experiments using noise maskers with frequency-dependent interaural phase differences. II: Influence of frequency and interaural-phase uncertainty

This study investigates whether binaural signal detection is improved by the listener's previous knowledge about the interaural phase relations of masker and test signal. Binaural masked thresholds were measured for a 500-ms dichotic noise masker that had an interaural phase difference of 0 below 500 Hz and of pi above 500 Hz. The thresholds for two difference 20-ms test signals were determined within the same measurement using an interleaved adaptive 3-interval forced-choice (3IFC) procedure. In each 3IFC trial, both signals could occur with equal probability (uncertainty). The two signals differed in frequency and interaural phase in such a way that one signal always had a frequency above the masker edge frequency (500 Hz) and no interaural phase difference (So), whereas the other signal frequency was below 500 Hz and the interaural phase difference was pi (S pi). The frequencies of a signal pair remained fixed during the whole 3IFC track. These two signals thus lead to two different binaural conditions, i.e., NoS pi for the low-frequency signal and N pi So for the high-frequency signal. For comparison, binaural masked thresholds were measured with the same masker for fixed signal frequency and phase. The binaural masking level differences (BMLDs) resulting from the two experimental conditions show no significant difference. This indicates that the binaural system is able to apply different internal transformations or processing strategies simultaneously in different critical bands and even within the same critical band.     

Binaural masking experiments using noise maskers with frequency-dependent interaural phase differences. I: Influence of signal and masker duration

In this paper previous experiments on auditory filter shapes in binaural masking experiments [A. Kohlrausch, J. Acoust. Soc. Am. 84, 573-583 (1988)] are extended to a wider range of masker and signal durations. The masker was a dichotic broadband noise with frequency-dependent interaural parameters. The interaural phase difference of the masker was 0 below 500 Hz and pi above 500 Hz. Signal frequency varied between 200 and 800 Hz, and the signal was presented either monaurally (Sm) or binaurally in antiphase (S pi). In the first experiment, the masker duration was fixed at 500 ms and signals of 250 and 20 ms were used. In the second experiment, the signal duration was fixed at 20 ms, and the masker duration was reduced to 25 ms. The results from both experiments are consistent with studies using No or N pi maskers: The binaural masking level difference (BMLD) increases slightly for shorter test signals and decreases strongly for short maskers. The BMLD patterns of the first experiment are well described by the auditory-filter model derived for stationary test signals, if the additional influence of "off-frequency listening" for the short test signal is taken into account. The BMLDs resulting from the second experiment (25-ms masker), however, are much lower than predicted by this filter model This outcome supports previous observations that binaural unmasking becomes less effective for very short masker durations and indicates that this effect is even stronger for maskers with a complex structure of interaural parameters.     

The effect of head-induced interaural time and level differences on speech intelligibility in noise

A study was made of the effect of interaural time delay (ITD) and acoustic headshadow on binaural speech intelligibility in noise. A free-field condition was simulated by presenting recordings, made with a KEMAR manikin in an anechoic room, through earphones. Recordings were made of speech, reproduced in front of the manikin, and of noise, emanating from seven angles in the azimuthal plane, ranging from 0 degree (frontal) to 180 degrees in steps of 30 degrees. From this noise, two signals were derived, one containing only ITD, the other containing only interaural level differences (ILD) due to headshadow. Using this material, speech reception thresholds (SRT) for sentences in noise were determined for a group of normal-hearing subjects. Results show that (1) for noise azimuths between 30 degrees and 150 degrees, the gain due to ITD lies between 3.9 and 5.1 dB, while the gain due to ILD ranges from 3.5 to 7.8 dB, and (2) ILD decreases the effectiveness of binaural unmasking due to ITD (on the average, the threshold shift drops from 4.6 to 2.6 dB). In a second experiment, also conducted with normal-hearing subjects, similar stimuli were used, but now presented monaurally or with an overall 20-dB attenuation in one channel, in order to simulate hearing loss. In addition, SRTs were determined for noise with fixed ITDs, for comparison with the results obtained with head-induced (frequency dependent) ITDs.(ABSTRACT TRUNCATED AT 250 WORDS)     

Localization of sound in rooms. IV: The Franssen effect

The Franssen effect is an illusion that causes human listeners to make large errors in localizing a sound source. This paper describes steps taken to convert the illusion into an experiment in order to study the localization precedence effect as it operates in rooms. The results of the experiment suggest that there are two components to the illusion: The first is the inability of listeners to localize a sine tone in a room in the absence of an onset; the second is the obscuring of modulation cues by the irregular transient response of a room. Experiments show that the Franssen effect fails completely in an anechoic environment, as expected if the effect depends upon the implausibility of steady-state cues in a room. The Franssen effect also fails when the spectrum of the sound is dense.     

Spatial cues alone produce inaccurate sound segregation: the effect of interaural time differences

To clarify the role of spatial cues in sound segregation, this study explored whether interaural time differences (ITDs) are sufficient to allow listeners to identify a novel sound source from a mixture of sources. Listeners heard mixtures of two synthetic sounds, a target and distractor, each of which possessed naturalistic spectrotemporal correlations but otherwise lacked strong grouping cues, and which contained either the same or different ITDs. When the task was to judge whether a probe sound matched a source in the preceding mixture, performance improved greatly when the same target was presented repeatedly across distinct distractors, consistent with previous results. In contrast, performance improved only slightly with ITD separation of target and distractor, even when spectrotemporal overlap between target and distractor was reduced. However, when subjects localized, rather than identified, the sources in the mixture, sources with different ITDs were reported as two sources at distinct and accurately identified locations. ITDs alone thus enable listeners to perceptually segregate mixtures of sources, but the perceived content of these sources is inaccurate when other segregation cues, such as harmonicity and common onsets and offsets, do not also promote proper source separation.     

Binaural prediction of speech intelligibility in reverberant rooms with multiple noise sources

When speech is in competition with interfering sources in rooms, monaural indicators of intelligibility fail to take account of the listener's abilities to separate target speech from interfering sounds using the binaural system. In order to incorporate these segregation abilities and their susceptibility to reverberation, Lavandier and Culling [J. Acoust. Soc. Am. 127, 387-399 (2010)] proposed a model which combines effects of better-ear listening and binaural unmasking. A computationally efficient version of this model is evaluated here under more realistic conditions that include head shadow, multiple stationary noise sources, and real-room acoustics. Three experiments are presented in which speech reception thresholds were measured in the presence of one to three interferers using real-room listening over headphones, simulated by convolving anechoic stimuli with binaural room impulse-responses measured with dummy-head transducers in five rooms. Without fitting any parameter of the model, there was close correspondence between measured and predicted differences in threshold across all tested conditions. The model's components of better-ear listening and binaural unmasking were validated both in isolation and in combination. The computational efficiency of this prediction method allows the generation of complex "intelligibility maps" from room designs.     

Sequential streaming due to manipulation of interaural time differences

The effect of apparent spatial location on sequential streaming was investigated by manipulating interaural time differences (ITDs). The degree of obligatory stream segregation was inferred indirectly from the threshold for detecting a rhythmic irregularity in an otherwise isochronous sequence of interleaved "A" and "B" tones. Stimuli were bandpass-filtered harmonic complexes with a 100-Hz fundamental. The A and B tones had equal but opposite ITDs of 0, 0.25, 0.5, 1, or 2 ms and had the same or different passbands. The passband ranges were 1250-2500 Hz and 1768-3536 Hz in experiment 1, and 353-707 Hz and 500-1000 Hz in experiment 2. In both experiments, increases in ITD led to increases in threshold, mainly when the passbands of A and B were the same. The effects were largest for ITDs above 0.5 ms, for which rhythmic irregularities in the timing of the A or B tones alone may have disrupted performance. It is concluded that the differences in apparent spatial location produced by ITD have only weak effects on obligatory streaming.     

Mechanisms determining the salience of coloration in echoed sound: influence of interaural time and level differences

This study investigates whether the salience of the pitch associated with a single reflection of a broadband sound, such as noise, is determined by the monaural information mediated by the stimuli at the two ears, or by the relative locations of the primary sound and the reflection. Pitch strength was measured as a function of the reflection delay and the lateral displacement between the primary sound and the reflection. Thereby, lateral displacement was produced by means of interaural time differences (ITDs) in experiment 1 and interaural level differences (ILDs) in experiment 3. The results from both experiments are in accordance with the assumption that the strength of the pitch associated with a reflection is based on a central average of the internal representations of the stimuli at the two ears. This notion was corroborated by experiment 2, which showed that the results from experiment 1 could be mimicked by simply adding the stimuli from the two ears and presenting the merged stimulus identically to both ears.     

Localization by interaural time difference (ITD): effects of interaural frequency mismatch.

A commonly accepted physiological model for lateralization of low-frequency sounds by interaural time delay (ITD) stipulates that binaural comparison neurons receive input from frequency-matched channels from each ear. Here, the effects of hypothetical interaural frequency mismatches on this model are reported. For this study, the cat's auditory system peripheral to the binaural comparison neurons was represented by a neurophysiologically derived model, and binaural comparison neurons were represented by cross-correlators. The results of the study indicate that, for binaural comparison neurons receiving input from one cochlear channel from each ear, interaural CF mismatches may serve to either augment or diminish the effective difference in ipsilateral and contralateral axonal time delays from the periphery to the binaural comparison neuron. The magnitude of this increase or decrease in the effective time delay difference can be up to 400 microseconds for CF mismatches of 0.2 octaves or less for binaural neurons with CFs between 250 Hz and 2.5 kHz. For binaural comparison neurons with nominal CFs near 500 Hz, the 25-microsecond effective time delay difference caused by a 0.012-octave CF mismatch is equal to the ITD previously shown to be behaviorally sufficient for the cat to lateralize a low-frequency sound source.     

Lateralization of bands of noise: effects of bandwidth and differences of interaural time and phase

The effects of stimulus bandwidth on lateralization of narrow bands of noise were investigated with an acoustic pointing task. Stimuli were narrow bands of noise (centered on 500 Hz with bandwidths ranging from 50-400 Hz) that contained interaural time delays and/or interaural phase shifts. The overall extent of lateralization and sidedness was found to vary greatly as a function of stimulus bandwidth, as insightfully discussed earlier by Jeffress [L. A. Jeffress, Foundations of Modern Auditory Theory, edited by J. V. Tobias (Academic, New York, 1972)]. The data are qualitatively consistent with a weighted-image model [Stern et al., J. Acoust. Soc. Am. 84, 156-165 (1988)] that specifies and utilizes the shapes and locations of patterns of hypothesized neural activity. These patterns are topographically organized along a two-dimensional surface, and they describe the cross-correlation function of the stimuli as a joint function of frequency and the delay parameter of the cross-correlation operation. In this fashion, lateralization depends upon individual modes of such patterns that are weighed with respect to their straightness (consistency of interaural delay over frequency) and centrality (the extent to which interaural delays are small in magnitude).     

Enhancement of interaural level differences improves sound localization in bimodal hearing

Users of a cochlear implant together with a contralateral hearing aid-so-called bimodal listeners-have difficulties with localizing sound sources. This is mainly due to the distortion of interaural time and level difference cues (ITD and ILD), and limited ITD sensitivity. An algorithm is presented that enhances ILD cues. Horizontal plane sound-source localization performance of six bimodal listeners was evaluated in (1) a real sound field with their clinical devices, (2) in a virtual sound field, under direct computer control, and (3) in a virtual sound field with ILD enhancement. The results in the real sound field did not differ significantly from the results in the virtual field, and ILD enhancement improved localization performance by 4°-10° absolute error, relative to a mean absolute error of 28° in the condition without ILD enhancement.     

The role of head-induced interaural time and level differences in the speech reception threshold for multiple interfering sound sources

Three experiments investigated the roles of interaural time differences (ITDs) and level differences (ILDs) in spatial unmasking in multi-source environments. In experiment 1, speech reception thresholds (SRTs) were measured in virtual-acoustic simulations of an anechoic environment with three interfering sound sources of either speech or noise. The target source lay directly ahead, while three interfering sources were (1) all at the target's location (0 degrees,0 degrees,0 degrees), (2) at locations distributed across both hemifields (-30 degrees,60 degrees,90 degrees), (3) at locations in the same hemifield (30 degrees,60 degrees,90 degrees), or (4) co-located in one hemifield (90 degrees,90 degrees,90 degrees). Sounds were convolved with head-related impulse responses (HRIRs) that were manipulated to remove individual binaural cues. Three conditions used HRIRs with (1) both ILDs and ITDs, (2) only ILDs, and (3) only ITDs. The ITD-only condition produced the same pattern of results across spatial configurations as the combined cues, but with smaller differences between spatial configurations. The ILD-only condition yielded similar SRTs for the (-30 degrees,60 degrees,90 degrees) and (0 degrees,0 degrees,0 degrees) configurations, as expected for best-ear listening. In experiment 2, pure-tone BMLDs were measured at third-octave frequencies against the ITD-only, speech-shaped noise interferers of experiment 1. These BMLDs were 4-8 dB at low frequencies for all spatial configurations. In experiment 3, SRTs were measured for speech in diotic, speech-shaped noise. Noises were filtered to reduce the spectrum level at each frequency according to the BMLDs measured in experiment 2. SRTs were as low or lower than those of the corresponding ITD-only conditions from experiment 1. Thus, an explanation of speech understanding in complex listening environments based on the combination of best-ear listening and binaural unmasking (without involving sound-localization) cannot be excluded.     

Localization of sound in rooms, III: Onset and duration effects

The steady-state sound field of a sine tone does not provide useful localization information in a room. Nevertheless, listeners can localize a sine tone in a room if it has an onset transient which allows the precedence effect to operate. In the present study, we made a quantitative assessment of onsets and the precedence effect by systematically varying onset duration from 0 s (impulsive), where the precedence effect is maximal, to 5 s, where there is no precedence effect at all. We also assessed listeners' sensitivity to the steady-state sound field under impulsive conditions by varying the total duration of tone pulses. Our experiments were conducted in a room with a single acoustical reflection having various directions and delays, and in an anechoic room. The results for tones of various frequencies (500 and 2000 Hz) and sound-pressure levels (65 and 40 dBA) indicate the following: Localization in rooms is facilitated by onsets even if the onsets are as long as 100 ms. The facilitation depends upon the peak intensity of the tone, as well as the onset duration, suggesting that onset rate is critical for the precedence effect; our results are most consistent with rate expressed as an increase in sound pressure per unit time. The facilitation also depends upon the reflection delay time for a room; gradual onsets take on much more importance for the precedence effect in rooms with long delays. As onsets begin to lose their effectiveness listeners become increasingly "misdirected" by invalid cues in the steady-state sound field. The pattern of misdirection suggests a perceptual averaging of cues over an interval more than an order of magnitude longer than previous estimates of the summation window for the precedence effect. The pattern of misdirection varies with the frequency of a tone, due to frequency-dependent interference effects in a room, but it is independent of signal level. Localization of an impulsive sine tone in rooms is very insensitive to the pulse duration; this suggests that binaural inhibition models of the precedence effect must be supplemented by an evaluative component that we term the "plausibility hypothesis."