Binaural weighting of monaural spectral cues for sound localization

For human listeners, cues for vertical-plane localization are provided by direction-dependent pinna filtering. This study quantified listeners' weighting of the spectral cues from each ear as a function of stimulus lateral angle, interaural time difference (ITD), and interaural level difference (ILD). Subjects indicated the apparent position of headphone-presented noise bursts synthesized in virtual auditory space. The synthesis filters for the two ears either corresponded to the same location or to two different locations separated vertically by 20 deg. Weighting of each ear's spectral information was determined by a multiple regression between the elevations to which each ear's spectrum corresponded and the vertical component of listeners' responses. The apparent horizontal source location was controlled either by choosing synthesis filters corresponding to locations on or 30 deg left or right of the median plane or by attenuating or delaying the signal at one ear. For broadband stimuli, spectral weighting and apparent lateral angle were determined primarily by ITD. Only for high-pass stimuli were weighting and lateral angle determined primarily by ILD. The results suggest that the weighting of monaural spectral cues and the perceived lateral angle of a sound source depend similarly on ITD, ILD, and stimulus spectral range.     

The effect of interaural differences in envelope shape on the perceived location of sounds (L)

Users of bilateral cochlear implants and a cochlear implant combined with a contralateral hearing aid are sensitive to interaural time differences (ITDs). The way cochlear implant speech processors work and differences between modalities may result in interaural differences in shape of the temporal envelope presented to the binaural system. The effect of interaural differences in envelope shape on ITD sensitivity was investigated with normal-hearing listeners using a 4?kHz pure tone modulated with a periodic envelope with a trapezoid shape in each cycle. In one ear the onset segment of the trapezoid was transformed by a power function. No effect on the just noticeable difference in ITD was found with an interaural difference in envelope shape, but the ITD for a centered percept was significantly different across envelope shape conditions.     

Frequency resolution for diotic and dichotic listening conditions compared using the bandlimiting measure and a modified bandlimiting measure

Two experiments were performed that examined the relation between frequency selectivity for diotic and dichotic stimuli. Subjects were eight normal-hearing listeners. In each experiment, a 500-Hz pure tone of 400-ms duration was presented in continuous noise. In the diotic listening conditions, a signal and noise were presented binaurally with no interaural differences (So and No, respectively). In the dichotic listening conditions, the signal or noise at one ear was 180 degrees out-of-phase relative to the respective stimulus at the other ear (S pi and N pi, respectively). The first experiment examined frequency selectivity using the bandlimiting measure. Here, signal thresholds were determined as a function of masker bandwidth (50, 100, 250, 500, and 1000 Hz) for SoNo, S pi No, and SoN pi listening conditions. The second experiment used a modified bandlimiting measure. Here, signal thresholds (So and S pi) were determined with a relatively narrow No band of masker energy (50 Hz wide) centered about the signal. Then, a second No narrow-band masker (30 Hz wide) was added at another frequency region, and signal thresholds were reestablished. The results of the two experiments indicated that listeners process a wider band of frequencies when resolving dichotic stimuli than when resolving diotic or monotic stimuli. The results also indicated that the bandlimiting measure may underestimate the spectral band processed upon dichotic stimulation. Results are interpreted in terms of an across-ear and across-frequency processing of waveform amplitude envelope.     

Mechanisms determining the salience of coloration in echoed sound: influence of interaural time and level differences

This study investigates whether the salience of the pitch associated with a single reflection of a broadband sound, such as noise, is determined by the monaural information mediated by the stimuli at the two ears, or by the relative locations of the primary sound and the reflection. Pitch strength was measured as a function of the reflection delay and the lateral displacement between the primary sound and the reflection. Thereby, lateral displacement was produced by means of interaural time differences (ITDs) in experiment 1 and interaural level differences (ILDs) in experiment 3. The results from both experiments are in accordance with the assumption that the strength of the pitch associated with a reflection is based on a central average of the internal representations of the stimuli at the two ears. This notion was corroborated by experiment 2, which showed that the results from experiment 1 could be mimicked by simply adding the stimuli from the two ears and presenting the merged stimulus identically to both ears.     

Click lateralization is related to the beta component of the dichotic brainstem auditory evoked potentials of human subjects

The changes in perception and in the binaural difference waveform (BD) for dichotic clicks with interaural time and level differences (ITDs and ILDs) are compared. Only beta, the first major peak of the BD, correlated with the perceptual measurements. Whenever beta is clearly present, the clicks are perceived as a unitary fused image. Whenever the clicks are perceived as not fused, beta is undetectable by our methods. The amplitude of beta remains nearly constant as the ITD is increased to about 1 ms, while the click's position is perceived as moving from midline toward the leading ear. Over about the next 0.2 ms, beta becomes undetectable, as the image stops moving and loses its fused quality. As the ILD is increased, beta amplitude decreases gradually, while the image remains unitary and moves toward the unattenuated earphone. Thus beta becomes undetectable for ILDs of 30 to 35 dB, and the dichotic clicks become indistinguishable from monotic clicks for ILDs of 44 to 53 dB. The ITD and ILD matching curve for beta latency is similar to the ITD and ILD psychophysical matching curve for lateralization. These results suggest that beta is a physiological correlate of the categorical percept, binaural fusion, and is generated by a brainstem structure essential for the preception of click lateralization.     

Temporal pitch perception and the binaural system

Two experiments examined the relationship between temporal pitch (and, more generally, rate) perception and auditory lateralization. Both used dichotic pulse trains that were filtered into the same high (3,900-5,400-Hz) frequency region in order to eliminate place-of-excitation cues. In experiment 1, a 1-s periodic pulse train of rate Fr was presented to one ear, and a pulse train of rate 2Fr was presented to the other. In the "synchronous" condition, every other pulse in the 2Fr train was simultaneous with a pulse in the opposite ear. In each trial, subjects concentrated on one of the two binaural images produced by this mixture: they matched its perceived location by adjusting the interaural level difference (ILD) of a bandpass noise, and its rate/pitch was then matched by adjusting the rate of a regular pulse train. The results showed that at low Fr (e.g., 2 Hz), subjects heard two pulse trains of rate Fr, one in the "higher rate" ear, and one in the middle of the head. At higher Fr (>25 Hz) subjects heard two pulse trains on opposite sides of the midline, with the image on the higher rate side having a higher pitch than that on the "lower rate" side. The results were compared to those in a control condition, in which the pulses in the two ears were asynchronous. This comparison revealed a duplex region at Fr > 25 Hz, where across-ear synchrony still affected the perceived locations of the pulse trains, but did not affect their pitches. Experiment 2 used a 1.4-s 200-Hz dichotic pulse train, whose first 0.7 s contained a constant interaural time difference (ITD), after which the sign of the ITD alternated between subsequent pulses. Subjects matched the location and then the pitch of the "new" sound that started halfway through the pulse train. The matched location became more lateralized with increasing ITD, but subjects always matched a pitch near 200 Hz, even though the rate of pulses sharing the new ITD was only 100 Hz. It is concluded from both experiments that temporal pitch perception is not driven by the output of binaural mechanisms.     

Localization of sound in rooms. V. Binaural coherence and human sensitivity to interaural time differences in noise

Binaural recordings of noise in rooms were used to determine the relationship between binaural coherence and the effectiveness of the interaural time difference (ITD) as a cue for human sound localization. Experiments showed a strong, monotonic relationship between the coherence and a listener's ability to discriminate values of ITD. The relationship was found to be independent of other, widely varying acoustical properties of the rooms. However, the relationship varied dramatically with noise band center frequency. The ability to discriminate small ITD changes was greatest for a mid-frequency band. To achieve sensitivity comparable to mid-band, the binaural coherence had to be much larger at high frequency, where waveform ITD cues are imperceptible, and also at low frequency, where the binaural coherence in a room is necessarily large. Rivalry experiments with opposing interaural level differences (ILDs) found that the trading ratio between ITD and ILD increasingly favored the ILD as coherence decreased, suggesting that the perceptual weight of the ITD is decreased by increased reflections in rooms.     

Binaural speech intelligibility in noise for hearing-impaired listeners

The effect of head-induced interaural time delay (ITD) and interaural level differences (ILD) on binaural speech intelligibility in noise was studied for listeners with symmetrical and asymmetrical sensorineural hearing losses. The material, recorded with a KEMAR manikin in an anechoic room, consisted of speech, presented from the front (0 degree), and noise, presented at azimuths of 0 degree, 30 degrees, and 90 degrees. Derived noise signals, containing either only ITD or only ILD, were generated using a computer. For both groups of subjects, speech-reception thresholds (SRT) for sentences in noise were determined as a function of: (1) noise azimuth, (2) binaural cue, and (3) an interaural difference in overall presentation level, simulating the effect of a monaural hearing acid. Comparison of the mean results with corresponding data obtained previously from normal-hearing listeners shows that the hearing impaired have a 2.5 dB higher SRT in noise when both speech and noise are presented from the front, and 2.6-5.1 dB less binaural gain when the noise azimuth is changed from 0 degree to 90 degrees. The gain due to ILD varies among the hearing-impaired listeners between 0 dB and normal values of 7 dB or more. It depends on the high-frequency hearing loss at the side presented with the most favorable signal-to-noise (S/N) ratio. The gain due to ITD is nearly normal for the symmetrically impaired (4.2 dB, compared with 4.7 dB for the normal hearing), but only 2.5 dB in the case of asymmetrical impairment. When ITD is introduced in noise already containing ILD, the resulting gain is 2-2.5 dB for all groups. The only marked effect of the interaural difference in overall presentation level is a reduction of the gain due to ILD when the level at the ear with the better S/N ratio is decreased. This implies that an optimal monaural hearing aid (with a moderate gain) will hardly interfere with unmasking through ITD, while it may increase the gain due to ILD by preventing or diminishing threshold effects.     

Perception of across-frequency interaural level differences

The interaural level difference (ILD) is an important cue for the localization of sound sources. Just noticeable differences (JND) in ILD were measured in 12 normal hearing subjects for uncorrelated noise bands with a bandwidth of 13 octave and a different center frequency in both ears. In one ear the center frequency was either 250, 500, 1000, or 4000 Hz. In the other ear, a frequency shift of 0, 16, 13, or 1 octave was introduced. JNDs in ILD for unshifted, uncorrelated noise bands of 13 octave width were 2.6, 2.6, 2.5, and 1.4 dB for 250, 500, 1000, and 4000 Hz, respectively. Averaged over all shifts, JNDs decreased significantly with increasing frequency. For the shifted conditions, JNDs increased significantly with increasing shift. Performance on average worsened by 0.5, 0.9, and 1.5 dB for shifts of 16, 13, and 1 octave. Though performance decreases, the just noticeable ILDs for the shifted conditions were still in a range usable for lateralization. This has implications for signal processing algorithms for bilateral bimodal hearing instruments and the fitting of bilateral cochlear implants.     

Speech perception,localization, and lateralization with bilateral cochlear implants

Five bilateral cochlear implant users were tested for their localization abilities and speech understanding in noise, for both monaural and binaural listening conditions. They also participated in lateralization tasks to assess the impact of variations in interaural time delays (ITDs) and interaural level differences (ILDs) for electrical pulse trains under direct computer control. The localization task used pink noise bursts presented from an eight-loudspeaker array spanning an arc of approximately 108 degrees in front of the listeners at ear level (0-degree elevation). Subjects showed large benefits from bilateral device use compared to either side alone. Typical root-mean-square (rms) averaged errors across all eight loudspeakers in the array were about 10 degrees for bilateral device use and ranged from 20 degrees to 60 degrees using either ear alone. Speech reception thresholds (SRTs) were measured for sentences presented from directly in front of the listeners (0 degrees) in spectrally matching speech-weighted noise at either 0 degrees, +90 degrees or -90 degrees for four subjects out of five tested who could perform the task. For noise to either side, bilateral device use showed a substantial benefit over unilateral device use when noise was ipsilateral to the unilateral device. This was primarily because of monaural head-shadow effects, which resulted in robust SRT improvements (P<0.001) of about 4 to 5 dB when ipsilateral and contralateral noise positions were compared. The additional benefit of using both ears compared to the shadowed ear (i.e., binaural unmasking) was only 1 or 2 dB and less robust (P = 0.04). Results from the lateralization studies showed consistently good sensitivity to ILDs; better than the smallest level adjustment available in the implants (0.17 dB) for some subjects. Sensitivity to ITDs was moderate on the other hand, typically of the order of 100 micros. ITD sensitivity deteriorated rapidly when stimulation rates for unmodulated pulse-trains increased above a few hundred Hz but at 800 pps showed sensitivity comparable to 50-pps pulse-trains when a 50-Hz modulation was applied. In our opinion, these results clearly demonstrate important benefits are available from bilateral implantation, both for localizing sounds (in quiet) and for listening in noise when signal and noise sources are spatially separated. The data do indicate, however, that effects of interaural timing cues are weaker than those from interaural level cues and according to our psychophysical findings rely on the availability of low-rate information below a few hundred Hz.     

Tori of confusion: binaural localization cues for sources within reach of a listener

To a first-order approximation, binaural localization cues are ambiguous: many source locations give rise to nearly the same interaural differences. For sources more than a meter away, binaural localization cues are approximately equal for any source on a cone centered on the interaural axis (i.e., the well-known "cone of confusion"). The current paper analyzes simple geometric approximations of a head to gain insight into localization performance for nearby sources. If the head is treated as a rigid, perfect sphere, interaural intensity differences (IIDs) can be broken down into two main components. One component depends on the head shadow and is constant along the cone of confusion (and covaries with the interaural time difference, or ITD). The other component depends only on the relative path lengths from the source to the two ears and is roughly constant for a sphere centered on the interaural axis. This second factor is large enough to be perceptible only when sources are within one or two meters of the listener. Results are not dramatically different if one assumes that the ears are separated by 160 deg along the surface of the sphere (rather than diametrically opposite one another). Thus for nearby sources, binaural information should allow listeners to locate sources within a volume around a circle centered on the interaural axis on a "torus of confusion." The volume of the torus of confusion increases as the source approaches the median plane, degenerating to a volume around the median plane in the limit.     

Enhancing interaural-delay-based extents of laterality at high frequencies by using "transposed stimuli"

An acoustic pointing task was used to determine whether interaural temporal disparities (ITDs) conveyed by high-frequency "transposed" stimuli would produce larger extents of laterality than ITDs conveyed by bands of high-frequency Gaussian noise. The envelopes of transposed stimuli are designed to provide high-frequency channels with information similar to that conveyed by the waveforms of low-frequency stimuli. Lateralization was measured for low-frequency Gaussian noises, the same noises transposed to 4 kHz, and high-frequency Gaussian bands of noise centered at 4 kHz. Extents of laterality obtained with the transposed stimuli were greater than those obtained with bands of Gaussian noise centered at 4 kHz and, in some cases, were equivalent to those obtained with low-frequency stimuli. In a second experiment, the general effects on lateral position produced by imposed combinations of bandwidth, ITD, and interaural phase disparities (IPDs) on low-frequency stimuli remained when those stimuli were transposed to 4 kHz. Overall, the data were fairly well accounted for by a model that computes the cross-correlation subsequent to known stages of peripheral auditory processing augmented by low-pass filtering of the envelopes within the high-frequency channels of each ear.     

Failure of the precedence effect with a noise-band vocoder

The precedence effect (PE) describes the ability to localize a direct, leading sound correctly when its delayed copy (lag) is present, though not separately audible. The relative contribution of binaural cues in the temporal fine structure (TFS) of lead-lag signals was compared to that of interaural level differences (ILDs) and interaural time differences (ITDs) carried in the envelope. In a localization dominance paradigm participants indicated the spatial location of lead-lag stimuli processed with a binaural noise-band vocoder whose noise carriers introduced random TFS. The PE appeared for noise bursts of 10 ms duration, indicating dominance of envelope information. However, for three test words the PE often failed even at short lead-lag delays, producing two images, one toward the lead and one toward the lag. When interaural correlation in the carrier was increased, the images appeared more centered, but often remained split. Although previous studies suggest dominance of TFS cues, no image is lateralized in accord with the ITD in the TFS. An interpretation in the context of auditory scene analysis is proposed: By replacing the TFS with that of noise the auditory system loses the ability to fuse lead and lag into one object, and thus to show the PE.     

Sensitivity of human subjects to head-related transfer-function phase spectra.

Head-related transfer functions (HRTFs) for human subjects in anechoic space were modeled with modified phase spectra, including minimum-phase-plus-delay, linear-phase, and reversed-phase-plus-delay functions. The overall (wide-band) interaural time delay (ITD) for the modeled HRTFs was made consistent with that of the empirical HRTFs by setting the position-dependent, frequency-independent delay in the HRTF for the lagging ear. Signal analysis of the minimum-phase-plus-delay reconstructions indicated that model HRTFs deviate from empirical HRTF measurements maximally for contralateral azimuths and low elevations. Subjects assessed the perceptual validity of the model HRTFs in a four-interval, two-alternative, forced-choice discrimination paradigm. Results indicate that monaural discrimination performance of subjects was at chance for all three types of HRTF models. Binaural discrimination performance was at chance for the linear-phase HRTFs, was above chance for some locations for the minimum-phase-plus-delay HRTFs, and was above chance for all tested locations for the reversed-phase-plus-delay HRTFs. An analysis of low-frequency timing information showed that all of these results are consistent with efficient use of interaural time differences in the low-frequency components of the stimulus waveforms. It is concluded that listeners are insensitive to HRTF phase spectra as long as the overall ITD of the low-frequency components does not provide a reliable cue. In particular, the minimum-phase-plus-delay approximation to the HRTF phase spectrum is an adequate approximation as long as the low-frequency ITD is appropriate. These results and conclusions are all limited to the anechoic case when the HRTFs correspond to brief impulse responses limited to a few milliseconds.     

The effect of head-induced interaural time and level differences on speech intelligibility in noise

A study was made of the effect of interaural time delay (ITD) and acoustic headshadow on binaural speech intelligibility in noise. A free-field condition was simulated by presenting recordings, made with a KEMAR manikin in an anechoic room, through earphones. Recordings were made of speech, reproduced in front of the manikin, and of noise, emanating from seven angles in the azimuthal plane, ranging from 0 degree (frontal) to 180 degrees in steps of 30 degrees. From this noise, two signals were derived, one containing only ITD, the other containing only interaural level differences (ILD) due to headshadow. Using this material, speech reception thresholds (SRT) for sentences in noise were determined for a group of normal-hearing subjects. Results show that (1) for noise azimuths between 30 degrees and 150 degrees, the gain due to ITD lies between 3.9 and 5.1 dB, while the gain due to ILD ranges from 3.5 to 7.8 dB, and (2) ILD decreases the effectiveness of binaural unmasking due to ITD (on the average, the threshold shift drops from 4.6 to 2.6 dB). In a second experiment, also conducted with normal-hearing subjects, similar stimuli were used, but now presented monaurally or with an overall 20-dB attenuation in one channel, in order to simulate hearing loss. In addition, SRTs were determined for noise with fixed ITDs, for comparison with the results obtained with head-induced (frequency dependent) ITDs.(ABSTRACT TRUNCATED AT 250 WORDS)     

Localization cues with bilateral cochlear implants

Selected subjects with bilateral cochlear implants (CIs) showed excellent horizontal localization of wide-band sounds in previous studies. The current study investigated localization cues used by two bilateral CI subjects with outstanding localization ability. The first experiment studied localization for sounds of different spectral and temporal composition in the free field. Localization of wide-band noise was unaffected by envelope pulsation, suggesting that envelope-interaural time difference (ITD) cues contributed little. Low-pass noise was not localizable for one subject and localization depended on the cutoff frequency for the other which suggests that ITDs played only a limited role. High-pass noise with slow envelope changes could be localized, in line with contribution of interaural level differences (ILDs). In experiment 2, processors of one subject were raised above the head to void the head shadow. If they were spaced at ear distance, ITDs allowed discrimination of left from right for a pulsed wide-band noise. Good localization was observed with a head-sized cardboard inserted between processors, showing the reliance on ILDs. Experiment 3 investigated localization in virtual space with manipulated ILDs and ITDs. Localization shifted predominantly for offsets in ILDs, even for pulsed high-pass noise. This confirms that envelope ITDs contributed little and that localization with bilateral CIs was dominated by ILDs.     

The extent to which a position-based explanation accounts for binaural release from informational masking

Detection was measured for a 500 Hz tone masked by noise (an "energetic" masker) or sets of ten randomly drawn tones (an "informational" masker). Presenting the maskers diotically and the target tone with a variety of interaural differences (interaural amplitude ratios and/or interaural time delays) resulted in reduced detection thresholds relative to when the target was presented diotically ("binaural release from masking"). Thresholds observed when time and amplitude differences applied to the target were "reinforcing" (favored the same ear, resulting in a lateralized position for the target) were not significantly different from thresholds obtained when differences were "opposing" (favored opposite ears, resulting in a centered position for the target). This irrelevance of differences in the perceived location of the target is a classic result for energetic maskers but had not previously been shown for informational maskers. However, this parallellism between the patterns of binaural release for energetic and informational maskers was not accompanied by high correlations between the patterns for individual listeners, supporting the idea that the mechanisms for binaural release from energetic and informational masking are fundamentally different.     

Separation of concurrent broadband sound sources by human listeners

The effect of spatial separation on the ability of human listeners to resolve a pair of concurrent broadband sounds was examined. Stimuli were presented in a virtual auditory environment using individualized outer ear filter functions. Subjects were presented with two simultaneous noise bursts that were either spatially coincident or separated (horizontally or vertically), and responded as to whether they perceived one or two source locations. Testing was carried out at five reference locations on the audiovisual horizon (0 degrees, 22.5 degrees, 45 degrees, 67.5 degrees, and 90 degrees azimuth). Results from experiment 1 showed that at more lateral locations, a larger horizontal separation was required for the perception of two sounds. The reverse was true for vertical separation. Furthermore, it was observed that subjects were unable to separate stimulus pairs if they delivered the same interaural differences in time (ITD) and level (ILD). These findings suggested that the auditory system exploited differences in one or both of the binaural cues to resolve the sources, and could not use monaural spectral cues effectively for the task. In experiments 2 and 3, separation of concurrent noise sources was examined upon removal of low-frequency content (and ITDs), onset/offset ITDs, both of these in conjunction, and all ITD information. While onset and offset ITDs did not appear to play a major role, differences in ongoing ITDs were robust cues for separation under these conditions, including those in the envelopes of high-frequency channels.     

Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user

Experiments were conducted with a single, bilateral cochlear implant user to examine interaural level and time-delay cues that putatively underlie the design and efficacy of bilateral implant systems. The subject's two implants were of different types but custom equipment allowed presentation of controlled bilateral stimuli, particularly those with specified interaural time difference (ITD) and interaural level difference (ILD) cues. A lateralization task was used to measure the effect of these cues on the perceived location of the sensations elicited. For trains of fixed-amplitude, biphasic current pulses at 100 pps, the subject demonstrated sensitivity to an ITD of 300 micros, providing evidence of access to binaural information. The choice of bilateral electrode pair greatly influenced ITD sensitivity, suggesting that electrode pairings are likely to be an important consideration in the effort to provide binaural advantages. The selection of bilateral electrode pairs showing sensitivity to ITD was partially aided by comparisons of the pitch elicited by individual electrodes in each ear (when stimulated alone with fixed-amplitude current pulses at 813 pps): specifically, interaural electrodes with similar pitches were more likely (but not certain) to show ITD sensitivity. Significant changes in lateral position occurred with specific electrode pairs. With five bilateral electrode pairs of 14 tested, ITDs of 300 and 600 micros moved an auditory image significantly from right to left. With these same pairs, ILD changes of approximately 11% of the dynamic range (in microApp) moved an auditory image from the far left to the far right-significantly farther than the nine pairs not showing significant ITD sensitivity. However, even these nine pairs did show response changes as a function of the interaural (or confounding monaural) level cue. Overall, insofar as the access to bilateral cues demonstrated herein generalizes to other subjects, it provides hope that the normal binaural advantages for speech recognition and sound localization can be made available to bilateral implant users.