Binaural speech intelligibility in noise for hearing-impaired listeners

The effect of head-induced interaural time delay (ITD) and interaural level differences (ILD) on binaural speech intelligibility in noise was studied for listeners with symmetrical and asymmetrical sensorineural hearing losses. The material, recorded with a KEMAR manikin in an anechoic room, consisted of speech, presented from the front (0 degree), and noise, presented at azimuths of 0 degree, 30 degrees, and 90 degrees. Derived noise signals, containing either only ITD or only ILD, were generated using a computer. For both groups of subjects, speech-reception thresholds (SRT) for sentences in noise were determined as a function of: (1) noise azimuth, (2) binaural cue, and (3) an interaural difference in overall presentation level, simulating the effect of a monaural hearing acid. Comparison of the mean results with corresponding data obtained previously from normal-hearing listeners shows that the hearing impaired have a 2.5 dB higher SRT in noise when both speech and noise are presented from the front, and 2.6-5.1 dB less binaural gain when the noise azimuth is changed from 0 degree to 90 degrees. The gain due to ILD varies among the hearing-impaired listeners between 0 dB and normal values of 7 dB or more. It depends on the high-frequency hearing loss at the side presented with the most favorable signal-to-noise (S/N) ratio. The gain due to ITD is nearly normal for the symmetrically impaired (4.2 dB, compared with 4.7 dB for the normal hearing), but only 2.5 dB in the case of asymmetrical impairment. When ITD is introduced in noise already containing ILD, the resulting gain is 2-2.5 dB for all groups. The only marked effect of the interaural difference in overall presentation level is a reduction of the gain due to ILD when the level at the ear with the better S/N ratio is decreased. This implies that an optimal monaural hearing aid (with a moderate gain) will hardly interfere with unmasking through ITD, while it may increase the gain due to ILD by preventing or diminishing threshold effects.     

The effect of head-induced interaural time and level differences on speech intelligibility in noise

A study was made of the effect of interaural time delay (ITD) and acoustic headshadow on binaural speech intelligibility in noise. A free-field condition was simulated by presenting recordings, made with a KEMAR manikin in an anechoic room, through earphones. Recordings were made of speech, reproduced in front of the manikin, and of noise, emanating from seven angles in the azimuthal plane, ranging from 0 degree (frontal) to 180 degrees in steps of 30 degrees. From this noise, two signals were derived, one containing only ITD, the other containing only interaural level differences (ILD) due to headshadow. Using this material, speech reception thresholds (SRT) for sentences in noise were determined for a group of normal-hearing subjects. Results show that (1) for noise azimuths between 30 degrees and 150 degrees, the gain due to ITD lies between 3.9 and 5.1 dB, while the gain due to ILD ranges from 3.5 to 7.8 dB, and (2) ILD decreases the effectiveness of binaural unmasking due to ITD (on the average, the threshold shift drops from 4.6 to 2.6 dB). In a second experiment, also conducted with normal-hearing subjects, similar stimuli were used, but now presented monaurally or with an overall 20-dB attenuation in one channel, in order to simulate hearing loss. In addition, SRTs were determined for noise with fixed ITDs, for comparison with the results obtained with head-induced (frequency dependent) ITDs.(ABSTRACT TRUNCATED AT 250 WORDS)     

Temporal weighting functions for interaural time and level differences. II. The effect of binaurally synchronous temporal jitter

Recent work has demonstrated that sensitivity to interaural time differences (ITD) carried by high-rate cochlear implant pulse trains or analogous acoustic signals can be enhanced by imposing random temporal variation on the stimulus rate [see Goupell et al. (2009). J. Acoust. Soc. Am. 126, 2511-2521]. The present study characterized the effect of such "temporal jitter" on normal-hearing listeners' weighting of ITD and interaural level differences (ILD) applied to brief trains of Gabor clicks (4 kHz center frequency) presented at nominal interclick intervals (ICI) of 1.25 and 2.5 ms. Lateral discrimination judgments were evaluated on the basis of the ITD or ILD carried by individual clicks in each train. Random perturbation of the ICI significantly reduced listeners' weighting of onset cues for both ITD and ILD discrimination compared to corresponding isochronous conditions, consistent with enhanced sensitivity to post-onset binaural cues in jittered stimuli, although the reduction of onset weighting was not statistically significant at 1.25 ms ICI. An additional analysis suggested greater weighting of ITD or ILD presented following lengthened versus shortened ICI, although weights for such "gaps" and "squeezes" were comparable to other post-onset weights. Results are discussed in terms of binaural information available in jittered versus isochronous stimuli.     

A model for sound lateralization.

Recent studies of multiple sclerosis (MS) and stroke patients suggested a correlation between two patterns of abnormal performance in lateralization tasks and two sites of pontine lesions. Most patients who had lesions below or at the superior olivary complex (SOC) perceived all interaural differences in binaural stimuli as small, while most patients who had lesions above the SOC perceived all interaural differences as large. The two abnormal performance patterns occurred for interaural time differences (ITD) and/or for interaural level differences (ILD). The present model proposes a multi-level hierarchical brainstem structure that estimates ITD and ILD. The first level seeks dissimilarity between the left and right inputs and a second level looks for similarity between the two sides' inputs. Each level is modeled as an ensemble of neural arrays in which each unit performs a logic or arithmetic function. The inputs are simulations of auditory nerve responses to broadband stimuli. Simulations yield good correspondence to the effect of both locations of pontine lesions on binaural performance.     

Interaural spectral asymmetry and sensitivity to interaural time differences

Listeners' ability to discriminate interaural time difference (ITD) changes in low-frequency noise was determined as a function of differences in the noise spectra delivered to each ear. An ITD was applied to Gaussian noise, which was bandpass filtered using identical high-pass, but different low-pass cutoff frequencies across ears. Thus, one frequency region was dichotic, and a higher-frequency region monotic. ITD thresholds increased as bandwidth to one ear (i.e., monotic bandwidth) increased, despite the fact that the region of interaural spectral overlap remained constant. Results suggest that listeners can process ITD differences when the spectra at two ears are moderately different.     

Array signal processing with two outputs preserving binaural information

A new type of array signal processing combined with a weighted least squares algorithm to enable two-channel output with binaural information is proposed in this paper. This algorithm may be effective for use in a binaural hearing aid because the interaural relationship can be preserved after array signal processing. Retaining spatial information on specified directions while sufficiently suppressing unnecessary ambient noise coming from directions other than those of target sounds is required for this type of algorithm. In order to satisfy these two simultaneous requirements, the proposed algorithm was derived from a constraint algorithm by employing the weighted least squares algorithm. Performance in directivity patterns as well as interaural time difference (ITD) and interaural level difference (ILD) were evaluated. Computer simulations showed that this algorithm yields robust performance in various conditions compared with array signal processing based on a constraint algorithm.     

Source localization in complex listening situations: selection of binaural cues based on interaural coherence

In everyday complex listening situations, sound emanating from several different sources arrives at the ears of a listener both directly from the sources and as reflections from arbitrary directions. For localization of the active sources, the auditory system needs to determine the direction of each source, while ignoring the reflections and superposition effects of concurrently arriving sound. A modeling mechanism with these desired properties is proposed. Interaural time difference (ITD) and interaural level difference (ILD) cues are only considered at time instants when only the direct sound of a single source has non-negligible energy in the critical band and, thus, when the evoked ITD and ILD represent the direction of that source. It is shown how to identify such time instants as a function of the interaural coherence (IC). The source directions suggested by the selected ITD and ILD cues are shown to imply the results of a number of published psychophysical studies related to source localization in the presence of distracters, as well as in precedence effect conditions.     

The spatial unmasking of speech: evidence for within-channel processing of interaural time delay

Across-frequency processing by common interaural time delay (ITD) in spatial unmasking was investigated by measuring speech reception thresholds (SRTs) for high- and low-frequency bands of target speech presented against concurrent speech or a noise masker. Experiment 1 indicated that presenting one of these target bands with an ITD of +500 micros and the other with zero ITD (like the masker) provided some release from masking, but full binaural advantage was only measured when both target bands were given an ITD of + 500 micros. Experiment 2 showed that full binaural advantage could also be achieved when the high- and low-frequency bands were presented with ITDs of equal but opposite magnitude (+/- 500 micros). In experiment 3, the masker was also split into high- and low-frequency bands with ITDs of equal but opposite magnitude (+/-500 micros). The ITD of the low-frequency target band matched that of the high-frequency masking band and vice versa. SRTs indicated that, as long as the target and masker differed in ITD within each frequency band, full binaural advantage could be achieved. These results suggest that the mechanism underlying spatial unmasking exploits differences in ITD independently within each frequency channel.     

Influence of spatial and temporal coding on auditory gap detection

This study investigated the effect on gap detection of perceptual channels, hypothesized to be tuned to spatial location or fundamental frequency (f0). Thresholds were measured for the detection of a silent temporal gap between two markers. In the first experiment, the markers were broadband noise, presented either binaurally or monaurally. In the binaural conditions, the markers were either diotic, or had a 640-micros interaural time difference (ITD) or a 12-dB interaural level difference (ILD). Reversing the ITD across the two markers had no effect on gap detection relative to the diotic condition. Reversing the ILD across the two markers produced a marked deterioration in performance. However, the same deterioration was observed in the monaural conditions when a 12-dB level difference was introduced between the two markers. The results provide no evidence for the role of spatially tuned neural channels in gap detection. In the second experiment, the markers were harmonic tone complexes, filtered to contain only high, unresolved harmonics. Using complexes with a fixed spectral envelope, where the f0 (of 140 or 350 Hz) was different for the two markers, produced a deterioration in performance, relative to conditions where the f0 remained the same. A larger deterioration was observed when the two markers occupied different spectral regions but had the same f0. This supports the idea that peripheral coding is dominant in determining gap-detection thresholds when the two markers differ along any physical dimension. Higher-order neural coding mechanisms of f0 and spatial location seem to play a smaller role and no role, respectively.     

Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user

Experiments were conducted with a single, bilateral cochlear implant user to examine interaural level and time-delay cues that putatively underlie the design and efficacy of bilateral implant systems. The subject's two implants were of different types but custom equipment allowed presentation of controlled bilateral stimuli, particularly those with specified interaural time difference (ITD) and interaural level difference (ILD) cues. A lateralization task was used to measure the effect of these cues on the perceived location of the sensations elicited. For trains of fixed-amplitude, biphasic current pulses at 100 pps, the subject demonstrated sensitivity to an ITD of 300 micros, providing evidence of access to binaural information. The choice of bilateral electrode pair greatly influenced ITD sensitivity, suggesting that electrode pairings are likely to be an important consideration in the effort to provide binaural advantages. The selection of bilateral electrode pairs showing sensitivity to ITD was partially aided by comparisons of the pitch elicited by individual electrodes in each ear (when stimulated alone with fixed-amplitude current pulses at 813 pps): specifically, interaural electrodes with similar pitches were more likely (but not certain) to show ITD sensitivity. Significant changes in lateral position occurred with specific electrode pairs. With five bilateral electrode pairs of 14 tested, ITDs of 300 and 600 micros moved an auditory image significantly from right to left. With these same pairs, ILD changes of approximately 11% of the dynamic range (in microApp) moved an auditory image from the far left to the far right-significantly farther than the nine pairs not showing significant ITD sensitivity. However, even these nine pairs did show response changes as a function of the interaural (or confounding monaural) level cue. Overall, insofar as the access to bilateral cues demonstrated herein generalizes to other subjects, it provides hope that the normal binaural advantages for speech recognition and sound localization can be made available to bilateral implant users.     

Head-related transfer function database and its analyses

Based on the measurements from 52 Chinese subjects (26 males and 26 females), a high-spatial-resolution head-related transfer function (HRTF) database with corre- sponding anthropometric parameters is established. By using the database, cues relating to sound source localization, including interaural time difference (ITD), interaural level difference (ILD), and spectral features introduced by pinna, are analyzed. Moreover, the statistical relationship between ITD and anthropometric parameters is estimated. It is proved that the mean values of maximum ITD for male and female are significantly different, so are those for Chinese and western sub- jects. The difference in ITD is due to the difference in individual anthropometric parameters. It is further proved that the spectral features introduced by pinna strongly depend on individual; while at high frequencies (f≥ 5.5 kHz), HRTFs are left-right asymmetric. This work is instructive and helpful for the research on bin- aural hearing and applications on virtual auditory in future.     

Enhancement, adaptation, and the binaural system

In a test sound consisting of a burst of pink noise, an arbitrarily selected target frequency band can be "enhanced" by the previous presentation of a similar noise with a spectral notch in the target frequency region. As a result of the enhancement, the test sound evokes a pitch sensation corresponding to the pitch of the target band. Here, a pitch comparison task was used to assess enhancement. In the first experiment, a stronger enhancement effect was found when the test sound and its precursor had the same interaural time difference (ITD) than when they had opposite ITDs. Two subsequent experiments were concerned with the audibility of an instance of dichotic pitch in binaural test sounds preceded by precursors. They showed that it is possible to enhance a frequency region on the sole basis of ITD manipulations, using spectrally identical test sounds and precursors. However, the observed effects were small. A major goal of this study was to test the hypothesis that enhancement originates at least in part from neural adaptation processes taking place at a central level of the auditory system. The data failed to provide strong support for this hypothesis.     

Binaural processing of modulated interaural level differences

Two experiments are presented that measure the acuity of binaural processing of modulated interaural level differences (ILDs) using psychoacoustic methods. In both experiments, dynamic ILDs were created by imposing an interaurally antiphasic sinusoidal amplitude modulation (AM) signal on high-frequency carriers, which were presented over headphones. In the first experiment, the sensitivity to dynamic ILDs was measured as a function of the modulation frequency using puretone, and interaurally correlated and uncorrelated narrow-band noise carriers. The intrinsic interaural level fluctuations of the uncorrelated noise carriers raised the ILD modulation detection thresholds with respect to the pure-tone carriers. The diotic fluctuations of the correlated noise carriers also caused a small increase in the thresholds over the pure-tone carriers, particularly with low ILD modulation frequencies. The second experiment investigated the modulation frequency selectivity in dynamic ILD processing by imposing an interaurally uncorrelated bandpass noise AM masker in series with the interaurally antiphasic AM signal on a pure-tone carrier. By varying the masker center frequencies relative to the signal modulation frequency, broadly tuned, bandpass-shaped patterns were obtained. Simulations with an existing binaural model show that a low-pass filter to limit the binaural temporal resolution is not sufficient to predict the results of the experiments.     

Lateralization and detection of pulse trains with alternating interaural time delays

The effect of onset interaural time differences (ITDs) on lateralization and detection was investigated for broadband pulse trains 250 ms long with a binaural fundamental frequency of 250 Hz. Within each train, ITDs of successive binaural pulse pairs alternated between two of three values (0 micros, 500 micros left-leading, and 500 micros right-leading) or were invariant. For the alternating conditions, the experimental manipulation was the choice of which of two ITDs was presented first (i.e., at stimulus onset). Lateralization, which was estimated using a broadband noise pointer with a listener adjustable interaural delay, was determined largely by the onset ITD. However, detection thresholds for the signals in left-leading or diotic continuous broadband noise were not affected by where the signals were lateralized. A quantitative analysis suggested that binaural masked thresholds for the pulse trains were well accounted for by the level and phase of harmonic components at 500 and 750 Hz. Detection thresholds obtained for brief stimuli (two binaural pulse or noise burst pairs) were also independent of which of two ITDs was presented first. The control of lateralization by onset cues appears to be based on mechanisms not essential for binaural detection.     

Interaural fluctuations and the detection of interaural incoherence. III. Narrowband experiments and binaural models

In the first two articles of this series, reproducible noises with a fixed value of interaural coherence (0.992) were used to study the human ability to detect interaural incoherence. It was found that incoherence detection is strongly correlated with fluctuations in interaural differences, especially for narrow noise bandwidths, but it remained unclear what function of the fluctuations best agrees with detection data. In the present article, ten different binaural models were tested against detection data for 14- and 108-Hz bandwidths. These models included different types of binaural processing: independent-interaural-phase-difference/interaural-level-difference, lateral-position, and short-term cross-correlation. Several preprocessing transformations of the interaural differences were incorporated: compression of binaural cues, temporal averaging, and envelope weighting. For the 14-Hz bandwidth data, the most successful model postulated that incoherence is detected via fluctuations of interaural phase and interaural level processed by independent centers. That model correlated with detectability at r=0.87. That model proved to be more successful than short-term cross-correlation models incorporating standard physiologically-based model features (r=0.78). For the 108-Hz bandwidth data, detection performance varied much less among different waveforms, and the data were less able to distinguish between models.     

Temporal pitch perception and the binaural system

Two experiments examined the relationship between temporal pitch (and, more generally, rate) perception and auditory lateralization. Both used dichotic pulse trains that were filtered into the same high (3,900-5,400-Hz) frequency region in order to eliminate place-of-excitation cues. In experiment 1, a 1-s periodic pulse train of rate Fr was presented to one ear, and a pulse train of rate 2Fr was presented to the other. In the "synchronous" condition, every other pulse in the 2Fr train was simultaneous with a pulse in the opposite ear. In each trial, subjects concentrated on one of the two binaural images produced by this mixture: they matched its perceived location by adjusting the interaural level difference (ILD) of a bandpass noise, and its rate/pitch was then matched by adjusting the rate of a regular pulse train. The results showed that at low Fr (e.g., 2 Hz), subjects heard two pulse trains of rate Fr, one in the "higher rate" ear, and one in the middle of the head. At higher Fr (>25 Hz) subjects heard two pulse trains on opposite sides of the midline, with the image on the higher rate side having a higher pitch than that on the "lower rate" side. The results were compared to those in a control condition, in which the pulses in the two ears were asynchronous. This comparison revealed a duplex region at Fr > 25 Hz, where across-ear synchrony still affected the perceived locations of the pulse trains, but did not affect their pitches. Experiment 2 used a 1.4-s 200-Hz dichotic pulse train, whose first 0.7 s contained a constant interaural time difference (ITD), after which the sign of the ITD alternated between subsequent pulses. Subjects matched the location and then the pitch of the "new" sound that started halfway through the pulse train. The matched location became more lateralized with increasing ITD, but subjects always matched a pitch near 200 Hz, even though the rate of pulses sharing the new ITD was only 100 Hz. It is concluded from both experiments that temporal pitch perception is not driven by the output of binaural mechanisms.     

Localization by interaural time difference (ITD): effects of interaural frequency mismatch.

A commonly accepted physiological model for lateralization of low-frequency sounds by interaural time delay (ITD) stipulates that binaural comparison neurons receive input from frequency-matched channels from each ear. Here, the effects of hypothetical interaural frequency mismatches on this model are reported. For this study, the cat's auditory system peripheral to the binaural comparison neurons was represented by a neurophysiologically derived model, and binaural comparison neurons were represented by cross-correlators. The results of the study indicate that, for binaural comparison neurons receiving input from one cochlear channel from each ear, interaural CF mismatches may serve to either augment or diminish the effective difference in ipsilateral and contralateral axonal time delays from the periphery to the binaural comparison neuron. The magnitude of this increase or decrease in the effective time delay difference can be up to 400 microseconds for CF mismatches of 0.2 octaves or less for binaural neurons with CFs between 250 Hz and 2.5 kHz. For binaural comparison neurons with nominal CFs near 500 Hz, the 25-microsecond effective time delay difference caused by a 0.012-octave CF mismatch is equal to the ITD previously shown to be behaviorally sufficient for the cat to lateralize a low-frequency sound source.     

Speech segregation in rooms: monaural, binaural, and interacting effects of reverberation on target and interferer

Speech reception thresholds were measured in virtual rooms to investigate the influence of reverberation on speech intelligibility for spatially separated targets and interferers. The measurements were realized under headphones, using target sentences and noise or two-voice interferers. The room simulation allowed variation of the absorption coefficient of the room surfaces independently for target and interferer. The direct-to-reverberant ratio and interaural coherence of sources were also varied independently by considering binaural and diotic listening. The main effect of reverberation on the interferer was binaural and mediated by the coherence, in agreement with binaural unmasking theories. It appeared at lower reverberation levels than the effect of reverberation on the target, which was mainly monaural and associated with the direct-to-reverberant ratio, and could be explained by the loss of amplitude modulation in the reverberant speech signals. This effect was slightly smaller when listening binaurally. Reverberation might also be responsible for a disruption of the mechanism by which the auditory system exploits fundamental frequency differences to segregate competing voices, and a disruption of the "listening in the gaps" associated with speech interferers. These disruptions may explain an interaction observed between the effects of reverberation on the targets and two-voice interferers.     

Similar patterns of learning and performance variability for human discrimination of interaural time differences at high and low frequencies

Sound source localization on the horizontal plane is primarily determined by interaural time differences (ITDs) for low-frequency stimuli and by interaural level differences (ILDs) for high-frequency stimuli, but ITDs in high-frequency complex stimuli can also be used for localization. Of interest here is the relationship between the processing of high-frequency ITDs and that of low-frequency ITDs and high-frequency ILDs. A few similarities in human performance with high- and low-frequency ITDs have been taken as evidence for similar ITD processing across frequency regions. However, such similarities, unless accompanied by differences between ITD and ILD performance on the same measure, could potentially reflect processing attributes common to both ITDs and ILDs rather than to ITDs only. In the present experiment, both learning and variability patterns in human discrimination of ITDs in high-frequency amplitude-modulated tones were examined and compared to previously obtained data with low-frequency ITDs and high-frequency ILDs. Both patterns for high-frequency ITDs were more similar to those for low-frequency ITDs than for high-frequency ILDs. These results thus add to the evidence supporting similar ITD processing across frequency regions, and further suggest that both high- and low-frequency ITD processing is less modifiable and more noisy than ILD processing.     

Interaural fluctuations and the detection of interaural incoherence. II. Brief duration noises

Listeners detected a small amount of interaural incoherence in reproducible noises with narrow bandwidths and a center frequency of 500 Hz. The durations of the noise stimuli were 100, 50, or 25 ms, and every one of the noises had the same value of interaural coherence, namely 0.992. When the nominal noise bandwidth was 14 Hz, the ability to detect incoherence was found to depend strongly on the size of the fluctuations in interaural phase and level for durations of 100 and 50 ms. For the duration of 25 ms, performance did not appear to depend entirely on fluctuations. Instead, listeners sometimes recognized incoherence on the basis of laterality. However, when the nominal bandwidth was doubled, leading to a greater number of fluctuations, detection performance at 25 ms resembled that at 50 ms for the smaller bandwidth. It is concluded that the detection of a small amount of interaural incoherence is mediated by fluctuations in phase and level for brief stimulus durations, so long as such fluctuations exist physically. This conclusion presents a promising alternative to models of binaural detection that are based on the short-term cross-correlation in the stimulus.