The effect of masker interaural phase on the detection of a monaural signal

The masking-level difference (MLD) for a 500-Hz monaural pure-tone signal was examined as a function of the interaural phase shift of a 100-Hz-wide noise band centered on 500 Hz. Results indicated that the MLD decreased in magnitude as the interaural phase shift of the masker increased. In a second experiment, the 100-Hz-wide noise band was used as both the masker and the signal in order to examine the detection cues of interaural time difference and interaural level difference separately. Again, the interaural phase of the masker was varied, and an Sm signal was presented. Results indicated that the MLD decreased as a function of increasing masker interaural temporal difference for the time cue, but that the MLD did not change systematically for the level cue. The deterioration of binaural detection as a function of increasing masker interaural phase difference was not as great as that which has been reported in localization and lateralization experiments.     

Lateralization of acoustic signals by dichotically listening budgerigars (Melopsittacus undulatus)

Sound localization allows humans and animals to determine the direction of objects to seek or avoid and indicates the appropriate position to direct visual attention. Interaural time differences (ITDs) and interaural level differences (ILDs) are two primary cues that humans use to localize or lateralize sound sources. There is limited information about behavioral cue sensitivity in animals, especially animals with poor sound localization acuity and small heads, like budgerigars. ITD and ILD thresholds were measured behaviorally in dichotically listening budgerigars equipped with headphones in an identification task. Budgerigars were less sensitive than humans and cats, and more similar to rabbits, barn owls, and monkeys, in their abilities to lateralize dichotic signals. Threshold ITDs were relatively constant for pure tones below 4 kHz, and were immeasurable at higher frequencies. Threshold ILDs were relatively constant over a wide range of frequencies, similar to humans. Thresholds in both experiments were best for broadband noise stimuli. These lateralization results are generally consistent with the free field localization abilities of these birds, and add support to the idea that budgerigars may be able to enhance their cues to directional hearing (e.g., via connected interaural pathways) beyond what would be expected based on head size.     

Speech perception from monaural and binaural information

Two experiments explored the concept of the binaural spectrogram [Culling and Colburn, J. Acoust. Soc. Am. 107, 517-527 (2000)] and its relationship to monaurally derived information. In each experiment, speech was added to noise at an adverse signal-to-noise ratio in the NoS pi binaural configuration. The resulting monaural and binaural cues were analyzed within an array of spectro-temporal bins and then these cues were resynthesized by modulating the intensity and/or interaural correlation of freshly generated noise. Experiment 1 measured the intelligibility of the resynthesized stimuli and compared them with the original NoSo and NoS pi stimuli at a fixed signal-to-noise ratio. While NoS pi stimuli were approximately equal to 50% intelligible, each cue in isolation produced similar (very low) intelligibility to the NoSo condition. The resynthesized combination produced approximately equal to 25% intelligibility. Modulation of interaural correlation below 1.2 kHz and of amplitude above 1.2 kHz was not as effective as their combination across all frequencies. Experiment 2 measured three-point psychometric functions in which the signal-to-noise ratio of the original NoS pi stimulus was increased in 3-dB steps from the level used in experiment 1. Modulation of interaural correlation alone proved to have a flat psychometric function. The functions for NoS pi and for combined monaural and binaural cues appeared similar in slope, but shifted horizontally. The results indicate that for sentence materials, neither fluctuations in interaural correlation nor in monaural intensity are sufficient to support speech recognition at signal-to-noise ratios where 50% intelligibility is achieved in the NoS pi configuration; listeners appear to synergistically combine monaural and binaural information in this task, to some extent within the same frequency region.     

Lateralization and detection of pulse trains with alternating interaural time delays

The effect of onset interaural time differences (ITDs) on lateralization and detection was investigated for broadband pulse trains 250 ms long with a binaural fundamental frequency of 250 Hz. Within each train, ITDs of successive binaural pulse pairs alternated between two of three values (0 micros, 500 micros left-leading, and 500 micros right-leading) or were invariant. For the alternating conditions, the experimental manipulation was the choice of which of two ITDs was presented first (i.e., at stimulus onset). Lateralization, which was estimated using a broadband noise pointer with a listener adjustable interaural delay, was determined largely by the onset ITD. However, detection thresholds for the signals in left-leading or diotic continuous broadband noise were not affected by where the signals were lateralized. A quantitative analysis suggested that binaural masked thresholds for the pulse trains were well accounted for by the level and phase of harmonic components at 500 and 750 Hz. Detection thresholds obtained for brief stimuli (two binaural pulse or noise burst pairs) were also independent of which of two ITDs was presented first. The control of lateralization by onset cues appears to be based on mechanisms not essential for binaural detection.     

Lateralization based on interaural phase differences: effects of frequency, amplitude, duration, and shape of rise/decay

Experiments in lateralization were performed to evaluate the relative contribution of envelope and phase cues in binaural hearing with particular reference to the effects of frequency, amplitude, shape of rise/decay, and duration of peak amplitude. Pure-tone signals were presented with interaural phase shifts ranging between 90 degrees and 360 degrees. For a given value of phase shift, the leading signal was presented randomly to the right or left ear over a block of 100 trials, and the laterality of the resultant image was judged. Rise/decay time was varied from 5 to 200 ms across blocks. The results confirmed our previous finding that a rise/decay time of at least 200 ms is required to secure a psychophysically steady-state signal. This value will, however, depend on the values chosen for the other signal parameters. Within limits, decreasing intensity could be compensated for by decreasing rise/decay, suggesting the psychophysical importance of the initial segment of the signal (precedence effect). For low frequencies of 650 to 1250 Hz, performance is sensitive to interaural phase shift and largely independent of frequency. For higher frequencies of 1500 and 2000 Hz, lateralization is independent of the phase cue and also largely insensitive to change in rise/decay time. Finally, performance remains unchanged with variation in peak duration ranging from 25 to 200 ms.     

Localization by interaural time difference (ITD): effects of interaural frequency mismatch.

A commonly accepted physiological model for lateralization of low-frequency sounds by interaural time delay (ITD) stipulates that binaural comparison neurons receive input from frequency-matched channels from each ear. Here, the effects of hypothetical interaural frequency mismatches on this model are reported. For this study, the cat's auditory system peripheral to the binaural comparison neurons was represented by a neurophysiologically derived model, and binaural comparison neurons were represented by cross-correlators. The results of the study indicate that, for binaural comparison neurons receiving input from one cochlear channel from each ear, interaural CF mismatches may serve to either augment or diminish the effective difference in ipsilateral and contralateral axonal time delays from the periphery to the binaural comparison neuron. The magnitude of this increase or decrease in the effective time delay difference can be up to 400 microseconds for CF mismatches of 0.2 octaves or less for binaural neurons with CFs between 250 Hz and 2.5 kHz. For binaural comparison neurons with nominal CFs near 500 Hz, the 25-microsecond effective time delay difference caused by a 0.012-octave CF mismatch is equal to the ITD previously shown to be behaviorally sufficient for the cat to lateralize a low-frequency sound source.     

Underwater localization of pure tones by harbor seals (Phoca vitulina)

The underwater sound localization acuity of harbor seals (Phoca vitulina) was measured in the horizontal plane. Minimum audible angles (MAAs) of pure tones were determined as a function of frequency from 0.2 to 16 kHz for two seals. Testing was conducted in a 10-m-diam underwater half circle using a right/left psychophysical procedure. The results indicate that for both harbor seals, MAAs were large at high frequencies (13.5 degrees and 17.4 degrees at 16 kHz), transitional at intermediate frequencies (9.6 degrees and 10.1 degrees at 4 kHz), and particularly small at low frequencies (3.2 degrees and 3.1 degrees at 0.2 kHz). Harbor seals seem to be able to utilize both binaural cues, interaural time differences (ITDs) and interaural intensity differences (IIDs), but a significant decrease in the sound localization acuity with increasing frequency suggests that IID cues may not be as robust as ITD cues under water. These results suggest that the harbor seal can be regarded as a low-frequency specialist. Additionally, to obtain a MAA more representative of the species, the horizontal underwater MAA of six adult harbor seals was measured at 2 kHz under identical conditions. The MAAs of the six animals ranged from 8.8 degrees to 11.7 degrees , resulting in a mean MAA of 10.3 degrees .     

Binaural speech unmasking and localization in noise with bilateral cochlear implants using envelope and fine-timing based strategies

Four adult bilateral cochlear implant users, with good open-set sentence recognition, were tested with three different sound coding strategies for binaural speech unmasking and their ability to localize 100 and 500 Hz click trains in noise. Two of the strategies tested were envelope-based strategies that are clinically widely used. The third was a research strategy that additionally preserved fine-timing cues at low frequencies. Speech reception thresholds were determined in diotic noise for diotic and interaurally time-delayed speech using direct audio input to a bilateral research processor. Localization in noise was assessed in the free field. Overall results, for both speech and localization tests, were similar with all three strategies. None provided a binaural speech unmasking advantage due to the application of 700 micros interaural time delay to the speech signal, and localization results showed similar response patterns across strategies that were well accounted for by the use of broadband interaural level cues. The data from both experiments combined indicate that, in contrast to normal hearing, timing cues available from natural head-width delays do not offer binaural advantages with present methods of electrical stimulation, even when fine-timing cues are explicitly coded.     

Sound segregation based on temporal envelope structure and binaural cues

The ability to segregate two spectrally and temporally overlapping signals based on differences in temporal envelope structure and binaural cues was investigated. Signals were a harmonic tone complex (HTC) with 20 Hz fundamental frequency and a bandpass noise (BPN). Both signals had interaural differences of the same absolute value, but with opposite signs to establish lateralization to different sides of the medial plane, such that their combination yielded two different spatial configurations. As an indication for segregation ability, threshold interaural time and level differences were measured for discrimination between these spatial configurations. Discrimination based on interaural level differences was good, although absolute thresholds depended on signal bandwidth and center frequency. Discrimination based on interaural time differences required the signals' temporal envelope structures to be sufficiently different. Long-term interaural cross-correlation patterns or long-term averaged patterns after equalization-cancellation of the combined signals did not provide information for the discrimination. The binaural system must, therefore, have been capable of processing changes in interaural time differences within the period of the harmonic tone complex, suggesting that monaural information from the temporal envelopes influences the use of binaural information in the perceptual organization of signal components.     

Acoustical cues for sound localization by the Mongolian gerbil, Meriones unguiculatus

The present study measured the head-related transfer functions (HRTFs) of the Mongolian gerbil for various sound-source directions, and explored acoustical cues for sound localization that could be available to the animals. The HRTF exhibited spectral notches for frequencies above 25 kHz. The notch frequency varied systematically with source direction, and thereby characterized the source directions well. The frequency dependence of the acoustical axis, the direction for which the HRTF amplitude was maximal, was relatively irregular and inconsistent between ears and animals. The frequency-by-frequency plot of the interaural level difference (ILD) exhibited positive and negative peaks, with maximum values of 30 dB at around 30 kHz. The ILD peak frequency had a relatively irregular spatial distribution, implying a poor sound localization cue. The binaural acoustical axis (the direction with the maximum ILD magnitude) showed relatively orderly clustering around certain frequencies, the pattern being fairly consistent among animals. The interaural time differences (ITDs) were also measured and fell in a +/- 120 micros range. When two different animal postures were compared (i.e., the animal was standing on its hind legs and prone), small but consistent differences were found for the lower rear directions on the HRTF amplitudes, the ILDs, and the ITDs.     

Binaural masking experiments using noise maskers with frequency-dependent interaural phase differences. II: Influence of frequency and interaural-phase uncertainty

This study investigates whether binaural signal detection is improved by the listener's previous knowledge about the interaural phase relations of masker and test signal. Binaural masked thresholds were measured for a 500-ms dichotic noise masker that had an interaural phase difference of 0 below 500 Hz and of pi above 500 Hz. The thresholds for two difference 20-ms test signals were determined within the same measurement using an interleaved adaptive 3-interval forced-choice (3IFC) procedure. In each 3IFC trial, both signals could occur with equal probability (uncertainty). The two signals differed in frequency and interaural phase in such a way that one signal always had a frequency above the masker edge frequency (500 Hz) and no interaural phase difference (So), whereas the other signal frequency was below 500 Hz and the interaural phase difference was pi (S pi). The frequencies of a signal pair remained fixed during the whole 3IFC track. These two signals thus lead to two different binaural conditions, i.e., NoS pi for the low-frequency signal and N pi So for the high-frequency signal. For comparison, binaural masked thresholds were measured with the same masker for fixed signal frequency and phase. The binaural masking level differences (BMLDs) resulting from the two experimental conditions show no significant difference. This indicates that the binaural system is able to apply different internal transformations or processing strategies simultaneously in different critical bands and even within the same critical band.     

The dominant role of low-frequency interaural time differences in sound localization.

Two experiments are described in which listeners judge the apparent directions of virtual sound sources-headphone-presented sounds that are processed in order to simulate free-field sounds. Previous results suggest that when the cues to sound direction are preserved by the simulation, the apparent directions of virtual sources are nearly the same as the apparent directions of real free-field sources. In the experiments reported here, the interaural phase relations in the processing algorithms are manipulated in order to produce stimuli in which the interaural time difference cues signal one direction and interaural intensity and pinna cues signal another direction. The apparent directions of these conflicting cue stimuli almost always follow the interaural time cue, as long as the wideband stimuli include low frequencies. With low frequencies removed from the stimuli, the dominance of interaural time difference disappears, and apparent direction is determined primarily by interaural intensity difference and pinna cues.     

Individual differences in the masking level difference with a narrowband masker at 500 or 2000 Hz

The masking level difference (MLD) for a narrowband noise masker is associated with marked individual differences. This pair of studies examines factors that might account for these individual differences. Experiment 1 estimated the MLD for a 50 Hz wide band of masking noise centered at 500 or 2000 Hz, gated on for 400 ms. Tonal signals were either brief (15 ms) or long (200 ms), and brief signals were coincident with either a dip or peak in the masker envelope. Experiment 2 estimated the MLD for both signal and masker consisting of a 50 Hz wide bandpass noise centered on 500 Hz. Signals were generated to provide only interaural phase cues, only interaural level cues, or both. The pattern of individual differences was dominated by variability in NoSpi thresholds, and NoSpi thresholds were highly correlated across all conditions. Results suggest that the individual differences observed in Experiment 1 were not primarily driven by differences in the use of binaural fine structure cues or in binaural temporal resolution. The range of thresholds obtained for a brief NoSpi tonal signal at 500 Hz was consistent with a model based on normalized interaural correlation. This model was not consistent for analogous conditions at 2000 Hz.     

Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user

Experiments were conducted with a single, bilateral cochlear implant user to examine interaural level and time-delay cues that putatively underlie the design and efficacy of bilateral implant systems. The subject's two implants were of different types but custom equipment allowed presentation of controlled bilateral stimuli, particularly those with specified interaural time difference (ITD) and interaural level difference (ILD) cues. A lateralization task was used to measure the effect of these cues on the perceived location of the sensations elicited. For trains of fixed-amplitude, biphasic current pulses at 100 pps, the subject demonstrated sensitivity to an ITD of 300 micros, providing evidence of access to binaural information. The choice of bilateral electrode pair greatly influenced ITD sensitivity, suggesting that electrode pairings are likely to be an important consideration in the effort to provide binaural advantages. The selection of bilateral electrode pairs showing sensitivity to ITD was partially aided by comparisons of the pitch elicited by individual electrodes in each ear (when stimulated alone with fixed-amplitude current pulses at 813 pps): specifically, interaural electrodes with similar pitches were more likely (but not certain) to show ITD sensitivity. Significant changes in lateral position occurred with specific electrode pairs. With five bilateral electrode pairs of 14 tested, ITDs of 300 and 600 micros moved an auditory image significantly from right to left. With these same pairs, ILD changes of approximately 11% of the dynamic range (in microApp) moved an auditory image from the far left to the far right-significantly farther than the nine pairs not showing significant ITD sensitivity. However, even these nine pairs did show response changes as a function of the interaural (or confounding monaural) level cue. Overall, insofar as the access to bilateral cues demonstrated herein generalizes to other subjects, it provides hope that the normal binaural advantages for speech recognition and sound localization can be made available to bilateral implant users.     

The influence of interaural stimulus uncertainty on binaural signal detection

This paper investigated the influence of stimulus uncertainty in binaural detection experiments and the predictions of several binaural models for such conditions. Masked thresholds of a 500-Hz sinusoid were measured in an NrhoSpi condition for both running and frozen-noise maskers using a three interval, forced-choice (3IFC) procedure. The nominal masker correlation varied between 0.64 and 1, and the bandwidth of the masker was either 10, 100, or 1,000 Hz. The running-noise thresholds were expected to be higher than the frozen-noise thresholds because of stimulus uncertainty in the running-noise conditions. For an interaural correlation close to +1, no difference between frozen-noise and running-noise thresholds was expected for all values of the masker bandwidth. These expectations were supported by the experimental data: for interaural correlations less than 1.0, substantial differences between frozen and running-noise conditions were observed for bandwidths of 10 and 100 Hz. Two additional conditions were tested to further investigate the influence of stimulus uncertainty. In the first condition a different masker sample was chosen on each trial, but the correlation of the masker was forced to a fixed value. In the second condition one of two independent frozen-noise maskers was randomly chosen on each trial. Results from these experiments emphasized the influence of stimulus uncertainty in binaural detection tasks: if the degree of uncertainty in binaural cues was reduced, thresholds decreased towards thresholds in the conditions without any stimulus uncertainty. In the analysis of the data, stimulus uncertainty was expressed in terms of three theories of binaural processing: the interaural correlation, the EC theory, and a model based on the processing of interaural intensity differences (IIDs) and interaural time differences (ITDs). This analysis revealed that none of the theories tested could quantitatively account for the observed thresholds. In addition, it was found that, in conditions with stimulus uncertainty, predictions based on correlation differ from those based on the EC theory.     

Binaural modulation masking

Modulation thresholds were measured in three subjects for a sinusoidally amplitude-modulated (SAM) wideband noise (the signal) in the presence of a second amplitude-modulated wideband noise (the masker). In monaural conditions (Mm-Sm) masker and signal were presented to only one ear; in binaural conditions (M0-S pi) the masker was presented diotically while the phase of modulation of the SAM noise signal was inverted in one ear relative to the other. In experiment 1 masker modulation frequency (fm) was fixed at 16 Hz, and signal modulation frequency (fs) was varied from 2-512 Hz. For monaural presentation, masking generally decreased as fs diverged from fm, although there was a secondary increase in masking for very low signal modulation frequencies, as reported previously [Bacon and Grantham, J. Acoust. Soc. Am. 85, 2575-2580 (1989)]. The binaural masking patterns did not show this low-frequency upturn: binaural thresholds continued to improve as fs decreased from 16 to 2 Hz. Thus, comparing masked monaural and masked binaural thresholds, there was an average binaural advantage, or masking-level difference (MLD) of 9.4 dB at fs = 2 Hz and 5.3 dB at fs = 4 Hz. In addition, there were positive MLDs for the on-frequency condition (fm = fs = 16 Hz: average MLD = 4.4 dB) and for the highest signal frequency tested (fs = 512 Hz: average MLD = 7.3 dB). In experiment 2 the signal was a SAM noise (fs = 16 Hz), and the masker was a wideband noise, amplitude-modulated by a narrow band of noise centered at fs. There was no effect on monaural or binaural thresholds as masker modulator bandwidth was varied from 4 to 20 Hz (the average MLD remained constant at 8.0 dB), which suggests that the observed "tuning" for modulation may be based on temporal pattern discrimination and not on a critical-band-like filtering mechanism. In a final condition the masker modulator was a 10-Hz-wide band of noise centered at the 64-Hz signal modulation frequency. The average MLD in this case was 7.4 dB. The results are discussed in terms of various binaural capacities that probably play a role in binaural release from modulation masking, including detection of varying interaural intensity differences (IIDs) and discrimination of interaural correlation.     

Sensitivity to binaural timing in bilateral cochlear implant users

Various measures of binaural timing sensitivity were made in three bilateral cochlear implant users, who had demonstrated moderate-to-good interaural time delay (ITD) sensitivity at 100 pulses-per-second (pps). Overall, ITD thresholds increased at higher pulse rates, lower levels, and shorter durations, although intersubject differences were evident. Monaural rate-discrimination thresholds, using the same stimulation parameters, showed more substantial elevation than ITDs with increased rate. ITD sensitivity with 6000 pps stimuli, amplitude-modulated at 100 Hz, was similar to that with unmodulated pulse trains at 100 pps, but at 200 and 300 Hz performance was poorer than with unmodulated signals. Measures of sensitivity to binaural beats with unmodulated pulse-trains showed that all three subjects could use time-varying ITD cues at 100 pps, but not 300 pps, even though static ITD sensitivity was relatively unaffected over that range. The difference between static and dynamic ITD thresholds is discussed in terms of relative contributions from initial and later arriving cues, which was further examined in an experiment using two-pulse stimuli as a function of interpulse separation. In agreement with the binaural-beat data, findings from that experiment showed poor discrimination of ITDs on the second pulse when the interval between pulses was reduced to a few milliseconds.     

Subcomponent cues in binaural unmasking

The addition of a signal in the N0Sπ binaural configuration gives rise to fluctuations in interaural phase and amplitude. Sensitivity to these individual cues was measured by applying sinusoidal amplitude modulation (AM) or quasi-frequency modulation (QFM) to a band of noise. Discrimination between interaurally in-phase and out-of-phase modulation was measured using an adaptive task for narrow bands of noise at center frequencies from 250 to 1500 Hz, for modulation rates of 2-40 Hz, and with or without flanking bands of diotic noise. Discrimination thresholds increased steeply for QFM with increasing center frequency, but increased only modestly for AM, and mainly for modulation rates below 10 Hz. Flanking bands of noise increased thresholds for AM, but had no consistent effect for QFM. The results suggest that two underlying mechanisms may support binaural unmasking: one most sensitive to interaural amplitude modulations that is susceptible to across-frequency interference, and a second, most sensitive to interaural phase modulations that is immune to such effects.     

Contrasting monaural and interaural spectral cues for human sound localization

A human psychoacoustical experiment is described that investigates the role of the monaural and interaural spectral cues in human sound localization. In particular, it focuses on the relative contribution of the monaural versus the interaural spectral cues towards resolving directions within a cone of confusion (i.e., directions with similar interaural time and level difference cues) in the auditory localization process. Broadband stimuli were presented in virtual space from 76 roughly equidistant locations around the listener. In the experimental conditions, a "false" flat spectrum was presented at the left eardrum. The sound spectrum at the right eardrum was then adjusted so that either the true right monaural spectrum or the true interaural spectrum was preserved. In both cases, the overall interaural time difference and overall interaural level difference were maintained at their natural values. With these virtual sound stimuli, the sound localization performance of four human subjects was examined. The localization performance results indicate that neither the preserved interaural spectral difference cue nor the preserved right monaural spectral cue was sufficient to maintain accurate elevation judgments in the presence of a flat monaural spectrum at the left eardrum. An explanation for the localization results is given in terms of the relative spectral information available for resolving directions within a cone of confusion.     

A binaural analog of gap detection.

The temporal resolution of the binaural auditory system was measured using a binaural analog of gap detection. A binaural "gap" was defined as a burst of interaurally uncorrelated noise (Nu) placed between two bursts of interaurally correlated noise (N0). The Nu burst creates a dip in the output of a binaural temporal window integrating interaural correlation, analogous to the dip created by a silent gap in the output of a monaural temporal window integrating intensity. The equivalent rectangular duration (ERD) of the binaural window was used as an index of binaural temporal resolution. In order to derive the ERD, both the shortest-detectable binaural gap and the jnd for a reduction in interaural correlation from unity were measured. In experiment 1, binaural-gap thresholds were measured using narrow-band noise carriers as a function of center frequency from 250 to 2000 Hz (fixed 100-Hz bandwidth) and a function of lower-cutoff frequency from 100 to 400 Hz (fixed 500-Hz upper-cutoff frequency). Binaural-gap thresholds (1) increased significantly with increasing frequency in both tasks, and (2) at frequencies below 500 Hz, were shorter than corresponding silent-gap thresholds measured with the same N0 noises. In experiment 2, interaural-correlation jnd's were measured for the same conditions. The jnd's also increased significantly with increasing frequency. The results were analyzed using a temporal window integrating the output of a computational model of binaural processing. The ERD of the window varied widely across listeners, with a mean value of 140 ms, and did not significantly depend on frequency. This duration is about an order of magnitude longer than the ERD of the monaural temporal window and is, therefore, consistent with "binaural sluggishness."