Tonal masking and frequency selectivity for the monaural and binaural hearing systems

A series of masking experiments was performed with the aim of comparing frequency selectivity for the monaural and binaural systems. The masking stimulus used in this study combined a sinusoid, which was gated simultaneously with the signal, with a continuous broadband noise. Signal frequency was fixed at 500 Hz. In one condition, the tonal masker and noise were interaurally in phase and the signal was phase reversed. In a second condition, noise, tonal masker, and signal were presented to one ear alone. Signal thresholds were obtained as a function of masker frequency for these two conditions. After making an appropriate selection of noise levels, masking functions for the monaural and binaural system conditions were found to agree closely except for a region about their tips where the binaural condition was more detectable. Two possible interpretations of these results are discussed. Either the monaural and binaural systems contain filters each which have similarly shaped skirts, or the frequency selectivity observed under both diotic and dichotic conditions (for large frequency separations of masker and signal) reflect the operation of a common peripheral filter.     

Combined monaural and binaural masking release

Stimulus conditions were examined where both across-frequency [comodulation masking release (CMR)] and across-ear [binaural masking-level difference (BMLD)] cues were available, as well as conditions where only one of these cue types was available. The main goal of the study was to determine how the two types of cues combine. The effects of comodulation were assessed either by modulating a masking noise and manipulating its bandwidth (experiment 1) or by using two comodulated narrow bands of noise separated in frequency (experiment 2). The masker was always No, and the 500-Hz pure-tone signal was either So or S pi. The effect of the frequency of modulation was examined either by changing the frequency of the modulating stimulus (experiment 1) or by changing the bandwidth of the comodulated narrow-band noise (experiment 2). Four of six subjects showed greater masking release when both BMLD and CMR cues were available than for either type of cue alone, whereas the other two subjects did not show an ability to combine the two cues for additional advantage. For the subjects who were able to combine the two types of cue, the additional advantage was greater for low frequencies of modulation. The results indicate that one component of CMR may be based upon across-frequency envelope comparisons at a stage of processing after binaural analysis.     

Speech perception from monaural and binaural information

Two experiments explored the concept of the binaural spectrogram [Culling and Colburn, J. Acoust. Soc. Am. 107, 517-527 (2000)] and its relationship to monaurally derived information. In each experiment, speech was added to noise at an adverse signal-to-noise ratio in the NoS pi binaural configuration. The resulting monaural and binaural cues were analyzed within an array of spectro-temporal bins and then these cues were resynthesized by modulating the intensity and/or interaural correlation of freshly generated noise. Experiment 1 measured the intelligibility of the resynthesized stimuli and compared them with the original NoSo and NoS pi stimuli at a fixed signal-to-noise ratio. While NoS pi stimuli were approximately equal to 50% intelligible, each cue in isolation produced similar (very low) intelligibility to the NoSo condition. The resynthesized combination produced approximately equal to 25% intelligibility. Modulation of interaural correlation below 1.2 kHz and of amplitude above 1.2 kHz was not as effective as their combination across all frequencies. Experiment 2 measured three-point psychometric functions in which the signal-to-noise ratio of the original NoS pi stimulus was increased in 3-dB steps from the level used in experiment 1. Modulation of interaural correlation alone proved to have a flat psychometric function. The functions for NoS pi and for combined monaural and binaural cues appeared similar in slope, but shifted horizontally. The results indicate that for sentence materials, neither fluctuations in interaural correlation nor in monaural intensity are sufficient to support speech recognition at signal-to-noise ratios where 50% intelligibility is achieved in the NoS pi configuration; listeners appear to synergistically combine monaural and binaural information in this task, to some extent within the same frequency region.     

Influence of monaural spectral cues on binaural localization

Seven subjects located, monaurally and binaurally, narrow bands of noise originating in the horizontal plane. The stimuli were 1.0 kHz wide and centered at 4.0-14.0 kHz in steps of 0.5 kHz. The loudspeakers, 15 deg apart, were arranged in a semicircle (0-270-180 deg, azimuth). In the first part of the experiment all sounds emanated from the loudspeaker at 270 deg, but their apparent locations varied widely as a function of their center frequency. For each subject, the pattern of location judgments under the binaural listening condition corresponded to that recorded for the monaural condition. In the second part of the experiment the loudspeaker from which each of the same narrow bands of noise emanated was varied in irregular order. Again, monaural location judgments were governed by the frequency content of the noise bands. Binaural location judgments were strongly influenced by the sounds' frequency composition when the stimuli originated from 315-225 deg, notwithstanding the presence of interaural differences in time and intensity. For narrow bands of noise emanating off midline, monaural spectral cues significantly override binaural difference cues, and they also determine the resolution of front-back ambiguities.     

The effect of random intensity fluctuation on monaural and binaural detection

Two experiments were performed to determine the effects of random intensity fluctuation on NoSo and NoS pi performance. Noise was used as both signal and masker, and stimuli were bands of noise from either 0-2.0 or 2.0-4.0kHz. Signal and masker were either coherent (from the same source) or noncoherent (from independent sources). In the first experiment, noise fluctuation was achieved by modulating a wide band of noise. In the second experiment, fluctuation was achieved by narrowing the noise bandwidth. Results from both experiments indicated that NoSo performance was adversely affected by fluctuation and by noncoherent relation between signal and masker. NoS pi detection was not adversely affected by fluctuation at low frequency, and was affected less adversely than was NoSo detection at high frequency. This difference between NoSo and NoS pi performance is an important consideration when making inferences about monaural and binaural processing when the stimuli are fluctuating rather than temporally steady.     

Integration of monaural and binaural evidence of vowel formants

The intelligibility of speech is sustained at lower signal-to-noise ratios when the speech has a different interaural configuration from the noise. This paper argues that the advantage arises in part because listeners combine evidence of the spectrum of speech in the across-frequency profile of interaural decorrelation with evidence in the across-frequency profile of intensity. To support the argument, three experiments examined the ability of listeners to integrate and segregate evidence of vowel formants in these two profiles. In experiment 1, listeners achieved accurate identification of the members of a small set of vowels whose first formant was defined by a peak in one profile and whose second formant was defined by a peak in the other profile. This result demonstrates that integration is possible. Experiment 2 demonstrated that integration is not mandatory, insofar as listeners could report the identity of a vowel defined entirely in one profile despite the presence of a competing vowel in the other profile. The presence of the competing vowel reduced accuracy of identification, however, showing that segregation was incomplete. Experiment 3 demonstrated that segregation of the binaural vowel, in particular, can be increased by the introduction of an onset asynchrony between the competing vowels. The results of experiments 2 and 3 show that the intrinsic cues for segregation of the profiles are relatively weak. Overall, the results are compatible with the argument that listeners can integrate evidence of spectral peaks from the two profiles.     

Exploring the additivity of binaural and monaural masking release

Experiment 1 examined comodulation masking release (CMR) for a 700-Hz tonal signal under conditions of N(o)S(o) (noise and signal interaurally in phase) and N(o)S(π) (noise in phase, signal out of phase) stimulation. The baseline stimulus for CMR was either a single 24-Hz wide narrowband noise centered on the signal frequency [on-signal band (OSB)] or the OSB plus, a set of flanking noise bands having random envelopes. Masking noise was either gated or continuous. The CMR, defined with respect to either the OSB or the random noise baseline, was smaller for N(o)S(π) than N(o)S(o) stimulation, particularly when the masker was continuous. Experiment 2 examined whether the same pattern of results would be obtained for a 2000-Hz signal frequency; the number of flanking bands was also manipulated (two versus eight). Results again showed smaller CMR for N(o)S(π) than N(o)S(o) stimulation for both continuous and gated masking noise. The CMR was larger with eight than with two flanking bands, and this difference was greater for N(o)S(o) than N(o)S(π). The results of this study are compatible with serial mechanisms of binaural and monaural masking release, but they indicate that the combined masking release (binaural masking-level difference and CMR) falls short of being additive.     

Nonsense-syllable recognition in noise using monaural and binaural listening strategies

Using a binaurally equipped KEMAR manikin, syllables of the CUNY Nonsense Syllable Test were recorded in sound field at 0-degree azimuth against a background of cafeteria noise at 270-degrees azimuth, at several signal-to-noise (S/N) ratios. The combination of inputs recorded at each ear was delivered to ten normal-hearing (NH) and eight sensorineurally hearing impaired (HI) listeners through insert ear phones to produce five experimental listening conditions: (1) binaural head shadow (HS), in which ear presentation was analogous to the original stimulus recording, (2) binaural favorable (BF), in which the noise-shadowed (right-ear) recording was presented to both ears, (3) monaural favorable (MF), in which the noise-shadowed recording was presented only to the right ear, (4) monoaural unfavorable (MU), in which the noise-unshadowed (left ear) recording was presented only to the left ear, and (5) simulated monoaural aided (SMA), in which the noise-shadowed recording was presented to the right ear and the noise-unshadowed recording--attenuated by 20 dB relative to the HS condition--was presented to the left ear. All main effects (subject type, listening condition, and S/N ratio) were statistically significant. Normal listeners showed 3.3- and 3.2-dB advantages, respectively, due to head-shadow and binaural squelch, over hearing-impaired listeners. Some hearing-impaired listeners performed better under the SMA or BF conditions than under the HS condition. Potential digital signal processing strategies designed to optimize speech understanding under binaurally aided listening conditions are discussed.     

Late-onset auditory deprivation: effects of monaural versus binaural hearing aids

Performance on tests of pure-tone thresholds, speech-recognition thresholds, and speech-recognition scores for the two ears of each subject were evaluated in two groups of adults with bilateral hearing losses. One group was composed of individuals fitted with binaural hearing aids, and the other group included persons with monaural hearing aids. Performance prior to the use of hearing aids was compared to performance after 4-5 years of hearing aid use in order to determine whether the unaided ear would show effects of auditory deprivation. There were no differences over time for pure-tone thresholds or speech-recognition thresholds for both ears of both groups. Nevertheless, the results revealed that the speech-recognition difference scores of the binaurally fitted subjects remained stable over time whereas they increased for the monaurally fitted subjects. The findings reveal an auditory deprivation effect for the unfitted ears of the subjects with monaural hearing aids.     

The role of frequency selectivity in measures of auditory and vibrotactile temporal resolution.

The purpose of this study was to compare the role of frequency selectivity in measures of auditory and vibrotactile temporal resolution. In the first experiment, temporal modulation transfer functions for a sinusoidally amplitude modulated (SAM) 250-Hz carrier revealed auditory modulation thresholds significantly lower than corresponding vibrotactile modulation thresholds at SAM frequencies greater than or equal to 100 Hz. In the second experiment, auditory and vibrotactile gap detection thresholds were measured by presenting silent gaps bounded by markers of the same or different frequency. The marker frequency F1 = 250 Hz preceded the silent gap and marker frequencies after the silent gap included F2 = 250, 255, 263, 310, and 325 Hz. Auditory gap detection thresholds were lower than corresponding vibrotactile thresholds for F2 markers less than or equal to 263 Hz, but were greater than the corresponding vibrotactile gap detection thresholds for F2 markers greater than or equal to 310 Hz. When the auditory gap detection thresholds were transformed into filter attenuation values, the results were modeled well by a constant-percentage (10%) bandwidth filter centered on F1. The vibrotactile gap detection thresholds, however, were independent of marker frequency separation. In a third experiment, auditory and vibrotactile rate difference limens (RDLs) were measured for a 250-Hz carrier at SAM rates less than or equal to 100 Hz. Auditory RDLs were lower than corresponding vibrotactile RDLs for standard rates greater than 10 Hz. Combination tones may have confounded auditory performance for standard rates of 80 and 100 Hz. The results from these experiments revealed that frequency selectivity influences auditory measures of temporal resolution, but there was no evidence of frequency selectivity affecting vibrotactile temporal resolution.     

Masked detection and discrimination of tone sequences under conditions of monaural and binaural masking release

Experiment 1 examined detection and discrimination of monaural four-tone sequences composed of 400-, 500-, and 625-Hz sinusoids. In the baseline conditions, the masker was monaural composed of 25-Hz-wide bands of random noise centered on 320, 400, 500, 625, and 781 Hz. In the binaural masking release conditions, the noise was presented diotically. In the monaural masking release conditions, the noise was presented to the same ear as the signal, but it was comodulated. Tones had half-amplitude durations of 30, 60, or 150 ms. There was no delay between successive tones, so the rate of frequency change depended on tone duration. Listeners discriminated between sequences composed of 500-400-625-500 Hz and 500-625-400-500 Hz. Discrimination results were poor for rapid sequences in both monaural and binaural masking release conditions relative to baseline conditions. Results from experiment 2 indicated that poor discrimination for rapid sequences could also occur in the baseline conditions, provided that the frequency separation among tonal components was small. Sluggish processing in the present paradigm was not restricted to conditions relying on binaural cues. It is argued that sluggishness may reflect a long temporal window in monaural and binaural masking release conditions or an interaction between poor cue quality and task difficulty.     

Multichannel speech intelligibility and talker recognition using monaural, binaural, and three-dimensional auditory presentation

In a 3D auditory display, sounds are presented over headphones in a way that they seem to originate from virtual sources in a space around the listener. This paper describes a study on the possible merits of such a display for bandlimited speech with respect to intelligibility and talker recognition against a background of competing voices. Different conditions were investigated: speech material (words/sentences), presentation mode (monaural/binaural/3D), number of competing talkers (1-4), and virtual position of the talkers (in 45 degrees-steps around the front horizontal plane). Average results for 12 listeners show an increase of speech intelligibility for 3D presentation for two or more competing talkers compared to conventional binaural presentation. The ability to recognize a talker is slightly better and the time required for recognition is significantly shorter for 3D presentation in the presence of two or three competing talkers. Although absolute localization of a talker is rather poor, spatial separation appears to have a significant effect on communication. For either speech intelligibility, talker recognition, or localization, no difference is found between the use of an individualized 3D auditory display and a general display.     

Speech segregation in rooms: monaural, binaural, and interacting effects of reverberation on target and interferer

Speech reception thresholds were measured in virtual rooms to investigate the influence of reverberation on speech intelligibility for spatially separated targets and interferers. The measurements were realized under headphones, using target sentences and noise or two-voice interferers. The room simulation allowed variation of the absorption coefficient of the room surfaces independently for target and interferer. The direct-to-reverberant ratio and interaural coherence of sources were also varied independently by considering binaural and diotic listening. The main effect of reverberation on the interferer was binaural and mediated by the coherence, in agreement with binaural unmasking theories. It appeared at lower reverberation levels than the effect of reverberation on the target, which was mainly monaural and associated with the direct-to-reverberant ratio, and could be explained by the loss of amplitude modulation in the reverberant speech signals. This effect was slightly smaller when listening binaurally. Reverberation might also be responsible for a disruption of the mechanism by which the auditory system exploits fundamental frequency differences to segregate competing voices, and a disruption of the "listening in the gaps" associated with speech interferers. These disruptions may explain an interaction observed between the effects of reverberation on the targets and two-voice interferers.     

Real-time processing using the frequency domain binaural model

There are many approaches to achieving high-performance speech enhancement. The modeling of the human auditory system is a good approach, since human beings can focus on target speech under concurrent speech conditions. One example of the binaural models is the time domain binaural model. However, this model has a high-calculation cost because the algorithm is based on auto-correlation, which is computationally intensive. Another example is the frequency domain binaural model proposed by Nakashima et al. [Nakashima H, Chisaki Y, Usagawa T, Ebata M. Frequency domain binaural model based on interaural phase and level differences. Acoust Sci Technol 2003;24(4):172-8]. Since the frequency domain binaural model uses the fast fourier transform, the calculation cost is much lower than that of the time domain binaural model. Therefore, it is not difficult to perform real-time processing using recent hardware such as digital signal processors and even laptop personal computers. However the quality of the segregated sound obtained using the frequency domain binaural model depends on system parameters such as frequency resolution and frame shift length for overlap adding in time domain. This paper introduces the construction of a prototype of a hearing assistant system based on the frequency domain binaural model. The detailed implementation techniques and parameter tuning are mentioned. The proposed system runs in real-time after parameter tuning. The directional attenuation levels, that is, the directivity patterns of the proposed system is measured. Finally, it is shown that the prototype can extract sounds coming from specific directions in real-time.     

Comodulation masking release for various monaural and binaural combinations of the signal, on-frequency, and flanking bands

The threshold for a signal masked by a narrow band of noise centered at the signal frequency (the on-frequency band) may be reduced by adding to the masker a second band of noise (the flanking band) whose envelope is correlated with that of the first band. This effect is called comodulation masking release (CMR). These experiments examine two questions. (1) How does the CMR vary with the number and ear of presentation of the flanking band(s)? (2) Is it possible to obtain a CMR when a binaural masking level difference (BMLD) is already present, and vice versa? Thresholds were measured for a 400-ms signal in a continuous 25-Hz-wide noise centered at signal frequencies (fs) of 250, 1000, and 4000 Hz. This masker was presented either alone or with one or more continuous flanking bands whose envelopes were either correlated or uncorrelated with that of the on-frequency band; their frequencies ranged from 0.5fs to 1.5fs. CMRs were measured for six conditions in which the signal, the on-frequency band, and the flanking band(s) were presented in various monaural and binaural combinations. When a single flanking band was used, the CMR was typically around 2-3 dB. The CMR increased to 5-6 dB if an additional flanking band was added. The effect of the additional band was similar whether it was in the same ear as the original band or in the opposite ear. At the lowest signal frequency, a large CMR was observed in addition to a BMLD and vice versa. At the highest signal frequency, the extra release from masking was small. The results are interpreted in terms of the cues producing the CMR and the BMLD.