The effect of random intensity fluctuation on monaural and binaural detection

Two experiments were performed to determine the effects of random intensity fluctuation on NoSo and NoS pi performance. Noise was used as both signal and masker, and stimuli were bands of noise from either 0-2.0 or 2.0-4.0kHz. Signal and masker were either coherent (from the same source) or noncoherent (from independent sources). In the first experiment, noise fluctuation was achieved by modulating a wide band of noise. In the second experiment, fluctuation was achieved by narrowing the noise bandwidth. Results from both experiments indicated that NoSo performance was adversely affected by fluctuation and by noncoherent relation between signal and masker. NoS pi detection was not adversely affected by fluctuation at low frequency, and was affected less adversely than was NoSo detection at high frequency. This difference between NoSo and NoS pi performance is an important consideration when making inferences about monaural and binaural processing when the stimuli are fluctuating rather than temporally steady.     

Masking effects in binaural detection and interaural time discrimination

This study was designed to investigate the effects of masker level and frequency on binaural detection and interaural time discrimination. Detection and interaural time discrimination of a 700-Hz sinusoidal signal were measured as a function of the center frequency and level of a narrow-band masking noise. The masker was a continuous, diotic, 80-Hz-wide noise that varied in center frequency from 250 to 1370 Hz. In the detection experiment, the signal was presented either diotically (NoSo) or interaurally phase reversed (NoS pi). In the interaural time discrimination experiment, the signal level needed to discriminate a 30-microseconds interaural delay was measured. As would be expected, the presence of the masker has a greater effect on NoSo detection than NoS pi detection, and for masker frequencies at or near the signal frequency. In contrast, interaural time discrimination can be improved by the presence of a low-level masker. Also, performance improves more rapidly as the signal/masker frequency separation increases for NoSo detection than for interaural time discrimination and NoS pi detection. For all three tasks, significant upward spread of masking occurs only at the highest masker level; at low masker levels, there is a tendency toward downward spread of masking.     

Speech perception from monaural and binaural information

Two experiments explored the concept of the binaural spectrogram [Culling and Colburn, J. Acoust. Soc. Am. 107, 517-527 (2000)] and its relationship to monaurally derived information. In each experiment, speech was added to noise at an adverse signal-to-noise ratio in the NoS pi binaural configuration. The resulting monaural and binaural cues were analyzed within an array of spectro-temporal bins and then these cues were resynthesized by modulating the intensity and/or interaural correlation of freshly generated noise. Experiment 1 measured the intelligibility of the resynthesized stimuli and compared them with the original NoSo and NoS pi stimuli at a fixed signal-to-noise ratio. While NoS pi stimuli were approximately equal to 50% intelligible, each cue in isolation produced similar (very low) intelligibility to the NoSo condition. The resynthesized combination produced approximately equal to 25% intelligibility. Modulation of interaural correlation below 1.2 kHz and of amplitude above 1.2 kHz was not as effective as their combination across all frequencies. Experiment 2 measured three-point psychometric functions in which the signal-to-noise ratio of the original NoS pi stimulus was increased in 3-dB steps from the level used in experiment 1. Modulation of interaural correlation alone proved to have a flat psychometric function. The functions for NoS pi and for combined monaural and binaural cues appeared similar in slope, but shifted horizontally. The results indicate that for sentence materials, neither fluctuations in interaural correlation nor in monaural intensity are sufficient to support speech recognition at signal-to-noise ratios where 50% intelligibility is achieved in the NoS pi configuration; listeners appear to synergistically combine monaural and binaural information in this task, to some extent within the same frequency region.     

Discrimination of interaural envelope correlation and its relation to binaural unmasking at high frequencies.

Listeners' sensitivity to interaural correlation of the envelope of high-frequency waveforms and whether such sensitivity might account for detectability in a masking-level difference paradigm were assessed. Thresholds of interaural envelope decorrelation (from a reference correlation of 1.0) were measured for bands of noise centered at 4 kHz and bandwidths ranging from 50-1600 Hz. Decorrelation of the envelope was achieved by "mixing" two independent narrow-band noises. Separately, with the same listeners, NoSo and NoS pi detection thresholds were measured for maskers of the same center frequency and bandwidths. For bandwidths of noise up to about 400 Hz, listeners were similarly sensitive to interaural decorrelation in both types of task. However, for bandwidths greater than 400 Hz or so, while sensitivity in the discrimination task was unaffected, sensitivity was reduced in the NoS pi conditions. Additional data suggested that listeners were able to maintain their sensitivity independent of bandwidth in the discrimination task by focusing on binaural information within select spectral regions of the stimuli.     

Detection of tones in reproducible narrow-band noise

Hit and false-alarm rates were measured for detection of a 500-Hz tone target in each of ten reproducible samples of 1/3-oct bandwidth noise centered at 500 Hz for both NoS pi and NoSo conditions. The effects on hit rates of the starting phase of the target relative to individual noise samples were investigated with two target phase angles for three subjects. The major results are: (1) performance varies significantly over masker waveforms; (2) for NoS pi conditions, the effect of target-to-marker phase angle on hit rates is not significant for these narrow-band maskers; (3) for NoSo conditions, the target-to-masker phase angle has a large effect; (4) no significant correlation between NoSo performance and NoS pi performance is seen across masker waveforms. These results are generally consistent wuth previously reported results for wideband maskers [R.H. Gilkey, D.E. Robinson, and T.E. Hanna, "Effects of masker waveform and signal-to-masker phase relation on diotic and dichotic masking by reproducible noise," J. Acoust. Soc. Am. 78, 1207-1219 (1985)] with an important exception. Specifically, in the wideband experiment, significant correlation between NoSo and NoS pi performance across noise samples was found. In addition, in the wideband experiment, a small yet statistically significant effect of target-to-masker phase was observed in the NoS pi condition.     

Temporal integration, frequency resolution, and off-frequency listening in normal-hearing and cochlear-impaired listeners

Temporal integration for a 1000-Hz signal was determined for normal-hearing and cochlear hearing-impaired listeners in quiet and in masking noise of variable bandwidth. Critical ratio and 3-dB critical band measures of frequency resolution were derived from the masking data. Temporal integration for the normal-hearing listeners was markedly reduced in narrow-band noise, when contrasted with temporal integration in quiet or in wideband noise. The effect of noise bandwidth on temporal integration was smaller for the hearing-impaired group. Hearing-impaired subjects showed both reduced temporal integration and reduced frequency resolution for the 200-ms signal. However, a direct relation between temporal integration and frequency resolution was not indicated. Frequency resolution for the normal-hearing listeners did not differ from that of the hearing-impaired listeners for the 20-ms signal. It was suggested that some of the frequency resolution and temporal integration differences between normal-hearing and hearing-impaired listeners could be accounted for by off-frequency listening.     

Effects of temporal separation and masker level on binaural analysis in forward masking.

In the present study detection under diotic (NoSo) and dichotic (NoS pi) listening conditions in a forward masking paradigm was investigated. Both the level of a noise masker and the temporal separation between the masker and a 250-Hz tone burst served as independent variables. Results showed that most of the variance in the data could be accounted for by the amount of masking in the NoSo condition, independent of the value of the temporal parameter, which itself accounted for only 1.4% of the variance that remained. Once the data were corrected for NoSo masking effectiveness, the MLD was found to decrease by only 1.4 dB as temporal separation increased from 5-100 ms, which is consistent with a very long time constant for the binaural system. Consistent with this finding, it was shown that slope changes of the growth of masking functions, for simultaneous as compared to forward masking, were similar for both the NoSo and NoS pi conditions.     

The role of monaural frequency selectivity in binaural analysis

The relation between the monaural critical band and binaural analysis was examined using an NoSm MLD paradigm, in order to resolve ambiguities about the width of the masking spectrum important for binaural detection. A 500-Hz pure-tone signal was presented with a 600-Hz-wide band of masking noise to the signal ear. Bands of noise ranging in width from 25 to 600 Hz, or noise notches (imposed on a 600-Hz-wide band centered on the signal frequency) ranging in width from 0 to 600 Hz were presented to the nonsignal ear. All noise bands and notches were centered on 500 Hz, the frequency of the signal. The effects of varying bandwidth were radically different from those of varying notchwidth: the MLD changed from zero to approximately 8 dB over a bandwidth range of 400 Hz; for notchwidths, however, the MLD changed 8 dB over a range of only 50 Hz. The results support an interpretation that the fine frequency selectivity of monaural analysis is preserved in peripheral binaural interaction, but that a relatively wide frequency range of critical bands is scanned at a later stage of binaural processing. It was suggested that the wide spectral range of binaural analysis may provide a background against which binaural differences due to the signal are detected.     

Binaural processing of noisy stimuli: internal/external noise ratios for diotic and dichotic stimuli

A set of ten digitized statistically similar Gaussian maskers was used in one-internal tone-in-noise detection experiments under diotic (NoSo) and dichotic (NoS pi) interaural conditions. Stimulus/response matrices were generated for each masker in the presence or absence of a target 500-Hz tone. For both NoSo and NoS pi, nonparametric analyses show that response probabilities and sensitivities vary significantly across noise waveforms, indicating a considerable external noise component in subject response variability. A parametric model is developed that maps individual stimulus waveforms onto a decision axis, facilitating evaluation of internal/external noise variance ratios. For both NoSo and NoS pi, internal and external noise variance are of similar magnitude.     

The effects of signal duration on NoSo and NoS pi thresholds at 500 Hz and 4 kHz

A two-interval, two-alternative temporal forced-choice procedure was used to measure NoSo and NoS pi masked thresholds with 500-Hz and 4-kHz tonal signals. The duration of the signal was either 10, 20, 40, or 320 ms. The maskers were 200-Hz-wide bands of Gaussian noise centered at the frequency of the signal and presented continuously. Decreasing the duration of the 500-Hz tonal signal resulted in a modest increase (1.5 dB or so) in the masking-level difference (MLD) measured between NoSo and NoS pi conditions. In contrast, decreasing the duration of the 4-kHz tonal signal resulted in a substantial decrease (4.5 dB or so) in the MLD. Comparisons of the data with thresholds predicted from analyses based on "windows of temporal integration" provided quantitatively acceptable accounts of the data. The data obtained in the NoS pi condition at 4 kHz, which are novel and were of primary interest, were well-accounted for in a statistical sense. However, there were small, but systematic, discrepancies between the predictions and the data. Those discrepancies, although small in magnitude, suggest that binaural temporal integration at high frequencies, where the envelopes of the stimuli convey the information, may be inherently different from both monaural temporal integration and binaural temporal integration at low frequencies.     

Spectrotemporal analysis and cochlear hearing impairment: effects of frequency selectivity, temporal resolution, signal frequency, and rate of modulation

The detection of 500- or 2000-Hz pure-tone signals in unmodulated and modulated noise was investigated in normal-hearing and sensorineural hearing-impaired listeners, as a function of noise bandwidth. Square-wave modulation rates of 15 and 40 Hz were used in the modulated noise conditions. A notched noise measure of frequency selectivity and a gap detection measure of temporal resolution were also obtained on each subject. The modulated noise results indicated a masking release that increased as a function of increasing noise bandwidth, and as a function of decreasing modulation rate for both groups of listeners. However, the improvement of threshold with increasing modulated noise bandwidth was often greatly reduced among the sensorineural hearing-impaired listeners. It was hypothesized that the masking release in modulated noise may be due to several types of processes including across-critical band analysis (CMR), within-critical band analysis, and suppression. Within-band effects appeared to be especially large at the higher frequency region and lower modulation rate. In agreement with previous research, there was a significant correlation between frequency selectivity and masking release in modulated noise. At the 500-Hz region, masking release was correlated more highly with the filter skirt and tail measures than with the filter passband measure. At the 2000-Hz region, masking release was correlated more with the filter passband and skirt measures than with the filter tail measure. The correlation between gap detection and masking release was significant at the 40-Hz modulation rate, but not at the 15-Hz modulation rate. The results of this study suggest that masking release in modulated noise is limited by frequency selectivity at low modulation rates, and by both frequency selectivity and temporal resolution at high modulation rates. However, even when the present measures of frequency selectivity and temporal resolution are both taken into account, significant variance in masking release still remains unaccounted for.     

Binaural critical masking bands.

Current understanding of the relation monaural estimates of the critical bandwidth for masking and those obtained in binaural listening situations is poor. The present study was designed to improve this situation by obtaining estimates of critical bandwich when the signal and masker were presented: (1) monaurally (NmSm), (2) binaurally with both signal and masker in phase at the ears (NoSo), (3) binaurally with masker in phase and signals 180 degrees out of phase (NoSpi). Threshold estimates were obtained in a two-interval forced-choice paradigm as a function of masker bandwidth for signal frequencies of 500 and 2000 Hz for the three conditions mentioned above. Maskers were computer-synthesized and had essentially infinite rejection slopes. For all conditions, as masker bandwidth was narrowed from wide band, threshold remained relatively constant until some critical bandwidth was reached. Further reductions in bandwidth were followed by progressive lowering of threshold, presumably due to removal of masker energy in the critical band. For both signal frequencies, the derived critical bandwidth estimates for the NmSm and NoSo conditions were similar and were smaller than the critical bandwidth estimates obtained in the NoSpi condition.     

Frequency dependence of binaural performance in listeners with impaired binaural hearing.

Binaural performance was measured as a function of stimulus frequency for four impaired listeners, each with bilaterally symmetric audiograms. The subjects had various degrees and configurations of audiometric losses: two had high-frequency, sensorineural losses; one had a flat sensorineural loss; and one had multiple sclerosis with normal audiometric thresholds. Just noticeable differences (jnd's) in interaural time, interaural intensity, and interaural correlation as well as detection thresholds for NoSo and NoS pi conditions were obtained for narrow-band noise stimuli at octave frequencies from 250-4000 Hz. Performance of the impaired listeners was generally poorer than that of normal-hearing listeners, although it was comparable to normal in a few instances. The patterns of binaural performance showed no apparent relation to the audiometric patterns; even the two subjects with similar degree and configuration of hearing loss have very different binaural performance, both in the level and frequency dependence of their performance. The frequency dependence of performance on individual tests is irregular enough that one cannot confidently interpolate between octaves. In addition, it appears that no subset of the measurements is adequate to characterize the performance in the rest of the measurements with the exception that, within limits, interaural correlation discrimination and NoS pi detection performance are related.     

Measurement of the binaural auditory filter using a detection task

The spectral resolution of the binaural system was measured using a tone-detection task in a binaural analog of the notched-noise technique. Three listeners performed 2-interval, 2-alternative, forced choice tasks with a 500-ms out-of-phase signal within 500 ms of broadband masking noise consisting of an "outer" band of either interaurally uncorrelated or anticorrelated noise, and an "inner" band of interaurally correlated noise. Three signal frequencies were tested (250, 500, and 750 Hz), and the asymmetry of the filter was measured by keeping the signal at a constant frequency and moving the correlated noise band relative to the signal. Thresholds were taken for bandwidths of correlated noise ranging from 0 to 400 Hz. The equivalent rectangular bandwidth of the binaural filter was found to increase with signal frequency, and estimates tended to be larger than monaural bandwidths measured for the same listeners using equivalent techniques.     

Binaural comodulation masking release: effects of masker interaural correlation

Binaural detection was examined for a signal presented in a narrow band of noise centered on the on-signal masking band (OSB) or in the presence of flanking noise bands that were random or comodulated with respect to the OSB. The noise had an interaural correlation of 1.0 (No), 0.99 or 0.95. In No noise, random flanking bands worsened Spi detection and comodulated bands improved Spi detection for some listeners but had no effect for other listeners. For the 0.99 or 0.95 interaural correlation conditions, random flanking bands were less detrimental to Spi detection and comodulated flanking bands improved Spi detection for all listeners. Analyses based on signal detection theory indicated that the improvement in Spi thresholds obtained with comodulated bands was not compatible with an optimal combination of monaural and binaural cues or to across-frequency analyses of dynamic interaural phase differences. Two accounts consistent with the improvement in Spi thresholds in comodulated noise were (1) envelope information carried by the flanking bands improves the weighting of binaural cues associated with the signal; (2) the auditory system is sensitive to across-frequency differences in ongoing interaural correlation.     

Differences in auditory performance between monaural and dichotic conditions. I: masking thresholds in frozen noise.

Thresholds of a 5-ms, 1-kHz signal were determined in the presence of a frozen-noise masker. The noise had a flat power spectrum between 20 Hz and 5 kHz and was presented with a duration of 300 ms. The following interaural conditions were tested with four listeners: Noise and signal monaural at the same ear (monaural condition, NmSm), noise and signal identical at both ears (diotic condition, NoSo), noise identical at both ears and signal monaural (dichotic condition, NoSm) and uncorrelated noise at the two ears and signal monaural (NuSm). The signal was presented at a fixed temporal position with respect to the frozen noise in all measurements and thresholds were determined for different starting phases of the carrier frequency of the signal. Variation of the carrier phase strongly influenced the detection in the diotic condition and the masked thresholds varied by more than 10 dB. The pattern of thresholds for the monaural condition was less variable and the thresholds were generally higher than for the diotic condition. The monaural-diotic difference for specific starting phases amounted to as much as 8 dB. Comparison measurements using running noise maskers revealed no such difference. This relation between monaural and diotic thresholds was further investigated with eight additional subjects. Again, monaural and diotic thresholds in running noise were identical, while in frozen noise, diotic thresholds were consistently lower than monaural thresholds, even when the ear with the lower NmSm threshold was compared. For the starting phase showing the largest monaural-diotic difference, the thresholds for NoSm lay between the monaural and the diotic values. At other starting phases, the NoSm threshold was clearly lower than both the NmSm and the NoSo threshold. One possible explanation of the observed monaural-diotic differences relates to contralateral efferent interaction between the right and the left hearing pathway. A prediction based on this explanation was verified in a final experiment, where frozen-noise performance for NmSm was improved by simultaneously presenting an uncorrelated running noise to the opposite ear.     

Comodulation masking release as a function of bandwidth and time delay between on-frequency and flanking-band maskers

The threshold for a signal masked by a narrow band of noise centered at the signal frequency (the on-frequency band) may be reduced by adding to the masker a second band of noise (the flanking band) whose envelope is correlated with that of the first band, an effect called comodulation masking release (CMR). This paper examines CMR as a function of masker bandwidth and time delay between the envelopes of the on-frequency and flanking bands. The 1.0-kHz sinusoidal signal had a duration of 400 ms. The on-frequency band was presented alone (reference condition) or with the flanking band. The flanking-band envelope was either correlated or uncorrelated with that of the on-frequency band. Flanking-band center frequencies ranged from 0.25-2.0 kHz. The flanking band was presented either in the same ear as the on-frequency band (monaural condition) or in the opposite ear (dichotic condition). The noise bands had bandwidths of 6.25, 25, or 100 Hz. In the correlated conditions, the flanking-band envelope was delayed with respect to that of the on-frequency band by 0, 5, 10, or 20 ms. For the 100-Hz bandwidth, CMRs were small (typically less than 1 dB) in both monaural and dichotic conditions at all delay times. For the 25-Hz bandwidth, CMRs were about 3.5 dB for the 0-ms delay, and decreased to about 1.5 dB for the 20-ms delay. For the 6.25-Hz bandwidth, CMRs averaged about 5 dB and were almost independent of delay time. The results suggest that the absolute delay time is not the critical variable determining CMR. The magnitude of CMR appears to depend on the correlation between the envelopes of the on-frequency and flanking bands. However, the results do not support a model of CMR that assumes that signal threshold corresponds to a constant change in across-band envelope correlation when the correlation is transformed to Fisher's z.     

Relative importance of temporal information in various frequency regions for consonant identification in quiet and in noise

The relative importance of temporal information in broad spectral regions for consonant identification was assessed in normal-hearing listeners. For the purpose of forcing listeners to use primarily temporal-envelope cues, speech sounds were spectrally degraded using four-noise-band vocoder processing Frequency-weighting functions were determined using two methods. The first method consisted of measuring the intelligibility of speech with a hole in the spectrum either in quiet or in noise. The second method consisted of correlating performance with the randomly and independently varied signal-to-noise ratio within each band. Results demonstrated that all bands contributed equally to consonant identification when presented in quiet. In noise, however, both methods indicated that listeners consistently placed relatively more weight upon the highest frequency band. It is proposed that the explanation for the difference in results between quiet and noise relates to the shape of the modulation spectra in adjacent frequency bands. Overall, the results suggest that normal-hearing listeners use a common listening strategy in a given condition. However, this strategy may be influenced by the competing sounds, and thus may vary according to the context. Some implications of the results for cochlear implantees and hearing-impaired listeners are discussed.     

Binaural modulation masking

Modulation thresholds were measured in three subjects for a sinusoidally amplitude-modulated (SAM) wideband noise (the signal) in the presence of a second amplitude-modulated wideband noise (the masker). In monaural conditions (Mm-Sm) masker and signal were presented to only one ear; in binaural conditions (M0-S pi) the masker was presented diotically while the phase of modulation of the SAM noise signal was inverted in one ear relative to the other. In experiment 1 masker modulation frequency (fm) was fixed at 16 Hz, and signal modulation frequency (fs) was varied from 2-512 Hz. For monaural presentation, masking generally decreased as fs diverged from fm, although there was a secondary increase in masking for very low signal modulation frequencies, as reported previously [Bacon and Grantham, J. Acoust. Soc. Am. 85, 2575-2580 (1989)]. The binaural masking patterns did not show this low-frequency upturn: binaural thresholds continued to improve as fs decreased from 16 to 2 Hz. Thus, comparing masked monaural and masked binaural thresholds, there was an average binaural advantage, or masking-level difference (MLD) of 9.4 dB at fs = 2 Hz and 5.3 dB at fs = 4 Hz. In addition, there were positive MLDs for the on-frequency condition (fm = fs = 16 Hz: average MLD = 4.4 dB) and for the highest signal frequency tested (fs = 512 Hz: average MLD = 7.3 dB). In experiment 2 the signal was a SAM noise (fs = 16 Hz), and the masker was a wideband noise, amplitude-modulated by a narrow band of noise centered at fs. There was no effect on monaural or binaural thresholds as masker modulator bandwidth was varied from 4 to 20 Hz (the average MLD remained constant at 8.0 dB), which suggests that the observed "tuning" for modulation may be based on temporal pattern discrimination and not on a critical-band-like filtering mechanism. In a final condition the masker modulator was a 10-Hz-wide band of noise centered at the 64-Hz signal modulation frequency. The average MLD in this case was 7.4 dB. The results are discussed in terms of various binaural capacities that probably play a role in binaural release from modulation masking, including detection of varying interaural intensity differences (IIDs) and discrimination of interaural correlation.     

Within- and across-channel gap detection in cochlear implant listeners

This study examined within- and across-electrode-channel processing of temporal gaps in successful users of MED-EL COMBI 40+ cochlear implants. The first experiment tested across-ear gap duration discrimination (GDD) in four listeners with bilateral implants. The results demonstrated that across-ear GDD thresholds are elevated relative to monaural, within-electrode-channel thresholds; the size of the threshold shift was approximately the same as for monaural, across-electrode-channel configurations. Experiment 1 also demonstrated a decline in GDD performance for channel-asymmetric markers. The second experiment tested the effect of envelope fluctuation on gap detection (GD) for monaural markers carried on a single electrode channel. Results from five cochlear implant listeners indicated that envelopes associated with 50-Hz wide bands of noise resulted in poorer GD thresholds than envelopes associated with 300-Hz wide bands of noise. In both cases GD thresholds improved when envelope fluctuations were compressed by an exponent of 0.2. The results of both experiments parallel those found for acoustic hearing, therefore suggesting that temporal processing of gaps is largely limited by factors central to the cochlea.