Spectrotemporal analysis and cochlear hearing impairment: effects of frequency selectivity, temporal resolution, signal frequency, and rate of modulation

The detection of 500- or 2000-Hz pure-tone signals in unmodulated and modulated noise was investigated in normal-hearing and sensorineural hearing-impaired listeners, as a function of noise bandwidth. Square-wave modulation rates of 15 and 40 Hz were used in the modulated noise conditions. A notched noise measure of frequency selectivity and a gap detection measure of temporal resolution were also obtained on each subject. The modulated noise results indicated a masking release that increased as a function of increasing noise bandwidth, and as a function of decreasing modulation rate for both groups of listeners. However, the improvement of threshold with increasing modulated noise bandwidth was often greatly reduced among the sensorineural hearing-impaired listeners. It was hypothesized that the masking release in modulated noise may be due to several types of processes including across-critical band analysis (CMR), within-critical band analysis, and suppression. Within-band effects appeared to be especially large at the higher frequency region and lower modulation rate. In agreement with previous research, there was a significant correlation between frequency selectivity and masking release in modulated noise. At the 500-Hz region, masking release was correlated more highly with the filter skirt and tail measures than with the filter passband measure. At the 2000-Hz region, masking release was correlated more with the filter passband and skirt measures than with the filter tail measure. The correlation between gap detection and masking release was significant at the 40-Hz modulation rate, but not at the 15-Hz modulation rate. The results of this study suggest that masking release in modulated noise is limited by frequency selectivity at low modulation rates, and by both frequency selectivity and temporal resolution at high modulation rates. However, even when the present measures of frequency selectivity and temporal resolution are both taken into account, significant variance in masking release still remains unaccounted for.     

Temporal integration, frequency resolution, and off-frequency listening in normal-hearing and cochlear-impaired listeners

Temporal integration for a 1000-Hz signal was determined for normal-hearing and cochlear hearing-impaired listeners in quiet and in masking noise of variable bandwidth. Critical ratio and 3-dB critical band measures of frequency resolution were derived from the masking data. Temporal integration for the normal-hearing listeners was markedly reduced in narrow-band noise, when contrasted with temporal integration in quiet or in wideband noise. The effect of noise bandwidth on temporal integration was smaller for the hearing-impaired group. Hearing-impaired subjects showed both reduced temporal integration and reduced frequency resolution for the 200-ms signal. However, a direct relation between temporal integration and frequency resolution was not indicated. Frequency resolution for the normal-hearing listeners did not differ from that of the hearing-impaired listeners for the 20-ms signal. It was suggested that some of the frequency resolution and temporal integration differences between normal-hearing and hearing-impaired listeners could be accounted for by off-frequency listening.     

Comodulation masking release in speech identification with real and simulated cochlear-implant hearing

For normal-hearing (NH) listeners, masker energy outside the spectral region of a target signal can improve target detection and identification, a phenomenon referred to as comodulation masking release (CMR). This study examined whether, for cochlear implant (CI) listeners and for NH listeners presented with a "noise vocoded" CI simulation, speech identification in modulated noise is improved by a co-modulated flanking band. In Experiment 1, NH listeners identified noise-vocoded speech in a background of on-target noise with or without a flanking narrow band of noise outside the spectral region of the target. The on-target noise and flanker were either 16-Hz square-wave modulated with the same phase or were unmodulated; the speech was taken from a closed-set corpus. Performance was better in modulated than in unmodulated noise, and this difference was slightly greater when the comodulated flanker was present, consistent with a small CMR of about 1.7 dB for noise-vocoded speech. Experiment 2, which tested CI listeners using the same speech materials, found no advantage for modulated versus unmodulated maskers and no CMR. Thus although NH listeners can benefit from CMR even for speech signals with reduced spectro-temporal detail, no CMR was observed for CI users.     

Comodulation masking release (CMR) as a function of masker bandwidth, modulator bandwidth, and signal duration

These experiments examine how comodulation masking release (CMR) varies with masker bandwidth, modulator bandwidth, and signal duration. In experiment 1, thresholds were measured for a 400-ms, 2000-Hz signal masked by continuous noise varying in bandwidth from 50-3200 Hz in 1-oct steps. In one condition, using random noise maskers, thresholds increased with increasing bandwidth up to 400 Hz and then remained approximately constant. In another set of conditions, the masker was multiplied (amplitude modulated) by a low-pass noise (bandwidth varied from 12.5-400 Hz in 1-oct steps). This produced correlated envelope fluctuations across frequency. Thresholds were generally lower than for random noise maskers with the same bandwidth. For maskers less than one critical band wide, the release from masking was largest (about 5 dB) for maskers with low rates of modulation (12.5-Hz-wide low-pass modulator). It is argued that this release from masking is not a "true" CMR but results from a within-channel cue. For broadband maskers (greater than 400 Hz), the release from masking increased with increasing masker bandwidth and decreasing modulator bandwidth, reaching an asymptote of 12 dB for a masker bandwidth of 800 Hz and a modulator bandwidth of 50 Hz. Most of this release from masking can be attributed to a CMR. In experiment 2, the modulator bandwidth was fixed at 12.5 Hz and the signal duration was varied. For masker bandwidths greater than 400 Hz, the CMR decreased from 12 to 5 dB as the signal duration was decreased from 400 to 25 ms.(ABSTRACT TRUNCATED AT 250 WORDS)     

Combined monaural and binaural masking release

Stimulus conditions were examined where both across-frequency [comodulation masking release (CMR)] and across-ear [binaural masking-level difference (BMLD)] cues were available, as well as conditions where only one of these cue types was available. The main goal of the study was to determine how the two types of cues combine. The effects of comodulation were assessed either by modulating a masking noise and manipulating its bandwidth (experiment 1) or by using two comodulated narrow bands of noise separated in frequency (experiment 2). The masker was always No, and the 500-Hz pure-tone signal was either So or S pi. The effect of the frequency of modulation was examined either by changing the frequency of the modulating stimulus (experiment 1) or by changing the bandwidth of the comodulated narrow-band noise (experiment 2). Four of six subjects showed greater masking release when both BMLD and CMR cues were available than for either type of cue alone, whereas the other two subjects did not show an ability to combine the two cues for additional advantage. For the subjects who were able to combine the two types of cue, the additional advantage was greater for low frequencies of modulation. The results indicate that one component of CMR may be based upon across-frequency envelope comparisons at a stage of processing after binaural analysis.     

Within-channel cues in comodulation masking release (CMR): experiments and model predictions using a modulation-filterbank model

Experiments and model calculations were performed to study the influence of within-channel cues versus across-channel cues in comodulation masking release (CMR). A class of CMR experiments is considered that are characterized by a single (unmodulated or modulated) bandpass noise masker with variable bandwidth centered at the signal frequency. A modulation-filterbank model suggested by Dau et al. [J. Acoust. Soc. Am. 102, 2892-2905 (1997)] was employed to quantitatively predict the experimental data. Effects of varying masker bandwidth, center frequency, modulator bandwidth, modulator type, and signal duration on CMR were examined. In addition, the effect of band limiting the noise before or after modulation was shown to influence the CMR in the same way as a systematic variation of the modulation depth. It is demonstrated that a single-channel analysis, which analyzes only the information from one peripheral channel, quantitatively accounts for the CMR in most cases, indicating that an across-channel process is generally not necessary for simulating results from this class of CMR experiments. True across-channel processes may be found in another class of CMR experiments.     

The effect of across-frequency differences in masking level on spectro-temporal pattern analysis

Masking noise well separated in frequency from the signal may improve the detectability of the signal if the masking noise is modulated. This effect is referred to as co-modulation masking release (CMR). The present experiments examine the effect of across-frequency differences in masking noise level on CMR. Three experiments were performed, each using a different method to create modulated noise stimuli having across-frequency differences in the spectrum level. All stimulation was monaural. Experiment I used a notched noise method (selectively reducing the level for the critical band centered on the signal). Experiment II used a method in which the level of a 100-Hz-wide masker centered on the signal was varied, and flanking noise bands were of constant level. Experiment III used a method in which flanking noise bands were varied in level, and the 100-Hz-wide masker centered on the signal was of constant level. The signal was a 1000-Hz, 300-ms pure tone. The CMR effect was negated by small spectral notches centered on the signal (experiment I). However, CMR proved to be relatively robust to across-frequency level differences in experiments II and III (a CMR effect occurred for across-frequency differences in spectrum level as great as 20 dB). Low CMR's obtained in experiment I were probably due to relatively poor correlation of across-frequency modulation pattern which occurred with notched noise. The results of experiments II and III suggest that the fluctuation pattern is of primary importance in providing release from masking, and that information on absolute levels, coded across frequency, is of less importance.     

Exploring the additivity of binaural and monaural masking release

Experiment 1 examined comodulation masking release (CMR) for a 700-Hz tonal signal under conditions of N(o)S(o) (noise and signal interaurally in phase) and N(o)S(π) (noise in phase, signal out of phase) stimulation. The baseline stimulus for CMR was either a single 24-Hz wide narrowband noise centered on the signal frequency [on-signal band (OSB)] or the OSB plus, a set of flanking noise bands having random envelopes. Masking noise was either gated or continuous. The CMR, defined with respect to either the OSB or the random noise baseline, was smaller for N(o)S(π) than N(o)S(o) stimulation, particularly when the masker was continuous. Experiment 2 examined whether the same pattern of results would be obtained for a 2000-Hz signal frequency; the number of flanking bands was also manipulated (two versus eight). Results again showed smaller CMR for N(o)S(π) than N(o)S(o) stimulation for both continuous and gated masking noise. The CMR was larger with eight than with two flanking bands, and this difference was greater for N(o)S(o) than N(o)S(π). The results of this study are compatible with serial mechanisms of binaural and monaural masking release, but they indicate that the combined masking release (binaural masking-level difference and CMR) falls short of being additive.     

Effects of spectral smearing on the identification of speech in noise filtered into low- and mid-frequency regions

Le?ger et al. [J. Acoust. Soc. Am. 131, 1502-1514 (2012)] reported deficits in the identification of consonants in noise by hearing-impaired listeners using stimuli filtered into low- or mid-frequency regions in which audiometric thresholds were normal or near-normal. The deficits could not be fully explained in terms of reduced audibility or temporal-envelope processing. However, previous studies indicate that the listeners may have had reduced frequency selectivity, with auditory filters broadened by a factor of about 1.3, despite having normal or near-normal audiometric thresholds in the tested regions. The present study aimed to determine whether the speech-perception deficits could be explained by such a small reduction of frequency selectivity. Consonant identification was measured for normal-hearing listeners in quiet and in unmodulated and modulated noises using the same method as Le?ger et al. The signal-to-noise ratio was set to -3 dB for the masked conditions. Various amounts of reduced frequency selectivity were simulated using a spectral-smearing algorithm. Performance was reduced only for spectral-smearing factors greater than 1.7. For all conditions, identification scores for hearing-impaired listeners could not be explained by a mild reduction of frequency selectivity.     

Comodulation masking release as a function of bandwidth and test frequency

Comodulation masking release (CMR) was investigated as a function of signal frequency (0.5-4.0 kHz) and the total bandwidth of noise centered on the signal frequency. Taking noncomodulated noise of the same bandwidth as the reference condition, CMR for modulated noise increased with increasing bandwidth of the flanking noise outside the critical band centered on the signal tone; however, this growth asymptoted for broad total bandwidths. These bandwidth effects were expressed by scaling the width of the flanking bands beyond the critical band centered on the signal frequency, approximately according to a critical bandwidth scale. After this scaling, signal frequency had negligible effect on CMR magnitude. For the low modulation frequencies involved, a beneficial effect on CMR at high carrier frequencies would not be expected, and none was observed. Some further trends in the masked thresholds in comodulated and noncomodulated conditions, and the choice of appropriate reference condition are discussed.     

Comodulation masking release as a function of bandwidth and time delay between on-frequency and flanking-band maskers

The threshold for a signal masked by a narrow band of noise centered at the signal frequency (the on-frequency band) may be reduced by adding to the masker a second band of noise (the flanking band) whose envelope is correlated with that of the first band, an effect called comodulation masking release (CMR). This paper examines CMR as a function of masker bandwidth and time delay between the envelopes of the on-frequency and flanking bands. The 1.0-kHz sinusoidal signal had a duration of 400 ms. The on-frequency band was presented alone (reference condition) or with the flanking band. The flanking-band envelope was either correlated or uncorrelated with that of the on-frequency band. Flanking-band center frequencies ranged from 0.25-2.0 kHz. The flanking band was presented either in the same ear as the on-frequency band (monaural condition) or in the opposite ear (dichotic condition). The noise bands had bandwidths of 6.25, 25, or 100 Hz. In the correlated conditions, the flanking-band envelope was delayed with respect to that of the on-frequency band by 0, 5, 10, or 20 ms. For the 100-Hz bandwidth, CMRs were small (typically less than 1 dB) in both monaural and dichotic conditions at all delay times. For the 25-Hz bandwidth, CMRs were about 3.5 dB for the 0-ms delay, and decreased to about 1.5 dB for the 20-ms delay. For the 6.25-Hz bandwidth, CMRs averaged about 5 dB and were almost independent of delay time. The results suggest that the absolute delay time is not the critical variable determining CMR. The magnitude of CMR appears to depend on the correlation between the envelopes of the on-frequency and flanking bands. However, the results do not support a model of CMR that assumes that signal threshold corresponds to a constant change in across-band envelope correlation when the correlation is transformed to Fisher's z.     

Temporal and spectral masking release in low- and mid-frequency regions for normal-hearing and hearing-impaired listeners

"Masking release" (MR), the improvement of speech intelligibility in modulated compared with unmodulated maskers, is typically smaller than normal for hearing-impaired listeners. The extent to which this is due to reduced audibility or to suprathreshold processing deficits is unclear. Here, the effects of audibility were controlled by using stimuli restricted to the low- (≤1.5 kHz) or mid-frequency (1-3 kHz) region for normal-hearing listeners and hearing-impaired listeners with near-normal hearing in the tested region. Previous work suggests that the latter may have suprathreshold deficits. Both spectral and temporal MR were measured. Consonant identification was measured in quiet and in the presence of unmodulated, amplitude-modulated, and spectrally modulated noise at three signal-to-noise ratios (the same ratios for the two groups). For both frequency regions, consonant identification was poorer for the hearing-impaired than for the normal-hearing listeners in all conditions. The results suggest the presence of suprathreshold deficits for the hearing-impaired listeners, despite near-normal audiometric thresholds over the tested frequency regions. However, spectral MR and temporal MR were similar for the two groups. Thus, the suprathreshold deficits for the hearing-impaired group did not lead to reduced MR.     

NoSo and NoS pi detection as a function of masker bandwidth in normal-hearing and cochlear-impaired listeners

NoSo and NoS pi detection thresholds for a 500-Hz pure-tone signal were measured as a function of masking noise bandwidth in normal-hearing and cochlear hearing-impaired subjects. NoSo and NoS pi critical bands were derived from the bandlimited noise functions. A notched noise measure of the monaural critical band was also obtained for each ear. One hypothesis tested was that an asymmetrical monaural critical band would result in a relatively steep improvement of the NoS pi detection threshold as a function of decreasing masker bandwidth and would, therefore, be associated with a wider binaural critical band. This was hypothesized because the outputs of the left and right auditory filters would be more decorrelated the greater the interaural difference in the monaural critical band. However, as the noise bandwidth was narrowed, the decorrelation would lessen, resulting in a relatively steep improvement in NoS pi detection. Results indicated that the masking level difference (MLD) was smaller and that the monaural critical bands were generally wider in cochlear-impaired listeners. NoSo and NoS pi critical bands were somewhat larger in the cochlear hearing-impaired listeners having relatively wide monaural critical bands. There was a significant correlation between monaural critical band asymmetry and the NoS pi critical band; however, this correlation was insignificant when a control was employed for the critical band in the worse ear. Therefore, the present results did not support a strong association between monaural critical band asymmetry and the width of the NoS pi critical band.     

Signal detection in temporally modulated and spectrally shaped maskers.

The first part of this paper presents several experiments on signal detection in temporally modulated noise, yielding a general approach toward the concept of comodulation masking release (CMR). Measurements were made on masked thresholds of both long- and short-duration, narrow-band signals presented in a 100% sinusoidally amplitude-modulated (SAM) noise masker (modulation frequency 32 Hz), as a function of masker bandwidth from 1/3 oct up to 13/3 octs, while the masker band was geometrically centered at signal frequency. With the short-duration signals placed in the valley of the masker, a substantial CMR (i.e., a decrease of masked threshold with increasing masker bandwidth) was found, whereas for the long-duration signals CMR was smaller. Furthermore, investigations were carried out to determine whether CMR changes when the bandwidth of the signals, consisting of bandpass impulse responses, is increased. The data indicate that substantial CMR remains even when all masker bands contain a signal component, thus minimizing across-channel differences. This finding is not in line with current models accounting for the CMR phenomenon. The second part of this paper concerns signal detection in spectrally shaped noise. Also investigated was whether release from masking occurs for the detection of a pure-tone signal at a valley or a peak of a simultaneously presented masking noise with a sinusoidally rippled power spectrum, when this masker was preceded and followed by a second noise (temporal flanking burst) with an identical spectral shape as the on-signal noise. Similar to CMR effects for temporal modulations, the data indicate that coshaping masking release (CSMR) occurs when the signal is placed in a valley of the spectral envelope of the masker, whereas no release from masking is found when the signal is placed at a peak of the spectral envelope of the masker. The implications of these experiments for measures of spectral and temporal resolution are discussed.     

Frequency discrimination under conditions of comodulation masking release (L)

Masked detection thresholds can often be improved by introducing coherent masker amplitude modulation across frequency, a phenomenon referred to as comodulation masking release (CMR). While CMR can be large for detection, it is smaller for supra-threshold tasks, such as intensity discrimination. In this experiment, frequency discrimination for a 1000-Hz tone near threshold was found to be poorer in an amplitude-modulated than a steady bandpass noise. These results parallel previous findings for intensity discrimination. Although this study examined the relatively simple task of frequency discrimination, the results may have implications for more complex tasks, such as speech recognition in fluctuating noise.     

The effect of broadband noise on the human brainstem auditory evoked response. II. Frequency specificity

A series of experiments evaluated the effects of broadband noise (ipsilateral) on wave V of the brainstem auditory evoked response (BAER) elicited by tone bursts or clicks in the presence of high-pass masking noise. Experiment 1 used 1000- and 4000-Hz, 60-dB nHL tone bursts in the presence of broadband noise. With increasing noise level, wave V latency shift was greater for the 1000-Hz tone bursts, while amplitude decrements were similar for both tone-burst frequencies. Experiment 2 varied high-pass masker cutoff frequency and the level of subtotal masking in the presence of 50-dB nHL clicks. The effects of subtotal masking on wave V (increase in latency and decrease in amplitude) increased with increasing derived-band frequency. Experiment 3 covaried high-pass masker cutoff frequency and subtotal masking level for 1000- and 4000-Hz tone-burst stimuli. The effect of subtotal masking on wave V latency was reduced for both tone-burst frequencies when the response-generating region of the cochlear partition was limited by high-pass maskers. The results of these three experiments suggest that most of the wave V latency shift associated with increasing levels of broadband noise is mediated by a place mechanism when the stimulus is a moderate intensity (60 dB nHL), low-frequency (1000 Hz) tone burst. However, the interpretation of the latency shifts produced by broadband noise for 4000-Hz tone-burst stimuli is made more complex by multiple technical factors discussed herein.     

Additivity of forward masking

Masked thresholds for a 1000-Hz sinusoidal signal were measured as a function of masker level in both forward and simultaneous masking for two types of maskers: a 1000-Hz sinusoid and a narrowband noise, 60-Hz wide, centered at 1000 Hz. In forward masking, the noise masker produced much steeper growth-of-masking functions than the sinusoid. Presenting a contralateral broadband noise "cue" with the forward masker dramatically reduced the slope of masking for the noise masker but did not influence results for the sinusoidal masker. The noise remained the more effective masker. The amount of masking produced by combinations of equally effective narrowband-noise and sinusoidal maskers was compared to that produced by each masker individually with and without the contralateral cue. No additional masking beyond that predicted by energy summation was measured for forward masking. Additional masking beyond energy-sum predictions was measured for analogous conditions in simultaneous masking. Comparisons of results obtained with and without the contralateral cue suggest that signal thresholds in the presence of narrowband-noise forward maskers can reflect nonperipheral auditory processes.     

Excess masking among listeners with a sensorineural hearing loss

Three experiments were conducted to determine whether listeners with a sensorineural hearing loss exhibited greater than normal amounts of masking at frequencies above the frequency of the masker. Excess masking was defined as the difference (in dB) between the masked thresholds actually obtained from a hearing-impaired listener and the expected thresholds calculated for the same individual. The expected thresholds were the power sum of the listener's thresholds in quiet and the average masked thresholds obtained from a group of normal-hearing subjects at the test frequency. Hearing-impaired listeners, with thresholds in quiet ranging from approximately 35-70 dB SPL (at test frequencies between 500-3000 Hz), displayed approximately 12-15 dB of maximum excess masking. The maximum amount of excess masking occurred in the region where the threshold in quiet of the hearing-impaired listener and the average normal masked threshold were equal. These findings indicate that listeners with a sensorineural hearing loss display one form of reduced frequency selectivity (i.e., abnormal upward spread of masking) even when their thresholds in quiet are taken into account.     

Forward-masking properties of multicomponent signals in normal and hearing-impaired subjects

The forward-masking properties of inharmonic complex stimuli were measured both for normal and hearing-impaired subjects. The signal threshold for a 1000-Hz pure-tone probe was obtained for six different maskers, which varied in the number of pure-tone components. The masking stimuli consisted of 1, 3, 5, 7, 9, or 11 components, logarithmically spaced in frequency surrounding the signal and presented at a fixed level of 80 dB SPL per component. In most normal-hearing subjects, the threshold for the probe decreased as the number of masking components was increased, demonstrating that stimuli with more components tended to be less effective maskers. Results from hearing-impaired subjects showed no decrease in threshold with increasing number of masking components. Instead, the thresholds increased as more components were added to the first masker. These results appear to be consistent with suppression effects within the multicomponent maskers for the normal subjects and a lack of suppression effects for the hearing-impaired subjects. The results from the normal-hearing subjects are also consistent with "across-channel" cuing.     

Modulation detection interference: effects of concurrent and sequential streaming

The presence of amplitude fluctuations in one frequency region can interfere with our ability to detect similar fluctuations in another (remote) frequency region. This effect is known as modulation detection interference (MDI). Gating the interfering and target sounds asynchronously is known to lead to a reduction in MDI, presumably because the two sounds become perceptually segregated. The first experiment examined the relative effects of carrier and modulator gating asynchrony in producing a release from MDI. The target carrier was a 900-ms, 4.3-kHz sinusoid, modulated in amplitude by a 500-ms, 16-Hz sinusoid, with 200-ms unmodulated fringes preceding and following the modulation. The interferer (masker) was a 1-kHz sinusoid, modulated by a narrowband noise with a 16-Hz bandwidth, centered around 16 Hz. Extending the masker carrier for 200 ms before and after the signal carrier reduced MDI, regardless of whether the target and masker modulators were gated synchronously or were gated with onset and offset asynchronies of 200 ms. Similarly, when the carriers were gated synchronously, asynchronous gating of the modulators did not produce a release from MDI. The second experiment measured MDI with a synchronous target and masker and investigated the effect of adding a series of precursor tones, which were designed to promote the forming of a perceptual stream with the masker, thereby leaving the target perceptually isolated. Four modulated or unmodulated precursor tones presented at the masker frequency were sufficient to completely eliminate MDI. The results support the idea that MDI is due to a perceptual grouping of the masker and target, and show that conditions promoting sufficient perceptual segregation of the masker and target can lead to a total elimination of MDI.