The role of the envelope in processing iterated rippled noise.

Iterated rippled noise (IRN) is generated by a cascade of delay and add (the gain after the delay is 1.0) or delay and subtract (the gain is -1.0) operations. The delay and add/subtract operations impart a spectral ripple and a temporal regularity to the noise. The waveform fine structure is different in these two conditions, but the envelope can be extremely similar. Four experiments were used to determine conditions in which the processing of IRN stimuli might be mediated by the waveform fine structure or by the envelope. In experiments 1 and 3 listeners discriminated among three stimuli in a single-interval task: IRN stimuli generated with the delay and add operations (g = 1.0), IRN stimuli generated using the delay and subtract operations (g = -1.0), and a flat-spectrum noise stimulus. In experiment 2 the listeners were presented two IRN stimuli that differed in delay (4 vs 6 ms) and a flat-spectrum noise stimulus that was not an IRN stimulus. In experiments 1 and 2 both the envelope and waveform fine structure contained the spectral ripple and temporal regularity. In experiment 3 only the envelope had this spectral and temporal structure. In all experiments discrimination was determined as a function of high-pass filtering the stimuli, and listeners could discriminate between the two IRN stimuli up to frequency regions as high as 4000-6000 Hz. Listeners could discriminate the IRN stimuli from the flat-spectrum noise stimulus at even higher frequencies (as high as 8000 Hz), but these discriminations did not appear to depend on the pitch of the IRN stimuli. A control experiment (fourth experiment) suggests that IRN discriminations in high-frequency regions are probably not due entirely to low-frequency nonlinear distortion products. The results of the paper imply that pitch processing of IRN stimuli is based on the waveform fine structure.     

Asymmetry of masking between complex tones and noise: partial loudness

This experiment examined the partial masking of periodic complex tones by a background of noise, and vice versa. The tones had a fundamental frequency (F0) of 62.5 or 250 Hz, and components were added in either cosine phase (CPH) or random phase (RPH). The tones and the noise were bandpass filtered into the same frequency region, from the tenth harmonic up to 5 kHz. The target alone was alternated with the target and the background; for the mixture, the background and target were either gated together, or the background was turned on 400 ms before, and off 200 ms after, the target. Subjects had to adjust the level of either the target alone or the target in the background so as to match the loudness of the target in the two intervals. The overall level of the background was 50 dB SPL, and loudness matches were obtained for several fixed levels of the target alone or in the background. The resulting loudness-matching functions showed clear asymmetry of partial masking. For a given target-to-background ratio, the partial loudness of a complex tone in a noise background was lower than the partial loudness of a noise in a complex tone background. Expressed as the target-to-background ratio required to achieve a given loudness, the asymmetry typically amounted to 12-16 dB. When the F0 of the complex tone was 62.5 Hz, the asymmetry of partial masking was greater for CPH than for RPH. When the F0 was 250 Hz, the asymmetry was greater for RPH than for CPH. Masked thresholds showed the same pattern as for partial masking for both F0's. Onset asynchrony had some effect on the loudness matching data when the target was just above its masked threshold, but did not significantly affect the level at which the target in the background reached its unmasked loudness. The results are interpreted in terms of the temporal structure of the stimuli.     

Differences in auditory performance between monaural and dichotic conditions. I: masking thresholds in frozen noise.

Thresholds of a 5-ms, 1-kHz signal were determined in the presence of a frozen-noise masker. The noise had a flat power spectrum between 20 Hz and 5 kHz and was presented with a duration of 300 ms. The following interaural conditions were tested with four listeners: Noise and signal monaural at the same ear (monaural condition, NmSm), noise and signal identical at both ears (diotic condition, NoSo), noise identical at both ears and signal monaural (dichotic condition, NoSm) and uncorrelated noise at the two ears and signal monaural (NuSm). The signal was presented at a fixed temporal position with respect to the frozen noise in all measurements and thresholds were determined for different starting phases of the carrier frequency of the signal. Variation of the carrier phase strongly influenced the detection in the diotic condition and the masked thresholds varied by more than 10 dB. The pattern of thresholds for the monaural condition was less variable and the thresholds were generally higher than for the diotic condition. The monaural-diotic difference for specific starting phases amounted to as much as 8 dB. Comparison measurements using running noise maskers revealed no such difference. This relation between monaural and diotic thresholds was further investigated with eight additional subjects. Again, monaural and diotic thresholds in running noise were identical, while in frozen noise, diotic thresholds were consistently lower than monaural thresholds, even when the ear with the lower NmSm threshold was compared. For the starting phase showing the largest monaural-diotic difference, the thresholds for NoSm lay between the monaural and the diotic values. At other starting phases, the NoSm threshold was clearly lower than both the NmSm and the NoSo threshold. One possible explanation of the observed monaural-diotic differences relates to contralateral efferent interaction between the right and the left hearing pathway. A prediction based on this explanation was verified in a final experiment, where frozen-noise performance for NmSm was improved by simultaneously presenting an uncorrelated running noise to the opposite ear.     

Asymmetry of masking between complex tones and noise: the role of temporal structure and peripheral compression

Thresholds for the detection of harmonic complex tones in noise were measured as a function of masker level. The rms level of the masker ranged from 40 to 70 dB SPL in 10-dB steps. The tones had a fundamental frequency (F0) of 62.5 or 250 Hz, and components were added in either cosine or random phase. The complex tones and the noise were bandpass filtered into the same frequency region, from the tenth harmonic up to 5 kHz. In a different condition, the roles of masker and signal were reversed, keeping all other parameters the same; subjects had to detect the noise in the presence of a harmonic tone masker. In both conditions, the masker was either gated synchronously with the 700-ms signal, or it started 400 ms before and stopped 200 ms after the signal. The results showed a large asymmetry in the effectiveness of masking between the tones and noise. Even though signal and masker had the same bandwidth, the noise was a more effective masker than the complex tone. The degree of asymmetry depended on F0, component phase, and the level of the masker. The maximum difference between masked thresholds for tone and noise was about 28 dB; this occurred when the F0 was 62.5 Hz, the components were in cosine phase, and the masker level was 70 dB SPL. In most conditions, the growth-of-masking functions had slopes close to 1 (on a dB versus dB scale). However, for the cosine-phase tone masker with an F0 of 62.5 Hz, a 10-dB increase in masker level led to an increase in masked threshold of the noise of only 3.7 dB, on average. We suggest that the results for this condition are strongly affected by the active mechanism in the cochlea.     

Listening experience with iterated rippled noise alters the perception of 'pitch' strength of complex sounds in the chinchilla

Behavioral responses obtained from chinchillas trained to discriminate a cosine-phase harmonic tone complex from wideband noise indicate that the perception of 'pitch' strength in chinchillas is largely influenced by periodicity information in the stimulus envelope. The perception of 'pitch' strength was examined in chinchillas in a stimulus generalization paradigm after animals had been retrained to discriminate infinitely iterated rippled noise from wideband noise. Retrained chinchillas gave larger behavioral responses to test stimuli having strong fine structure periodicity, but weak envelope periodicity. That is, chinchillas learn to use the information in the fine structure and consequently, their perception of 'pitch' strength is altered. Behavioral responses to rippled noises having similar periodicity strengths, but large spectral differences were also tested. Responses to these rippled noises were similar, suggesting a temporal analysis can be used to account for the behavior. Animals were then retested using the cosine-phase harmonic tone complex as the expected signal stimulus. Generalization gradients returned to those obtained originally in the na?ve condition, suggesting that chinchillas do not remain "fine structure listeners," but rather revert back to being "envelope listeners" when the periodicity strength in the envelope of the expected stimulus is high.     

Pitch strength and pitch dominance of iterated rippled noises in hearing-impaired listeners.

Reports using a variety of psychophysical tasks indicate that pitch perception by hearing-impaired listeners may be abnormal, contributing to difficulties in understanding speech and enjoying music. Pitches of complex sounds may be weaker and more indistinct in the presence of cochlear damage, especially when frequency regions are affected that form the strongest basis for pitch perception in normal-hearing listeners. In this study, the strength of the complex pitch generated by iterated rippled noise was assessed in normal-hearing and hearing-impaired listeners. Pitch strength was measured for broadband noises with spectral ripples generated by iteratively delaying a copy of a given noise and adding it back into the original. Octave-band-pass versions of these noises also were evaluated to assess frequency dominance regions for rippled-noise pitch. Hearing-impaired listeners demonstrated consistently weaker pitches in response to the rippled noises relative to pitch strength in normal-hearing listeners. However, in most cases, the frequency regions of pitch dominance, i.e., strongest pitch, were similar to those observed in normal-hearing listeners. Except where there exists a substantial sensitivity loss, contributions from normal pitch dominance regions associated with the strongest pitches may not be directly related to impaired spectral processing. It is suggested that the reduced strength of rippled-noise pitch in listeners with hearing loss results from impaired frequency resolution and possibly an associated deficit in temporal processing.     

Temporal processing in the aging auditory system.

Measures of monaural temporal processing and binaural sensitivity were obtained from 12 young (mean age = 26.1 years) and 12 elderly (mean age = 70.9 years) adults with clinically normal hearing (pure-tone thresholds < or = 20 dB HL from 250 to 6000 Hz). Monaural temporal processing was measured by gap detection thresholds. Binaural sensitivity was measured by interaural time difference (ITD) thresholds. Gap and ITD thresholds were obtained at three sound levels (4, 8, or 16 dB above individual threshold). Subjects were also tested on two measures of speech perception, a masking level difference (MLD) task, and a syllable identification/discrimination task that included phonemes varying in voice onset time (VOT). Elderly listeners displayed poorer monaural temporal analysis (higher gap detection thresholds) and poorer binaural processing (higher ITD thresholds) at all sound levels. There were significant interactions between age and sound level, indicating that the age difference was larger at lower stimulus levels. Gap detection performance was found to correlate significantly with performance on the ITD task for young, but not elderly adult listeners. Elderly listeners also performed more poorly than younger listeners on both speech measures; however, there was no significant correlation between psychoacoustic and speech measures of temporal processing. Findings suggest that age-related factors other than peripheral hearing loss contribute to temporal processing deficits of elderly listeners.     

Speech processing in the auditory system. II: Lateral inhibition and the central processing of speech evoked activity in the auditory nerve

A biologically realistic model of a uniform lateral inhibitory network (LIN) is shown capable of extracting from the complex spatio-temporal firing patterns of the cat's auditory nerve the formants and low-order harmonics of synthetic voiced speech stimuli. The model provides a realistic mechanism to utilize the temporal aspects of the firing and thus supports the hypothesis that the neural coding of complex sounds in terms of average rates can be supplemented by the information coded in the synchronous firing. At low levels of intensity the LIN can sharpen the average rate profiles. At moderate and high levels the LIN uses the cues available in the distribution of phases of the synchronous activity which exhibit rapid relative phase shifts at specific characteristic frequency (CF) locations (corresponding to the frequencies of the low-order harmonics in the stimulus). These temporal phase shifts manifest themselves at the input of the LIN as steep and localized spatial discontinuities in the instantaneous pattern of activity across the fiber array. The LIN enhances its output from these spatially steep input regions while suppressing its output from spatially smooth input regions (where little phase shifts occur). In this manner the LIN recreates from the response patterns a representation of the stimulus spectrum using the temporal cues as spatial markers of the stimulus components rather than as absolute measures of their frequencies. Similar results are obtained with various lateral inhibitory topologies, e.g., recurrent versus nonrecurrent, single versus double layer, and linear versus nonlinear.     

Psychophysical evidence against the autocorrelation theory of auditory temporal processing.

Nowadays, it is widely believed that the temporal structure of the auditory nerve fibers' response to sound stimuli plays an important role in auditory perception. An influential hypothesis is that information is extracted from this temporal structure by neural operations akin to an autocorrelation algorithm. The goal of the present work was to test this hypothesis. The stimuli consisted of sequences of unipolar clicks that were high-pass filtered and mixed with low-pass noise so as to exclude spectral cues. In experiment 1, "interfering" clicks were inserted in an otherwise periodic (isochronous) click sequence. Each click belonging to the periodic sequence was followed, after a random portion of the period, by one interfering click. This disrupted the detection of temporal regularity, even when the interfering clicks were 5 dB less intense than the periodic clicks. Experiments 2-4 used click sequences that showed a single peak in their autocorrelation functions. For some sequences, this peak originated from "first-order" temporal regularities, that is from the temporal relations between consecutive clicks. For other sequences, the peak originated instead from "second-order" regularities, relative to nonconsecutive clicks. The detection of second-order regularities appeared to be much more difficult than the detection of comparable first-order regularities. Overall, these results do not tally with the current autocorrelation models of temporal processing. They suggest that the extraction of temporal information from a group of closely spaced spectral components makes no use of time intervals between nonconsecutive peaks of the amplitude envelope.     

Frequency specificity of the human auditory brainstem and middle latency responses using notched noise masking

This study investigated the frequency specificity of the auditory brainstem and middle latency responses to 80 and 90 dB ppe SPL 500-Hz and 90 dB ppe SPL 2000-Hz tonebursts. The stimuli were brief (2-1-2 cycle) linear-gated tonebursts. ABR/MLRs were recorded using two electrode montages: (1) Cz-nape of neck and (2) Cz-ipsilateral earlobe. Cochlear contributions to ABR wave V-Na and MLR waves Na-Pa and Pa-Nb were assessed by plotting notched noise tuning curves which showed amplitudes and latencies as a function of center frequency of the noise masker [Abdala and Folsom, J. Acoust. Soc. Am. 97, 2394 (1995); ibid. 98, 921 (1995)]. Maxima in the response amplitude profiles for the ABR and MLR to 80 dB ppe SPL tonebursts occurred within one-half octave of the nominal stimulus frequency, with minimal contributions to the responses from frequencies greater than one octave away. At 90 dB ppe SPL, contributions came from a slightly broader frequency region for both stimulus frequencies. Thus, the ABR/MLR to 80 dB ppe SPL tonebursts shows good frequency specificity which decreases at 90 dB ppe SPL. No significant differences exist in frequency specificity of: (1) ABR wave V-Na versus MLR waves Na-Pa and Pa-Nb at either stimulus frequency or intensity; and (2) ABR/MLRs recorded using the two electrode montages.     

Estimating the transition bandwidth between two auditory processes: evidence for broadband auditory filters

A spectral discrimination task was used to estimate the frequency range over which information about the temporal envelope is consolidated. The standard consisted of n equal intensity, random phase sinusoids, symmetrically placed around a signal component. The signal was an intensity increment of the central sinusoid, which on average was 1000 Hz. Pitch cues were degraded by randomly selecting the center frequency of the complex and single channel energy cues were degraded with a roving-level procedure. Stimulus bandwidth was controlled by varying the number of tones and the frequency separation between tones. For a fixed frequency separation, thresholds increased as n increased until a certain bandwidth was reached, beyond which thresholds decreased. This discontinuity in threshold functions suggests that different auditory processes predominate at different bandwidths, presumably an envelope analysis at bandwidths less than the breakpoint and across channel level comparisons for wider stimulus bandwidths. Estimates of the "transition bandwidth" for 46 listeners ranged from 100 to 1250 Hz. The results are consistent with a peripheral filtering system having multiple filterbanks.     

The perceptual tone/noise ratio of merged, iterated rippled noises with octave, harmonic, and nonharmonic delay ratios

The perceptual tone/noise ratio was measured for merged iterated ripple noise stimuli (IRNs) in which one of the individual IRNs always had a delay of 16 ms. The second IRN was chosen to create merged IRNs with single octave delay ratios (e.g., 16 ms:8 ms), double octave delay ratios (e.g., 16 ms:4 ms), harmonic delay ratios (e.g., 16 ms:12 ms), and nonharmonic delay ratios (e.g., 16 ms:3.9 ms). All stimuli were high-pass filtered at 800 Hz. The tone/noise ratio was significantly enhanced for the octave ratios, and there was a strong interaction between the single and double octave delay ratios and number of iterations. But, the perceptual tone/noise ratio for nonoctave ratios was determined solely by the number of iterations. The pattern of the results can be explained in terms of the height of the largest peak in the summary autocorrelogram [Meddis and Hewitt, J. Acoust. Soc. Am. 89, 2866-2882 (1991)] provided the model is modified to improve the simulation of the loss of phase locking.     

Investigating temporal asymmetry using masking period patterns and models of peripheral auditory processing

Two experiments were conducted in conjunction with modeling to evaluate the role of peripheral nonlinearity and neural adaptation in the perception of temporally asymmetric sounds. In both experiments, maskers were broadband noises amplitude modulated with ramped and damped exponential modulators that repeated at 40 Hz. Masking period patterns (MPPs) were constructed by measuring detection threshold of a 5-ms, 1000-Hz tone burst as function of the signal's onset delay. Experiment I showed that varying modulator half-life from 1 to 16 ms led to differences in the damped and the ramped MPPs that were largest at the short half-lives and diminished at the longer half-lives. When masker level was varied (experiment II), the largest difference between ramped and damped MPPs occurred at moderate stimulus levels. Two peripheral auditory models were evaluated, one a simple auditory filter followed by a power-law nonlinearity and another, a model of auditory nerve processing [J. Acoust. Soc. Am. 126, 2390-2412 (2009)] that includes neural adaptation. Neither models predicted differences between the ramped and damped MPPs, providing indirect support that the central auditory system has a role in perceptual temporal asymmetry.     

Temporal representation of rippled noise in the anteroventral cochlear nucleus of the chinchilla.

This paper describes the temporal responses of anteroventral cochlear nucleus (AVCN) units in the chinchilla to rippled noises. Rippled noise is generated when a wideband noise is delayed and added (cos+ noise) or subtracted (cos- noise) to the undelayed noise. Renewal densities were constructed to evaluate synchronous discharges at the delay. In response to rippled noise, AVCN units which show phase locking to best frequency (BF) tones gave renewal densities having major peaks at the delay for cos+ noise, but nulls at the delay for cos- noise. Most AVCN units which did not show BF phase locking gave renewal densities that did not contain features related to the rippled noise delay; a few of these nonphase-locked units did show peaks in renewal densities for both cos+ and cos- noises. Synchrony at the rippled noise delay was also demonstrated with evoked potential recording. Autocorrelation functions of the neurophonic potential showed peaks at the rippled noise delay for both cos+ and cos- noises. In addition, peaks could be observed in the autocorrelation functions of neurophonic potentials for rippled noises with delays as short as 1 ms; peaks were never observed in renewal densities of single units for ripple delays as short as 1 ms. The results show that a temporal representation of rippled noise delay does exist in the AVCN and are consistent with current hypotheses regarding functions of AVCN subsystems. The temporal representation of the delay is a presumptive neural code for the pitches of rippled noises.     

Zwicker tone illusion and noise reduction in the auditory system

The Zwicker tone is an auditory aftereffect. For instance, after switching off a broadband noise with a spectral gap, one perceives it as a lingering pure tone with the pitch in the gap. It is a unique illusion in that it cannot be explained by known properties of the auditory periphery alone. Here we introduce a neuronal model explaining the Zwicker tone. We show that a neuronal noise-reduction mechanism in conjunction with dominantly unilateral inhibition explains the effect. A pure tone's "hole burning" in noisy surroundings is given as an illustration.     

Speech processing in the auditory system. I: The representation of speech sounds in the responses of the auditory nerve

In a previous paper the speech evoked spatio-temporal response patterns recorded in large populations of auditory-nerve fibers in the cat were examined [M.I. Miller and M.B. Sachs, J. Acoust. Soc. Am. 74, 502-517 (1983)]. The distribution of the relative phases of synchronized activity emerges as an important response feature reflecting the stimulus spectral parameters. Specifically, each strong low-order harmonic of the stimulus (less than or equal to 1.5-2 kHz) dominates the synchrony of a relatively broad segment of fibers near its corresponding characteristic frequency (CF) location in a pattern which mirrors the underlying traveling wave component. Each such fiber segment can be roughly subdivided into two regions: (1) a region basal to the point of resonance of the harmonic where the fiber PST histograms accumulate only small delays (or phase shifts) relative to each other reflecting the fast speed of propagation of the traveling wave, and (2) a region at or very near the point of resonance where the responses exhibit drastic relative phase shifts owing to the sudden slow down of the traveling wave and the consequent rapid accumulation of phase shifts. These rapid phase shifts thus manifest themselves as steep and localized spatial discontinuities in an otherwise relatively uniform instantaneous pattern of activity across the fiber array, all occurring at the CF locations corresponding to the low-order harmonics of the stimulus.     

Temporal processing deficits in the pre-senescent auditory system

This study tested the hypothesis that temporal processing deficits are evident in the pre-senescent (middle-aged) auditory system for listening tasks that involve brief stimuli, across-frequency-channel processing, and/or significant processing loads. A gap duration discrimination (GDD) task was employed that used either fixed-duration gap markers (experiment 1) or random-duration markers (experiment 2). Independent variables included standard gap duration (0, 35, and 250 ms), marker frequency (within- and across-frequency), and task complexity. A total of 18 young and 23 middle-aged listeners with normal hearing participated in the GDD experiments. Middle age was defined operationally as 40-55 years of age. The results indicated that middle-aged listeners performed more poorly than the young listeners in general, and that this deficit was sometimes, but not always, exacerbated by increases in task complexity. A third experiment employed a categorical perception task that measured the gap duration associated with a perceptual boundary. The results from 12 young and 12 middle-aged listeners with normal hearing indicated that the categorical boundary was associated with shorter gaps in the young listeners. The results of these experiments indicate that temporal processing deficits can be observed relatively early in the aging process, and are evident in middle age.     

基于听觉掩蔽效应的自适应反馈抵消

摘要当系统输入信号是有色信号时，传统的自适应反馈抵消算法会由于系统的输出和输入信号存在相关性而造成辨识反馈路径存在偏差，从而导致反馈抵消性能的降低。为了减小反馈路径的辨识偏差，本文提出在系统输出信号中加入被掩蔽噪声来降低系统的输入信号和输出信号的相关性的方法，噪声的能量由频域掩蔽阈值控制。这种基于听觉频域掩蔽效应的自适应反馈抵消算法改善了自适应反馈抵消的性能，同时加入的噪声是被掩蔽不可听的，输出语音的质量没有受到损害。