The role of frequency selectivity in measures of auditory and vibrotactile temporal resolution.

The purpose of this study was to compare the role of frequency selectivity in measures of auditory and vibrotactile temporal resolution. In the first experiment, temporal modulation transfer functions for a sinusoidally amplitude modulated (SAM) 250-Hz carrier revealed auditory modulation thresholds significantly lower than corresponding vibrotactile modulation thresholds at SAM frequencies greater than or equal to 100 Hz. In the second experiment, auditory and vibrotactile gap detection thresholds were measured by presenting silent gaps bounded by markers of the same or different frequency. The marker frequency F1 = 250 Hz preceded the silent gap and marker frequencies after the silent gap included F2 = 250, 255, 263, 310, and 325 Hz. Auditory gap detection thresholds were lower than corresponding vibrotactile thresholds for F2 markers less than or equal to 263 Hz, but were greater than the corresponding vibrotactile gap detection thresholds for F2 markers greater than or equal to 310 Hz. When the auditory gap detection thresholds were transformed into filter attenuation values, the results were modeled well by a constant-percentage (10%) bandwidth filter centered on F1. The vibrotactile gap detection thresholds, however, were independent of marker frequency separation. In a third experiment, auditory and vibrotactile rate difference limens (RDLs) were measured for a 250-Hz carrier at SAM rates less than or equal to 100 Hz. Auditory RDLs were lower than corresponding vibrotactile RDLs for standard rates greater than 10 Hz. Combination tones may have confounded auditory performance for standard rates of 80 and 100 Hz. The results from these experiments revealed that frequency selectivity influences auditory measures of temporal resolution, but there was no evidence of frequency selectivity affecting vibrotactile temporal resolution.     

包络调制率和载波频率对听觉时间调制检测能力的影响

通过心理物理实验探讨了包络调制率(<300 Hz)和纯音载波频率(<8 kHz)对听觉时间调制检测能力的影响. 测试信号为以纯音为载波的正弦幅度调制信号, 采用二选一强迫选择法和自适应调整步长的心理物理实验方法, 测试得到不同载波频率条件下的时间调制传递函数. 实验结果表明, 包络调制率和载波频率均会对听觉的时间调制检测能力产生影响. 当载波频率低于2 kHz时, 人耳的检测能力与调制率呈单调递增趋势;当载波频率高于3.5 kHz时, 检测能力也会受到调制率的显著影响, 但没有显著的单调变化趋势. 当调制率在10-100 Hz之间时, 检测能力不随载波频率明显变化;当调制率在150-300 Hz之间时, 调制检测能力随着载波频率上升而下降, 在载波频率达到3.5 kHz时, 调制检测能力不随载波频率显著改变.     

Discrimination of modulation depth of sinusoidal amplitude modulation (SAM) noise

The detection of sinusoidal amplitude modulation (SAM) provides a lower bound on the degree to which temporal information in the envelope of complex waveforms is encoded by the auditory system. The extent to which changes in the amount of modulation are discriminable provides additional information on the ability of the auditory system to utilize envelope fluctuations. Results from an experiment on the discrimination of modulation depth of broadband noise are presented. Discrimination thresholds, expressed as differences in modulation power, increase monotonically with the modulation depth of the standard, but do not obey Weber's law. The effects of carrier level and of modulation frequency are consistent with those observed in modulation detection: Changes in carrier level have little effect on modulation discrimination; changes in modulation frequency also have little effect except for standards near the modulation detection threshold. The discrimination of modulation depth is consistent with the leaky-integrator model of modulation detection for standards below--10 dB (20 log ms); for standards greater than--10 dB, the leaky integrator predicts better performance than that observed behaviorally.     

Modulation of auditory evoked responses to spectral and temporal changes by behavioral discrimination training

Background  

Due to auditory experience, musicians have better auditory expertise than non-musicians. An increased neocortical activity during auditory oddball stimulation was observed in different studies for musicians and for non-musicians after discrimination training. This suggests a modification of synaptic strength among simultaneously active neurons due to the training. We used amplitude-modulated tones (AM) presented in an oddball sequence and manipulated their carrier or modulation frequencies. We investigated non-musicians in order to see if behavioral discrimination training could modify the neocortical activity generated by change detection of AM tone attributes (carrier or modulation frequency). Cortical evoked responses like N1 and mismatch negativity (MMN) triggered by sound changes were recorded by a whole head magnetoencephalographic system (MEG). We investigated (i) how the auditory cortex reacts to pitch difference (in carrier frequency) and changes in temporal features (modulation frequency) of AM tones and (ii) how discrimination training modulates the neuronal activity reflecting the transient auditory responses generated in the auditory cortex.     

Inner hair cell loss and steady-state potentials from the inferior colliculus and auditory cortex of the chinchilla

Steady-state evoked potentials were measured from unanesthetized chinchillas both before and after carboplatin-induced selective inner hair cell loss. Recordings were made from both the inferior colliculus (IC) and the auditory cortex (AC). The steady-state potential was measured in the form of the envelope following response (EFR), obtained by presenting a two-tone stimulus (f1 = 2000 Hz; f2 = 2020, 2040, 2080, 2160, or 2320 Hz), and measuring the magnitude of the Fourier coefficient at the f2-f1 difference frequency. From the IC, precarboplatin, EFR amplitude vs difference tone frequency showed a bandpass pattern, with maximum amplitude at either 160 or 80 Hz, depending upon stimulus level. Postcarboplatin, the preferred difference frequency was 80 Hz for all stimulus levels. From the AC, EFR amplitude versus difference tone frequency also showed a bandpass pattern, with the maximum amplitude at 80 Hz both pre- and postcarboplatin. EFR amplitude from the IC was decreased for some conditions postcarboplatin, while the amplitude from the AC showed no significant change.     

Modulation gap detection: effects of modulation rate, carrier separation, and mode of presentation.

Modulation gap detection (MGD) is a procedure that measures the sensitivity to an interruption in the modulation pattern imposed upon one or more carrier frequencies. The MGD task was developed to test conditions where a temporal event traverses frequency, but without a concomitant interruption in the spectral continuity of the stimulus. This contrasts with across-frequency gap detection where there is an inherent spectral discontinuity associated with the temporal gap, and where there is a marked decline in performance when the markers of the temporal gap are widely separated in frequency. The purpose of this study was to test the hypothesis that a wideband temporal analysis will be facilitated if there exists a spectral continuity throughout the temporal event. Experiment 1 established the procedure of MGD and indicated that a modulation rate of 8 Hz was optimal for the task. Experiment 2 showed that performance declined markedly when the carrier frequencies of the modulation markers were widely separated in frequency. This finding indicates that spectral continuity across the temporal event is not a sufficient prerequisite for the auditory system to undertake a wideband temporal analysis. Experiment 3 revealed that dichotic MGD also results in poor performance, similar to that seen for widely separated carrier frequencies in the monaural case. This supports the hypothesis that the "channels" across which temporal events are poorly processed do not necessarily correspond to peripheral frequency channels.     

Temporal interactions between pure tones and amplitude-modulated noise

An auditory interaction between the temporal fine structure of a low-frequency tone and the envelope of a high-frequency waveform was observed at very large frequency separations. Thresholds for detection of sinusoidal amplitude modulation of a high-frequency, narrow-band noise were measured as a function of the relative phase between the modulator and a pure tone with the same frequency as the modulator. These "phase functions" were determined at various intensities of the noise and tone for three different modulation frequencies. In general, the phase functions show that low-frequency stimulation has a cyclic effect on the sensitivity to amplitude modulation; over a limited range of relative phases, the modulation threshold is lower than that measured without low-frequency stimulation whereas over a broader range of relative phases, the modulation threshold is much higher. The difference between minimum and maximum modulation thresholds was observed to be as great as 23 dB. Despite this substantial degree of temporal interaction, little, if any, masking by the low-frequency tone of the high-frequency noise was observed.     

A masking level difference due to harmonicity

The role of harmonicity in masking was studied by comparing the effect of harmonic and inharmonic maskers on the masked thresholds of noise probes using a three-alternative, forced-choice method. Harmonic maskers were created by selecting sets of partials from a harmonic series with an 88-Hz fundamental and 45 consecutive partials. Inharmonic maskers differed in that the partial frequencies were perturbed to nearby values that were not integer multiples of the fundamental frequency. Average simultaneous-masked thresholds were as much as 10 dB lower with the harmonic masker than with the inharmonic masker, and this difference was unaffected by masker level. It was reduced or eliminated when the harmonic partials were separated by more than 176 Hz, suggesting that the effect is related to the extent to which the harmonics are resolved by auditory filters. The threshold difference was not observed in a forward-masking experiment. Finally, an across-channel mechanism was implicated when the threshold difference was found between a harmonic masker flanked by harmonic bands and a harmonic masker flanked by inharmonic bands. A model developed to explain the observed difference recognizes that an auditory filter output envelope is modulated when the filter passes two or more sinusoids, and that the modulation rate depends on the differences among the input frequencies. For a harmonic masker, the frequency differences of adjacent partials are identical, and all auditory filters have the same dominant modulation rate. For an inharmonic masker, however, the frequency differences are not constant and the envelope modulation rate varies across filters. The model proposes that a lower variability facilitates detection of a probe-induced change in the variability, thus accounting for the masked threshold difference. The model was supported by significantly improved predictions of observed thresholds when the predictor variables included envelope modulation rate variance measured using simulated auditory filters.     

Comodulation masking release in bottlenose dolphins (Tursiops truncatus)

The acoustic environment of the bottlenose dolphin often consists of noise where energy across frequency regions is coherently modulated in time (e.g., ambient noise from snapping shrimp). However, most masking studies with dolphins have employed random Gaussian noise for estimating patterns of masked thresholds. The current study demonstrates a pattern of masking where temporally fluctuating comodulated noise produces lower masked thresholds (up to a 17 dB difference) compared to Gaussian noise of the same spectral density level. Noise possessing wide bandwidths, low temporal modulation rates, and across-frequency temporal envelope coherency resulted in lower masked thresholds, a phenomenon known as comodulation masking release. The results are consistent with a model where dolphins compare temporal envelope information across auditory filters to aid in signal detection. Furthermore, results suggest conventional models of masking derived from experiments using random Gaussian noise may not generalize well to environmental noise that dolphins actually encounter.     

Modulation and gap detection for broadband and filtered noise signals

Modulation detection thresholds (as a function of sinusoidal amplitude modulation frequency) and temporal gap detection thresholds were measured for three low-pass-filtered noise signals (fc = 1000, 2000, and 4000 Hz), a high-pass-filtered noise signal (fc = 4000 Hz), and a broadband signal. The two latter noise signals were effectively low-pass filtered (fc = 6500 Hz) by the earphone. Each of the filtered signals was presented with a complementary filtered noise masker. Modulation and gap detection thresholds were lowest for the broadband and high-pass signals. Thresholds were significantly higher for the low-pass signals than for the broadband and high-pass signals. For these tasks and conditions, the high-frequency content of the noise signal was more important than was the signal bandwidth. Sensitivity (s) and time constant (tau) indices were derived from functions fitted to the modulation detection data. These indices were compared with gap detection thresholds for corresponding signals. The gap detection thresholds were correlated inversely (rho = -1.0, p less than 0.05) with s (i.e., smaller gap detection thresholds were correlated with greater sensitivity to modulation), but were not correlated significantly with tau, which was relatively invariant across signal conditions.     

Perceptual interaction between carrier periodicity and amplitude modulation in broadband stimuli: a comparison of the autocorrelation and modulation-filterbank model

Recent temporal models of pitch and amplitude modulation perception converge on a relatively realistic implementation of cochlear processing followed by a temporal analysis of periodicity. However, for modulation perception, a modulation filterbank is applied whereas for pitch perception, autocorrelation is applied. Considering the large overlap in pitch and modulation perception, this is not parsimonious. Two experiments are presented to investigate the interaction between carrier periodicity, which produces strong pitch sensations, and envelope periodicity using broadband stimuli. Results show that in the presence of carrier periodicity, detection of amplitude modulation is impaired throughout the tested range (8-1000 Hz). On the contrary, detection of carrier periodicity in the presence of an additional amplitude modulation is impaired only for very low frequencies below the pitch range (<33 Hz). Predictions of a generic implementation of a modulation-filterbank model and an autocorrelation model are compared to the data. Both models were too insensitive to high-frequency envelope or carrier periodicity and to infra-pitch carrier periodicity. Additionally, both models simulated modulation detection quite well but underestimated the detrimental effect of carrier periodicity on modulation detection. It is suggested that a hybrid model consisting of bandpass envelope filters with a ripple in their passband may provide a functionally successful and physiologically plausible basis for a unified model of auditory periodicity extraction.     

Intrinsic envelope fluctuations and modulation-detection thresholds for narrow-band noise carriers

A model is presented which calculates the intrinsic envelope power of a bandpass noise carrier within the passband of a hypothetical modulation filter tuned to a specific modulation frequency. Model predictions are compared to experimentally obtained amplitude modulation (AM) detection thresholds. In experiment 1, thresholds for modulation rates of 5, 25, and 100 Hz imposed on a bandpass Gaussian noise carrier with a fixed upper cutoff frequency of 6 kHz and a bandwidth in the range from 1 to 6000 Hz were obtained. In experiment 2, three noises with different spectra of the intrinsic fluctuations served as the carrier: Gaussian noise, multiplied noise, and low-noise noise. In each case, the carrier was spectrally centered at 5 kHz and had a bandwidth of 50 Hz. The AM detection thresholds were obtained for modulation frequencies of 10, 20, 30, 50, 70, and 100 Hz. The intrinsic envelope power of the carrier at the output of the modulation filter tuned to the signal modulation frequency appears to provide a good estimate for AM detection threshold. The results are compared with predictions on the basis of the more complex auditory processing model by Dau et al.     

Frequency modulation detection: effects of age, psychophysical method, and modulation waveform

As part of an ongoing study of auditory aging, detection of sinusoidal and quasitrapezoidal frequency modulation (FM) was measured with a 5-Hz modulation frequency and 500- and 4000-Hz carriers in two experiments. In Experiment 1, psychometric functions for FM detection were measured with several modulation waveform time patterns in younger adults with normal hearing. Detection of a three-cycle modulated signal improved when its duration was extended by a preceding unmodulated cycle, an effect similar to adding a modulated cycle. In Experiment 2, FM detection was measured for younger and older adults with normal hearing using two psychophysical methods. Similar to frequency discrimination, FM detection was poorer in older than younger subjects and age-related differences were larger at 500 Hz than at 4000 Hz, suggesting that FM detection with low modulation frequencies and frequency discrimination may share common underlying mechanisms. One mechanism is likely related to temporal information coded by neural phase locking which is strong at low frequencies and decreases with increasing frequency, as observed in animals. The frequency-dependent aging effect suggests that this temporal mechanism may be affected by age. The effect of psychophysical method was sizable and frequency dependent, whereas the effect of modulation waveform was minimal.     

The shape of the ear's temporal window

This article examines the idea that the temporal resolution of the auditory system can be modeled using a temporal window (an intensity weighting function) analogous to the auditory filter measured in the frequency domain. To estimate the shape of the hypothetical temporal window, threshold was measured for a brief sinusoidal signal presented in a temporal gap between two bursts of noise. The duration of the gap was systematically varied and the signal was placed both symmetrically and asymmetrically within the gap. The data were analyzed by assuming that the temporal window had the form of a simple mathematical expression with a small number of free parameters. The values of the parameters were adjusted to give the best fit to the data. The analysis assumed that, for each condition, the temporal window was centered at the time giving the highest signal-to-masker ratio, and that threshold corresponded to a fixed ratio of signal energy to masker energy at the output of the window. The data were fitted well by modeling each side of the window as the sum of two rounded-exponential functions. The window was highly asymmetric, having a shallower slope for times before the center than for times after. The equivalent rectangular duration (ERD) of the window was typically about 8 ms. The ERD increased slightly when the masker level was decreased, but did not differ significantly for signal frequencies of 500 and 2000 Hz. The temporal-window model successfully accounts for the data from a variety of experiments measuring temporal resolution. However, it fails to predict certain aspects of forward masking and of the detection of amplitude modulation at high rates.     

Level-dependent changes in detection of temporal gaps in noise markers by adults with normal and impaired hearing

Compression in the basilar-membrane input-output response flattens the temporal envelope of a fluctuating signal when more gain is applied to lower level than higher level temporal components. As a result, level-dependent changes in gap detection for signals with different depths of envelope fluctuation and for subjects with normal and impaired hearing may reveal effects of compression. To test these assumptions, gap detection with and without a broadband noise was measured with 1,?000-Hz-wide (flatter) and 50-Hz-wide (fluctuating) noise markers as a function of marker level. As marker level increased, background level also increased, maintaining a fixed acoustic signal-to-noise ratio (SNR) to minimize sensation-level effects on gap detection. Significant level-dependent changes in gap detection were observed, consistent with effects of cochlear compression. For the flatter marker, gap detection that declines with increases in level up to mid levels and improves with further increases in level may be explained by an effective flattening of the temporal envelope at mid levels, where compression effects are expected to be strongest. A flatter effective temporal envelope corresponds to a reduced effective SNR. The effects of a reduction in compression (resulting in larger effective SNRs) may contribute to better-than-normal gap detection observed for some hearing-impaired listeners.     

Detection of temporal gaps in sinusoids by normally hearing and hearing-impaired subjects

A two-alternative forced-choice task was used to measure psychometric functions for the detection of temporal gaps in a 1-kHz, 400-ms sinusoidal signal. The signal always started and finished at a positive-going zero crossing, and the gap duration was varied from 0.5 to 6.0 ms in 0.5-ms steps. The signal level was 80 dB SPL, and a spectrally shaped noise was used to mask splatter associated with the abrupt onset and offset of the signal. Two subjects with normal hearing, two subjects with unilateral cochlear hearing loss, and two subjects with bilateral cochlear hearing loss were tested. The impaired ears had confirmed reductions in frequency selectivity at 1 kHz. For the normal ears, the psychometric functions were nonmonotonic, showing minima for gap durations corresponding to integer multiples of the signal period (n ms, where n is a positive integer) and maxima for durations corresponding to (n - 0.5) ms. For the impaired ears, the psychometric functions showed only small (nonsignificant) nonmonotonicities. Performance overall was slightly worse for the impaired than for the normal ears. The main features of the results could be accounted for using a model consisting of a bandpass filter (the auditory filter), a square-law device, and a sliding temporal integrator. Consistent with the data, the model demonstrates that, although a broader auditory filter has a faster transient response, this does not necessarily lead to improved performance in a gap detection task. The model also indicates that gap thresholds do not provide a direct measure of temporal resolution, since they depend at least partly on intensity resolution.     

Investigation of perceptual constancy in the temporal-envelope domain

The ability to discriminate complex temporal envelope patterns submitted to temporal compression or expansion was assessed in normal-hearing listeners. An XAB, matching-to-sample-procedure was used. X, the reference stimulus, is obtained by applying the sum of two, inharmonically related, sinusoids to a broadband noise carrier. A and B are obtained by multiplying the frequency of each modulation component of X by the same time expansion/compression factor, alpha (alphain[0.35-2.83]). For each trial, A or B is a time-reversed rendering of X, and the listeners' task is to choose which of the two is matched by X. Overall, the results indicate that discrimination performance degrades for increasing amounts of time expansion/compression (i.e., when alpha departs from 1), regardless of the frequency spacing of modulation components and the peak-to-trough ratio of the complex envelopes. An auditory model based on envelope extraction followed by a memory-limited, template-matching process accounted for results obtained without time scaling of stimuli, but generally underestimated discrimination ability with either time expansion or compression, especially with the longer stimulus durations. This result is consistent with partial or incomplete perceptual normalization of envelope patterns.     

Detection of partially filled gaps in noise and the temporal modulation transfer function

Results of experiments on the detection of silent intervals, or gaps, in broadband noise are reported for normal-hearing listeners. In some preliminary experiments, a gap threshold of about 2 ms was measured. This value was independent of the duration of the noise burst, variation of the noise level on each presentation, or the temporal position of the gap within the noise burst. In the main experiments, the thresholds for partial decrements in the noise waveform as well as brief increments were determined. As predicted by a model that assumes a single fixed peak-to-valley detection ratio, thresholds for increments are slightly higher than thresholds for decrements when the signal is measured as the change in rms noise level. A first-order model describes the temporal properties of the auditory system as a low-pass filter with a 7- to 8-ms time constant. Temporal modulation transfer functions were determined for the same subjects, and the estimated temporal parameters agreed well with those estimated from the gap detection data. More detailed modeling was carried out by simulating Viemeister's three-stage temporal model. Simulations, using an initial stage bandwidth of 4000 Hz and a 3-ms time constant for the low-pass filter, generate data that are very similar to those obtained from human subjects in both modulation and gap detection.     

Auditory analysis of the periodicity of sound and its envelope: A mathematical model

A mathematical model of the auditory analysis of periodicity of sound and its envelope is proposed. The model consists of a sequence of mathematical transformations that describe the signal processing stages. The following parameters and properties of the auditory system are taken into account: the crude analysis of the input acoustic signal accurate to the width of the aural critical band; the frequency dependence of the width of the aural critical band; the spectrum of the input signal analysis by a set of 3500 filters closely spaced in frequency; the absolute audibility thresholds at a given frequency; the time-domain analysis of both the output signals of each filter and the envelope profile with the help of the periodicity function; the pulsed activity of auditory neurons; the ability of the auditory system to memorize the spectral-time images of the signal and its individual parameters; the ability of the auditory system to form the perception of the loudness of sound, to memorize and compare the loudness of sound at different time moments, and to conclude which of them is higher or lower or whether they are equal accurate to a certain threshold; the dependence of the critical modulation bandwidth on the modulation frequency; and the dependence of the audibility thresholds of amplitude modulation on the modulation frequency. By an example of processing amplitude-modulated signals with various carrier-to-envelope frequency ratios, the model is shown to give a satisfactory explanation of their pitch and auditory estimate of the envelope period.