Discrimination of depth of sinusoidal amplitude modulation with and without roved carrier levels

Thresholds for the discrimination of the depth of sinusoidal amplitude modulation with a broadband noise carrier were measured for three listeners in a two-alternative, forced-choice task for modulation frequencies of 8, 32, and 128 Hz. Thresholds were measured with the spectrum level of the carrier fixed at 20 dB across all trials and, separately, with the carrier spectrum level roved randomly over a 20-dB range (10-30 dB) in each interval. Mean thresholds were equal or slightly lower (but not significantly so) for the fixed conditions relative to the roved conditions, and the differences between thresholds were too small to be explained by assuming that listeners compared instantaneous intensity at corresponding phases of the modulation cycle (for example, in the troughs). Rather, it appears that listeners discriminated modulation depth by extracting an estimate of the modulation depth within each interval that was independent of the overall level. Consequently, models of envelope extraction must include normalization of the envelope fluctuations to the envelope dc.     

包络调制率和载波频率对听觉时间调制检测能力的影响

通过心理物理实验探讨了包络调制率(<300 Hz)和纯音载波频率(<8 kHz)对听觉时间调制检测能力的影响. 测试信号为以纯音为载波的正弦幅度调制信号, 采用二选一强迫选择法和自适应调整步长的心理物理实验方法, 测试得到不同载波频率条件下的时间调制传递函数. 实验结果表明, 包络调制率和载波频率均会对听觉的时间调制检测能力产生影响. 当载波频率低于2 kHz时, 人耳的检测能力与调制率呈单调递增趋势;当载波频率高于3.5 kHz时, 检测能力也会受到调制率的显著影响, 但没有显著的单调变化趋势. 当调制率在10-100 Hz之间时, 检测能力不随载波频率明显变化;当调制率在150-300 Hz之间时, 调制检测能力随着载波频率上升而下降, 在载波频率达到3.5 kHz时, 调制检测能力不随载波频率显著改变.     

Temporal modulation transfer functions obtained using sinusoidal carriers with normally hearing and hearing-impaired listeners

Temporal modulation transfer functions were obtained using sinusoidal carriers for four normally hearing subjects and three subjects with mild to moderate cochlear hearing loss. Carrier frequencies were 1000, 2000 and 5000 Hz, and modulation frequencies ranged from 10 to 640 Hz in one-octave steps. The normally hearing subjects were tested using levels of 30 and 80 dB SPL. For the higher level, modulation detection thresholds varied only slightly with modulation frequency for frequencies up to 80 Hz, but decreased for high modulation frequencies. The decrease can be attributed to the detection of spectral sidebands. For the lower level, thresholds varied little with modulation frequency for all three carrier frequencies. The absence of a decrease in the threshold for large modulation frequencies can be explained by the low sensation level of the spectral sidebands. The hearing-impaired subjects were tested at 80 dB SPL, except for two cases where the absolute threshold at the carrier frequency was greater than 70 dB SPL; in these cases a level of 90 dB was used. The results were consistent with the idea that spectral sidebands were less detectable for the hearing-impaired than for the normally hearing subjects. For the two lower carrier frequencies, there were no large decreases in threshold with increasing modulation frequency, and where decreases did occur, this happened only between 320 and 640 Hz. For the 5000-Hz carrier, thresholds were roughly constant for modulation frequencies from 10 to 80 or 160 Hz, and then increased monotonically, becoming unmeasurable at 640 Hz. The results for this carrier may reflect "pure" effects of temporal resolution, without any influence from the detection of spectral sidebands. The results suggest that temporal resolution for deterministic stimuli is similar for normally hearing and hearing-impaired listeners.     

External and internal limitations in amplitude-modulation processing

Three experiments are presented to explore the relative role of "external" signal variability and "internal" resolution limitations of the auditory system in the detection and discrimination of amplitude modulations (AM). In the first experiment, AM-depth discrimination performance was determined using sinusoidally modulated broadband-noise and pure-tone carriers. The AM index, m, of the standard ranged from -28 to -3 dB (expressed as 20 log m). AM-depth discrimination thresholds were found to be a fraction of the AM depth of the standard for standards down to -18 dB, in the case of the pure-tone carrier, and down to -8 dB, in the case of the broadband-noise carrier. For smaller standards, AM-depth discrimination required a fixed increase in AM depth, independent of the AM depth of the standard. In the second experiment, AM-detection thresholds were obtained for signal-modulation frequencies of 4, 16, 64, and 256 Hz, applied to either a band-limited random-noise carrier or a deterministic ("frozen") noise carrier, as a function of carrier bandwidth (8 to 2048 Hz). In general, detection thresholds were higher for the random- than for the frozen-noise carriers. For both carrier types, thresholds followed the pattern expected from frequency-selective processing of the stimulus envelope. The third experiment investigated AM masking at 4, 16, and 64 Hz in the presence of a narrow-band masker modulation. The variability of the masker was changed from entirely frozen to entirely random, while the long-term average envelope power spectrum was held constant. The experiment examined the validity of a long-term average quantity as the decision variable, and the role of memory in experiments with frozen-noise maskers. The empirical results were compared to predictions obtained with two modulation-filterbank models. The predictions revealed that AM-depth discrimination and AM detection are limited by a combination of the external signal variability and an internal "Weber-fraction" noise process.     

Second-order temporal modulation transfer functions

Detection thresholds were measured for a sinusoidal modulation applied to the modulation depth of a sinusoidally amplitude-modulated (SAM) white noise carrier as a function of the frequency of the modulation applied to the modulation depth (referred to as f'm). The SAM noise acted therefore as a "carrier" stimulus of frequency fm, and sinusoidal modulation of the SAM-noise modulation depth generated two additional components in the modulation spectrum: fm-f'm and fm+f'm. The tracking variable was the modulation depth of the sinusoidal variation applied to the "carrier" modulation depth. The resulting "second-order" temporal modulation transfer functions (TMTFs) measured on four listeners for "carrier" modulation frequencies fm of 16, 64, and 256 Hz display a low-pass segment followed by a plateau. This indicates that sensitivity to fluctuations in the strength of amplitude modulation is best for fluctuation rates f'm below about 2-4 Hz when using broadband noise carriers. Measurements of masked modulation detection thresholds for the lower and upper modulation sideband suggest that this capacity is possibly related to the detection of a beat in the sound's temporal envelope. The results appear qualitatively consistent with the predictions of an envelope detector model consisting of a low-pass filtering stage followed by a decision stage. Unlike listeners' performance, a modulation filterbank model using Q values > or = 2 should predict that second-order modulation detection thresholds should decrease at high values of f'm due to the spectral resolution of the modulation sidebands (in the modulation domain). This suggests that, if such modulation filters do exist, their selectivity is poor. In the latter case, the Q value of modulation filters would have to be less than 2. This estimate of modulation filter selectivity is consistent with the results of a previous study using a modulation-masking paradigm [S. D. Ewert and T. Dau, J. Acoust. Soc. Am. 108, 1181-1196 (2000)].     

Spectral modulation detection as a function of modulation frequency, carrier bandwidth, and carrier frequency region

The present study investigates the nature of spectral envelope perception using a spectral modulation detection task in which sinusoidal spectral modulation is superimposed upon a noise carrier. The principal goal of this study is to characterize spectral envelope perception in terms of the influence of modulation frequency (cycles/octave), carrier bandwidth (octaves), and carrier frequency region (defined by lower and upper cutoff frequencies in Hz). Spectral modulation detection thresholds measured as a function of spectral modulation frequency result in a spectral modulation transfer function (SMTF). The general form of the SMTF is bandpass in nature, with a minimum modulation detection threshold in the region between 2 to 4 cycles/octave. SMTFs are not strongly dependent on carrier bandwidth (ranging from 1 to 6 octaves) or carrier frequency region (ranging from 200 to 12 800 Hz), with the exception of carrier bands restricted to very low audio frequencies (e.g., 200-400 Hz). Spectral modulation detection thresholds do not depend on the presence of random level variations or random modulation phase across intervals. The SMTFs reported here and associated excitation pattern computations are considered in terms of a linear systems approach to spectral envelope perception and potential underlying mechanisms for the perception of spectral features.     

Noise improves modulation detection by cochlear implant listeners at moderate carrier levels

Envelope detection and processing are very important for cochlear implant (CI) listeners, who must rely on obtaining significant amounts of acoustic information from the time-varying envelopes of stimuli. In previous work, Chatterjee and Robert [JARO 2(2), 159-171 (2001)] reported on a stochastic-resonance-type effect in modulation detection by CI listeners: optimum levels of noise in the envelope enhanced modulation detection under certain conditions, particularly when the carrier level was low. The results of that study suggested that a low carrier level was sufficient to evoke the observed stochastic resonance effect, but did not clarify whether a low carrier level was necessary to evoke the effect. Modulation thresholds in CI listeners generally decrease with increasing carrier level. The experiments in this study were designed to investigate whether the observed noise-induced enhancement is related to the low carrier level per se, or to the poor modulation sensitivity that accompanies it. This was done by keeping the carrier amplitude fixed at a moderate level and increasing modulation frequency so that modulation sensitivity could be reduced without lowering carrier level. The results suggest that modulation sensitivity, not carrier level, is the primary factor determining the effect of the noise.     

海面动态波动引起的船舶辐射噪声线谱伴随调制特性

针对海上实验发现的船舶辐射噪声载波线谱两侧对称出现伴随线谱现象,建立了基于抛物方程近似理论的动态起伏海面条件下连续波信号传播预报模型,揭示了海面风速、收发距离、声源深度等因素对伴随调制线谱频率间隔和强度的影响规律。数值仿真结果表明,伴随调制线谱与其载波线谱的频率间隔由具有稳定频率的海面涌浪决定;伴随调制线谱强度随海面风速增大而增大;不同收发距离和声源深度等条件下伴随调制线谱强度随距离的变化趋势与其载波线谱强度基本一致,近水面（平均深度3 m以内）声源上移和下移伴随调制线谱能量大致相当,比载波线谱能量低约10 dB;除了载波传播损失大的深度外,非近水面声源上移和下移伴随调制线谱强度能量相差较大,比载波线谱能量整体上低约20 dB以上。对海上实测水面船辐射噪声数据进行长时间窗时频分析表明,上移和下移频率伴随调制线谱与载波线谱的间隔为0.1 Hz左右,伴随调制线谱强度与载波线谱强度相差约10 dB,与仿真分析结果一致。海面动态波动引起的船舶辐射噪声线谱伴随调制特性对水中目标特征识别等具有重要价值。      

Effects of the use of personal music players on amplitude modulation detection and frequency discrimination

Measures of auditory performance were compared for an experimental group who listened regularly to music via personal music players (PMP) and a control group who did not. Absolute thresholds were similar for the two groups for frequencies up to 2 kHz, but the experimental group had slightly but significantly higher thresholds at higher frequencies. Thresholds for the frequency discrimination of pure tones were measured for a sensation level (SL) of 20 dB and center frequencies of 0.25, 0.5, 1, 2, 3, 4, 5, 6, and 8 kHz. Thresholds were significantly higher (worse) for the experimental than for the control group for frequencies from 3 to 8 kHz, but not for lower frequencies. Thresholds for detecting sinusoidal amplitude modulation (AM) were measured for SLs of 10 and 20 dB, using four carrier frequencies 0.5, 3, 4, and 6 kHz, and three modulation frequencies 4, 16, and 50 Hz. Thresholds were significantly lower (better) for the experimental than for the control group for the 4- and 6-kHz carriers, but not for the other carriers. It is concluded that listening to music via PMP can have subtle effects on frequency discrimination and AM detection.     

Mechanisms underlying the detection of frequency modulation

Frequency modulation detection limens (FMDLs) were measured for carrier frequencies (f(c)) of 1000, 4000, and 6000 Hz, using modulation frequencies (f(m)) of 2 and 10 Hz and levels of 20 and 60 dB sensation level (SL), both with and without random amplitude modulation (AM), applied in all intervals of a forced-choice trial. The AM was intended to disrupt excitation-pattern cues. At 60 dB SL, the deleterious effect of the AM was smaller for f(m) = 2 than for f(m) = 10 Hz for f(c) = 1000 and 4000 Hz, respectively, while for f(c) = 6000 Hz the deleterious effect was large and similar for the two values of f(m). This is consistent with the idea that, for f(c) below about 5000 Hz and f(m) = 2 Hz, frequency modulation can be detected via changes in phase locking over time. However, at 20 dB SL, the deleterious effect of the added AM for f(c) = 1000 and 4000 Hz was similar for the two values of f(m), while for f(c) = 6000 Hz, the deleterious effect of the AM was greater for f(m) = 10 than for f(m) = 2 Hz. It is suggested that, at low SLs, the auditory filters become relatively sharp and phase locking weakens, so that excitation-pattern cues influence FMDLs even for low f(c) and low f(m).     

The role of time and place cues in the detection of frequency modulation by hearing-impaired listeners

Frequency modulation detection limens (FMDLs) were measured for five hearing-impaired (HI) subjects for carrier frequencies f(c) = 1000, 4000, and 6000 Hz, using modulation frequencies f(m) = 2 and 10 Hz and levels of 20 dB sensation level and 90 dB SPL. FMDLs were smaller for f(m) = 10 than for f(m) = 2 Hz for the two higher f(c), but not for f(c) = 1000 Hz. FMDLs were also determined with additional random amplitude modulation (AM), to disrupt excitation-pattern cues. The disruptive effect was larger for f(m) = 10 than for f(m) = 2 Hz. The smallest disruption occurred for f(m) = 2 Hz and f(c) = 1000 Hz. AM detection thresholds for normal-hearing and HI subjects were measured for the same f(c) and f(m) values. Performance was better for the HI subjects for both f(m). AM detection was much better for f(m) = 10 than for f(m) = 2 Hz. Additional tests showed that most HI subjects could discriminate temporal fine structure (TFS) at 800 Hz. The results are consistent with the idea that, for f(m) = 2 Hz and f(c) = 1000 Hz, frequency modulation (FM) detection was partly based on the use of TFS information. For higher carrier frequencies and for all carrier frequencies with f(m) = 10 Hz, FM detection was probably based on place cues.     

Modulation of auditory evoked responses to spectral and temporal changes by behavioral discrimination training

Background  

Due to auditory experience, musicians have better auditory expertise than non-musicians. An increased neocortical activity during auditory oddball stimulation was observed in different studies for musicians and for non-musicians after discrimination training. This suggests a modification of synaptic strength among simultaneously active neurons due to the training. We used amplitude-modulated tones (AM) presented in an oddball sequence and manipulated their carrier or modulation frequencies. We investigated non-musicians in order to see if behavioral discrimination training could modify the neocortical activity generated by change detection of AM tone attributes (carrier or modulation frequency). Cortical evoked responses like N1 and mismatch negativity (MMN) triggered by sound changes were recorded by a whole head magnetoencephalographic system (MEG). We investigated (i) how the auditory cortex reacts to pitch difference (in carrier frequency) and changes in temporal features (modulation frequency) of AM tones and (ii) how discrimination training modulates the neuronal activity reflecting the transient auditory responses generated in the auditory cortex.     

Auditory processing of real and illusory changes in frequency modulation (FM) phase

Auditory processing of frequency modulation (FM) was explored. In experiment 1, detection of a tau-radians modulator phase shift deteriorated as modulation rate increased from 2.5 to 20 Hz, for 1- and 6-kHz carriers. In experiment 2, listeners discriminated between two 1-kHz carriers, where, mid-way through, the 10-Hz frequency modulator had either a phase shift or increased in depth by deltaD% for half a modulator period. Discrimination was poorer for deltaD = 4% than for smaller or larger increases. These results are consistent with instantaneous frequency being smoothed by a time window with a total duration of about 110 ms. In experiment 3, the central 200-ms of a 1-s 1-kHz carrier modulated at 5 Hz was replaced by noise, or by a faster FM applied to a more intense 1-kHz carrier. Listeners heard the 5-Hz FM continue at the same depth throughout the stimulus. Experiments 4 and 5 showed that, after an FM tone had been interrupted by a 200-ms noise, listeners were insensitive to the phase at which the FM resumed. It is argued that the auditory system explicitly encodes the presence, and possibly the rate and depth, of FM in a way that does not preserve information on FM phase.     

Detection of quasitrapezoidal frequency and amplitude modulation

It has been proposed that the detection of frequency modulation (FM) of sinusoidal carriers can be mediated by two mechanisms; a place mechanism based on FM-induced amplitude modulation (AM) in the excitation pattern, and a temporal mechanism based on phase locking in the auditory nerve. The temporal mechanism appears to be "sluggish" and does not play a role for FM rates above about 10 Hz. It also does not play a role for high carrier frequencies (above about 5 kHz). This experiment provided a further test of the hypothesis that the effectiveness of the temporal mechanism depends upon the time spent close to frequency extremes during the modulation cycle. Psychometric functions for the detection of AM and FM were measured for two carrier frequencies, 1 and 6 kHz. The modulation waveform was quasitrapezoidal. Within each modulation period, P, a time Tss was spent at each extreme of frequency or amplitude. The transitions between the extremes, with duration Ttrans had the form of a half-cycle of a cosine function. The modulation rate was 2, 5, 10, or 20 Hz, giving values of P of 500, 200, 100, and 50 ms. TSS varied from 0 ms (sinusoidal modulation) up to 160, 80, 40, or 20 ms, for rates of 2, 5, 10, and 20 Hz, respectively. The detectability of AM was not greatly affected by modulation rate or by the value of TSS, except for a slight improvement with increasing TSS for the lowest modulation rates; this was true for both carrier frequencies. For FM of the 6-kHz carrier, the pattern of results was similar to that found for AM, which is consistent with an excitation-pattern model of FM detection. For FM of the 1-kHz carrier, performance improved markedly with increasing TSS, especially for the lower FM rates; there was no change in performance with TSS for the 20-Hz modulation rate. The results are consistent with the idea that detection of FM of a 1-kHz carrier is partly mediated by a sluggish temporal mechanism. That mechanism benefits from greater time spent at frequency extremes of the modulation cycle for rates up to 10 Hz.     

Critical modulation frequency based on detection of AM versus FM tones

The ratios between the modulation index (eta) for just noticeable FM of a sinusoidally modulated pure tone and the degree of modulation (m) for just noticeable AM at the same carrier and the same modulation frequency were measured at carrier frequencies of 0.125, 0.25, 0.5, 1, 2, 4, and 8 kHz. Signal levels were 20 dB SL and 50 dB SPL or 80 dB SPL. At low modulation frequencies, for example, 8 Hz, AM and FM elicit very different auditory sensations (i.e., a fluctuation in loudness or pitch, respectively). In this case, eta and m show different values for just noticeable modulation. Since both stimuli have almost equal amplitude spectra if eta equals m (m less than 0.3), the difference in detection thresholds reflects differences in the phase relation between carrier and sidebands in AM and FM. With increasing modulation frequency, the eta-m ratio decreases and reaches unity at a modulation frequency called the "critical modulation frequency" (CMF). At modulation frequencies above the CMF, the same modulation thresholds are obtained for AM and FM. Therefore, it can be concluded that the difference in phase between the two types of stimuli is not perceived in this range. At center frequencies below 1 kHz, where phase errors caused by headphones and ear canal presumably are small, the CMF is useful in estimating critical bandwidth.     

Frequency modulation detection: effects of age, psychophysical method, and modulation waveform

As part of an ongoing study of auditory aging, detection of sinusoidal and quasitrapezoidal frequency modulation (FM) was measured with a 5-Hz modulation frequency and 500- and 4000-Hz carriers in two experiments. In Experiment 1, psychometric functions for FM detection were measured with several modulation waveform time patterns in younger adults with normal hearing. Detection of a three-cycle modulated signal improved when its duration was extended by a preceding unmodulated cycle, an effect similar to adding a modulated cycle. In Experiment 2, FM detection was measured for younger and older adults with normal hearing using two psychophysical methods. Similar to frequency discrimination, FM detection was poorer in older than younger subjects and age-related differences were larger at 500 Hz than at 4000 Hz, suggesting that FM detection with low modulation frequencies and frequency discrimination may share common underlying mechanisms. One mechanism is likely related to temporal information coded by neural phase locking which is strong at low frequencies and decreases with increasing frequency, as observed in animals. The frequency-dependent aging effect suggests that this temporal mechanism may be affected by age. The effect of psychophysical method was sizable and frequency dependent, whereas the effect of modulation waveform was minimal.     

Sensitivity to envelope coherence

Measurements are reported on the ability of observers to discriminate whether the envelope of two amplitude-modulated sinusoids are in phase or out of phase. Spacing between the two carriers was either 2/3 or 4/3 octave, and the depth of modulation was varied to determine threshold. Discrimination performance improved as the level of the carriers increases up to about 60 dB SPL. The frequency locus of the two carriers (geometric mean of the two frequencies), which varied from 500 to 8000 Hz in different experiments, had little effect on discrimination accuracy. Discrimination performance was relatively constant for modulation rates below 100 Hz and deteriorates for higher modulation rates. These results are compared with data obtained from comodulation masking release experiments.     

Potentials evoked by the sinusoidal modulation of the amplitude or frequency of a tone

Steady state responses to the sinusoidal modulation of the amplitude or frequency of a tone were recorded from the human scalp. For both amplitude modulation (AM) and frequency modulation (FM), the responses were most consistent at modulation frequencies between 30 and 50 Hz. However, reliable responses could also be recorded at lower frequencies, particularly at 2-5 Hz for AM and at 3-7 Hz for FM. With increasing modulation depth at 40 Hz, both the AM and FM response increased in amplitude, but the AM response tended to saturate at large modulation depths. Neither response showed any significant change in phase with changes in modulation depth. Both responses increased in amplitude and decreased in phase delay with increasing intensity of the carrier tone, the FM response showing some saturation of amplitude at high intensities. Both responses could be recorded at modulation depths close to the subjective threshold for detecting the modulation and at intensities close to the subjective threshold for hearing the stimulus. The responses were variable but did not consistently adapt over periods of 10 min. The 40-Hz AM and FM responses appear to originate in the same generator, this generator being activated by separate auditory systems that detect changes in either amplitude or frequency.     

Within- versus cross-channel mechanisms in detection of envelope phase disparity

These experiments were designed to examine the mechanism of detection of phase disparity in the envelopes of two sinusoidally amplitude-modulated (AM) sinusoids. Specifically, they were performed to determine whether detection of envelope phase disparity was consistent with processing within a single channel in which the AM tones were simply added. In the first condition, with an 8-Hz modulation frequency, phase-disparity thresholds increased sharply with an initial increase in separation of the carrier frequencies. They then remained approximately constant when the separation was an octave or above. In the second condition, with carrier pairs of 1 and 2 kHz or 1 and 3.2 kHz and a modulation frequency of 8 Hz, thresholds were little affected as the level of one carrier was decreased relative to the other. With a modulation frequency of 128 Hz, for most subjects there was more of an effect of level disparity on thresholds. In the third condition, when the modulation frequency was 8 Hz, subjects showed relatively constant thresholds whether the signals were presented monotically, dichotically, or dichotically with low- and high-pass noise. Dichotic thresholds were typically higher than monotic when the modulation frequency was 128 Hz. These results suggest that it is not necessary to have information available within a single additive channel to detect envelope phase disparity. In certain circumstances, a comparison across channels may be used to detect such disparities.     

The effect of temporal asymmetry on amplitude modulation detection using pure-tone carriers (L)

The effect of temporal asymmetry on amplitude modulation detection was studied using sawtooth modulators with rising (ramped) or falling (damped) temporal envelopes within each period of modulation. For pure-tone carriers, damped modulation was more detectable than ramped modulation for a 5-kHz carrier (by a threshold difference of 3.2 dB on average) but not for a 1-kHz carrier. The threshold difference obtained at 5 kHz between the ramped and damped modulators was consistent across modulation rates (8-128 Hz). This carrier frequency dependence suggests that the effect of temporally asymmetry on modulation detection originates from envelope-based, within-channel mechanisms.