Monaural and interaural temporal modulation transfer functions measured with 5-kHz carriers

Temporal modulation transfer functions (TMTFs) were measured for detection of monaural sinusoidal amplitude modulation and dynamically varying interaural level differences for a single set of listeners. For the interaural TMTFs, thresholds are the modulation depths at which listeners can just discriminate interaural envelope-phase differences of 0 and 180 degrees. A 5-kHz pure tone and narrowband noises, 30- and 300-Hz wide centered at 5 kHz, were used as carriers. In the interaural conditions, the noise carriers were either diotic or interaurally uncorrelated. The interaural TMTFs with tonal and diotic noise carriers exhibited a low-pass characteristic but the cutoff frequencies changed nonmonotonically with increasing bandwidth. The interaural TMTFs for the tonal carrier began rolling off approximately a half-octave lower than the tonal monaural TMTF (approximately 80 Hz vs approximately 120 Hz). Monaural TMTFs obtained with noise carriers showed effects attributable to masking of the signal modulation by intrinsic fluctuations of the carrier. In the interaural task with dichotic noise carriers, similar masking due to the interaural carrier fluctuations was observed. Although the mechanisms responsible for differences between the monaural and interaural TMTFs are unknown, the lower binaural TMTF cutoff frequency suggests that binaural processing exhibits greater temporal limitation than monaural processing.     

Noise improves modulation detection by cochlear implant listeners at moderate carrier levels

Envelope detection and processing are very important for cochlear implant (CI) listeners, who must rely on obtaining significant amounts of acoustic information from the time-varying envelopes of stimuli. In previous work, Chatterjee and Robert [JARO 2(2), 159-171 (2001)] reported on a stochastic-resonance-type effect in modulation detection by CI listeners: optimum levels of noise in the envelope enhanced modulation detection under certain conditions, particularly when the carrier level was low. The results of that study suggested that a low carrier level was sufficient to evoke the observed stochastic resonance effect, but did not clarify whether a low carrier level was necessary to evoke the effect. Modulation thresholds in CI listeners generally decrease with increasing carrier level. The experiments in this study were designed to investigate whether the observed noise-induced enhancement is related to the low carrier level per se, or to the poor modulation sensitivity that accompanies it. This was done by keeping the carrier amplitude fixed at a moderate level and increasing modulation frequency so that modulation sensitivity could be reduced without lowering carrier level. The results suggest that modulation sensitivity, not carrier level, is the primary factor determining the effect of the noise.     

Intrinsic envelope fluctuations and modulation-detection thresholds for narrow-band noise carriers

A model is presented which calculates the intrinsic envelope power of a bandpass noise carrier within the passband of a hypothetical modulation filter tuned to a specific modulation frequency. Model predictions are compared to experimentally obtained amplitude modulation (AM) detection thresholds. In experiment 1, thresholds for modulation rates of 5, 25, and 100 Hz imposed on a bandpass Gaussian noise carrier with a fixed upper cutoff frequency of 6 kHz and a bandwidth in the range from 1 to 6000 Hz were obtained. In experiment 2, three noises with different spectra of the intrinsic fluctuations served as the carrier: Gaussian noise, multiplied noise, and low-noise noise. In each case, the carrier was spectrally centered at 5 kHz and had a bandwidth of 50 Hz. The AM detection thresholds were obtained for modulation frequencies of 10, 20, 30, 50, 70, and 100 Hz. The intrinsic envelope power of the carrier at the output of the modulation filter tuned to the signal modulation frequency appears to provide a good estimate for AM detection threshold. The results are compared with predictions on the basis of the more complex auditory processing model by Dau et al.     

Quantifying the implications of nonlinear cochlear tuning for auditory-filter estimates

The relation between auditory filters estimated from psychophysical methods and peripheral tuning was evaluated using a computational auditory-nerve (AN) model that included many of the response properties associated with nonlinear cochlear tuning. The phenomenological AN model included the effects of dynamic level-dependent tuning, compression, and suppression on the responses of high-, medium-, and low-spontaneous-rate AN fibers. Signal detection theory was used to evaluate psychophysical performance limits imposed by the random nature of AN discharges and by random-noise stimuli. The power-spectrum model of masking was used to estimate psychophysical auditory filters from predicted AN-model detection thresholds for a tone signal in fixed-level notched-noise maskers. Results demonstrate that the role of suppression in broadening peripheral tuning in response to the noise masker has implications for the interpretation of psychophysical auditory-filter estimates. Specifically, the estimated psychophysical auditory-filter equivalent-rectangular bandwidths (ERBs) that were derived from the nonlinear AN model with suppression always overestimated the ERBs of the low-level peripheral model filters. Further, this effect was larger for an 8-kHz signal than for a 2-kHz signal, suggesting a potential characteristic-frequency (CF) dependent bias in psychophysical estimates of auditory filters due to the increase in strength of cochlear nonlinearity with increases in CF.     

Amplitude modulation sensitivity as a mechanism increment detection

Detectability of a tonal signal added to a tonal masker increases with increasing duration ("temporal integration"), up to some maximum duration. Initially assumed to be some form of energy integration over time, this phenomenon is now often described as the result of a statistical "multiple looks" process. For continuous maskers, listeners may also use a mechanism sensitive to changes in stimulus intensity, possibly a result of inherent sensitivity to amplitude modulation (AM). In order to examine this hypothesis, change detection was investigated in the presence of AM maskers presented at either the same carrier frequency as the target signal or at a distant frequency. The results are compatible with the hypothesis that listeners detect intensity increments by using change-detection mechanisms (modeled here as the outputs of a bank of modulation filters) sensitive to envelope modulation at both low (4-16 Hz) and high (around 100 Hz) rates. AM masking occurred even when the masker was at a carrier frequency more than two octaves above that of the signal to be detected. This finding is also compatible with the hypothesis that similar mechanisms underlie sensitivity to AM (where across-frequency masking is commonly shown) and detection of intensity increments.     

The influence of spread of excitation on the detection of amplitude modulation imposed on sinusoidal carriers at high levels

The improvement in amplitude modulation (AM) detection thresholds with increasing level of a sinusoidal carrier has been attributed to listening on the high-frequency side of the excitation pattern, where the growth of excitation is more linear, or to an increase in the number of "channels" via spread of excitation. In the present study, AM detection thresholds were measured using a 1000-Hz sinusoidal carrier. Thresholds for modulation frequencies of 4-64 Hz improved by about 10-20 dB as the carrier level increased from 10 dB SL (14.5 dB SPL on average) to 80 dB SPL. To minimize the use of spread of excitation with an 80-dB carrier, tonal "restrictors" with frequencies of 501, 801, 1210, and 1510 Hz were used alone and in combination. High-frequency restrictors elevated AM detection thresholds, whereas low-frequency restrictors did not, indicating that excitation on the high side is more important for detecting AM. Results of modeling suggest that the improvement in AM detection thresholds at high levels is likely due to the use of a relatively linear growth of response on the high-frequency side of the excitation pattern.     

Perceptual interaction between carrier periodicity and amplitude modulation in broadband stimuli: a comparison of the autocorrelation and modulation-filterbank model

Recent temporal models of pitch and amplitude modulation perception converge on a relatively realistic implementation of cochlear processing followed by a temporal analysis of periodicity. However, for modulation perception, a modulation filterbank is applied whereas for pitch perception, autocorrelation is applied. Considering the large overlap in pitch and modulation perception, this is not parsimonious. Two experiments are presented to investigate the interaction between carrier periodicity, which produces strong pitch sensations, and envelope periodicity using broadband stimuli. Results show that in the presence of carrier periodicity, detection of amplitude modulation is impaired throughout the tested range (8-1000 Hz). On the contrary, detection of carrier periodicity in the presence of an additional amplitude modulation is impaired only for very low frequencies below the pitch range (<33 Hz). Predictions of a generic implementation of a modulation-filterbank model and an autocorrelation model are compared to the data. Both models were too insensitive to high-frequency envelope or carrier periodicity and to infra-pitch carrier periodicity. Additionally, both models simulated modulation detection quite well but underestimated the detrimental effect of carrier periodicity on modulation detection. It is suggested that a hybrid model consisting of bandpass envelope filters with a ripple in their passband may provide a functionally successful and physiologically plausible basis for a unified model of auditory periodicity extraction.     

A framework for the automated real-time detection of short tonal sounds from ocean observatories

Acquisition of acoustic data from ocean observatories is expected to play a key role for the long-term monitoring of marine mammals and anthropogenic noise. It typically requires processing of a large volume of acoustic data and it must rely on automated identification of signals. We present an algorithmic framework for the detection of short tonal sounds (e.g. cetacean calls, anthropogenic pings) intended to act as a first stage in a system for the automated real-time detection, classification, and localisation of acoustic sources. The algorithm was validated under a diversity of scenarios expected at ocean observatories. Using simulated signals that emulate a variety of cetacean call-types, perfect identification of signal position was obtained for signal to noise ratios of ?15 to ?5 dB, depending on the signal-type. Separation of real-world data segments with short tonal sounds (mainly cetacean calls) from segments with other sounds or noise resulted in Area Under the ROC Curve values between 0.96 and 0.98. The algorithm can be used to automatically identify cetacean calls and anthropogenic short tonal sounds much faster than in real-time, thereby reducing the burden put on data transmission, storage, or processing by classification and localisation algorithms.     

The influence of carrier level and frequency on modulation and beat-detection thresholds for sinusoidal carriers

This paper is concerned with modulation and beat detection for sinusoidal carriers. In the first experiment, temporal modulation transfer functions (TMTFs) were measured for carrier frequencies between 1 and 10 kHz. Modulation rates covered the range from 10 Hz to about the rate equaling the critical bandwidth at the carrier frequency. In experiment 2, TMTFs for three carrier frequencies were obtained as a function of the carrier level. In the final experiment, thresholds for the detection of either the lower or the upper modulation sideband (beat detection) were measured for "carrier" frequencies of 5 and 10 kHz, using the same range of modulation rates as in experiment 1. The TMTFs for carrier frequencies of 2 kHz and higher remained flat up to a modulation rate of about 100-130 Hz and had similar values across carrier frequencies. For higher rates, modulation thresholds initially increased and then decreased rapidly, reflecting the subjects' ability to resolve the sidebands spectrally. Detection thresholds generally improved with increasing carrier level, but large variations in the exact level dependence were observed, across subjects as well as across carrier frequencies. For beat rates up to about 70 Hz (at 5 kHz) and 100 Hz (at 10 kHz), beat detection thresholds were the same for the upper and the lower sidebands and were about 6 dB higher than the level per sideband at the modulation-detection threshold. At higher rates the threshold for both sidebands increased, but the increase was larger for the lower sideband. This reflects an asymmetry in masking with more masking towards lower frequencies. Only at rates well beyond the maximum of the TMTF did detection for the lower sideband start to be better than that for the upper sideband. The asymmetry at intermediate frequency separations can be explained by assuming that detection always takes place in filters centered above the stimulus spectrum. The shape of the TMTF and the beat-detection data reflects a limitation in resolving fast amplitude variations, which must occur central to the inner-ear filtering. Its characteristic resembles that of a first-order low-pass filter with a cutoff frequency of about 150 Hz.     

Spectral modulation masking patterns reveal tuning to spectral envelope frequency

Auditory processing appears to include a series of domain-specific filtering operations that include tuning in the audio-frequency domain, followed by tuning in the temporal modulation domain, and perhaps tuning in the spectral modulation domain. To explore the possibility of tuning in the spectral modulation domain, a masking experiment was designed to measure masking patterns in the spectral modulation domain. Spectral modulation transfer functions (SMTFs) were measured for modulation frequencies from 0.25 to 14 cycles/octave superimposed on noise carriers either one octave (800-1600 Hz, 6400-12,800 Hz) or six octaves wide (200-12,800 Hz). The resulting SMTFs showed maximum sensitivity to modulation between 1 and 3 cycles/octave with reduced sensitivity above and below this region. Masked spectral modulation detection thresholds were measured for masker modulation frequencies of 1, 3, and 5 cycles/octave with a fixed modulation depth of 15 dB. The masking patterns obtained for each masker frequency and carrier band revealed tuning (maximum masking) near the masker frequency, which is consistent with the theory that spectral envelope perception is governed by a series of spectral modulation channels tuned to different spectral modulation frequencies.     

Forward masking of amplitude modulation: basic characteristics

In this study we demonstrate an effect for amplitude modulation (AM) that is analogous to forward making of audio frequencies, i.e., the modulation threshold for detection of AM (signal) is raised by preceding AM (masker). In the study we focused on the basic characteristics of the forward-masking effect. Functions representing recovery from AM forward masking measured with a 150- ms 40- Hz masker AM and a 50- ms signal AM of the same rate imposed on the same broadband-noise carrier, showed an exponential decay of forward masking with increasing delay from masker offset. Thresholds remained elevated by more than 2 dB over an interval of at least 150 ms following the masker. Masked-threshold patterns, measured with a fixed signal rate (20, 40, and 80 Hz) and a variable masker rate, showed tuning of the AM forward-masking effect. The tuning was approximately constant across signal modulation rates used and consistent with the idea of modulation-rate selective channels. Combining two equally effective forward maskers of different frequencies did not lead to an increase in forward masking relative to that produced by either component alone. Overall, the results are consistent with modulation-rate selective neural channels that adapt and recover from the adaptation relatively quickly.     

Factors affecting the loudness of modulated sounds.

Loudness matches were obtained between unmodulated carriers and carriers that were amplitude modulated either periodically (rates between 2 and 32 Hz, modulation sinusoidal either on a linear amplitude scale or on a dB scale; the latter is called dB modulation) or with the envelope of the speech of a single talker. The carrier was a 4-kHz sinusoid, white noise, or speech-shaped noise. Both normally hearing subjects and subjects with cochlear hearing loss were tested. Results were expressed as the root-mean-square (rms) level of the modulated carrier minus the level of the unmodulated carrier at the point of equal loudness. If this difference is positive, this indicates that the modulated carrier has a higher rms level at the point of equal loudness. For normally hearing subjects, the results show: (1) For a 4000-Hz sinusoidal carrier, the difference was slightly positive (averaging about 0.7 dB). There was no significant effect of modulation rate or level over the range 20-80 dB SL. (2) For a speech-shaped noise or white noise carrier, the difference was close to zero, although for large modulation depths it tended to be negative. There was no clear effect of level (over the range 35-75 dB SPL) or modulation rate. For the hearing-impaired subjects, the differences were small, but tended to be slightly negative for both the 4000-Hz carrier and the noise carriers, when the modulation rate was above 2 Hz. Again, there was no clear effect of overall level. However, for dB modulation, the differences became more negative with increasing modulation depth. For modulation rates in the range 4-32 Hz, the results could be fitted reasonably well using the assumption that the loudness of modulated sounds is based on the rms value of the time-varying intensity of the response of the basilar membrane (taking into account the compression that occurs in the normal cochlea). The implications of the results for the fitting of multi-band compression hearing aids and for the design of loudness meters are discussed.     

Discrimination of modulation depth of sinusoidal amplitude modulation (SAM) noise

The detection of sinusoidal amplitude modulation (SAM) provides a lower bound on the degree to which temporal information in the envelope of complex waveforms is encoded by the auditory system. The extent to which changes in the amount of modulation are discriminable provides additional information on the ability of the auditory system to utilize envelope fluctuations. Results from an experiment on the discrimination of modulation depth of broadband noise are presented. Discrimination thresholds, expressed as differences in modulation power, increase monotonically with the modulation depth of the standard, but do not obey Weber's law. The effects of carrier level and of modulation frequency are consistent with those observed in modulation detection: Changes in carrier level have little effect on modulation discrimination; changes in modulation frequency also have little effect except for standards near the modulation detection threshold. The discrimination of modulation depth is consistent with the leaky-integrator model of modulation detection for standards below--10 dB (20 log ms); for standards greater than--10 dB, the leaky integrator predicts better performance than that observed behaviorally.     

Non-Gaussian noise benefits for coherent detection of narrowband weak signal

In an ad hoc suboptimal detector, the benefits of non-Gaussian noise to narrowband weak signal detection are demonstrated. Particularly, for a noise envelope with a Rice distribution, we can improve the detector performance by tuning threshold parameter but keeping noise level, or increasing the noise level for a fixed threshold. It is verified that, under certain circumstances, the optimal detection probability achieved by tuning noise level is superior to that obtained by optimizing the detector threshold.     

A comparison among three measures of cross-spectral processing of amplitude modulation with tonal signals

Results were obtained from three paradigms used to study cross-spectral processing of envelope modulation [comodulation masking release (CMR), comodulation detection difference (CDD), and modulation detection interference (MDI)]. When tonal carriers separated by two octaves (flanking tone at 1000 Hz and target tone at 4000 Hz) were amplitude modulated at 20 Hz, there was no evidence of a cMR or CDD effect, but there was substantial MDI.     

Detection of partially filled gaps in noise and the temporal modulation transfer function

Results of experiments on the detection of silent intervals, or gaps, in broadband noise are reported for normal-hearing listeners. In some preliminary experiments, a gap threshold of about 2 ms was measured. This value was independent of the duration of the noise burst, variation of the noise level on each presentation, or the temporal position of the gap within the noise burst. In the main experiments, the thresholds for partial decrements in the noise waveform as well as brief increments were determined. As predicted by a model that assumes a single fixed peak-to-valley detection ratio, thresholds for increments are slightly higher than thresholds for decrements when the signal is measured as the change in rms noise level. A first-order model describes the temporal properties of the auditory system as a low-pass filter with a 7- to 8-ms time constant. Temporal modulation transfer functions were determined for the same subjects, and the estimated temporal parameters agreed well with those estimated from the gap detection data. More detailed modeling was carried out by simulating Viemeister's three-stage temporal model. Simulations, using an initial stage bandwidth of 4000 Hz and a 3-ms time constant for the low-pass filter, generate data that are very similar to those obtained from human subjects in both modulation and gap detection.     

Rate coding model for discrimination of simple tones in the presence of noise

The predictions of a rate coding model for frequency and amplitude jnd's in the presence of noise are presented for a 1-kHz, 100-ms tone. The model for the neural response incorporates physiological data on dynamic range distribution and rate suppression. A central processor is assumed to estimate the tone frequency, or amplitude, from the tone-evoked rate increment profile. This central processor acts like an ideal detector with respect to the neural noise. The effects of the neural noise as well as the signal variability on the discrimination performance level are evaluated, and the signal variability is found to be significant. The combined effect of threshold distribution, rate suppression, and signal variability make the jnd's practically invariant with noise level, in accordance with published psychophysical data. The values of the frequency jnd at high signal-to-noise ratio, however, are borderline in their consistency with the data. A more obvious discrepancy exists between the model and the psychophysical data regarding the ratio of frequency to amplitude Weber fractions, which can be resolved only by modifying the model auditory filters to be five times sharper than those measured in cats.     

Binaural processing of modulated interaural level differences

Two experiments are presented that measure the acuity of binaural processing of modulated interaural level differences (ILDs) using psychoacoustic methods. In both experiments, dynamic ILDs were created by imposing an interaurally antiphasic sinusoidal amplitude modulation (AM) signal on high-frequency carriers, which were presented over headphones. In the first experiment, the sensitivity to dynamic ILDs was measured as a function of the modulation frequency using puretone, and interaurally correlated and uncorrelated narrow-band noise carriers. The intrinsic interaural level fluctuations of the uncorrelated noise carriers raised the ILD modulation detection thresholds with respect to the pure-tone carriers. The diotic fluctuations of the correlated noise carriers also caused a small increase in the thresholds over the pure-tone carriers, particularly with low ILD modulation frequencies. The second experiment investigated the modulation frequency selectivity in dynamic ILD processing by imposing an interaurally uncorrelated bandpass noise AM masker in series with the interaurally antiphasic AM signal on a pure-tone carrier. By varying the masker center frequencies relative to the signal modulation frequency, broadly tuned, bandpass-shaped patterns were obtained. Simulations with an existing binaural model show that a low-pass filter to limit the binaural temporal resolution is not sufficient to predict the results of the experiments.     

Second-order temporal modulation transfer functions

Detection thresholds were measured for a sinusoidal modulation applied to the modulation depth of a sinusoidally amplitude-modulated (SAM) white noise carrier as a function of the frequency of the modulation applied to the modulation depth (referred to as f'm). The SAM noise acted therefore as a "carrier" stimulus of frequency fm, and sinusoidal modulation of the SAM-noise modulation depth generated two additional components in the modulation spectrum: fm-f'm and fm+f'm. The tracking variable was the modulation depth of the sinusoidal variation applied to the "carrier" modulation depth. The resulting "second-order" temporal modulation transfer functions (TMTFs) measured on four listeners for "carrier" modulation frequencies fm of 16, 64, and 256 Hz display a low-pass segment followed by a plateau. This indicates that sensitivity to fluctuations in the strength of amplitude modulation is best for fluctuation rates f'm below about 2-4 Hz when using broadband noise carriers. Measurements of masked modulation detection thresholds for the lower and upper modulation sideband suggest that this capacity is possibly related to the detection of a beat in the sound's temporal envelope. The results appear qualitatively consistent with the predictions of an envelope detector model consisting of a low-pass filtering stage followed by a decision stage. Unlike listeners' performance, a modulation filterbank model using Q values > or = 2 should predict that second-order modulation detection thresholds should decrease at high values of f'm due to the spectral resolution of the modulation sidebands (in the modulation domain). This suggests that, if such modulation filters do exist, their selectivity is poor. In the latter case, the Q value of modulation filters would have to be less than 2. This estimate of modulation filter selectivity is consistent with the results of a previous study using a modulation-masking paradigm [S. D. Ewert and T. Dau, J. Acoust. Soc. Am. 108, 1181-1196 (2000)].     

Within- versus cross-channel mechanisms in detection of envelope phase disparity

These experiments were designed to examine the mechanism of detection of phase disparity in the envelopes of two sinusoidally amplitude-modulated (AM) sinusoids. Specifically, they were performed to determine whether detection of envelope phase disparity was consistent with processing within a single channel in which the AM tones were simply added. In the first condition, with an 8-Hz modulation frequency, phase-disparity thresholds increased sharply with an initial increase in separation of the carrier frequencies. They then remained approximately constant when the separation was an octave or above. In the second condition, with carrier pairs of 1 and 2 kHz or 1 and 3.2 kHz and a modulation frequency of 8 Hz, thresholds were little affected as the level of one carrier was decreased relative to the other. With a modulation frequency of 128 Hz, for most subjects there was more of an effect of level disparity on thresholds. In the third condition, when the modulation frequency was 8 Hz, subjects showed relatively constant thresholds whether the signals were presented monotically, dichotically, or dichotically with low- and high-pass noise. Dichotic thresholds were typically higher than monotic when the modulation frequency was 128 Hz. These results suggest that it is not necessary to have information available within a single additive channel to detect envelope phase disparity. In certain circumstances, a comparison across channels may be used to detect such disparities.