Informational processing of complex sound. I: Intensity discrimination

This paper reports on some initial experiments using the sample discrimination paradigm to investigate normal-hearing listeners' ability to process information in complex, nonspeech sounds. An important feature of the sample discrimination experiment is that the value of the difference to be discriminated randomly varies from trial to trial. It is this variation that yields potential information. In the present study, listeners heard a pair of multitone complexes (or sequences) on each trial. The individual levels of the tones were drawn from two normal distributions differing only in mean. The listener's task was to identify the sound having the higher mean tone level. For an ideal observer in these experiments, performance in d' grows as the square root n, where n is the number of tones. Obtained d' grew more nearly as the cube root of n regardless of whether the tones were played sequentially or simultaneously or whether they were increased in number from high frequencies to low or from low frequencies to high. A preliminary model is proposed in which discrimination performance depends predominantly on the information content of the sounds and is largely independent of the physical dimensions along which the sounds vary. Information content is defined in terms of the variance of the underlying stimulus distributions and a stimulus equivocation factor that is derived from the data. Based on this model, transmitted information is estimated to be between 1.0 and 2.6 bits.     

Efficient across-frequency integration: evidence from psychometric functions

Across-frequency integration of complex signals was investigated by measuring psychometric functions [log (d') versus signal level in dB SPL] for detection of brief and long signals presented in broadband noise. The signals were tones at 630, 1600, and 4000 Hz, and a nine-tone complex with components spaced at one-third-octave frequencies between 630 and 4000 Hz. The phase relationship of the components in the complex was varied such that adjacent components were in phase (at 0 degrees), 90, or 180 degrees out of phase. Signal durations (defined in terms of the number of cycles between the half-amplitude points of the Gaussian envelopes) of 4.7 and 150 cycles were tested. Results for six normal-hearing listeners showed that the slopes of the psychometric functions were steeper for the brief than for the long signals, and steeper for the tone complexes than for the tones, particularly for the brief signals. This suggests that the transformation from signal intensity to decision variable may be different for brief complex signals than for tonal signals and long complex signals. Thresholds obtained from the psychometric functions were in excellent agreement with those obtained with an adaptive procedure that employed three interleaved tracks. For the long signals, the threshold improvement for the tone complexes relative to a single tone was well described by a 5* log (n) integration rule. However, the threshold improvement for brief signals obeyed a more efficient integration rule of 7 to 8* log (n). A portion of this effect could be accounted for by the phase relationship of the tone complexes; thresholds for brief signals were lowest when the components were in phase at the envelope peak of the signal. This finding indicates that temporal synchrony across auditory channels may enhance detection of brief multi-tone complexes.     

Integration of spectral and temporal cues in discrimination of nonspeech sounds: a psychoacoustic analysis

This study presents a psychoacoustic analysis of the integration of spectral and temporal cues in the discrimination of simple nonspeech sounds. The experimental task was a same-different discrimination between a standard and a comparison pair of tones. Each pair consists of two 80-ms, 1500-Hz tone bursts separated by a 60-ms interval. The just-discriminable (d' = 2.0) increment in duration delta t, of one of the bursts was measured as a function of increments in the frequency delta f, of the other burst. A trade off between the values of delta t and delta f required to perform at d' = 2.0 was observed, which suggests that listeners integrate the evidence from the two dimensions. Integration occurred with both sub- and supra-threshold values of delta t or delta f, regardless of the order in which the cues were presented. The performance associated to the integration of cues was found to be determined by the discriminability of delta t plus that of delta f, and thus, it is within the psychophysical limits of auditory processing. To a first approximation the results agreed with the prediction of orthogonal vector summation of evidence stemming from signal detection theory. It is proposed that the ability to integrate spectral and temporal cues is in the repertoire of auditory processing capabilities. This integration does not appear to depend on perceiving sounds as members of phonetic classes.     

Interaural correlation sensitivity

Sensitivity to differences in interaural correlation was measured for 1.3-ERB-wide bands of noise using a 2IFC task at six frequencies: 250, 500, 750, 1000, 1250, and 1500 Hz. The sensitivity index, d', was measured for discriminations between a number of fixed pairs of correlation values. Cumulative d' functions were derived for each frequency and condition. The d' for discriminating any two values of correlation may be recovered from the cumulative d' function by the difference between cumulative d's for these values. Two conditions were employed: the noisebands were either presented in isolation (narrow-band condition) or in the context of broad, contiguous flanking bands of correlated noise (fringed condition). The cumulative d' functions showed greater sensitivity to differences in correlation close to 1 than close to 0 at low frequencies, but this difference was less pronounced in the fringed condition. Also, a more linear relationship was observed when cumulative d' was plotted as a function of the equivalent signal-to-noise ratio (SNR) in dB for each correlation value, rather than directly against correlation. The equivalent SNR was the SNR at which the interaural correlation in an NoS(pi) stimulus would equal the interaural correlation of the noise used in the experiment. The maximum cumulative d' declined above 750 Hz. This decline was steeper for the fringed than for the narrow-band condition. For the narrow-band condition, the total cumulative d' was variable across listeners. All cumulative d' functions were closely fitted using a simple two-parameter function. The complete data sets, averaged across listeners, from the fringed and narrow-band conditions were fitted using functions to describe the changes in these parameters over frequency, in order to produce an interpolated family of curves that describe sensitivity at frequencies between those tested. These curves predict the spectra recovered by the binaural system when complex sounds, such as speech, are masked by noise.     

Psychometric functions for frequency discrimination from listeners with sensorineural hearing loss

Psychometric functions for pulsed pure-tone frequency discrimination were obtained from hearing-impaired listeners at frequencies with normal hearing and at frequencies with mild or moderate hearing losses. The general form of psychometric functions at hearing-impaired frequencies was found to be the same as at normal-hearing frequencies, i.e.,d' was linear with the frequency difference between tones, in Hz. For all but one psychometric function, the addition of an intercept term to the fitting equation did not account for significantly more variance than did the slope term alone. Therefore, it was concluded that psychometric functions for frequency discrimination can be adequately described with only one parameter: the slope of the psychometric function. Deficits in discrimination at hearing-loss frequencies were manifested by more gradual slopes of psychometric functions. Procedures for normalizing psychometric functions are presented, which facilitate comparisons of normal and impaired frequency discrimination data across studies and frequencies. Comparisons of dlf's (difference limen for frequency) obtained with adaptive and fixed procedures show a bias toward larger dlf's with adaptive procedures, but only at higher frequencies. A discussion of equal-interval and equal-ratio adaptive stepping rules indicates that an equal-ratio rule may be preferable.     

Enhancement of temporal cues to pitch in cochlear implants: effects on pitch ranking

The abilities to hear changes in pitch for sung vowels and understand speech using an experimental sound coding strategy (eTone) that enhanced coding of temporal fundamental frequency (F0) information were tested in six cochlear implant users, and compared with performance using their clinical (ACE) strategy. In addition, rate- and modulation rate-pitch difference limens (DLs) were measured using synthetic stimuli with F0s below 300 Hz to determine psychophysical abilities of each subject and to provide experience in attending to rate cues for the judgment of pitch. Sung-vowel pitch ranking tests for stimuli separated by three semitones presented across an F0 range of one octave (139-277 Hz) showed a significant benefit for the experimental strategy compared to ACE. Average d-prime (d') values for eTone (d' = 1.05) were approximately three time larger than for ACE (d' = 0.35). Similar scores for both strategies in the speech recognition tests showed that coding of segmental speech information by the experimental strategy was not degraded. Average F0 DLs were consistent with results from previous studies and for all subjects were less than or equal to approximately three semitones for F0s of 125 and 200?Hz.     

Accuracy of pitch matching for pure tones and for complex tones with overlapping or nonoverlapping harmonics.

The discrimination of the fundamental frequency (fo) of pairs of complex tones with no common harmonics is worse than the discrimination of fo for tones with all harmonics in common. These experiments were conducted to assess whether this effect is a result of pitch shifts between pairs of tones without common harmonics or whether it reflects influences of spectral differences (timbre) on the accuracy of pitch perception. In experiment 1, pitch matches were obtained between sounds drawn from the following types: (1) pure tones (P) with frequencies 100, 200, or 400 Hz; (2) a multiple-component complex tone, designated A, with harmonics 3, 4, 8, 9, 10, 14, 15, and fo = 100, 200, or 400 Hz; (3) A multiple-component complex tone, designated B, with harmonics 5, 6, 7, 11, 12, 13, 16, and with fo = 100, 200 or 400 Hz. The following matches were made; A vs A, B vs B, A vs P, B vs P and P vs P. Pitch shifts were found between the pure tones and the complex tones (A vs P and B vs P), but not between the A and B tones (A vs B). However, the variability of the A vs B matches was significantly greater than that of the A vs A or B vs B matches. Also, the variability of the A vs P and B vs P matches was greater than that for the A vs B matches. In a second experiment, frequency difference limens (DLCs) were measured for the A vs A, B vs B, and A vs B pairs of sounds. The DLCs were larger for the A vs B pair than for A vs A or B vs B. The results suggest that the poor frequency discrimination of tones with no common harmonics does not result from pitch shifts between the tones. Rather, it seems that spectral differences between tones interfere with judgements of their relative pitch.     

Across-frequency interference effects in fundamental frequency discrimination: questioning evidence for two pitch mechanisms

Carlyon and Shackleton [J. Acoust. Soc. Am. 95, 3541-3554 (1994)] presented an influential study supporting the existence of two pitch mechanisms, one for complex tones containing resolved and one for complex tones containing only unresolved components. The current experiments provide an alternative explanation for their finding, namely the existence of across-frequency interference in fundamental frequency (F0) discrimination. Sensitivity (d') was measured for F0 discrimination between two sequentially presented 400 ms complex (target) tones containing only unresolved components. In experiment 1, the target was filtered between 1375 and 15,000 Hz, had a nominal F0 of 88 Hz, and was presented either alone or with an additional complex tone ("interferer"). The interferer was filtered between 125-625 Hz, and its F0 varied between 88 and 114.4 Hz across blocks. Sensitivity was significantly reduced in the presence of the interferer, and this effect decreased as its F0 was moved progressively further from that of the target. Experiment 2 showed that increasing the level of a synchronously gated lowpass noise that spectrally overlapped with the interferer reduced this "pitch discrimination interference (PDI)". In experiment 3A, the target was filtered between 3900 and 5400 Hz and had an F0 of either 88 or 250 Hz. It was presented either alone or with an interferer, filtered between 1375 and 1875 Hz with an F0 corresponding to the nominal target F0. PDI was larger in the presence of the resolved (250 Hz F0) than in the presence of the unresolved (88 Hz F0) interferer, presumably because the pitch of the former was more salient than that of the latter. Experiments 4A and 4B showed that PDI was reduced but not eliminated when the interferer was gated on 200 ms before and off 200 ms after the target, and that some PDI was observed with a continuous interferer. The current findings provide an alternative interpretation of a study supposedly providing strong evidence for the existence of two pitch mechanisms.     

Integration of spectral and temporal cues separated in time and frequency

Subjects discriminated a "standard" pair of tone bursts (T1, T2) from a "comparison" pair (T1 + delta t, T2 + delta f), containing increments in the duration delta t of the first burst and/or the frequency delta f of the second burst. The threshold (d' = 2.0) for delta t was measured as a function of delta f, and the threshold for delta f as a function of delta t. The integration of increments in duration and frequency was studied as a function of the spectral and temporal separation between T1 and T2. A trade-off between the values of delta t and delta f required for d' = 2.0 performance was observed. This integration takes place when delta t, delta f occur simultaneously in the same spectral region, and when they occur separated by up to 120 ms, or by up to a full octave. The efficiency of integration was similar for all conditions of temporal and spectral separation studied, because the discriminability of delta t and of delta f is also nearly uniform across experimental conditions. The results from all experimental conditions are adequately described by a vector summation model derived from TSD. In a subsidiary experiment, subjects categorized pure tones varying in duration and frequency as "high" or "low" in pitch and "long" or "short" in duration. It was found that combined variations in duration and frequency result in essentially independent perceptual processes, although pitch has a small effect upon the perceived duration. It is concluded that spectral-temporal integration is a general ability operating in a variety of stimulus conditions.(ABSTRACT TRUNCATED AT 250 WORDS)     

Comparing F0 discrimination in sequential and simultaneous conditions

In an influential study, Carlyon and Shackleton [J. Acoust. Soc. Am. 95, 3541-3554 (1994)] measured listeners' performance (d') in fundamental-frequency (F0) discrimination between harmonic complex tones (HCTs) presented simultaneously in different spectral regions and compared their performance with that found in a sequential-comparison task. In this Letter, it is suggested that Carlyon and Shackleton's analysis of the simultaneous-comparison data did not adequately reflect their assumption that listeners were effectively comparing F0's across regions. A reanalysis consistent with this assumption is described. The new results suggest that under the assumption that listeners were effectively comparing F0 across regions, their performance in this task was substantially higher than originally estimated by Carlyon and Shackleton, and in some conditions much higher than expected from the performances measured in a traditional F0-discrimination task with sequential HCTs. Possible explanations for this outcome, as well as alternative interpretations, are proposed.     

Memory for pitch versus memory for loudness

The decays of pitch traces and loudness traces in short-term auditory memory were compared in forced-choice discrimination experiments. The two stimuli presented on each trial were separated by a variable delay (D); they consisted of pure tones, series of resolved harmonics, or series of unresolved harmonics mixed with lowpass noise. A roving procedure was employed in order to minimize the influence of context coding. During an initial phase of each experiment, frequency and intensity discrimination thresholds [P(C) = 0.80] were measured with an adaptive staircase method while D was fixed at 0.5 s. The corresponding physical differences (in cents or dB) were then constantly presented at four values of D: 0.5, 2, 5, and 10 s. In the case of intensity discrimination, performance (d') markedly decreased when D increased from 0.5 to 2 s, but was not further reduced when D was longer. In the case of frequency discrimination, the decline of performance as a function of D was significantly less abrupt. This divergence suggests that pitch and loudness are processed in separate modules of auditory memory.     

Psychometric functions for level discrimination

To determine the form of psychometric functions for 2I,2AFC level discrimination (commonly called intensity discrimination), ten increment levels were presented in random order within blocks of 100 trials. Stimuli were chosen to encompass a wide range of conditions and difference limens: eight 10-ms tones had frequencies of 0.25, 1, 8, or 14 kHz and levels of 30, 60, or 90 dB SPL; two 500-ms stimuli also were tested: a 1-kHz tone at 90 dB SPL and broadband noise at 63 dB SPL. For each condition, at least 20 blocks were presented in mixed order. Results for five normal listeners show that the sensitivity, d', is nearly proportional to delta L (= 20 log [(p + delta p)/p], where p is sound pressure) over the entire range of difference limens. When d' is plotted against Weber fractions for sound pressure, delta p/p, or intensity, delta I/I, exponents of the best-fitting power functions decrease with increasing difference limens and are less than unity for large difference limens. The approximately proportional relation between d' and delta L agrees with modern multichannel models of level discrimination and with psychometric functions derived for single auditory-nerve fibers. The results also support the notion that the difference limen, expressed as delta LDL and plotted on a logarithmic scale, is an appropriate representation of performance in level-discrimination experiments.     

Dissociation of pitch from timbre in auditory short-term memory

In three experiments, untrained listeners made same/different judgments on pairs of pure or complex tones with periods that eventually differed by +/- 4%. On each trial, the two test tones were separated by 4.3 s, during which other tones (I) were heard but had to be ignored. The period (p) of the first test tone was randomly selected between 1/600 and 1/300 s. The period of each I tone was randomly selected among four possible values, close to p (+/- 3% or 6% apart) in some conditions, and remote from p in other conditions. In addition, from condition to condition, the spectral content of the I tones was varied independently of their periods: The I tones could have the same harmonic content as the test tones, or a very different harmonic content. Subjects' performances were much better when the periods of the I tones were remote from p than when they were close to p, as expected from previous findings by D. Deutsch [e.g., Science 175, 1020-1022 (1972)]. But, more importantly, the relation between the spectral contents of the I tones and the test tones had, by itself, practically no effect on performance. Thus performance was affected by the pitches of the I tones, but not by their timbres. These results suggest that pitch is processed independently of timbre in auditory short-term memory.     

Further evidence that fundamental-frequency difference limens measure pitch discrimination

Difference limens for complex tones (DLCs) that differ in F0 are widely regarded as a measure of periodicity-pitch discrimination. However, because F0 changes are inevitably accompanied by changes in the frequencies of the harmonics, DLCs may actually reflect the discriminability of individual components. To test this hypothesis, DLCs were measured for complex tones, the component frequencies of which were shifted coherently upward or downward by ΔF = 0%, 25%, 37.5%, or 50% of the F0, yielding fully harmonic (ΔF = 0%), strongly inharmonic (ΔF = 25%, 37.5%), or odd-harmonic (ΔF = 50%) tones. If DLCs truly reflect periodicity-pitch discriminability, they should be larger (worse) for inharmonic tones than for harmonic and odd harmonic tones because inharmonic tones have a weaker pitch. Consistent with this prediction, the results of two experiments showed a non-monotonic dependence of DLCs on ΔF, with larger DLCs for ΔF's of ± 25% or ± 37.5% than for ΔF's of 0 or ± 50% of F0. These findings are consistent with models of pitch perception that involve harmonic templates or with an autocorrelation-based model provided that more than just the highest peak in the summary autocorrelogram is taken into account.     

Perceptual learning of fundamental frequency discrimination: effects of fundamental frequency, harmonic number, and component phase

Thresholds (F0DLs) were measured for discrimination of the fundamental frequency (F0) of a group of harmonics (group B) embedded in harmonics with a fixed F0. Miyazono and Moore [(2009). Acoust. Sci. & Tech. 30, 383386] found a large training effect for tones with high harmonics in group B, when the harmonics were added in cosine phase. It is shown here that this effect was due to use of a cue related to pitch pulse asynchrony (PPA). When PPA cues were disrupted by introducing a temporal offset between the envelope peaks of the harmonics in group B and the remaining harmonics, F0DLs increased markedly. Perceptual learning was examined using a training stimulus with cosine-phase harmonics, F0 = 50 Hz, and high harmonics in group B, under conditions where PPA was not useful. Learning occurred, and it transferred to other cosine-phase tones, but not to random-phase tones. A similar experiment with F0 = 100 Hz showed a learning effect which transferred to a cosine-phase tone with mainly high unresolved harmonics, but not to cosine-phase tones with low harmonics, and not to random-phase tones. The learning found here appears to be specific to tones for which F0 discrimination is based on distinct peaks in the temporal envelope.     

Psychometric functions for pure-tone frequency discrimination

The form of the psychometric function (PF) for auditory frequency discrimination is of theoretical interest and practical importance. In this study, PFs for pure-tone frequency discrimination were measured for several standard frequencies (200-8000 Hz) and levels [35-85 dB sound pressure level (SPL)] in normal-hearing listeners. The proportion-correct data were fitted using a cumulative-Gaussian function of the sensitivity index, d', computed as a power transformation of the frequency difference, Δf. The exponent of the power function corresponded to the slope of the PF on log(d')-log(Δf) coordinates. The influence of attentional lapses on PF-slope estimates was investigated. When attentional lapses were not taken into account, the estimated PF slopes on log(d')-log(Δf) coordinates were found to be significantly lower than 1, suggesting a nonlinear relationship between d' and Δf. However, when lapse rate was included as a free parameter in the fits, PF slopes were found not to differ significantly from 1, consistent with a linear relationship between d' and Δf. This was the case across the wide ranges of frequencies and levels tested in this study. Therefore, spectral and temporal models of frequency discrimination must account for a linear relationship between d' and Δf across a wide range of frequencies and levels.     

Temporal integration of trains of tone pulses by normal and by cochlearly impaired listeners

Two experiments investigated the temporal integration of trains of tone pulses by normal and by cochlearly impaired listeners. In the first experiment, thresholds were measured for a single 5-ms, 4-kHz tone pulse, and for ten such tone pulses as a function of interpulse interval (delta t). For normal listeners, temporal integration, defined as the threshold difference between one and ten pulses, was about 8 dB for delta t less than 20 ms, and about 5 dB at longer delta t's. For impaired listeners, temporal integration was only about 2-3 dB across the range of delta t's (5-160 ms) studied. A second experiment measured psychometric functions (log d' versus log signal power) for a single pulse and for ten pulses with delta t's of 5 ms and 80 ms. The normal listeners' functions had slopes close to unity in all three conditions, with a few exceptions. The impaired listeners' functions had slopes close to unity for ten pulses with delta t = 5 ms, but had slopes significantly greater than unity for delta t = 80 ms, and for a single pulse. At delta t = 80 ms, the increase in d' relative to the condition with a single tone was similar (a factor of square root of 10) for both impaired and normal listeners, but the threshold difference was smaller for the impaired listeners due to their steeper psychometric functions. For impaired listeners, then, temporal integration at delta t = 80 ms was normal in terms of a change in d' but abnormal when measured as a threshold difference.(ABSTRACT TRUNCATED AT 250 WORDS)     

Medial efferent effects on auditory-nerve responses to tail-frequency tones. I. Rate reduction.

One way medial efferents are thought to inhibit responses of auditory-nerve fibers (ANFs) is by reducing the gain of the cochlear amplifier thereby reducing motion of the basilar membrane. If this is the only mechanism of medial efferent inhibition, then medial efferents would not be expected to inhibit responses where the cochlear amplifier has little effect, i.e., at sound frequencies in the tails of tuning curves. Inhibition at tail frequencies was tested for by obtaining randomized rate-level functions from cat ANFs with high characteristic frequencies (CF > or = 5 kHz), stimulated with tones two or more octaves below CF. It was found that electrical stimulation of medial efferents can indeed inhibit ANF responses to tail-frequency tones. The amplitude of efferent inhibition depended on both sound level (largest near to threshold) and frequency (largest two to three octaves below CF). On average, inhibition of high-CF ANFs responding to 1 kHz tones was around 5 dB. Although an efferent reduction of basilar-membrane motion cannot be ruled out as the mechanism producing the inhibition of ANF responses to tail frequency tones, it seems more likely that efferents produce this effect by changing the micromechanics of the cochlear partition.     

Sample discrimination of frequency by hearing-impaired and normal-hearing listeners

In a multiple observation, sample discrimination experiment normal-hearing (NH) and hearing-impaired (HI) listeners heard two multitone complexes each consisting of six simultaneous tones with nominal frequencies spaced evenly on an ERB(N) logarithmic scale between 257 and 6930 Hz. On every trial, the frequency of each tone was sampled from a normal distribution centered near its nominal frequency. In one interval of a 2IFC task, all tones were sampled from distributions lower in mean frequency and in the other interval from distributions higher in mean frequency. Listeners had to identify the latter interval. Decision weights were obtained from multiple regression analysis of the between- interval frequency differences for each tone and listeners' responses. Frequency difference limens (an index of sensorineural resolution) and decision weights for each tone were used to predict the sensitivity of different decision-theoretic models. Results indicate that low-frequency tones were given much greater perceptual weight than high-frequency tones by both groups of listeners. This tendency increased as hearing loss increased and as sensorineural resolution decreased, resulting in significantly less efficient weighting strategies for the HI listeners. Overall, results indicate that HI listeners integrated frequency information less optimally than NH listeners, even after accounting for differences in sensorineural resolution.     

Discrimination of interval size in short tone sequences

This study investigates the discrimination of small changes of interval size in short sequences of musical tones. Major, minor and neutral thirds were varied in increments of 15 cents. The nine subjects had varying degrees of amateur musical experience-their level of musical training was lower than that of professional musicians. In some experiments the stimuli were presented purely melodically and in others they were presented together with a sustained tone at a higher pitch. Some subjects were able to make use of the additional cues from beats in the latter case. Category widths for identification were measured at around 70 cents and just-noticeable differences in frequency were measured at around 10 cents. Little significant variation of inter-stimulus sensitivity index d' was observed across the stimulus sets, i.e., there was little evidence for "anchors" or "landmarks" within the range of tunings employed. However, for major thirds, discrimination of the 15 cent increment between 400 and 415 cents was reduced compared to discrimination of other 15 cent increments within the stimulus sets.