Perceived continuity and pitch shifts for complex tones with unresolved harmonics

Brief complex tone bursts with fundamental frequencies (F0s) of 100, 125, 166.7, and 250 Hz were bandpass filtered between the 22nd and 30th harmonics, to produce waveforms with five regularly occurring envelope peaks ("pitch pulses") that evoked pitches associated with their repetition period. Two such tone bursts were presented sequentially and separated by a silent interval of two periods (2/F0). When the relative phases of the two bursts were varied, such that the interpulse interval (IPI) between the last pulse of the first burst and the first pulse of the second burst was varied, the pitch of the whole sequence was little affected. This is consistent with previous results suggesting that the pitch integration window may be "reset" by a discontinuity. However, when the interval between the two bursts was filled with a noise with the same spectral envelope as the complex, variations in IPI had substantial effects on the pitch of the sequence. It is suggested that the presence of the noise causes the two tones bursts to appear continuous, hence, resetting does not occur, and the pitch mechanism is sensitive to the phase discontinuity across the silent interval.     

Accuracy of pitch matching for pure tones and for complex tones with overlapping or nonoverlapping harmonics.

The discrimination of the fundamental frequency (fo) of pairs of complex tones with no common harmonics is worse than the discrimination of fo for tones with all harmonics in common. These experiments were conducted to assess whether this effect is a result of pitch shifts between pairs of tones without common harmonics or whether it reflects influences of spectral differences (timbre) on the accuracy of pitch perception. In experiment 1, pitch matches were obtained between sounds drawn from the following types: (1) pure tones (P) with frequencies 100, 200, or 400 Hz; (2) a multiple-component complex tone, designated A, with harmonics 3, 4, 8, 9, 10, 14, 15, and fo = 100, 200, or 400 Hz; (3) A multiple-component complex tone, designated B, with harmonics 5, 6, 7, 11, 12, 13, 16, and with fo = 100, 200 or 400 Hz. The following matches were made; A vs A, B vs B, A vs P, B vs P and P vs P. Pitch shifts were found between the pure tones and the complex tones (A vs P and B vs P), but not between the A and B tones (A vs B). However, the variability of the A vs B matches was significantly greater than that of the A vs A or B vs B matches. Also, the variability of the A vs P and B vs P matches was greater than that for the A vs B matches. In a second experiment, frequency difference limens (DLCs) were measured for the A vs A, B vs B, and A vs B pairs of sounds. The DLCs were larger for the A vs B pair than for A vs A or B vs B. The results suggest that the poor frequency discrimination of tones with no common harmonics does not result from pitch shifts between the tones. Rather, it seems that spectral differences between tones interfere with judgements of their relative pitch.     

Pitch perception of complex tones and human temporal-lobe function

Sixty-four patients with unilateral temporal-lobe excisions as well as 18 normal control subjects were tested in a missing fundamental pitch perception task. Subjects were required to indicate if the pitch of a pair of tones rose or fell. The excisions encroached upon Heschl's gyri in some cases, whereas, in others, this region was spared. All subjects included for study were able to perform well on a control task in which complex tones including a fundamental were presented. Stimuli for the experimental task, which was procedurally identical with the control task, consisted of several harmonic components spanning the same spectral range, but without a fundamental. Only subjects with right temporal lobectomy in whom Heschl's gyri were excised committed significantly more errors than the normal control group on this task. Patients with left temporal-lobe lesions or with anterior right temporal-lobe excisions were unimpaired. These results suggest that Heschl's gyri and surrounding cortex in the right cerebral hemisphere play a crucial role in extracting the pitch corresponding to the fundamental from a complex tone.     

Across-frequency pitch discrimination interference between complex tones containing resolved harmonics

Pitch discrimination interference (PDI) refers to an impairment in the ability to discriminate changes in the fundamental frequency (F0) of a target harmonic complex, caused by another harmonic complex (the interferer) presented simultaneously in a remote spectral region. So far, PDI has been demonstrated for target complexes filtered into a higher spectral region than the interferer and containing no peripherally resolved harmonics in their passband. Here, it is shown that PDI also occurs when the target harmonic complex contains resolved harmonics in its passband (experiment 1). PDI was also observed when the target was filtered into a lower spectral region than that of the interferer (experiment 2), revealing that differences in relative harmonic dominance and pitch salience between the simultaneous target and the interferer, as confirmed using pitch matches (experiment 3), do not entirely explain PDI. When the target was in the higher spectral region, and the F0 separation between the target and the interferer was around 7% or 10%, dramatic PDI effects were observed despite the relatively large FO separation between the two sequential targets (14%-20%). Overall, the results suggest that PDI is more general than previously thought, and is not limited to targets consisting only of unresolved harmonics.     

Pitch matches between unresolved complex tones differing by a single interpulse interval

The experiment compared the pitches of complex tones consisting of unresolved harmonics. The fundamental frequency (F0) of the tones was 250 Hz and the harmonics were bandpass filtered between 5500 and 7500 Hz. Two 20-ms complex-tone bursts were presented, separated by a brief gap. The gap was an integer number of periods of the waveform: 0, 4, or 8 ms. The envelope phase of the second tone burst was shifted, such that the interpulse interval (IPI) across the gap was reduced or increased by 0.25 or 0.75 periods (1 or 3 ms). A "no shift" control was also included, where the IPI was held at an integer number of periods. Pitch matches were obtained by varying the F0 of a comparison tone with the same temporal parameters as the standard but without the shift. Relative to the no-shift control, the variations in IPI produced substantial pitch shifts when there was no gap between the bursts, but little effect was seen for gaps of 4 or 8 ms. However, for some conditions with the same IPI in the shifted interval, an increase in the IPI of the comparison interval from 4 to 8 ms (gap increased from 0 to 4 ms) changed the pitch match. The presence of a pitch shift suggests that the pitch mechanism is integrating information across the two tone bursts. It is argued that the results are consistent with a pitch mechanism employing a long integration time for continuous stimuli that is reset in response to temporal discontinuities. For a 250-Hz F0, an 8-ms IPI may be sufficient for resetting. Pitch models based on a spectral analysis of the simulated neural spike train, on an autocorrelation of the spike train, and on the mean rate of pitch pulses, all failed to account for the observed pitch matches.     

兴奋模式下谐波复合音音高感知机制的研究

通过测量谐波复合音的基频辨别阈,探讨中等\     

Pitch perception of concurrent harmonic tones with overlapping spectra

Fundamental frequency difference limens (F0DLs) were measured for a target harmonic complex tone with nominal fundamental frequency (F0) of 200 Hz, in the presence and absence of a harmonic masker with overlapping spectrum. The F0 of the masker was 0, ± 3, or ± 6 semitones relative to 200 Hz. The stimuli were bandpass filtered into three regions: 0-1000 Hz (low, L), 1600-2400 Hz (medium, M), and 2800-3600 Hz (high, H), and a background noise was used to mask combination tones and to limit the audibility of components falling on the filter skirts. The components of the target or masker started either in cosine or random phase. Generally, the effect of F0 difference between target and masker was small. For the target alone, F0DLs were larger for random than cosine phase for region H. For the target plus masker, F0DLs were larger when the target had random phase than cosine phase for regions M and H. F0DLs increased with increasing center frequency of the bandpass filter. Modeling using excitation patterns and "summary autocorrelation" and "stabilized auditory image" models suggested that use of temporal fine structure information can account for the small F0DLs obtained when harmonics are barely, if at all, resolved.     

Exploring the temporal mechanism involved in the pitch of unresolved harmonics

This paper continues a line of research initiated by Kaernbach and Demany [J. Acoust. Soc. Am. 104, 2298-2306 (1998)], who employed filtered click sequences to explore the temporal mechanism involved in the pitch of unresolved harmonics. In a first experiment, the just noticeable difference (jnd) for the fundamental frequency (F0) of high-pass filtered and low-pass masked click trains was measured, with F0 (100 to 250 Hz) and the cut frequency (0.5 to 6 kHz) being varied orthogonally. The data confirm the result of Houtsma and Smurzynski [J. Acoust. Soc. Am. 87, 304-310 (1990)] that a pitch mechanism working on the temporal structure of the signal is responsible for analyzing frequencies higher than ten times the fundamental. Using high-pass filtered click trains, however, the jnd for the temporal analysis is at 1.2% as compared to 2%-3% found in studies using band-pass filtered stimuli. Two further experiments provide evidence that the pitch of this stimulus can convey musical information. A fourth experiment replicates the finding of Kaernbach and Demany on first- and second-order regularities with a cut frequency of 2 kHz and extends the paradigm to binaural aperiodic click sequences. The result suggests that listeners can detect first-order temporal regularities in monaural click streams as well as in binaurally fused click streams.     

Pitch of components of complex tones

Subjects made pitch matches to individual components in complex tones consisting of either the 4th to 7th or the 1st to 7th harmonics of a 200-Hz fundamental. All components were at equal levels (either 31-, 51-, or 71-dB SPL per component) and the matching pure tone was equal in level to the component being matched. Attention was drawn to the component to be matched either by giving the matching tone an initial frequency close to that of the component (standard condition) or by suppressing and then introducing the component (emergent condition). The pitch matches did not differ significantly for the two conditions, and did not change with overall level. For two subjects, matches to components in the context of the complexes were very close to matches obtained for the components presented in isolation. For a third subject, matches in context were shifted slightly upwards for the lowest component, and downwards for the highest component. A control condition showed that subjects were able accurately to match a small shift in frequency of one component in a four-tone complex. An adaptive forced-choice method described by Jesteadt [Percept. Psychophys. 28, 85-88 (1980)] was also used to estimate the pitches of the components. A very slight bias was apparent in the results, but the pitches of components in context were again found to be very close to those of components in isolation.     

The influence of duration on the perception of pitch in single and simultaneous complex tones

The influence of duration on the virtual pitch of complex tones was measured using an absolute identification paradigm. If performance with two-tone complexes is expressed in terms of a single central frequency-coding noise function, this function is found to depend on duration in about the same way as the pure-tone difference limen function. The function is further found to be a reasonably good predictor of pitch identification performance with multitone complexes. Another experimental finding was that subjects tend to switch to the analytic mode of pitch perception when complex tones are shortened (i.e., they tend to hear the spectral pitches instead of the virtual ones). A third finding was that with simultaneous complex tones the degradation of each pitch percept depends not only on duration and harmonic order of the tone but also on the harmonic order of the other tone.     

Frequency discrimination of complex tones with overlapping and non-overlapping harmonics

These experiments address the following issues. (1) When two complex tones contain different harmonics, do the differences in timbre between them impair the ability to discriminate the pitches of the tones? (2) When two complex tones have only a single component in common, and that component is the most discriminable component in each tone, is the frequency discrimination of the component affected by differences in residue pitch between the two tones? (3) How good is the pitch discrimination of complex tones with no common components when each tone contains multiple harmonics, so as to avoid ambiguity of pitch? (4) Is the pitch discrimination of complex tones with common harmonics impaired by shifting the component frequencies to nonharmonic values? In all experiments, frequency difference limens (DLCs) were measured for multiple-component complex tones, using an adaptive two-interval, two-alternative, forced-choice task. Three highly trained subjects were used. The main conclusions are as follows. (1) When two tones have the first six harmonics in common, DLCs are larger when the upper harmonics are different than when the upper harmonics are in common or are absent. It appears that differences in timbre impair DLCs. (2) Discrimination of the frequency of a single common partial in two complex tones is worse when the two tones have different residue pitches than when they have the same residue pitch. (3) DLCs for complex tones with no common harmonics are generally larger than those for complex tones with common harmonics. For the former, large individual differences occur, probably because subjects are affected differently by differences in timbre. (4) DLCs for harmonic complex tones are smaller than DLCs for complex tones in which the components are mistuned from harmonic values. This can probably be attributed to the less distinct residue pitch of the inharmonic complexes, rather than to reduced discriminability of partials. Overall, the results support the idea that DLCs for complex tones with common harmonics depend on residue pitch comparisons, rather than on comparisons of the pitches of partials.     

Frequency and intensity difference limens for harmonics within complex tones

A two-interval, two-alternative forced choice task was used to estimate frequency difference limens (DLs) for individual harmonics within complex tones, and DLs for the periodicity (i.e., number of periods per s) of the whole complexes. For complex tones with equal-amplitude harmonics, the DLs for the lowest harmonics were small (less than one percent). The DLs increased rather abruptly around the fifth to seventh harmonic. The highest harmonic in each complex was also well discriminated, and the discriminability of a single high harmonic was markedly improved by increasing its level relative to the other components. The DL for a complex tone was generally smaller than the frequency DL of its most discriminable component. The DL for a complex was found to be predictable from the DLs of the harmonics comprising the complex, using a formula derived by Goldstein [J. Acoust. Soc. Am. 54, 1496-1516 (1973)] from his optimum processor theory for the formation of the pitch of complex tones. The DL for a complex is sometimes primarily determined by high harmonics, such as the highest harmonic, or a harmonic whose level exceeds that of adjacent harmonics. We also measured intensity DLs for individual harmonics within complex tones. The intensity DLs were smallest for low harmonic numbers, and for the highest harmonic in a complex. An excitation-pattern model was used to determine whether the frequency DLs of harmonics within complex tones could be explained in terms of place mechanisms, i.e., in terms of changes in the amount of excitation at appropriate frequency places. We conclude that place mechanisms are not adequate, and that information about the frequencies of individual harmonics is probably carried in the time patterning of neural impulses.     

Pitch strength decreases as F0 and harmonic resolution increase in complex tones composed exclusively of high harmonics

A melodic pitch experiment was performed to demonstrate the importance of time-interval resolution for pitch strength. The experiments show that notes with a low fundamental (75 Hz) and relatively few resolved harmonics support better performance than comparable notes with a higher fundamental (300 Hz) and more resolved harmonics. Two four note melodies were presented to listeners and one note in the second melody was changed by one or two semitones. Listeners were required to identify the note that changed. There were three orthogonal stimulus dimensions: F0 (75 and 300 Hz); lowest frequency component (3, 7, 11, or 15); and number of harmonics (4 or 8). Performance decreased as the frequency of the lowest component increased for both F0's, but performance was better for the lower F0. The spectral and temporal information in the stimuli were compared using a time-domain model of auditory perception. It is argued that the distribution of time intervals in the auditory nerve can explain the decrease in performance as F0, and spectral resolution increase. Excitation patterns based on the same time-interval information do not contain sufficient resolution to explain listener's performance on the melody task.     

Effects of signal envelope on the pitch of short complex tones

Envelope-induced pitch shifts were measured for exponentially decaying complex tones consisting of two sinusoidal components with frequencies f1 = nf0 + 50 Hz and f2 = (n + 1) f0 + 50 Hz, where n equals 3, 4, or 5 and exponential decay rates were 0, 0.5, 1, and 2 dB/ms. Four subjects adjusted a sinusoidal comparison tone to match the virtual pitch of the (missing) fundamental and the pitches of the lower and upper partials f1 and f2. Pitch shifts for f1 are generally less, and pitch shifts for f2 always greater, than envelope-induced shifts observed in isolated sinusoidal tones of comparable frequency and envelope decay rate. Pitch-shift functions for virtual pitch are similar in magnitude and shape to average pitch-shift functions of the partials, which supports the idea that virtual pitch depends on spectral pitch.     

Pitch shift of pure and complex tones induced by masking noise

Psychoacoustic experiments were performed to measure the pitch-shift effects of pure and complex tones resulting from the addition of a masking noise to the tonal stimuli. Harmonic residue tones with either two or three harmonics and a fundamental frequency of 200 Hz were chosen as test tones. The pitch shifts of virtual and spectral pitches of the residue tones were measured as a function of the intensity of a low-pass noise with 600-Hz cutoff frequency. The SPL of this noise varied between 30 and 70 dB. In another experiment, the pitch shifts of single pure tones corresponding to the frequencies and SPLs of the harmonics of the residue tones were measured using the same masking noise. The results from five subjects for the harmonic residue tones show only a weak dependence of pitch shift on masking noise intensity. This dependence exists for both spectral and virtual pitches. In the case of single pure tones, pitch shift depends more distinctly on noise intensity. Pitch shifts of up to 5% were found in the range of noise intensity investigated. The magnitude of pitch shift shows pronounced interindividual differences, but the direction of the shift effect is always the same. In all cases pitch increases with higher masking noise levels.     

The relation between the human frequency-following response and the low pitch of complex tones

The relation between the auditory brain stem potential called the frequency-following response (FFR) and the low pitch of complex tones was investigated. Eleven complex stimuli were synthesized such that frequency content varied but waveform envelope periodicity was constant. This was accomplished by repeatedly shifting the components of a harmonic complex tone upward in frequency by delta f of 20 Hz, producing a series of six-component inharmonic complex tones with constant intercomponent spacing of 200 Hz. Pitch-shift functions were derived from pitch matches for these stimuli to a comparison pure tone for each of four normal hearing adults with extensive musical training. The FFRs were recorded for the complex stimuli that were judged most divergent in pitch by each subject and for pure-tone signals that were judged equal in pitch to these complex stimuli. Spectral analyses suggested that the spectral content of the FFRs elicited by the complex stimuli did not vary consistently with component frequency or the first effect of pitch shift. Furthermore, complex and pure-tone signals judged equal in pitch did not elicit FFRs of similar spectral content.     

Sequential F0 comparisons between resolved and unresolved harmonics: no evidence for translation noise between two pitch mechanisms

Carlyon and Shackleton [J. Acoust. Soc. Am. 95, 3541-3554 (1994)] suggested that fundamental-frequency (F0) discrimination performance between resolved and unresolved harmonics is limited by an internal "translation" noise between the outputs of two distinct F0 encoding mechanisms, in addition to the encoding noise associated with each mechanism. To test this hypothesis further, F0 difference limens (DLF0s) were measured in six normal-hearing listeners using sequentially presented groups of harmonics. The two groups of harmonics presented on each trial were bandpass filtered into the same or different spectral regions, in such a way that both groups contained mainly resolved harmonics, both groups contained only unresolved harmonics, or one group contained mainly resolved and the other only unresolved harmonics. Three spectral regions (low: 600-1150 Hz, mid: 1400-2500 Hz, or high: 3000-5250 Hz) and two nominal F0s (100 and 200 Hz) were used. The DLF0s measured in across-region conditions were well accounted for by a model assuming only two sources of internal noise: the encoding noise estimated on the basis of the within-region results plus a constant noise associated with F0 comparisons across different spectral regions, independent of resolvability. No evidence for an across-pitch-mechanism translation noise was found. A reexamination of previous evidence for the existence of such noise suggests that the present negative outcome is unlikely to be explained by insufficient measurement sensitivity or an unusually large across-region comparison noise in the present study. While the results do not rule out the possibility of two separate pitch mechanisms, they indicate that the F0s of sequentially presented resolved and unresolved harmonics can be compared internally at no or negligible extra cost.