Thresholds for hearing mistuned partials as separate tones in harmonic complexes

When a low harmonic in a harmonic complex tone is mistuned from its harmonic value by a sufficient amount it is heard as a separate tone, standing out from the complex as a whole. This experiment estimated the degree of mistuning required for this phenomenon to occur, for complex tones with 10 or 12 equal-amplitude components (60 dB SPL per component). On each trial the subject was presented with a complex tone which either had all its partials at harmonic frequencies or had one partial mistuned from its harmonic frequency. The subject had to indicate whether he heard a single complex tone with one pitch or a complex tone plus a pure tone which did not "belong" to the complex. An adaptive procedure was used to track the degree of mistuning required to achieve a d' value of 1. Threshold was determined for each ot the first six harmonics of each complex tone. In one set of conditions stimulus duration was held constant at 410 ms, and the fundamental frequency was either 100, 200, or 400 Hz. For most conditions the thresholds fell between 1% and 3% of the harmonic frequency, depending on the subject. However, thresholds tended to be greater for the first two harmonics of the 100-Hz fundamental and, for some subjects, thresholds increased for the fifth and sixth harmonics. In a second set of conditions fundamental frequency was held constant at 200 Hz, and the duration was either 50, 110, 410, or 1610 ms. Thresholds increased by a factor of 3-5 as duration was decreased from 1610 ms to 50 ms. The results are discussed in terms of a hypothetical harmonic sieve and mechanisms for the formation of perceptual streams.     

Grouping in pitch perception: effects of onset asynchrony and ear of presentation of a mistuned component.

Three experiments investigated how the onset asynchrony and ear of presentation of a single mistuned frequency component influence its contribution to the pitch of an otherwise harmonic complex tone. Subjects matched the pitch of the target complex by adjusting the pitch of a second similar but strictly periodic complex tone. When the mistuned component (the 4th harmonic of a 155 Hz fundamental) started 160 ms or more before the remaining harmonics but stopped simultaneously with them, it made a reduced contribution to the pitch of the complex. It made no contribution if it started more than 300 ms before. Pitch shifts and their reduction with onset time were larger for short (90 ms) sounds than for long (410 ms). Pitch shifts were slightly larger when the mistuned component was presented to the same ear as the remaining 11 in-tune harmonics than to the opposite ear. Adding a "captor" complex tone with a fundamental of 200 Hz and a missing 3rd harmonic to the contralateral ear did not augment the effect of onset time, even though the captor was synchronous with the mistuned harmonic, the mistuned component was equal in frequency to the missing 3rd harmonic of the captor complex tone and it was played to the same ear as the captor. The results show that a difference in onset time can prevent a resolved frequency component from contributing to the pitch of a complex tone even though it is present throughout that complex tone.     

The effect of inharmonic partials on pitch of piano tones

Piano tones have partials whose frequencies are sharp relative to harmonic values. A listening test was conducted to determine the effect of inharmonicity on pitch for piano tones in the lowest three octaves of a piano. Nine real tones from the lowest three octaves of a piano were analyzed to obtain frequencies, relative amplitudes, and decay rates of their partials. Synthetic inharmonic tones were produced from these results. Synthetic harmonic tones, each with a twelfth of a semitone increase in the fundamental, were also produced. A jury of 21 listeners matched the pitch of each synthetic inharmonic tone to one of the synthetic harmonic tones. The effect of the inharmonicity on pitch was determined from an average of the listeners' results. For the nine synthetic piano tones studied, pitch increase ranged from approximately two and a half semitones at low fundamental frequencies to an eighth of a semitone at higher fundamental frequencies.     

Effect of level on the discrimination of harmonic and frequency-shifted complex tones at high frequencies

Moore and Se?k [J. Acoust. Soc. Am. 125, 3186-3193 (2009)] measured discrimination of a harmonic complex tone and a tone in which all harmonics were shifted upwards by the same amount in Hertz. Both tones were passed through a fixed bandpass filter and a background noise was used to mask combination tones. Performance was well above chance when the fundamental frequency was 800 Hz, and all audible components were above 8000 Hz. Moore and Se?k argued that this suggested the use of temporal fine structure information at high frequencies. However, the task may have been performed using excitation-pattern cues. To test this idea, performance on a similar task was measured as a function of level. The auditory filters broaden with increasing level, so performance based on excitation-pattern cues would be expected to worsen as level increases. The results did not show such an effect, suggesting that the task was not performed using excitation-pattern cues.     

Effects of level and frequency on the audibility of partials in inharmonic complex tones

The effect of level and frequency on the audibility of partials was measured for complex tones with partials uniformly spaced on an equivalent rectangular bandwidth (ERB(N)) number scale. On each trial, subjects heard a sinusoidal "probe" followed by a complex tone. The probe was mistuned downwards or upwards (at random) by 4.5% from the frequency of one randomly selected partial in the complex. The subject indicated whether the probe was higher or lower in frequency than the nearest partial in the complex. The frequencies were roved from trial to trial, keeping frequency ratios fixed. In experiment 1, the level per partial, L, was 40 or 70 dB SPL and the mean frequency of the central partial, f(c), was 1201 Hz. Scores for the highest and lowest partials in the complexes were generally high for all spacings. Scores for the inner partials were close to chance at 0.75-ERB(N) spacing, and improved as the spacing was increased up to 2 ERB(N). For intermediate spacings, performance was better for the lower level used. In experiment 2, L was 70 dB SPL and f(c) was 3544 Hz. Performance worsened markedly for partial frequencies above 3544 Hz, consistent with a role of phase locking.     

Effects of signal envelope on the pitch of short complex tones

Envelope-induced pitch shifts were measured for exponentially decaying complex tones consisting of two sinusoidal components with frequencies f1 = nf0 + 50 Hz and f2 = (n + 1) f0 + 50 Hz, where n equals 3, 4, or 5 and exponential decay rates were 0, 0.5, 1, and 2 dB/ms. Four subjects adjusted a sinusoidal comparison tone to match the virtual pitch of the (missing) fundamental and the pitches of the lower and upper partials f1 and f2. Pitch shifts for f1 are generally less, and pitch shifts for f2 always greater, than envelope-induced shifts observed in isolated sinusoidal tones of comparable frequency and envelope decay rate. Pitch-shift functions for virtual pitch are similar in magnitude and shape to average pitch-shift functions of the partials, which supports the idea that virtual pitch depends on spectral pitch.     

Reduced contribution of a nonsimultaneous mistuned harmonic to residue pitch

Ciocca and Darwin [V. Ciocca and C. J. Darwin, J. Acoust. Soc. Am. 105, 2421-2430 (1999)] reported that the shift in residue pitch caused by mistuning a single harmonic (the fourth out of the first 12) was the same when the mistuned harmonic was presented after the remainder of the complex as when it was simultaneous, even though subjects were asked to ignore the pure-tone percept. The present study tried to replicate this result, and investigated the role of the presence of the nominally mistuned harmonic in the matching sound. Subjects adjusted a "matching" sound so that its pitch equaled that of a subsequent 90-ms complex tone (12 harmonics of a 155-Hz F0), whose mistuned (+/-3%) third harmonic was presented either simultaneously with or after the remaining harmonics. In experiment 1, the matching sound was a harmonic complex whose third harmonic was either present or absent. In experiments 2A and 2B, the target and matching sound had nonoverlapping spectra. Pitch shifts were reduced both when the mistuned component was nonsimultaneous, and when the third harmonic was absent in the matching sound. The results indicate a shorter than originally estimated time window for obligatory integration of nonsimultaneous components into a virtual pitch.     

Hearing a mistuned harmonic in an otherwise periodic complex tone

The ability of a listener to detect a mistuned harmonic in an otherwise periodic tone is representative of the capacity to segregate auditory entities on the basis of steady-state signal cues. By use of a task in which listeners matched the pitch of a mistuned harmonic, this ability has been studied, in order to find dependences on mistuned harmonic number, fundamental frequency, signal level, and signal duration. The results considerably augment the data previously obtained from discrimination experiments and from experiments in which listeners counted apparent sources. Although previous work has emphasized the role of spectral resolution in the segregation process, the present work suggests that neural synchrony is an important consideration; our data show that listeners lose the ability to segregate mistuned harmonics at high frequencies where synchronous neural firing vanishes. The functional form of this loss is insensitive to the spacing of the harmonics. The matching experiment also permits the measurement of the pitches of mistuned harmonics. The data exhibit shifts of a form that argues against models of pitch shifts that are based entirely upon partial masking.     

Perceptual segregation and pitch shifts of mistuned components in harmonic complexes and in regular inharmonic complexes.

It is unclear whether the perceptual segregation of a mistuned harmonic from a periodic complex tone depends specifically on harmonic relations between the other components. A procedure used previously for harmonic complexes [W. M. Hartmann et al., J. Acoust. Soc. Am. 88, 1712-1724 (1990)] was adapted and extended to regular inharmonic complexes. On each trial, subjects heard a 12-component complex followed by a pure tone in a continuous loop. In experiment 1, a mistuning of +/- 4% was applied to one of the components 2-11. The complex was either harmonic, frequency shifted, or spectrally stretched. Subjects adjusted the pure tone to match the pitch of the mistuned component. Near matches were taken to indicate segregation, and were almost as frequent in the inharmonic conditions as in the harmonic case. Also, small but consistent mismatches, pitch shifts, were found in all conditions. These were similar in direction and size to earlier findings for harmonic complexes. Using a range of mistunings, experiment 2 showed that the segregation of components from regular inharmonic complexes could be sensitive to mistunings of 1.5% or less. These findings are consistent with the proposal that aspects of spectral regularity other than harmonic relations can also influence auditory grouping.     

兴奋模式下谐波复合音音高感知机制的研究

通过测量谐波复合音的基频辨别阈,探讨中等\     

Effects of signal envelope on the pitch of short sinusoidal tones

The pitch of short sinusoidal tones with exponentially rising or decaying envelopes is judged higher than the pitch of a gated tone of the same frequency, duration, and energy. The upward pitch shift depends on the rise or decay rate, the intensity, and the frequency. The effect, which requires a nonlinearity in the auditory system, cannot be adequately explained by existing models of hearing. Control experiments on pitch matching for short tones of varying duration and varying intensity are described. These suggest that envelope-induced pitch effects are linked to changes in average intensity, so that they are essentially the same as intensity-induced pitch changes. A model based on these considerations is proposed.     

The influence of duration on the perception of pitch in single and simultaneous complex tones

The influence of duration on the virtual pitch of complex tones was measured using an absolute identification paradigm. If performance with two-tone complexes is expressed in terms of a single central frequency-coding noise function, this function is found to depend on duration in about the same way as the pure-tone difference limen function. The function is further found to be a reasonably good predictor of pitch identification performance with multitone complexes. Another experimental finding was that subjects tend to switch to the analytic mode of pitch perception when complex tones are shortened (i.e., they tend to hear the spectral pitches instead of the virtual ones). A third finding was that with simultaneous complex tones the degradation of each pitch percept depends not only on duration and harmonic order of the tone but also on the harmonic order of the other tone.     

Perception of the low pitch of frequency-shifted complexes

When all of the components in a harmonic complex tone are shifted in frequency by delta f, the pitch of the complex shifts roughly in proportion to delta f. For tones with a small number of components, the shift is usually somewhat larger than predicted from pitch theories, which has been attributed to the influence of combination tones [Smoorenburg, J. Acoust. Soc. Am. 48, 924-941 (1970)]. Experiment 1 assessed whether combination tones influence the pitch of complex tones with more than five harmonics, by using noise to mask the combination tones. The matching stimulus was a harmonic complex. Test complexes were bandpass filtered with passbands centered on harmonic numbers 5 (resolved), 11 (intermediate), or 16 (unresolved) and fundamental frequencies (FOs) were 100, 200, or 400 Hz. For the intermediate and unresolved conditions, the matching stimuli were filtered with the same passband to minimize differences in the excitation patterns of the test and matching stimuli. For the resolved condition, the matching stimulus had a passband centered above that of the test stimulus, to avoid common partials. For resolved and intermediate conditions, pitch shifts were observed that could generally be predicted from the frequencies of the partials. The shifts were unaffected by addition of noise to mask combination tones. For the unresolved condition, no pitch shift was observed, which suggests that pitch is not based on temporal fine structure for stimuli containing only high unresolved harmonics. Experiment 2 used three-component complexes resembling those of Schouten [J. Acoust. Soc. Am. 34, 1418-1424 (1962)]. Nominal harmonic numbers were 3, 4, 5 (resolved), 8, 9, 10 (intermediate), or 13, 14, 15 (unresolved) and F0s were 50, 100, 200, or 400 Hz. Clear shifts in the matches were found for all conditions, including unresolved. For the latter, subjects may have matched the "center of gravity" of the excitation patterns of the test and matching stimuli.     

Detection and F0 discrimination of harmonic complex tones in the presence of competing tones or noise

Normal-hearing listeners' ability to "hear out" the pitch of a target harmonic complex tone (HCT) was tested with simultaneous HCT or noise maskers, all bandpass-filtered into the same spectral region (1200-3600 Hz). Target-to-masker ratios (TMRs) necessary to discriminate fixed fundamental-frequency (F0) differences were measured for target F0s between 100 and 400 Hz. At high F0s (400 Hz), asynchronous gating of masker and signal, presenting the masker in a different F0 range, and reducing the F0 rove of the masker, all resulted in improved performance. At the low F0s (100 Hz), none of these manipulations improved performance significantly. The findings are generally consistent with the idea that the ability to segregate sounds based on cues such as F0 differences and onset/offset asynchronies can be strongly limited by peripheral harmonic resolvability. However, some cases were observed where perceptual segregation appeared possible, even when no peripherally resolved harmonics were present in the mixture of target and masker. A final experiment, comparing TMRs necessary for detection and F0 discrimination, showed that F0 discrimination of the target was possible with noise maskers at only a few decibels above detection threshold, whereas similar performance with HCT maskers was only possible 15-25 dB above detection threshold.     

Perceived continuity and pitch shifts for complex tones with unresolved harmonics

Brief complex tone bursts with fundamental frequencies (F0s) of 100, 125, 166.7, and 250 Hz were bandpass filtered between the 22nd and 30th harmonics, to produce waveforms with five regularly occurring envelope peaks ("pitch pulses") that evoked pitches associated with their repetition period. Two such tone bursts were presented sequentially and separated by a silent interval of two periods (2/F0). When the relative phases of the two bursts were varied, such that the interpulse interval (IPI) between the last pulse of the first burst and the first pulse of the second burst was varied, the pitch of the whole sequence was little affected. This is consistent with previous results suggesting that the pitch integration window may be "reset" by a discontinuity. However, when the interval between the two bursts was filled with a noise with the same spectral envelope as the complex, variations in IPI had substantial effects on the pitch of the sequence. It is suggested that the presence of the noise causes the two tones bursts to appear continuous, hence, resetting does not occur, and the pitch mechanism is sensitive to the phase discontinuity across the silent interval.     

The relation between the human frequency-following response and the low pitch of complex tones

The relation between the auditory brain stem potential called the frequency-following response (FFR) and the low pitch of complex tones was investigated. Eleven complex stimuli were synthesized such that frequency content varied but waveform envelope periodicity was constant. This was accomplished by repeatedly shifting the components of a harmonic complex tone upward in frequency by delta f of 20 Hz, producing a series of six-component inharmonic complex tones with constant intercomponent spacing of 200 Hz. Pitch-shift functions were derived from pitch matches for these stimuli to a comparison pure tone for each of four normal hearing adults with extensive musical training. The FFRs were recorded for the complex stimuli that were judged most divergent in pitch by each subject and for pure-tone signals that were judged equal in pitch to these complex stimuli. Spectral analyses suggested that the spectral content of the FFRs elicited by the complex stimuli did not vary consistently with component frequency or the first effect of pitch shift. Furthermore, complex and pure-tone signals judged equal in pitch did not elicit FFRs of similar spectral content.     

Accuracy of pitch matching for pure tones and for complex tones with overlapping or nonoverlapping harmonics.

The discrimination of the fundamental frequency (fo) of pairs of complex tones with no common harmonics is worse than the discrimination of fo for tones with all harmonics in common. These experiments were conducted to assess whether this effect is a result of pitch shifts between pairs of tones without common harmonics or whether it reflects influences of spectral differences (timbre) on the accuracy of pitch perception. In experiment 1, pitch matches were obtained between sounds drawn from the following types: (1) pure tones (P) with frequencies 100, 200, or 400 Hz; (2) a multiple-component complex tone, designated A, with harmonics 3, 4, 8, 9, 10, 14, 15, and fo = 100, 200, or 400 Hz; (3) A multiple-component complex tone, designated B, with harmonics 5, 6, 7, 11, 12, 13, 16, and with fo = 100, 200 or 400 Hz. The following matches were made; A vs A, B vs B, A vs P, B vs P and P vs P. Pitch shifts were found between the pure tones and the complex tones (A vs P and B vs P), but not between the A and B tones (A vs B). However, the variability of the A vs B matches was significantly greater than that of the A vs A or B vs B matches. Also, the variability of the A vs P and B vs P matches was greater than that for the A vs B matches. In a second experiment, frequency difference limens (DLCs) were measured for the A vs A, B vs B, and A vs B pairs of sounds. The DLCs were larger for the A vs B pair than for A vs A or B vs B. The results suggest that the poor frequency discrimination of tones with no common harmonics does not result from pitch shifts between the tones. Rather, it seems that spectral differences between tones interfere with judgements of their relative pitch.     

Verification of the optimal probabilistic basis of aural processing in pitch of complex tones

Periodicity pitch for complex tones has been quantitatively accounted for by a two-stage process of Fourier-frequency analysis subject to random errors and significant nonlinearities, followed by an harmonic pattern recognizer that makes an optimum probabilistic estimate of the fundamental period of musical and speech sounds. The theory predicts that periodicity pitch is a multimodal probabilistic function of a given stimulus. A clear and empirically supported distinction is made between limitations on the pitch mechanism caused by the stochastic nature of aural frequency representation and by the deterministic resolution bandwidths of aural frequency analysis. This model was developed earlier [J. L. Goldstein, J. Acoust. Soc. Am 54, 1496-1516 (1973)] to account for probabilistic data on pitch errors [A. J. M. Houtsma and J. L. Goldstein, J. Acoust. Soc. Am. 51, 520 (1972)] measured with periodic stimuli comprising two successive harmonics. This paper presents new predictions by the theory that were calculated, with computer simulation where needed, for known probabilistic pitch data from stimuli comprising three to six successive harmonics. Predicted pitch errors increase with increasing errors in estimating the frequencies of stimulus harmonics and decrease as more harmonics are added to the stimulus. Optimum processor theory fully accounts for the multicomponent pitch data on the basis of similar errors in estimating component stimulus frequencies as reported earlier, thus providing further evidence for the optimum probabilistic basis of aural signal processing in pitch of complex tones.     

Modeling and effect of distortion product generated by harmonic complex tones

To study deeply the effect of distortion product on auditory perception, a functional model is proposed to generate distortion products at frequencies below those of primary stimuli. The operations include calculating different power of the stimuli, low pass filtering, searching optimum weights, and summing the weighted signals across all filtering channels. The model uses simulate annealing and genetic algorithm to search the globally optimum weights. Moreover, this paper studies the effect of distortion products on pitch perception for unresolved harmonics based on the proposed model. Results find that distortion products could enhance the resolvability and temporal information of the harmonics. Thus, it is suggested to use background noise with appropriate sound levels to mask distortion products to reduce the effect on pitch perception.