Evidence against an effect of grouping by spectral regularity on the perception of virtual pitch

Two experiments investigated the role of the regularity of the frequency spacing of harmonics, as a separate factor from harmonicity, on the perception of the virtual pitch of a harmonic series. The first experiment compared the shifts produced by mistuning the 3rd, 4th, and 5th harmonics in the pitch of two harmonic series: the odd-H and the all-H tones. The odd-H tone contained odd harmonics 1 to 11, plus the 4th harmonic; the all-H tone contained harmonics 1 to 12. Both tones had a fundamental frequency of 155 Hz. Pitch shifts produced by mistuning the 3rd harmonic, but not the 4th and 5th harmonics, were found to be significantly larger for the odd-H tone than for the all-H tone. This finding was consistent with the idea that grouping by spectral regularity affects pitch perception since an odd harmonic made a larger contribution than an adjacent even harmonic to the pitch of the odd-H tone. However, an alternative explanation was that the 3rd mistuned harmonic produced larger pitch shifts within the odd-H tone than the 4th mistuned harmonic because of differences in the partial masking of these harmonics by adjacent harmonics. The second experiment tested these explanations by measuring pitch shifts for a modified all-H tone in which each mistuned odd harmonic was tested in the presence of the 4th harmonic, but in the absence of its other even-numbered neighbor. The results showed that, for all mistuned harmonics, pitch shifts for the modified all-H tone were not significantly different from those for the odd-H tone. These findings suggest that the harmonic relations among frequency components, rather than the regularity of their frequency spacing, is the primary factor for the perception of the virtual pitch of complex sounds.     

Effects of signal envelope on the pitch of short complex tones

Envelope-induced pitch shifts were measured for exponentially decaying complex tones consisting of two sinusoidal components with frequencies f1 = nf0 + 50 Hz and f2 = (n + 1) f0 + 50 Hz, where n equals 3, 4, or 5 and exponential decay rates were 0, 0.5, 1, and 2 dB/ms. Four subjects adjusted a sinusoidal comparison tone to match the virtual pitch of the (missing) fundamental and the pitches of the lower and upper partials f1 and f2. Pitch shifts for f1 are generally less, and pitch shifts for f2 always greater, than envelope-induced shifts observed in isolated sinusoidal tones of comparable frequency and envelope decay rate. Pitch-shift functions for virtual pitch are similar in magnitude and shape to average pitch-shift functions of the partials, which supports the idea that virtual pitch depends on spectral pitch.     

The integration of nonsimultaneous frequency components into a single virtual pitch

The integration of nonsimultaneous frequency components into a single virtual pitch was investigated by using a pitch matching task in which a mistuned 4th harmonic (mistuned component) produced pitch shifts in a harmonic series (12 equal-amplitude harmonics of a 155-Hz F0). In experiment 1, the mistuned component could either be simultaneous, stop as the target started (pre-target component), or start as the target stopped (post-target component). Pitch shifts produced by the pre-target components were significantly smaller than those obtained with simultaneous components; in the post-target condition, the size of pitch shifts did not decrease relative to the simultaneous condition. In experiment 2, a silent gap of 20, 40, 80, or 160 ms was introduced between the nonsimultaneous components and the target sound. In the pre-target condition, pitch shifts were reduced to zero for silent gaps of 80 ms or longer; by contrast, a gap of 160 ms was required to eliminate pitch shifts in the post-target condition. The third experiment tested the hypothesis that, when post-target components were presented, the processing of the pitch of the target tone started at the onset of the target, and ended at the gap duration at which pitch shifts decreased to zero. This hypothesis was confirmed by the finding that pitch shifts could not be observed when the target tone had a duration of 410 ms. Taken together, the results of these experiments show that nonsimultaneous components that occur after the onset of the target sound make a larger contribution to the virtual pitch of the target, and over a longer period, than components that precede the onset of the target sound.     

Pitch shift of pure and complex tones induced by masking noise

Psychoacoustic experiments were performed to measure the pitch-shift effects of pure and complex tones resulting from the addition of a masking noise to the tonal stimuli. Harmonic residue tones with either two or three harmonics and a fundamental frequency of 200 Hz were chosen as test tones. The pitch shifts of virtual and spectral pitches of the residue tones were measured as a function of the intensity of a low-pass noise with 600-Hz cutoff frequency. The SPL of this noise varied between 30 and 70 dB. In another experiment, the pitch shifts of single pure tones corresponding to the frequencies and SPLs of the harmonics of the residue tones were measured using the same masking noise. The results from five subjects for the harmonic residue tones show only a weak dependence of pitch shift on masking noise intensity. This dependence exists for both spectral and virtual pitches. In the case of single pure tones, pitch shift depends more distinctly on noise intensity. Pitch shifts of up to 5% were found in the range of noise intensity investigated. The magnitude of pitch shift shows pronounced interindividual differences, but the direction of the shift effect is always the same. In all cases pitch increases with higher masking noise levels.     

Influence of rate of change of frequency on the overall pitch of frequency-modulated tones

The mechanism(s) determining pitch may assign less weight to portions of a sound where the frequency is changing rapidly. The present experiments explored the possible effect of this on the overall pitch of frequency-modulated sounds. Pitch matches were obtained between an adjustable unmodulated sinusoid and a sinusoidal carrier that was frequency modulated using a highly asymmetric function with the form of a repeating U or inverted U shaped function. The amplitude was constant during the 400-ms presentation time of each stimulus, except for 10-ms raised-cosine onset and offset ramps. In experiment 1, the carrier level was 50 dB SPL and the geometric mean of the instantaneous frequency of the modulated carrier, fc, was either 0.5, 1, 2, or 8 kHz. The modulation rate (fm) was 5, 10, or 20 Hz. The overall depth (maximum to minimum) of the FM was 8% of fc. For all carrier frequencies, the matched frequency was shifted away from the mean carrier frequency, downwards for the U shaped function stimuli and upwards for the repeated inverted U shaped function stimuli. The shift was typically slightly greater than 1% of fc, and did not vary markedly with fc. The effect of fm was small, but there was a trend for the shifts to decrease with increasing fm for fc = 0.5 kHz and to increase with increasing fm for fc = 2 kHz. In experiment 2, the carrier level was reduced to 20 dB SL and matches were obtained only for fc = 2 kHz. Shifts in matched frequency of about 1% were still observed, but the trend for the shifts to increase with increasing fm no longer occurred. In experiment 3, matches were obtained for a 4-kHz carrier at 50 dB SPL. Shifts of about 1% again occurred, which did not vary markedly with fm. The shifts in matched frequency observed in all three experiments are not predicted by models based on the amplitude- or intensity-weighted average of instantaneous frequency (EWAIF or IWAIF). The shifts (and the pitch shifts observed earlier for two-tone complexes and for stimuli with simultaneous AM and FM) are consistent with a model based on the assumption that the overall pitch of a frequency-modulated sound is determined from a weighted average of period estimates, with the weight attached to a given estimate being inversely related to the short-term rate of change of period and directly related to a compressive function of the amplitude.     

Pure-tone pitch anomalies. II. Pitch-intensity effects and diplacusis in impaired ears

Pitch-intensity functions and psychophysical tuning curves (PTC's) were measured in ten listeners with sensorineural impairments of presumed cochlear origin. Masking patterns, frequency jnd's, diplacusis measurements, and octave adjustments were also obtained for selected conditions in selected listeners. The results showed a tendency for increased frequency jnd's and increased pitch-matching variability in frequency regions where frequency resolution, as determined by PTC Q10 estimates, was degraded. The results also showed exaggerated pitch-level effects, both in regions where frequency resolution was degraded and, in many cases, in regions where thresholds and frequency resolution were apparently normal. The usual manifestation of exaggerated pitch-level effect was an abnormally large negative pitch shift with increasing level, particularly at low frequencies. The limited data from diplacusis measurements and octave adjustments suggest that the exaggerated negative pitch shifts are the consequence of a large increase in pitch at low stimulus levels which "recruits" at higher levels. These results are difficult to explain with simple tonotopic models, or presently formulated temporal models, of pure-tone pitch encoding.     

Grouping in pitch perception: effects of onset asynchrony and ear of presentation of a mistuned component.

Three experiments investigated how the onset asynchrony and ear of presentation of a single mistuned frequency component influence its contribution to the pitch of an otherwise harmonic complex tone. Subjects matched the pitch of the target complex by adjusting the pitch of a second similar but strictly periodic complex tone. When the mistuned component (the 4th harmonic of a 155 Hz fundamental) started 160 ms or more before the remaining harmonics but stopped simultaneously with them, it made a reduced contribution to the pitch of the complex. It made no contribution if it started more than 300 ms before. Pitch shifts and their reduction with onset time were larger for short (90 ms) sounds than for long (410 ms). Pitch shifts were slightly larger when the mistuned component was presented to the same ear as the remaining 11 in-tune harmonics than to the opposite ear. Adding a "captor" complex tone with a fundamental of 200 Hz and a missing 3rd harmonic to the contralateral ear did not augment the effect of onset time, even though the captor was synchronous with the mistuned harmonic, the mistuned component was equal in frequency to the missing 3rd harmonic of the captor complex tone and it was played to the same ear as the captor. The results show that a difference in onset time can prevent a resolved frequency component from contributing to the pitch of a complex tone even though it is present throughout that complex tone.     

Accuracy of pitch matching for pure tones and for complex tones with overlapping or nonoverlapping harmonics.

The discrimination of the fundamental frequency (fo) of pairs of complex tones with no common harmonics is worse than the discrimination of fo for tones with all harmonics in common. These experiments were conducted to assess whether this effect is a result of pitch shifts between pairs of tones without common harmonics or whether it reflects influences of spectral differences (timbre) on the accuracy of pitch perception. In experiment 1, pitch matches were obtained between sounds drawn from the following types: (1) pure tones (P) with frequencies 100, 200, or 400 Hz; (2) a multiple-component complex tone, designated A, with harmonics 3, 4, 8, 9, 10, 14, 15, and fo = 100, 200, or 400 Hz; (3) A multiple-component complex tone, designated B, with harmonics 5, 6, 7, 11, 12, 13, 16, and with fo = 100, 200 or 400 Hz. The following matches were made; A vs A, B vs B, A vs P, B vs P and P vs P. Pitch shifts were found between the pure tones and the complex tones (A vs P and B vs P), but not between the A and B tones (A vs B). However, the variability of the A vs B matches was significantly greater than that of the A vs A or B vs B matches. Also, the variability of the A vs P and B vs P matches was greater than that for the A vs B matches. In a second experiment, frequency difference limens (DLCs) were measured for the A vs A, B vs B, and A vs B pairs of sounds. The DLCs were larger for the A vs B pair than for A vs A or B vs B. The results suggest that the poor frequency discrimination of tones with no common harmonics does not result from pitch shifts between the tones. Rather, it seems that spectral differences between tones interfere with judgements of their relative pitch.     

Mistuning a harmonic of a vowel: grouping and phase effects on vowel quality

The harmonic sieve has been proposed as a mechanism for excluding extraneous frequency components from the estimate of the pitch of a complex sound. The experiments reported here examine whether a harmonic sieve could also determine whether a particular harmonic contributes to the phonetic quality of a vowel. Mistuning a harmonic in the first formant region of vowels from an /I/-/e/ continuum gave shifts in the phoneme boundary that could be explained by (i) phase effects for small amounts of mistuning and (ii) a harmonic sievelike grouping mechanism for larger amounts of mistuning. Similar grouping criteria to those suggested for pitch may operate for the determination of first formant frequency in voiced speech.     

Perception of the low pitch of frequency-shifted complexes

When all of the components in a harmonic complex tone are shifted in frequency by delta f, the pitch of the complex shifts roughly in proportion to delta f. For tones with a small number of components, the shift is usually somewhat larger than predicted from pitch theories, which has been attributed to the influence of combination tones [Smoorenburg, J. Acoust. Soc. Am. 48, 924-941 (1970)]. Experiment 1 assessed whether combination tones influence the pitch of complex tones with more than five harmonics, by using noise to mask the combination tones. The matching stimulus was a harmonic complex. Test complexes were bandpass filtered with passbands centered on harmonic numbers 5 (resolved), 11 (intermediate), or 16 (unresolved) and fundamental frequencies (FOs) were 100, 200, or 400 Hz. For the intermediate and unresolved conditions, the matching stimuli were filtered with the same passband to minimize differences in the excitation patterns of the test and matching stimuli. For the resolved condition, the matching stimulus had a passband centered above that of the test stimulus, to avoid common partials. For resolved and intermediate conditions, pitch shifts were observed that could generally be predicted from the frequencies of the partials. The shifts were unaffected by addition of noise to mask combination tones. For the unresolved condition, no pitch shift was observed, which suggests that pitch is not based on temporal fine structure for stimuli containing only high unresolved harmonics. Experiment 2 used three-component complexes resembling those of Schouten [J. Acoust. Soc. Am. 34, 1418-1424 (1962)]. Nominal harmonic numbers were 3, 4, 5 (resolved), 8, 9, 10 (intermediate), or 13, 14, 15 (unresolved) and F0s were 50, 100, 200, or 400 Hz. Clear shifts in the matches were found for all conditions, including unresolved. For the latter, subjects may have matched the "center of gravity" of the excitation patterns of the test and matching stimuli.     

Pitch shifts for complex tones with unresolved harmonics and the implications for models of pitch perception

Complex tone bursts were bandpass filtered, 22nd-30th harmonic, to produce waveforms with five regularly occurring envelope peaks ("pitch pulses") that evoked pitches associated with their repetition period. Two such tone bursts were presented sequentially and separated by an interpulse interval (IPI). When the IPI was varied, the pitch of the whole sequence was shifted by between +2% and -5%. When the IPI was greater than one period, little effect was seen. This is consistent with a pitch mechanism employing a long integration time for continuous stimuli that resets in response to temporal discontinuities of greater than about one period of the waveform. Similar pitch shifts were observed for fundamental frequencies from 100 to 250 Hz. The pitch shifts depended on the IPI duration relative to the period of the complex, not on the absolute IPI duration. The pitch shifts are inconsistent with the autocorrelation model of Meddis and O'Mard [J. Acoust. Soc. Am. 102, 1811-1820 (1997)], although a modified version of the weighted mean-interval model of Carlyon et al. [J. Acoust. Soc. Am. 112, 621-633 (2002)] was successful. The pitch shifts suggest that, when two pulses occur close together, one of the pulses is ignored on a probabilistic basis.     

Hearing a mistuned harmonic in an otherwise periodic complex tone

The ability of a listener to detect a mistuned harmonic in an otherwise periodic tone is representative of the capacity to segregate auditory entities on the basis of steady-state signal cues. By use of a task in which listeners matched the pitch of a mistuned harmonic, this ability has been studied, in order to find dependences on mistuned harmonic number, fundamental frequency, signal level, and signal duration. The results considerably augment the data previously obtained from discrimination experiments and from experiments in which listeners counted apparent sources. Although previous work has emphasized the role of spectral resolution in the segregation process, the present work suggests that neural synchrony is an important consideration; our data show that listeners lose the ability to segregate mistuned harmonics at high frequencies where synchronous neural firing vanishes. The functional form of this loss is insensitive to the spacing of the harmonics. The matching experiment also permits the measurement of the pitches of mistuned harmonics. The data exhibit shifts of a form that argues against models of pitch shifts that are based entirely upon partial masking.     

Frequency discrimination near the spectral edge of simultaneous and forward maskers

The effects of the presence of an amplitude discontinuity in the spectrum of a noise masker on frequency discrimination performance were examined. First, detection thresholds as a function of masker level were obtained for pure-tone signals masked by either simultaneous or forward white and low-pass maskers. Then frequency discrimination thresholds were obtained using four masker levels that were chosen to yield predetermined masked thresholds, with signal levels corresponding to each of three sensation levels above these masked thresholds. The principal results indicate that frequency discrimination is poorer in simultaneous low-pass noise than in simultaneous white noise, and that this difference in performance increases with increasing sensation level and with increasing masker level. These results are inconsistent with an explanation based on the pitches generated at spectral edges ("edge pitch"), pitch shifts, or disruption of phase-locking information, but are generally consistent with an explanation based on lateral suppression. It is proposed that a release from suppression may occur in filtered noise backgrounds at high noise levels and at high sensation levels. The reduced suppression may result in poorer frequency discrimination due, in part, to reduced signal detectability.     

Nonconscious control of fundamental voice frequency

The aim of this paper is to answer the question whether "perception-action" dissociation, which is well documented in vision, may also be found in auditory information processing. Trained singers were asked to produce vowel sounds into a microphone. The sound that each singer produced was fed back to their ears via headphones. Two seconds after the sound production had begun, the auditory feedback was shifted in pitch by a certain degree (9, 19, 50, or 99 cents in either direction). In every set of sounds, instances without any pitch shifts also appeared. After each trial, participants reported whether they were aware of a pitch change or not. It was found that even though the participants were unaware of subtle pitch changes, the fundamental frequency of their vowel production was found to shift slightly in the opposite direction to the pitch shift. These results show that auditory information is processed by two separate systems: one for perception and one for action. They also show that the function of the auditory control system differs from the visual control system. The latter is used to control bodily movements while the function of the former is a nonconscious, instant control of vocalization.     

Maximum speed of pitch change and how it may relate to speech

How fast speakers can change pitch voluntarily is potentially an important articulatory constraint for speech production. Previous attempts at assessing the maximum speed of pitch change have helped improve understanding of certain aspects of pitch production in speech. However, since only "response time"--time needed to complete the middle 75% of a pitch shift--was measured in previous studies, direct comparisons with speech data have been difficult. In the present study, a new experimental paradigm was adopted in which subjects produced rapid successions of pitch shifts by imitating synthesized model pitch undulation patterns. This permitted the measurement of the duration of entire pitch shifts. Native speakers of English and Mandarin participated as subjects. The speed of pitch change was measured both in terms of response time and excursion time-time needed to complete the entire pitch shift. Results show that excursion time is nearly twice as long as response time. This suggests that physiological limitation on the speed of pitch movement is greater than has been recognized. Also, it is found that the maximum speed of pitch change varies quite linearly with excursion size, and that it is different for pitch rises and falls. Comparisons of present data with data on speed of pitch change from studies of real speech found them to be largely comparable. This suggests that the maximum speed of pitch change is often approached in speech, and that the role of physiological constraints in determining the shape and alignment of F0 contours in speech is probably greater than has been appreciated.     

Effects of asynchrony and ear of presentation on the pitch of mistuned partials in harmonic and frequency-shifted complex tones

When a partial of a periodic complex is mistuned, its change in pitch is greater than expected. Two experiments examined whether these partial-pitch shifts are related to the computation of global pitch. In experiment 1, stimuli were either harmonic or frequency-shifted (25% of F0) complexes. One partial was mistuned by +/- 4% and played with leading and lagging portions of 500 ms each, relative to the other components (1 s), in both monaural and dichotic contexts. Subjects indicated whether the mistuned partial was higher or lower in pitch when concurrent with the other components. Responses were positively correlated with the direction of mistuning in all conditions. In experiment 2, stimuli from each condition were compared with synchronous equivalents. Subjects matched a pure tone to the pitch of the mistuned partial (component 4). The results showed that partial-pitch shifts are not reduced in size by asynchrony. Similar asynchronies are known to produce a near-exclusion of a mistuned partial from the global-pitch computation. This mismatch indicates that global and partial pitch are derived from different processes. The similarity of the partial-pitch shifts observed for harmonic and frequency-shifted stimuli suggests that they arise from a grouping mechanism that is sensitive to spectral regularity.     

A psychophysical pitch function determined by absolute magnitude estimation and its relation to the musical pitch scale

A psychophysical pitch function, describing the relation of perceived magnitude of pitch to the frequency of a pure tone, was determined by absolute magnitude estimation. Pitch estimates were made by listeners with relative pitch and by absolute pitch possessors for 27 tones spanning a frequency range of 31.5-12,500 Hz in 1/3 octave steps. Results show that the pitch function, plotted in log-log coordinates, is steeper below 200 Hz than at higher frequencies. It is hypothesized that the pitch function's bend may reflect the diversity of neurophysiological mechanisms of pitch encoding in frequency ranges below and above 200 Hz. The variation of the function's slope implies that pitch distances between tones with the same frequency ratios are perceived as larger below 200 Hz than at higher frequencies. It is argued that this implication may apply only to a purely sensory concept of pitch distance and cannot be extended to the perception of musical intervals, a phenomenon governed by musical cognitive principles. The results also show that pitch functions obtained for listeners with relative and absolute pitch have a similar shape, which means that quantitative pitch relations determined for both groups of listeners do not differ appreciably along the frequency scale.     

Voice F0 responses to pitch-shifted auditory feedback: a preliminary study

Auditory feedback has been suggested to be important for voice fundamental frequency (F₀) control. The present study featured a new technique for testing this hypothesis by which the pitch of a subject's voice was modulated, fed back over earphones, and the resultant change in the emitted voice F₀ was measured. The responses of 67 normal, healthy young adults were recorded as they attempted to ignore intermittent upward or downward shifts in pitch feedback while they sustained steady vowel sounds (/a/) or sang musical scales. Ninety-six percent of subjects increased their F₀ when the feedback pitch was decreased, and 78% of subjects decreased their F₀ when the pitch feedback was increased. Latencies of responses ranged from 104 to 223 ms. Results indicate people normally rely on pitch feedback to control voice F₀.     

Pitch matches between unresolved complex tones differing by a single interpulse interval

The experiment compared the pitches of complex tones consisting of unresolved harmonics. The fundamental frequency (F0) of the tones was 250 Hz and the harmonics were bandpass filtered between 5500 and 7500 Hz. Two 20-ms complex-tone bursts were presented, separated by a brief gap. The gap was an integer number of periods of the waveform: 0, 4, or 8 ms. The envelope phase of the second tone burst was shifted, such that the interpulse interval (IPI) across the gap was reduced or increased by 0.25 or 0.75 periods (1 or 3 ms). A "no shift" control was also included, where the IPI was held at an integer number of periods. Pitch matches were obtained by varying the F0 of a comparison tone with the same temporal parameters as the standard but without the shift. Relative to the no-shift control, the variations in IPI produced substantial pitch shifts when there was no gap between the bursts, but little effect was seen for gaps of 4 or 8 ms. However, for some conditions with the same IPI in the shifted interval, an increase in the IPI of the comparison interval from 4 to 8 ms (gap increased from 0 to 4 ms) changed the pitch match. The presence of a pitch shift suggests that the pitch mechanism is integrating information across the two tone bursts. It is argued that the results are consistent with a pitch mechanism employing a long integration time for continuous stimuli that is reset in response to temporal discontinuities. For a 250-Hz F0, an 8-ms IPI may be sufficient for resetting. Pitch models based on a spectral analysis of the simulated neural spike train, on an autocorrelation of the spike train, and on the mean rate of pitch pulses, all failed to account for the observed pitch matches.     

Pitch strength and pitch dominance of iterated rippled noises in hearing-impaired listeners.

Reports using a variety of psychophysical tasks indicate that pitch perception by hearing-impaired listeners may be abnormal, contributing to difficulties in understanding speech and enjoying music. Pitches of complex sounds may be weaker and more indistinct in the presence of cochlear damage, especially when frequency regions are affected that form the strongest basis for pitch perception in normal-hearing listeners. In this study, the strength of the complex pitch generated by iterated rippled noise was assessed in normal-hearing and hearing-impaired listeners. Pitch strength was measured for broadband noises with spectral ripples generated by iteratively delaying a copy of a given noise and adding it back into the original. Octave-band-pass versions of these noises also were evaluated to assess frequency dominance regions for rippled-noise pitch. Hearing-impaired listeners demonstrated consistently weaker pitches in response to the rippled noises relative to pitch strength in normal-hearing listeners. However, in most cases, the frequency regions of pitch dominance, i.e., strongest pitch, were similar to those observed in normal-hearing listeners. Except where there exists a substantial sensitivity loss, contributions from normal pitch dominance regions associated with the strongest pitches may not be directly related to impaired spectral processing. It is suggested that the reduced strength of rippled-noise pitch in listeners with hearing loss results from impaired frequency resolution and possibly an associated deficit in temporal processing.