Acoustic correlates of timbre space dimensions: a confirmatory study using synthetic tones

Timbre spaces represent the organization of perceptual distances, as measured with dissimilarity ratings, among tones equated for pitch, loudness, and perceived duration. A number of potential acoustic correlates of timbre-space dimensions have been proposed in the psychoacoustic literature, including attack time, spectral centroid, spectral flux, and spectrum fine structure. The experiments reported here were designed as direct tests of the perceptual relevance of these acoustical parameters for timbre dissimilarity judgments. Listeners presented with carefully controlled synthetic tones use attack time, spectral centroid, and spectrum fine structure in dissimilarity rating experiments. These parameters thus appear as major determinants of timbre. However, spectral flux appears as a less salient timbre parameter, its salience depending on the number of other dimensions varying concurrently in the stimulus set. Dissimilarity ratings were analyzed with two different multidimensional scaling models (CLASCAL and CONSCAL), the latter providing psychophysical functions constrained by the physical parameters. Their complementarity is discussed.     

Dissimilarity and the Classification of Male Singing Voices

Traditionally, timbre has been defined as that perceptual attribute that differentiates two sounds when pitch and loudness are equal, and thus is a measure of dissimilarity. By such a definition, each voice possesses a set of timbres, and the ability to identify any voice or voice category across different pitch-loudness-vowel combinations must be due to an ability to "link" these timbres by abstracting the "timbre transformation," the manner in which timbre subtly changes across pitch and loudness for a specific voice or voice category. Using stimuli produced across the singing range by singers from different voice categories, this study sought to examine how timbre and pitch interact in the perception of dissimilarity in male singing voices. This study also investigated whether or not listener experience affects the perception of timbre as a function of pitch. The resulting multidimensional scaling (MDS) representations showed that for all stimuli and listeners, dimension 1 correlated with pitch, while dimension 2 correlated with spectral centroid and separated vocal stimuli into the categories baritone and tenor. Dimension 3 appeared highly idiosyncratic depending on the nature of the stimuli and on the experience of the listener. Inexperienced listeners appeared to rely more heavily on pitch in making dissimilarity judgments than did experienced listeners. The resulting MDS representations of dissimilarity across pitch provide a glimpse of the timbre transformation of voice categories across pitch.     

Influence of spectral locus and F0 changes on the pitch and timbre of complex tones.

Harmonic complex tones comprising components in different spectral regions may differ considerably in timbre. While the pitch of "residue" tones of this type has been studied extensively, their timbral properties have received little attention. Discrimination of F0 for such tones is typically poorer than for complex tones with "corresponding" harmonics [A. Faulkner, J. Acoust. Soc. Am. 78, 1993-2004 (1985)]. The F0 DLs may be higher because timbre differences impair pitch discrimination. The present experiment explores effects of changes in spectral locus and F0 of harmonic complex tones on both pitch and timbre. Six normally hearing listeners indicated if the second tone of a two-tone sequence was: (1) same, (2) higher in pitch, (3) lower in pitch, (4) same in pitch but different in "something else," (5) higher in pitch and different in "something else," or (6) lower in pitch and different in "something else" than the first. ("Something else" is assumed to represent timbre.) The tones varied in spectral loci of four equal-amplitude harmonics m, m + 1, m + 2, and m + 3 (m = 1,2,3,4,5,6) and ranged in F0 from 200 to 200 +/- 2n Hz (n = 0,1,2,4,8,16,32). Results show that changes in F0 primarily affect pitch, and changes in spectral locus primarily affect timbre. However, a change in spectral locus can also influence pitch. The direction of locus change was reported as the direction of pitch change, despite no change in F0 or changes in F0 in the opposite direction for delta F0 < or = 0-2%. This implies that listeners may be attending to the "spectral pitch" of components, or to changes in a timbral attribute like "sharpness," which are construed as changes in overall pitch in the absence of strong F0 cues. For delta F0 > or = 2%, the direction of reported pitch change accord with the direction of F0 change, but the locus change continued to be reported as a timbre change. Rather than spectral-pitch matching of corresponding components, a context-dependent spectral evaluation process is thus implied in discernment of changes in pitch and timbre. Relative magnitudes of change in derived features of the spectrum such as harmonic number and F0, and absolute features such as spectral frequencies are compared. What is called "spectral pitch," contributes to the overall pitch, but also appears to be an important dimension of the multidimensional percept, timbre.     

Does fundamental-frequency discrimination measure virtual pitch discrimination?

Studies of pitch perception often involve measuring difference limens for complex tones (DLCs) that differ in fundamental frequency (F0). These measures are thought to reflect F0 discrimination and to provide an indirect measure of subjective pitch strength. However, in many situations discrimination may be based on cues other than the pitch or the F0, such as differences in the frequencies of individual components or timbre (brightness). Here, DLCs were measured for harmonic and inharmonic tones under various conditions, including a randomized or fixed lowest harmonic number, with and without feedback. The inharmonic tones were produced by shifting the frequencies of all harmonics upwards by 6.25%, 12.5%, or 25% of F0. It was hypothesized that, if DLCs reflect residue-pitch discrimination, these frequency-shifted tones, which produced a weaker and more ambiguous pitch than would yield larger DLCs than the harmonic tones. However, if DLCs reflect comparisons of component pitches, or timbre, they should not be systematically influenced by frequency shifting. The results showed larger DLCs and more scattered pitch matches for inharmonic than for harmonic complexes, confirming that the inharmonic tones produced a less consistent pitch than the harmonic tones, and consistent with the idea that DLCs reflect F0 pitch discrimination.     

Dissimilarity and the Classification of Female Singing Voices: A Preliminary Study

Traditionally, timbre has been defined as that perceptual attribute that differentiates two sounds when pitch and loudness are equal and thus is a measure of dissimilarity. By such a definition, each voice possesses a set of timbres, and the identity of any voice or voice category across different pitch-loudness-vowel combinations must be due to an abstraction of the pattern of timbre transformation. Using stimuli produced across the singing range by singers from different voice categories, this study sought to examine how timbre and pitch interact in the perception of dissimilarity. This study also investigated whether listener experience affects the perception of timbre as a function of pitch. The resulting multidimensional scaling (MDS) representations showed that for all stimuli and listeners, dimension 1 correlated with pitch, whereas dimension 2 correlated with spectral centroid and separated vocal stimuli into the categories mezzo-soprano and soprano. Dimension 3 appeared highly idiosyncratic depending on the nature of the stimuli and on the experience of the listener. Inexperienced listeners appeared to rely more heavily on pitch in making dissimilarity judgments than did experienced listeners. The resulting MDS representations of dissimilarity across pitch provide a glimpse of the timbre transformation of voice categories across pitch.     

Frequency discrimination of complex tones with overlapping and non-overlapping harmonics

These experiments address the following issues. (1) When two complex tones contain different harmonics, do the differences in timbre between them impair the ability to discriminate the pitches of the tones? (2) When two complex tones have only a single component in common, and that component is the most discriminable component in each tone, is the frequency discrimination of the component affected by differences in residue pitch between the two tones? (3) How good is the pitch discrimination of complex tones with no common components when each tone contains multiple harmonics, so as to avoid ambiguity of pitch? (4) Is the pitch discrimination of complex tones with common harmonics impaired by shifting the component frequencies to nonharmonic values? In all experiments, frequency difference limens (DLCs) were measured for multiple-component complex tones, using an adaptive two-interval, two-alternative, forced-choice task. Three highly trained subjects were used. The main conclusions are as follows. (1) When two tones have the first six harmonics in common, DLCs are larger when the upper harmonics are different than when the upper harmonics are in common or are absent. It appears that differences in timbre impair DLCs. (2) Discrimination of the frequency of a single common partial in two complex tones is worse when the two tones have different residue pitches than when they have the same residue pitch. (3) DLCs for complex tones with no common harmonics are generally larger than those for complex tones with common harmonics. For the former, large individual differences occur, probably because subjects are affected differently by differences in timbre. (4) DLCs for harmonic complex tones are smaller than DLCs for complex tones in which the components are mistuned from harmonic values. This can probably be attributed to the less distinct residue pitch of the inharmonic complexes, rather than to reduced discriminability of partials. Overall, the results support the idea that DLCs for complex tones with common harmonics depend on residue pitch comparisons, rather than on comparisons of the pitches of partials.     

The dependency of timbre on fundamental frequency

The dependency of the timbre of musical sounds on their fundamental frequency (F0) was examined in three experiments. In experiment I subjects compared the timbres of stimuli produced by a set of 12 musical instruments with equal F0, duration, and loudness. There were three sessions, each at a different F0. In experiment II the same stimuli were rearranged in pairs, each with the same difference in F0, and subjects had to ignore the constant difference in pitch. In experiment III, instruments were paired both with and without an F0 difference within the same session, and subjects had to ignore the variable differences in pitch. Experiment I yielded dissimilarity matrices that were similar at different F0's, suggesting that instruments kept their relative positions within timbre space. Experiment II found that subjects were able to ignore the salient pitch difference while rating timbre dissimilarity. Dissimilarity matrices were symmetrical, suggesting further that the absolute displacement of the set of instruments within timbre space was small. Experiment III extended this result to the case where the pitch difference varied from trial to trial. Multidimensional scaling (MDS) of dissimilarity scores produced solutions (timbre spaces) that varied little across conditions and experiments. MDS solutions were used to test the validity of signal-based predictors of timbre, and in particular their stability as a function of F0. Taken together, the results suggest that timbre differences are perceived independently from differences of pitch, at least for F0 differences smaller than an octave. Timbre differences can be measured between stimuli with different F0's.     

笙的簧片物理参数与音色相关性的初步研究

为了改善笙的声音品质,本文研究了笙的簧片物理尺度与笙的音色之间的相关性。在提出笙的物理模型并验证其有效性的基础上,固定音高,改变簧舌的厚度、长度以及缝隙宽度,合成一组笙的声样本。通过对偶比较法以及多维尺度法分析笙的音色空间,根据簧舌参数及音色特征量解释该音色空间的物理意义,并从发声原理比较簧舌参数对音色的作用。结果表明,音高一定时,簧舌宽度对音色的作用可忽略,厚度(及长度)和缝隙宽度对音色的作用相似,但影响方式不同。改变簧舌物理参数所形成的二维音色空间与声音的对数起振时间、频谱丰富性以及频谱不规则度有关。起振特征与频谱丰富性特征存在共变关系,通过改变这两个特征,能够改变音色的明亮度和柔软度。     

The Relationship Between Vocal Pitch-Matching Skills and Pitch Discrimination Skills in Untrained Accurate and Inaccurate Singers

Few studies have compared the relationship between pitch discrimination accuracy and the accuracy of fundamental frequency (F(o)) control. This study investigated the relationship between vocal pitch-matching skills, which is one method of testing F(o) control, and pitch discrimination skills in untrained accurate and inaccurate singers, and the effect of timbre on their pitch discrimination accuracy. Data showed that accurate singers had more precise discrimination and pitch-matching abilities compared with their inaccurate counterparts. Pitch discrimination was differentially affected by the timbre (eg, spectral differences) of comparison tones. In addition, results showed a significant relationship between pitch discrimination abilities and pitch-matching accuracy. The results suggest that accurate F(o) control is at least partially dependent on pitch discrimination abilities, which are important for accurate singing.     

Can listeners hear who is singing? A comparison of three-note and six-note discrimination tasks

Timbre is typically investigated as a perceptual attribute that differentiates a sound source at one pitch and loudness. Yet the perceptual usefulness of timbre is that it allows the listener to recognize one sound source at different pitches. This paper investigated the ability of listeners to identify which pitch in an ascending or descending sequence of three or six stimuli was sung by a different singer. For three-note sequences, the task was extremely difficult, and with rare exceptions, listeners chose the most dissimilarly pitched stimulus as coming from the oddball singer. For six-note sequences, the detection of the oddball singer was much improved in spite of the added complexity of the task. These results support the idea that timbre should be understood as a transformation that connects the different sounds of one source and that a "rich" set of sounds is necessary to discover the trajectory.     

Accuracy of pitch matching for pure tones and for complex tones with overlapping or nonoverlapping harmonics.

The discrimination of the fundamental frequency (fo) of pairs of complex tones with no common harmonics is worse than the discrimination of fo for tones with all harmonics in common. These experiments were conducted to assess whether this effect is a result of pitch shifts between pairs of tones without common harmonics or whether it reflects influences of spectral differences (timbre) on the accuracy of pitch perception. In experiment 1, pitch matches were obtained between sounds drawn from the following types: (1) pure tones (P) with frequencies 100, 200, or 400 Hz; (2) a multiple-component complex tone, designated A, with harmonics 3, 4, 8, 9, 10, 14, 15, and fo = 100, 200, or 400 Hz; (3) A multiple-component complex tone, designated B, with harmonics 5, 6, 7, 11, 12, 13, 16, and with fo = 100, 200 or 400 Hz. The following matches were made; A vs A, B vs B, A vs P, B vs P and P vs P. Pitch shifts were found between the pure tones and the complex tones (A vs P and B vs P), but not between the A and B tones (A vs B). However, the variability of the A vs B matches was significantly greater than that of the A vs A or B vs B matches. Also, the variability of the A vs P and B vs P matches was greater than that for the A vs B matches. In a second experiment, frequency difference limens (DLCs) were measured for the A vs A, B vs B, and A vs B pairs of sounds. The DLCs were larger for the A vs B pair than for A vs A or B vs B. The results suggest that the poor frequency discrimination of tones with no common harmonics does not result from pitch shifts between the tones. Rather, it seems that spectral differences between tones interfere with judgements of their relative pitch.     

Ambisonics声捡拾与重放音色的双耳听觉模型分析与实验

提出用双耳听觉模型对空间声音色进行分析的普遍方法,并以Ambisonics为例进行了分析。Ambisonics是基于物理声场重构的空间声系统,其最终重构声场误差以及音色改变是由传声器捡拾和重放空间混叠误差共同引起的。采用修正的Moore双耳响度模型计算了Ambisonics重构声场的双耳响度级谱并和目标声场的情况比较,从而定量评价重构声场的音色改变。结果表明,在理想捡拾信号的情况下,无音色改变重放的上限频率和区域大小随Ambisonics的阶数而增加。而对于传声器阵列捡拾的情况,只要阵列的上限频率大于Ambisonics重放的上限频率,在重放的上限频率以下,传声器阵列空间混叠误差对最终重构声场及其感知音色的影响就可以忽略。在此基础上,提出了一种综合考虑捡拾与重放性能的Ambisonics系统优化设计方法。心理声学实验得到了和双耳听觉模型一致的结果,从而也验证了模型分析的有效性。      

Analysis with binaural auditory model and experiment on the timbre of Ambisonics recording and reproduction

A scheme for analyzing the timbre in spatial sound with binaural auditory model is proposed and the Ambisonics is taken as an example for analysis.Ambisonics is a spatial sound system based on physical sound field reconstruction.The errors and timbre colorations in the final reconstructed sound field depend on the spatial aliasing errors on both the recording and reproducing stages of Ambisonics.The binaural loudness level spectra in Ambisonics reconstruction is calculated by using Moore's revised loudness model and then compared with the result of real sound source,so as to evaluate the timbre coloration in Ambisonics quantitatively.The results indicate that,in the case of ideal independent signals,the high-frequency limit and radius of region without perceived timbre coloration increase with the order of Ambisonics.On the other hand,in the case of recording by microphone array,once the high-frequency limit of microphone array exceeds that of sound field reconstruction,array recording influences little on the binaural loudness level spectra and thus timbre in final reconstruction up to the highfrequency limit of reproduction.Based on the binaural auditory model analysis,a scheme for optimizing design of Ambisonics recording and reproduction is also suggested.The subjective experiment yields consistent results with those of binaural model,thus verifies the effectiveness of the model analysis.     

Interactions between test- and inducer-tone durations in induced loudness reduction

A tone usually declines in loudness when preceded by a more intense inducer tone. This phenomenon is called "loudness recalibration" or "induced loudness reduction" (ILR). The present study investigates how ILR depends on level, loudness, and duration. A 2AFC procedure was used to obtain loudness matches between 2500-Hz comparison tones and 500-Hz test tones at 60 and 70 dB SPL, presented with and without preceding 500-Hz inducer tones. For 200-ms test and comparison tones, the amount of ILR did not depend on inducer level (set at 80 dB SPL and above), but ILR was greater with 200- than with 5-ms inducers, even when both were equally loud. For 5-ms tones, ILR was as great with 5- as with 200-ms inducers and about as great as when test and inducer tones both lasted 200 ms. These results suggest that (1) neither the loudness nor the SPL of the inducer alone governs ILR, and (2) inducer duration must equal or exceed test-tone duration to yield maximal amounts of ILR. Further analysis indicates that the efferent system may be partly responsible for ILR of 200-ms test tones, but is unlikely to account for ILR of 5-ms tones.     

The subjective assessment of trombone quality

A number of subjective experiments designed not only to assess the tonal and playing qualities of trombones but also to aid the interpretation of objective data is described. Quantifying multi-dimensional quantities such as timbre or quality is usually attempted either by multi-dimensional scaling (MDS) or by semantic differential scaling (SDS) and the advantages and disadvantages of each for the present purpose are briefly reviewed. For both methods additional information is needed either (for SDS) to aid the selection of scales, or (for MDS) to interpret the final results of the computer analysis; in this study such information is available from the investigations of Edwards [1]. A preliminary experiment testing the ability of subjects to rate trombone timbre using SDS showed that the intersubject variance was very large but that the order of factors governing timbre is (i) instrument, (ii) player and (iii) mouthpiece. A second experiment shows that pitch and loudness have a much greater influence on listener's ratings than do player, mouthpiece of instrument. Players' attitudes tested in further experiments show that the task of discriminating instruments when extraneous cues are removed is very hard indeed for most players, but a very few can be of quite remarkable discriminatory ability using either SDS or MDS. Results from one such player indicate clearly that timbre is the predominant acoustic factor deciding discrimination.     

Dissociation of pitch from timbre in auditory short-term memory

In three experiments, untrained listeners made same/different judgments on pairs of pure or complex tones with periods that eventually differed by +/- 4%. On each trial, the two test tones were separated by 4.3 s, during which other tones (I) were heard but had to be ignored. The period (p) of the first test tone was randomly selected between 1/600 and 1/300 s. The period of each I tone was randomly selected among four possible values, close to p (+/- 3% or 6% apart) in some conditions, and remote from p in other conditions. In addition, from condition to condition, the spectral content of the I tones was varied independently of their periods: The I tones could have the same harmonic content as the test tones, or a very different harmonic content. Subjects' performances were much better when the periods of the I tones were remote from p than when they were close to p, as expected from previous findings by D. Deutsch [e.g., Science 175, 1020-1022 (1972)]. But, more importantly, the relation between the spectral contents of the I tones and the test tones had, by itself, practically no effect on performance. Thus performance was affected by the pitches of the I tones, but not by their timbres. These results suggest that pitch is processed independently of timbre in auditory short-term memory.     

Perceptual organization of complex-tone sequences: a tradeoff between pitch and timbre?

Sequences of rapidly occurring sounds that differ from each other are often perceptually segregated into "streams" within which the range of differences is smaller [Bregman and Campbell, J. Exp. Psychol. 89, 244-249 (1971)]. Early research on streaming implied it to be pitch dominated, but Wessel [Comput. Music J. 3, 45-52 (1979)] demonstrated that timbre differences could also bring about segregation. In the present study, pitch and timbre attributes were put in competition in four-tone sequences of the form: T2P1-TmP1-T2Pn-TmPn, with the first pair assigned pitch P1 but different timbres T2 and Tm, and the second pair pitch Pn, and similarly contrasted timbres. Six listeners were asked to indicate whether perceived grouping of 49 such sequences was based on pitch proximity, timbre similarity, or ambiguous percepts not dominated by either cue. Results confirm that timbre can segregate sequences and imply that timbre and pitch compete in perceptually organizing complex sequences. Because timbre differences were provided by varying the locus of four equal-amplitude harmonics, and pitch differences were provided by varying their relative spacing, it is suggested that the tradeoffs observed may actually arise due to differences in perceived salience of "spectral pitch" and "virtual pitch" [Terhardt, J. Acoust. Soc. Am. 55, 1061-1069 (1974)] dependent on relative changes in spectral locus and spectral spacing over time.     

Monaural and binaural loudness of 5- and 200-ms tones in normal and impaired hearing

The difference in level required to match monaural and binaural loudness of 5- and 200-ms tones was measured for listeners with normal and impaired hearing. Stimuli were 1-kHz tones presented at levels ranging from 10 to 90 dB sensation level. Sixteen listeners (eight normal and eight with losses of primarily cochlear origin) made loudness matches between equal-duration monaural and binaural tones using an adaptive 2AFC procedure. The present results corroborate existing data for 200-ms tones in normal listeners and provide new data for 5-ms tones. On average, the binaural level difference required for equal loudness of monaural and binaural tones is about the same for 5- and 200-ms tones of equal level and changes as a function of level. The group data for normal and impaired listeners are in reasonable agreement with data in the literature. However, the data from some of the impaired listeners deviate markedly from the average, indicating that group data do not accurately represent the behavior of all impaired listeners. Derived loudness functions from the loudness-matching data are reasonably consistent with individual data in the literature.     

Induced loudness reduction as a function of exposure time and signal frequency

Induced loudness reduction (ILR) is the decline in the loudness of a weaker tone induced by a preceding stronger tone. In this study we investigate how ILR depends on exposure time and signal frequency. For 12 listeners, successive magnitude estimation was used to measure the loudness of 70-dB-SPL test tones, presented with and without preceding 80-dB-SPL inducer tones at the same frequency. Experiment 1 measured the evolution of ILR over time at 0.5 kHz. The results suggest that ILR may begin after a single inducer presentation, and increases over at least 2 to 3 min as the inducer and test tones are repeated every few seconds. Following the cessation of the inducer, the recovery of loudness is slow and still incomplete after 1 min. Experiment 2 extended the measurements to additional signal frequencies. The results show that the amount of ILR and its evolution over time are approximately the same at frequencies from 0.5 to 8 kHz. Similarly, loudness matching showed no effect of frequency on ILR, which averaged 8.2 dB. These findings, together with previously noted similarities among ILR, ipsilaterally induced loudness adaptation, and temporary loudness shift, indicate that loudness reduction induced by stronger sounds is a very common phenomenon.     

中西方典型乐器音高响度与音色明亮度的研究

为了客观地评价民族乐器与西洋乐器在听觉感知方面的差异,本文利用15种典型的中西方乐器声样本,建立了与音色、响度和音色明亮度有关的15种乐器的感知空间模型,通过这些模型可以预测不同乐器在音高、响度一定时,音色明亮度的感知情况。此外,根据已建立的感知空间模型分别对比弹拨乐器、拉弦乐器和不同类型的吹奏乐器中三种听觉感知属性的变化差异。结果表明,对于中西方典型乐器,音色明亮度随响度的增加而增大,但是响度对音色明亮度的影响程度受到音域和响度范围的影响。民族乐器的音色明亮度随音高的增加而增大,但是西洋乐器的音色明亮度并没有随音高的增加而发生明显的变化。