Laryngeal electromyographic responses to perturbations in voice pitch auditory feedback

The present study was conducted to test the hypothesis that intrinsic laryngeal muscles are involved in producing voice fundamental frequency (F(0)) responses to perturbations in voice pitch auditory feedback. Electromyography (EMG) recordings of the cricothyroid and thyroarytenoid muscles were made with hooked-wire electrodes, while subjects sustained vowel phonations at three different voice F(0) levels (conversational, high pitch in head register, and falsetto register) and received randomized pitch shifts (±100 or ±300 cents) in their voice auditory feedback. The median latencies from stimulus onset to the peak in the EMG and voice F(0) responses were 167 and 224 ms, respectively. Among the three different F(0) levels, the falsetto register produced compensatory EMG responses that occurred prior to vocal responses and increased along with rising voice F(0) responses and decreased for falling F(0) responses. For the conversational and high voice levels, the EMG response timing was more variable than in the falsetto voice, and changes in EMG activity with relevance to the vocal responses did not follow the consistent trend observed in the falsetto condition. The data from the falsetto condition suggest that both the cricothyroid and thyroarytenoid muscles are involved in generating the compensatory vocal responses to pitch-shifted voice feedback.     

Control of Fundamental Frequency in Dysphonic Patients During Phonation and Speech

PurposeThe pitch-shift reflex (PSR) is the adaptation of the fundamental frequency during phonation and speech and describes the auditory feedback control. Speakers without voice and speech disorders mostly show a compensation of the pitch change in the auditory feedback and adapt their fundamental frequency to the opposite direction. Dysphonic patients often display problems with the auditory perception and control of their voice during therapy. Our study focuses on the auditory and kinesthetic control mechanisms of patients with muscle tension dysphonia (MTD) and speakers without voice and speech problems. Main purpose of the study is the analysis of the functionality of the control mechanisms within phonation and speech between patients with MTD and normal speakers.MethodSixty-one healthy subjects (17 male, 44 female) and 22 patients with MTD (7 male, 15 female) participated following two paradigms including a sustained phonation (vowel /a/) and speech ([‘mama]). Within both paradigms the fundamental frequency of the auditory feedback was increased synthetically. For the analysis of the PSR the electroencephalogram, electroglottography, the voice signal, and the high-speed endoscopy data were recorded simultaneously. The PSR in the electroencephalogram was detected via the N100 and the mismatch negativity. Statistical tests were applied for the detection of the PSR in the physiological response within the electroglottography, voice, and high-speed endoscopy signals. The results were compared between both groups.ResultsNo differences were found between the controls and patients with MTD regarding latency and magnitude of the perception of the pitch shift in both paradigms, but for the magnitude of the behavioral response. Differences also could be found for both groups between the “no pitch” and “pitch” condition of the two paradigms regarding vocal fold dynamics and voice quality. Patients with MTD showed more vibrational irregularities during the PSR than the controls, especially regarding the symmetry of vocal fold dynamics.ConclusionPatients with MTD seem to have a disturbed interaction between the auditory and kinesthetic feedback inducing the execution of an overriding behavioral response.     

Sex-related differences in vocal responses to pitch feedback perturbations during sustained vocalization

The present study assessed the effect of sex on voice fundamental frequency (F(0)) responses to pitch feedback perturbations during sustained vocalization. Sixty-four native-Mandarin speakers heard their voice pitch feedback shifted at ± 50, ± 100, or ± 200 cents for 200 ms, five times during each vocalization. The results showed that, as compared to female speakers, male speakers produced significantly larger but slower vocal responses to the pitch-shifted stimuli. These findings reveal a modulation of vocal response as a function of sex, and suggest that there may be a differential processing of vocal pitch feedback perturbations between men and women.     

Compensation for pitch-shifted auditory feedback during the production of Mandarin tone sequences

Recent research has found that while speaking, subjects react to perturbations in pitch of voice auditory feedback by changing their voice fundamental frequency (F0) to compensate for the perceived pitch-shift. The long response latencies (150-200 ms) suggest they may be too slow to assist in on-line control of the local pitch contour patterns associated with lexical tones on a syllable-to-syllable basis. In the present study, we introduced pitch-shifted auditory feedback to native speakers of Mandarin Chinese while they produced disyllabic sequences /ma ma/ with different tonal combinations at a natural speaking rate. Voice F0 response latencies (100-150 ms) to the pitch perturbations were shorter than syllable durations reported elsewhere. Response magnitudes increased from 50 cents during static tone to 85 cents during dynamic tone productions. Response latencies and peak times decreased in phrases involving a dynamic change in F0. The larger response magnitudes and shorter latency and peak times in tasks requiring accurate, dynamic control of F0, indicate this automatic system for regulation of voice F0 may be task-dependent. These findings suggest that auditory feedback may be used to help regulate voice F0 during production of bi-tonal Mandarin phrases.     

Voice F0 responses to pitch-shifted voice feedback during English speech

Previous studies have demonstrated that motor control of segmental features of speech rely to some extent on sensory feedback. Control of voice fundamental frequency (F0) has been shown to be modulated by perturbations in voice pitch feedback during various phonatory tasks and in Mandarin speech. The present study was designed to determine if voice Fo is modulated in a task-dependent manner during production of suprasegmental features of English speech. English speakers received pitch-modulated voice feedback (+/-50, 100, and 200 cents, 200 ms duration) during a sustained vowel task and a speech task. Response magnitudes during speech (mean 31.5 cents) were larger than during the vowels (mean 21.6 cents), response magnitudes increased as a function of stimulus magnitude during speech but not vowels, and responses to downward pitch-shift stimuli were larger than those to upward stimuli. Response latencies were shorter in speech (mean 122 ms) compared to vowels (mean 154 ms). These findings support previous research suggesting the audio vocal system is involved in the control of suprasegmental features of English speech by correcting for errors between voice pitch feedback and the desired F0.     

Effects of pitch-shift velocity on voice Fo responses

Previous studies have shown that voice fundamental frequency (F0) is modified by changes in the pitch of vocal feedback and have demonstrated that the audio-vocal control system has both open- and closed-loop control properties. However, the extent to which this system operates in closed-loop fashion may have been underestimated in previous work. Because the step-type stimuli used were very rapid, and people are physically unable to change their voice F0 as rapidly as the stimuli, feedback responses might have been reduced or suppressed. In the present study, pitch-shift stimuli, consisting of a disparity between voice F0 and feedback pitch of varying ramp onset velocities, were presented to subjects vocalizing a steady /ah/ sound to examine the effect of stimulus onset on voice F0 responses. Results showed that response velocity covaried with stimulus velocity. Response latency and time of the peak response decreased with increases in stimulus velocity, while response magnitude decreased. A simple feedback model reproduced most features of these responses. These results strongly support previous suggestions that the audio-vocal system monitors auditory feedback and, through closed-loop negative feedback, adjusts voice F0 so as to cancel low-level fluctuations in F0.     

Effects of Professional Singing Education on Vocal Vibrato—A Longitudinal Study

Vocal vibrato is regarded as one of the essential characteristics of voice quality in classical singing. Professional singers seem to develop vibrato automatically, without actively striving to acquire it. In this longitudinal investigation, the vocal vibrato of 22 singing students was examined at the beginning of and after 3 years of professional singing education. Subjects sang an ascending-descending triad pattern in slow tempo on vowel [a:] at a comfortable pitch level twice at soft (piano) and twice at medium (mezzoforte) loudness. The top note of the triad pattern was sustained for approximately 5s. The mean and the standard deviation (SD) of the vibrato rate were measured for this note. Results revealed that after 3 years of training, voices with vibrato slower than 5.2 Hz were found to have a faster vibrato, and voices with vibrato faster than 5.8 Hz were found to have a slower vibrato. Standard deviation of vibrato rate was higher in soft than in medium loudness, particularly before the education. Also high values of SD of vibrato rate, exceeding 0.65 Hz, had decreased after the education. These findings confirm that vibrato characteristics can be affected by singing education.     

Voice responses to changes in pitch of voice or tone auditory feedback

The present study was undertaken to examine if a subject's voice F0 responded not only to perturbations in pitch of voice feedback but also to changes in pitch of a side tone presented congruent with voice feedback. Small magnitude brief duration perturbations in pitch of voice or tone auditory feedback were randomly introduced during sustained vowel phonations. Results demonstrated a higher rate and larger magnitude of voice F0 responses to changes in pitch of the voice compared with a triangular-shaped tone (experiment 1) or a pure tone (experiment 2). However, response latencies did not differ across voice or tone conditions. Data suggest that subjects responded to the change in F0 rather than harmonic frequencies of auditory feedback because voice F0 response prevalence, magnitude, or latency did not statistically differ across triangular-shaped tone or pure-tone feedback. Results indicate the audio-vocal system is sensitive to the change in pitch of a variety of sounds, which may represent a flexible system capable of adapting to changes in the subject's voice. However, lower prevalence and smaller responses to tone pitch-shifted signals suggest that the audio-vocal system may resist changes to the pitch of other environmental sounds when voice feedback is present.     

Effects of perturbation magnitude and voice F0 level on the pitch-shift reflex

The purpose of the present study was to investigate the responsiveness of the pitch-shift reflex to small magnitude stimuli and voice fundamental frequency (F(0)) level. English speakers received pitch-shifted voice feedback (+/-10, 20, 30, 40, and 50 cents, 200 ms duration) during vowel phonations at a high and a low F(0) level. Mean pitch-shift response magnitude increased as a function of pitch-shift stimulus magnitude, but when expressed as a percent of stimulus magnitude, declined from 100% with +/-10 cents to 37% with +/-50 cents stimuli. Response magnitudes were larger and latencies were shorter with a high F(0) level (16 cents;130 ms) compared to a low F(0) level (13 cents;152 ms). Data from the present study demonstrate that vocal response magnitudes are equal to small perturbation magnitudes, and they are larger and faster with a high F(0) voice. These results suggest that the audio-vocal system is optimally suited for compensating for small pitch rather than larger perturbations. Data also suggest the sensitivity of the audio-vocal system to voice perturbation may vary with F(0) level.     

Comparative measures of vocal tremor and vocal vibrato

Acoustic analyses were carried out on vocal vibrato produced by nine opera singers and vocal tremor accompanying the sustained phonation of patients with the following diagnoses: Parkinson's disease, amyotrophic lateral sclerosis, spinal muscular atrophy, essential tremor, and adductor spastic dysphonia. While vocal tremor on average had a faster oscillatory rate and greater amplitude extent when compared to vocal vibrato, only the cycle to cycle measures of shimmer and jitter differed significantly between these groups. However, these differences existed even when the effect of the oscillation was removed. These data are consistent with the hypothesis that vocal vibrato in singers and vocal tremor in patients may be part of the same continuum.     

Compensatory responses to loudness-shifted voice feedback during production of Mandarin speech

Previous studies have demonstrated that perturbations in voice pitch or loudness feedback lead to compensatory changes in voice F(0) or amplitude during production of sustained vowels. Responses to pitch-shifted auditory feedback have also been observed during English and Mandarin speech. The present study investigated whether Mandarin speakers would respond to amplitude-shifted feedback during meaningful speech production. Native speakers of Mandarin produced two-syllable utterances with focus on the first syllable, the second syllable, or none of the syllables, as prompted by corresponding questions. Their acoustic speech signal was fed back to them with loudness shifted by +/-3 dB for 200 ms durations. The responses to the feedback perturbations had mean latencies of approximately 142 ms and magnitudes of approximately 0.86 dB. Response magnitudes were greater and latencies were longer when emphasis was placed on the first syllable than when there was no emphasis. Since amplitude is not known for being highly effective in encoding linguistic contrasts, the fact that subjects reacted to amplitude perturbation just as fast as they reacted to F(0) perturbations in previous studies provides clear evidence that a highly automatic feedback mechanism is active in controlling both F(0) and amplitude of speech production.     

Cochlear Implant Users’ Vocal Control CorrelatesAcross Tasks

Cochlear implants (CIs) provide access to auditory information that can affect vocal control. For example, previous research shows that, when producing a sustained vowel, CI users will alter the pitch of their voice when the feedback of their own voice is perceived to shift. Although these results can be informative as to how perception and production are linked for CI users, the artificial nature of the task raises questions as to the applicability of the results to real-world vocal productions. To examine how vocal control, when producing sustained vowels, relates to vocal control for more ecologically valid tasks, 10 CI users’ vocal control was measured across two tasks: (1) sustained vowel production, and (2) singing. The results found that vocal control, as measured by the variability of the participants’ fundamental frequency, was significantly correlated when producing sustained vowels and when singing, although variability was significantly greater when singing. This suggests that, despite the artificial nature of sustained vowel production, vocal control on such tasks is related to vocal control for more ecologically valid tasks. However, the results also suggest that vocal control may be overestimated with sustained vowel production tasks.     

Effect of tonal native language on voice fundamental frequency responses to pitch feedback perturbations during sustained vocalizations

The purpose of this cross-language study was to examine whether the online control of voice fundamental frequency (F(0)) during vowel phonation is influenced by language experience. Native speakers of Cantonese and Mandarin, both tonal languages spoken in China, participated in the experiments. Subjects were asked to vocalize a vowel sound /u/at their comfortable habitual F(0), during which their voice pitch was unexpectedly shifted (± 50, ± 100, ± 200, or ± 500 cents, 200 ms duration) and fed back instantaneously to them over headphones. The results showed that Cantonese speakers produced significantly smaller responses than Mandarin speakers when the stimulus magnitude varied from 200 to 500 cents. Further, response magnitudes decreased along with the increase in stimulus magnitude in Cantonese speakers, which was not observed in Mandarin speakers. These findings suggest that online control of voice F(0) during vocalization is sensitive to language experience. Further, systematic modulations of vocal responses across stimulus magnitude were observed in Cantonese speakers but not in Mandarin speakers, which indicates that this highly automatic feedback mechanism is sensitive to the specific tonal system of each language.     

Voice F0 responses to pitch-shifted auditory feedback: a preliminary study

Auditory feedback has been suggested to be important for voice fundamental frequency (F₀) control. The present study featured a new technique for testing this hypothesis by which the pitch of a subject's voice was modulated, fed back over earphones, and the resultant change in the emitted voice F₀ was measured. The responses of 67 normal, healthy young adults were recorded as they attempted to ignore intermittent upward or downward shifts in pitch feedback while they sustained steady vowel sounds (/a/) or sang musical scales. Ninety-six percent of subjects increased their F₀ when the feedback pitch was decreased, and 78% of subjects decreased their F₀ when the pitch feedback was increased. Latencies of responses ranged from 104 to 223 ms. Results indicate people normally rely on pitch feedback to control voice F₀.     

Effect of the glottal source and the vocal tract on the partials amplitude of vibrato in male voices

In this paper the production of vocal vibrato is investigated. The most relevant features of the acoustical vibrato signal, frequency and amplitude variations of the partials, will be related to the voice production features, glottal source (GS) and vocal tract response (VTR). Unlike previous related works, in this approach, the effect on the amplitude variations of the partials of each one of the above-mentioned voice production features will be identified in recordings of natural singing voice. Moreover, we will take special care of the reliability of the measurements, and, to this aim, a noninteractive vibrato production model will be also proposed in order to describe the vibrato production process and, more importantly, validate the measurements carried out in natural vibrato. Based on this study, it will be shown that during a few vibrato cycles, the glottal pulse characteristics, as well as the VTR, do not significantly change, and only the fundamental frequency of the GS varies. As a result, the pitch variations can be attributed to the GS, and these variations, along with the vocal tract filtering effect, will result in frequency and amplitude variations of the acoustic signal partials.     

Perceived Pitch of Synthesized Voice with Alternate Cycles

Both in normal speech voice and in some types of pathological voice, adjacent vocal cycles may alternate in amplitude or period, or both. When this occurs, the determination of voice fundamental frequency (defined as number of vocal cycles per second) becomes difficult. The present study attempts to address this issue by investigating how human listeners perceive the pitch of alternate cycles. As stimuli, vowels /a/ and /i/ were synthesized with fundamental frequencies at 140 Hz and 220 Hz, and the effect of alternate cycles was simulated with both amplitude- and frequency-modulation of the glottal volume velocity waveform. Subjects were asked to judge the pitch of the modulated vowels in reference to vowels without modulation. The results showed that (a) perceived pitch became lower as the amount of modulation increased, and the effect seems to be more dramatic than would be predicted by existing hypotheses, (b) perceived pitch differed across vowels, fundamental frequencies, and modulation types, that is, amplitude versus frequency modulation, and (c) the prediction of perceived pitch was best made in the frequency domain in terms of subharmonic-to-harmonic ratio. These findings provide useful information on how we should assess the pitch of alternate cycles. They may also be helpful in developing more robust pitch determination algorithms.     

Audio-vocal responses to repetitive pitch-shift stimulation during a sustained vocalization: improvements in methodology for the pitch-shifting technique

The pitch-shift reflex is a sophisticated system that produces a "compensatory" response in voice F0 that is opposite in direction to a change in voice pitch feedback (pitch-shift stimulus), thus correcting for the discrepancy between the intended voice F0 and the feedback pitch. In order to more fully exploit the pitch-shift reflex as a tool for studying the influence of sensory feedback mechanisms underlying voice control, the optimal characteristics of the pitch-shift stimulus must be understood. The present study was undertaken to assess the effects of altering the duration of the interstimulus interval (ISI) and the number of trials comprising an average on measures of the pitch-shift reflex. Pitch-shift stimuli were presented to vocalizing subjects with ISI of 5.0, 2.5, 1.0, and 0.5 s to determine if an increase in ISI altered response properties. With each ISI, measures of event-related averages of the first 10, 15, 20, or 30 pitch-shift reflex responses were compared to see if increases in the number of responses comprising an event-related average altered response properties. Measures of response latency, peak time, magnitude, and prevalence were obtained for all ISI and average conditions. While quantitative measures were similar across ISI and averaging conditions, we observed more instances of "non-responses" with averages of ten trials as well as at an ISI of 0.5 s. These findings suggest an ISI of 1.0 s and an average consisting of at least 15 trials produce optimal results. Future studies using these stimulus parameters may produce more reliable data due to the fivefold decrease in subject participation time and a concomitant decrease in fatigue, boredom, and inattention.     

Cortical sensitivity to periodicity of speech sounds

Previous non-invasive brain research has reported auditory cortical sensitivity to periodicity as reflected by larger and more anterior responses to periodic than to aperiodic vowels. The current study investigated whether there is a lower fundamental frequency (F0) limit for this effect. Auditory evoked fields (AEFs) elicited by natural-sounding 400 ms periodic and aperiodic vowel stimuli were measured with magnetoencephalography. Vowel F0 ranged from normal male speech (113 Hz) to exceptionally low values (9 Hz). Both the auditory N1m and sustained fields were larger in amplitude for periodic than for aperiodic vowels. The AEF sources for periodic vowels were also anterior to those for the aperiodic vowels. Importantly, the AEF amplitudes and locations were unaffected by the F0 decrement of the periodic vowels. However, the N1m latency increased monotonically as F0 was decreased down to 19 Hz, below which this trend broke down. Also, a cascade of transient N1m-like responses was observed in the lowest F0 condition. Thus, the auditory system seems capable of extracting the periodicity even from very low F0 vowels. The behavior of the N1m latency and the emergence of a response cascade at very low F0 values may reflect the lower limit of pitch perception.     

Control of voice fundamental frequency in speaking versus singing

In order to investigate control of voice fundamental frequency (F0) in speaking and singing, 24 adults had to utter the nonsense word ['ta:tatas] repeatedly, while in selected trials their auditory feedback was frequency-shifted by 100 cents downwards. In the speaking condition the target speech rate and prosodic pattern were indicated by a rhythmic sequence made of white noise. In the singing condition the sequence consisted of piano notes, and subjects were instructed to match the pitch of the notes. In both conditions a response in voice F0 begins with a latency of about 150 ms. As predicted, response magnitude is greater in the singing condition (66 cents) than in the speaking condition (47 cents). Furthermore the singing condition seems to prolong the after-effect which is a continuation of the response in trials after the frequency shift. In the singing condition, response magnitude and the ability to match the target F0 correlate significantly. Results support the view that in speaking voice F0 is monitored mainly supra-segmentally and controlled less tightly than in singing.     

Voice of Postradiotherapy Nasopharyngeal Carcinoma Patients: Evidence of Vocal Tract Effect

This study was aimed at identifying acoustic and physiological measures useful for monitoring voice changes in postnasopharyngeal patients with nonlaryngeal malignancies, and providing evidences of vocal tract effect on voice through comparisons between individuals with and without intact vocal tract. Simultaneous acoustic-electroglottographic signals recorded during phonation of vowels /i/ and /a/ sustained at habitual, high, and low pitch levels were compared among 10 postradiotherapy patients with nasopharyngeal carcinoma (NPC), 10 voice patients (VPs) with intact vocal tract, and 10 healthy individuals with normal voice (NORM). Results from a series of discriminant analyses revealed that the NPC group generally exhibited lower signal-to-noise (SNR) and open quotient (OQ) and higher Formant 1 frequency (F(1)) and speed quotient (SQ) than the NORM group. Unlike both VP and NORM groups, the NPC group failed to show a pitch effect on all voice measures, including OQ, SQ, percent jitter, percent shimmer, and SNR, suggesting an effect of radiotherapy and/or vocal tract on laryngeal behaviors. For the vowel /i/, on the other hand, only the NPC and NORM groups showed a pattern of pitch-dependent F(1) raising, a reflection of increased pharyngeal narrowing. These findings suggested that the pitch effect on laryngeal behaviors differed not only between individuals with intact vocal tract and those without but also between those with structural and dynamic changes of vocal tract.