Learning to produce speech with an altered vocal tract: the role of auditory feedback

Modifying the vocal tract alters a speaker's previously learned acoustic-articulatory relationship. This study investigated the contribution of auditory feedback to the process of adapting to vocal-tract modifications. Subjects said the word /tas/ while wearing a dental prosthesis that extended the length of their maxillary incisor teeth. The prosthesis affected /s/ productions and the subjects were asked to learn to produce "normal" /s/'s. They alternately received normal auditory feedback and noise that masked their natural feedback during productions. Acoustic analysis of the speakers' /s/ productions showed that the distribution of energy across the spectra moved toward that of normal, unperturbed production with increased experience with the prosthesis. However, the acoustic analysis did not show any significant differences in learning dependent on auditory feedback. By contrast, when naive listeners were asked to rate the quality of the speakers' utterances, productions made when auditory feedback was available were evaluated to be closer to the subjects' normal productions than when feedback was masked. The perceptual analysis showed that speakers were able to use auditory information to partially compensate for the vocal-tract modification. Furthermore, utterances produced during the masked conditions also improved over a session, demonstrating that the compensatory articulations were learned and available after auditory feedback was removed.     

Significance of Auditory and Kinesthetic Feedback to Singers'' Pitch Control

An accurate control of fundamental frequency (F0) is required from singers. This control relies on auditory and kinesthetic feedback. However, a loud accompaniment may mask the auditory feedback, leaving the singers to rely on kinesthetic feedback. The object of the present study was to estimate the significance of auditory and kinesthetic feedback to pitch control in 28 students beginning a professional solo singing education. The singers sang an ascending and descending triad pattern covering their entire pitch range with and without masking noise in legato and staccato and in a slow and a fast tempo. F0 was measured by means of a computer program. The interval sizes between adjacent tones were determined and their departures from equally tempered tuning were calculated. The deviations from this tuning were used as a measure of the accuracy of intonation. Statistical analysis showed a significant effect of masking that amounted to a mean impairment of pitch accuracy by 14 cent across all subjects. Furthermore, significant effects were found of tempo as well as of the staccato/legato conditions. The results indicate that auditory feedback contributes significantly to singers' control of pitch.     

Sensorimotor adaptation to feedback perturbations of vowel acoustics and its relation to perception

The role of auditory feedback in speech motor control was explored in three related experiments. Experiment 1 investigated auditory sensorimotor adaptation: the process by which speakers alter their speech production to compensate for perturbations of auditory feedback. When the first formant frequency (F1) was shifted in the feedback heard by subjects as they produced vowels in consonant-vowel-consonant (CVC) words, the subjects' vowels demonstrated compensatory formant shifts that were maintained when auditory feedback was subsequently masked by noise-evidence of adaptation. Experiment 2 investigated auditory discrimination of synthetic vowel stimuli differing in F1 frequency, using the same subjects. Those with more acute F1 discrimination had compensated more to F1 perturbation. Experiment 3 consisted of simulations with the directions into velocities of articulators model of speech motor planning, which showed that the model can account for key aspects of compensation. In the model, movement goals for vowels are regions in auditory space; perturbation of auditory feedback invokes auditory feedback control mechanisms that correct for the perturbation, which in turn causes updating of feedforward commands to incorporate these corrections. The relation between speaker acuity and amount of compensation to auditory perturbation is mediated by the size of speakers' auditory goal regions, with more acute speakers having smaller goal regions.     

Individual differences in auditory capabilities. I

Twenty-eight audiometrically normal adult listeners were given a variety of auditory tests, ranging from quiet and masked thresholds through the discrimination of simple and moderately complex temporal patterns. Test-retest reliability was good. Individual differences persisted on a variety of psychoacoustic tasks following a period of training using adaptive threshold-tracking methods, and with trial-by-trial feedback. Large individual differences in performance on temporal-sequence-discrimination tasks suggest that this form of temporal processing may be of clinical significance. In addition, high correlations were obtained within given classes of tests (as, between all tests of frequency discrimination) and between certain classes of tests (as, between tests of frequency discrimination and those of sequence discrimination). Patterns of individual differences were found which support the conclusion that individual differences in auditory performance are, in part, a function of patterns of independent abilities.     

The effects of tongue loading and auditory feedback on vowel production

This study investigated the role of sensory feedback during the production of front vowels. A temporary aftereffect induced by tongue loading was employed to modify the somatosensory-based perception of tongue height. Following the removal of tongue loading, tongue height during vowel production was estimated by measuring the frequency of the first formant (F1) from the acoustic signal. In experiment 1, the production of front vowels following tongue loading was investigated either in the presence or absence of auditory feedback. With auditory feedback available, the tongue height of front vowels was not modified by the aftereffect of tongue loading. By contrast, speakers did not compensate for the aftereffect of tongue loading when they produced vowels in the absence of auditory feedback. In experiment 2, the characteristics of the masking noise were manipulated such that it masked energy either in the F1 region or in the region of the second and higher formants. The results showed that the adjustment of tongue height during the production of front vowels depended on information about F1 in the auditory feedback. These findings support the idea that speech goals include both auditory and somatosensory targets and that speakers are able to make use of information from both sensory modalities to maximize the accuracy of speech production.     

Apodization‐Assisted Subdiffraction Near‐Field Localization in 2D Phase Diffraction Grating

Conventional phase diffraction gratings can be used to localize the incoming optical radiation in the near‐field region. A new design of the binary phase diffraction grating is proposed with embedded pupil opaque mask inside each stripe. By means of numerical simulations, it is shown that with this masked phase grating the spatial resolution of the near‐field localization can be substantially improved and brought even beyond the solid immersion limit (λ/2n). Moreover, due to anomalous apodization effect, the subdiffraction field localization is accompanied by intensity enhancement as compared to the non‐masked design. The pupil mask rearranges the optical fluxes within the stripes and promotes the Fano resonances excitation in the periodic step lattice. This can be important for advancing the phase grating‐based super‐resolution technologies, including subdiffraction imaging, interferometry, and surface fabrication.     

Study on Fourier transforms profilometry based on bi-color projecting

Projecting a bicolor sinusoidal fringe pattern consisting of two interlaced RGB format base color fringe patterns with π phase difference onto an object thought digital light projector, we can capture a deformed color pattern by color digital camera, then decode two individual sinusoidal fringe patterns with π phase difference by color-separating technique. Accessing these two fringe patterns, not only are zero-order spectra eliminated, but mask function is also built to mark valid unwrapping area in FTP, automatically.Moreover, because the wrapped phase just inside the valid areas is needed unwrapping, we can mark these areas with mask function, which avoids the error transferring resulting from unwrapping the invalid areas and shortens the unwrapping time. Furthermore, in Fourier transform processing, the full-field deformed fringe pattern generally needed to guarantee measurement precision can be formed by expanding non-full-field fringe pattern captured using the mask function.     

防毒面具语言清晰度试验研究

在低背景噪声的野外环境中,采用小闭集汉语（声母）清晰度测试方法,试验比较了四种防毒面具的清晰度水平。测试结果证实：与不佩戴面具相比,佩戴面具后语言清晰度得分严重降低,并随通话距离的增加而进一步恶化;以７５％清晰度得分作为通话性能的可接受限度,那么,不佩戴面具及佩戴四种面具的有效通话距离分别为６３．６、１５．７、１８．６、２５．０和２６．９ｍ。此外,结合对四种面具传声特性测定结果,本文还分析了清晰度测试方法及其结果的合理性。     

Pitch Matching Accuracy of Trained Singers, Untrained Subjects with Talented Singing Voices, and Untrained Subjects with Nontalented Singing Voices in Conditions of Varying Feedback

At a physiological level, the act of singing involves control and coordination of several systems involved in the production of sound, including respiration, phonation, resonance, and afferent systems used to monitor production. The ability to produce a melodious singing voice (eg, in tune with accurate pitch) is dependent on control over these motor and sensory systems. To test this position, trained singers and untrained subjects with and without expressed singing talent were asked to match pitches of target pure tones. The ability to match pitch reflected the ability to accurately integrate sensory perception with motor planning and execution. Pitch-matching accuracy was measured at the onset of phonation (prephonatory set) before external feedback could be utilized to adjust the voiced source, during phonation when external auditory feedback could be utilized, and during phonation when external auditory feedback was masked. Results revealed trained singers and untrained subjects with singing talent were no different in their pitch-matching abilities when measured before or after external feedback could be utilized. The untrained subjects with singing talent were also significantly more accurate than the trained singers when external auditory feedback was masked. Both groups were significantly more accurate than the untrained subjects without singing talent.     

Contributions of suppression and excitation to simultaneous masking: effects of signal frequency and masker-signal frequency relation

This study investigated the contributions of suppression and excitation to simultaneous masking for a range of masker frequencies both below and above three different signal frequencies (750, 2000, and 4850 Hz). A two-stage experiment was employed. In stage I, the level of each off-frequency simultaneous masker necessary to mask a signal at 10 or 30 dB sensation level was determined. In stage II, three different forward-masking conditions were tested: (1) an on-frequency condition, in which the signals in stage I were used to mask probes of the same frequency; (2) an off-frequency condition, in which the off-frequency maskers (at the levels determined in stage I) were used to mask the probes; and (3) a combined condition, in which the on- and off-frequency maskers were combined to mask the probes. If the off-frequency maskers simultaneously masked the signal via spread of excitation in stage I, then the off-frequency and combined maskers should produce considerable forward masking in stage II. If, on the other hand, they masked via suppression, they should produce little or no forward masking. The contribution of suppression was found to increase with increasing signal frequency; it was absent at 750 Hz, but dominant at 4850 Hz. These results have implications for excitation pattern analyses and are consistent with stronger nonlinear processing at high rather than at low frequencies.     

The effect of superior auditory skills on vocal accuracy

The relationship between auditory perception and vocal production has been typically investigated by evaluating the effect of either altered or degraded auditory feedback on speech production in either normal hearing or hearing-impaired individuals. Our goal in the present study was to examine this relationship in individuals with superior auditory abilities. Thirteen professional musicians and thirteen nonmusicians, with no vocal or singing training, participated in this study. For vocal production accuracy, subjects were presented with three tones. They were asked to reproduce the pitch using the vowel /a/. This procedure was repeated three times. The fundamental frequency of each production was measured using an autocorrelation pitch detection algorithm designed for this study. The musicians' superior auditory abilities (compared to the nonmusicians) were established in a frequency discrimination task reported elsewhere. Results indicate that (a) musicians had better vocal production accuracy than nonmusicians (production errors of 1/2 a semitone compared to 1.3 semitones, respectively); (b) frequency discrimination thresholds explain 43% of the variance of the production data, and (c) all subjects with superior frequency discrimination thresholds showed accurate vocal production; the reverse relationship, however, does not hold true. In this study we provide empirical evidence to the importance of auditory feedback on vocal production in listeners with superior auditory skills.     

Relationship Between Masking Levels and Phonatory Stability in Normal-Speaking Women

Disruption of auditory feedback such as masking has been shown to influence vocal production. A reliable finding is an increase in intensity level; an increase in fundamental frequency (F0) is a less robust finding. Research is lacking concerning the effects of auditory masking on measures of phonatory stability such as jitter and harmonics-to-noise ratio (HNR). This study investigated changes in intensity, F0, jitter, and HNR in 22 normally speaking college aged women. Subjects produced the vowel /a/ under three conditions: no masking level (0-dB ML), 50-dB ML, and 80-dB ML. Significant differences between conditions emerged for intensity; means for the other measures were not significantly different. Intraindividual differences between conditions for each variable are discussed in the framework of auditory versus kinesthetic feedback.     

Vowel and consonant recognition of cochlear implant patients using formant-estimating speech processors

Vowel and consonant confusion matrices were collected in the hearing alone (H), lipreading alone (L), and hearing plus lipreading (HL) conditions for 28 patients participating in the clinical trial of the multiple-channel cochlear implant. All patients were profound-to-totally deaf and "hearing" refers to the presentation of auditory information via the implant. The average scores were 49% for vowels and 37% for consonants in the H condition and the HL scores were significantly higher than the L scores. Information transmission and multidimensional scaling analyses showed that different speech features were conveyed at different levels in the H and L conditions. In the HL condition, the visual and auditory signals provided independent information sources for each feature. For vowels, the auditory signal was the major source of duration information, while the visual signal was the major source of first and second formant frequency information. The implant provided information about the amplitude envelope of the speech and the estimated frequency of the main spectral peak between 800 and 4000 Hz, which was useful for consonant recognition. A speech processor that coded the estimated frequency and amplitude of an additional peak between 300 and 1000 Hz was shown to increase the vowel and consonant recognition in the H condition by improving the transmission of first formant and voicing information.     

Experimental study of cold gas spraying through a mask. Part 1

The paper presents experimental data for production of a coating using cold gas dynamic spraying with a mask with transverse size in the range 0.3–1 mm and placed at different distances from the substrate. The coated samples were produced, and coating profiles were measured in the vicinity of the masked zone. The tests with depositing of aluminum powder and copper powder demonstrated that the distinct profile of masked zone is obtained for placing the mask at a distance below critical (depending of spray conditions). The most accurate boundary of the masked zone takes place at a minimal distance (depends on the coating thickness). Depending on the spraying conditions, the increase in the mask-substrate distance may result either in monotonic decline of the masked zone width or a slight increase for a certain range. Experimental data are generalized by normalizing with the transverse size of the mask (under other equal conditions).     

Improvement of intelligibility of ideal binary-masked noisy speech by adding background noise

When a target-speech/masker mixture is processed with the signal-separation technique, ideal binary mask (IBM), intelligibility of target speech is remarkably improved in both normal-hearing listeners and hearing-impaired listeners. Intelligibility of speech can also be improved by filling in speech gaps with un-modulated broadband noise. This study investigated whether intelligibility of target speech in the IBM-treated target-speech/masker mixture can be further improved by adding a broadband-noise background. The results of this study show that following the IBM manipulation, which remarkably released target speech from speech-spectrum noise, foreign-speech, or native-speech masking (experiment 1), adding a broadband-noise background with the signal-to-noise ratio no less than 4 dB significantly improved intelligibility of target speech when the masker was either noise (experiment 2) or speech (experiment 3). The results suggest that since adding the noise background shallows the areas of silence in the time-frequency domain of the IBM-treated target-speech/masker mixture, the abruption of transient changes in the mixture is smoothed and the perceived continuity of target-speech components becomes enhanced, leading to improved target-speech intelligibility. The findings are useful for advancing computational auditory scene analysis, hearing-aid/cochlear-implant designs, and understanding of speech perception under "cocktail-party" conditions.     

Perceptual recalibration in human sound localization: learning to remediate front-back reversals

The efficacy of a sound localization training procedure that provided listeners with auditory, visual, and proprioceptive/vestibular feedback as to the correct sound-source position was evaluated using a virtual auditory display that used nonindividualized head-related transfer functions (HRTFs). Under these degraded stimulus conditions, in which the monaural spectral cues to sound-source direction were inappropriate, localization accuracy was initially poor with frequent front-back reversals (source localized to the incorrect front-back hemifield) for five of six listeners. Short periods of training (two 30-min sessions) were found to significantly reduce the rate of front-back reversal responses for four of five listeners that showed high initial reversal rates. Reversal rates remained unchanged for all listeners in a control group that did not participate in the training procedure. Because analyses of the HRTFs used in the display demonstrated a simple and robust front-back cue related to energy in the 3-7-kHz bandwidth, it is suggested that the reductions observed in reversal rates following the training procedure resulted from improved processing of this front-back cue, which is perhaps a form of rapid perceptual recalibration. Reversal rate reductions were found to generalize to untrained source locations, and persisted at least 4 months following the training procedure.     

Modulation of auditory evoked responses to spectral and temporal changes by behavioral discrimination training

Background  

Due to auditory experience, musicians have better auditory expertise than non-musicians. An increased neocortical activity during auditory oddball stimulation was observed in different studies for musicians and for non-musicians after discrimination training. This suggests a modification of synaptic strength among simultaneously active neurons due to the training. We used amplitude-modulated tones (AM) presented in an oddball sequence and manipulated their carrier or modulation frequencies. We investigated non-musicians in order to see if behavioral discrimination training could modify the neocortical activity generated by change detection of AM tone attributes (carrier or modulation frequency). Cortical evoked responses like N1 and mismatch negativity (MMN) triggered by sound changes were recorded by a whole head magnetoencephalographic system (MEG). We investigated (i) how the auditory cortex reacts to pitch difference (in carrier frequency) and changes in temporal features (modulation frequency) of AM tones and (ii) how discrimination training modulates the neuronal activity reflecting the transient auditory responses generated in the auditory cortex.     

Speech masking. II: Simultaneous masking thresholds under "naturalistic" listening conditions

This article investigates the role of listening conditions in determining thresholds for probe tones masked by natural speech. These thresholds are of interest because they are a sensitive probe of the activity profile, or spectrum, of sounds such as speech in the auditory system. Most human performance tests are carried out under highly artificial listening conditions, which may not reflect how people listen to speech in common listening environments. In this study, reference conditions (similar to minimal uncertainty listening conditions used in many performance tests) were compared to a "naturalistic" listening condition and to another, intermediate, condition. In the naturalistic listening condition, listeners did not know the frequency or the position of probe tones; additionally, they were required to attend to the semantic content of sentences. In the reference condition, listeners knew the frequency and position of probe tones masked by single syllables. Average thresholds were elevated by 4 dB in the naturalistic listening condition with respect to the reference condition, and thresholds tended to be elevated more for higher-frequency probe tones. The results provide previously unknown information about the resolution of speech sounds in the auditory system during speech comprehension.     

Speech feature recognition by profoundly hearing impaired children using a multiple-channel electrotactile speech processor and aided residual hearing

A group of prelinguistically hearing impaired children, between 7 and 11 years of age, were trained in the perception of vowel duration and place, the fricative /s/, and manner of articulation (/m/ vs /b/ and /s/ vs /t/) distinctions, using information provided by a multiple-channel electrotactile aid (Tickle Talker), and through aided hearing. Training was provided in the tactile-plus-aided hearing (TA) and tactile (T) conditions. Speech feature recognition tests were conducted in the TA, T, and aided hearing (A) conditions, during pretraining, training, and post-training phases. Test scores in the TA and T conditions were significantly greater than scores in the A condition for all tests, suggesting that perception of these features was improved when the tactile aid was worn. Test scores in the training and post-training phases were significantly greater than in the pretraining phase, suggesting that the training provided was responsible for the improvement in feature perception. Statistical analyses demonstrated a significant interaction between the main effects of condition and phase, suggesting that training improved perception in the TA and T conditions, but not in the A condition. Post-training and training test scores were similar suggesting that the perceptual skills acquired during training were retained after the removal of training. Recognition of trained features improved for trained, as well as for untrained words.     

Effects of a professional solo singer education on auditory and kinesthetic feedback—a longitudinal study of singers'' pitch control

The significance of auditory and kinesthetic feedback to pitch control in singing was described in a previous report of this project for students at the beginning of their professional solo singer education.(1) As it seems reasonable to assume that pitch control can be improved by training, the same students were reinvestigated after 3 years of professional singing education. As in the previous study, the singers sang an ascending and descending triad pattern with and without masking noise in legato and staccato and in a slow and a fast tempo. Fundamental frequency and interval sizes between adjacent tones were determined and compared with their equivalents in the equally tempered tuning. The average deviations from these values were used as estimates of intonation accuracy. Intonation accuracy was reduced by masking noise, by staccato as opposed to legato singing, and by fast as opposed to slow performance. The contribution of the auditory feedback to pitch control was not significantly improved after education, whereas the kinesthetic feedback circuit was improved in slow legato and slow staccato tasks. The results support the assumption that the kinesthetic feedback contributes substantially to intonation accuracy.