Vocal Expression of Emotions in Normally Hearing and Hearing-Impaired Infants

The vocalizations of seven normally hearing (NH) and seven severely hearing-impaired (HI) infants were compared to find out the influence of auditory feedback on preverbal utterances. It was tested whether there are general differences in vocalizations between NH and HI infants, and whether specific emotional states affect the vocal production of NH and HI infants in the same way. First, the acoustic structure of the three most common vocal types was analyzed; second, the composition of vocal sequences was examined. Vocal sequence composition turned out to be more affected by hearing impairment than the acoustic structure of single vocalizations. This result indicates that the acoustic structure of preverbal vocalizations is to a great extent predetermined, whereas the composition of vocal sequences is influenced by auditory input.     

Production of contrast between sibilant fricatives by children with cochlear implants

Speech production by children with cochlear implants (CIs) is generally less intelligible and less accurate on a phonemic level than that of normally hearing children. Research has reported that children with CIs produce less acoustic contrast between phonemes than normally hearing children, but these studies have included correct and incorrect productions. The present study compared the extent of contrast between correct productions of /s/ and /∫/ by children with CIs and two comparison groups: (1) normally hearing children of the same chronological age as the children with CIs and (2) normally hearing children with the same duration of auditory experience. Spectral peaks and means were calculated from the frication noise of productions of /s/ and /∫/. Results showed that the children with CIs produced less contrast between /s/ and /∫/ than normally hearing children of the same chronological age and normally hearing children with the same duration of auditory experience due to production of /s/ with spectral peaks and means at lower frequencies. The results indicate that there may be differences between the speech sounds produced by children with CIs and their normally hearing peers even for sounds that adults judge as correct.     

Tactile aids for profoundly deaf children

This paper treats acoustic-tactile communication aids for the deaf. Children who obtain negligible help from conventional hearing aids are of particular interest. For the prelingually deaf child tactile aids may facilitate the acquisition of lipreading, and improve vocal production. Although attempts to use tactile aids for the deaf go back many years, only recently have developments in technology led to greatly improved processing possibilities and the feasibility of aids that can be worn. Here, we report case studies in which prelingually, profoundly deaf young children used wearable tactile aids.     

Voice Analysis of Postlingually Deaf Adults Pre- and Postcochlear Implantation

Objectives

To ascertain whether cochlear implantation (CI), without specific vocal rehabilitation, is associated with changes in perceptual and acoustic vocal parameters in adults with severe to profound postlingual deafness.

Hypothesis

Merely restoring auditory feedback could allow the individual to make necessary adjustments in vocal pattern.

Study Design

Prospective and longitudinal.

Methods

The experimental group composed of 40 postlingually deaf adults (20 males and 20 females) with no previous laryngeal or voice disorders. Participants’ voices were recorded before CI and 6–9 months after CI. To check for chance modifications between two evaluations, a control group of 12 postlingually deaf adults, six male and six female, without CI was also evaluated. All sessions composed of the recording of read sentences from Consensus Auditory-Perceptual Evaluation of Voice and sustained vowel /a/. Auditory and acoustic analyses were then conducted.

Results

We found a statistically significant reduction in overall severity, strain, loudness, and instability in auditory analysis. In vocal acoustic analysis, we found statistically significant reduction fundamental frequency (F0) values (in male participants) and F0 variability (in both genders). The control group showed no statistically significant changes in most vocal parameters assessed, apart from pitch and F0 (in female participants only). On comparing the interval of variation of results between the experimental and control groups, we found no statistically significant difference in vocal parameters between CI recipients and nonrecipients, with the exception of F0 variability in male participants.

Conclusions

The patients in our sample showed changes in overall severity, strain, loudness, and instability values, and reductions in F0 and its variability. On comparing the variation of results between the groups, we were able to prove in our study that implant recipients postlingually deaf adults (experimental group), without specific vocal rehabilitation, differed from nonrecipients (control group) in loudness and F0 variability sustained vowel /a/ in male participants.     

The influence of final-syllable position on the vowel and word duration of deaf talkers

Hearing talkers produce shorter vowel and word durations in multisyllabic contexts than in monosyllabic contexts. This investigation determined whether a similar effect occurs for deaf talkers, a population often characterized as lacking coarticulation in their speech. Four prelingually deafened adults and two hearing controls produced three sets of word sequences. Each set included a kernel word and six derived forms (e.g., "speed," "speedy," "speeding," etc.). The derived forms were created by adding unstressed and stressed syllables to the kernel form. A spectrographic analysis indicated that the deaf subjects did not always decrease word and vowel durations for the derivatives. Unlike hearing speakers, they often did not reduce vowel segments more than consonant segments. Three explanations are forwarded for the shortening effects. One relates to the implementation of temporal rules, the second concerns the organization imposed upon the articulators to produce speech, and the third suggests a language-independent vocal tract characteristic. The role of auditory information in developing the shortening effects is also considered.     

Pitch perception by cochlear implant subjects

Direct electrical stimulation of the auditory nerve can be used to restore some degree of hearing to the profoundly deaf. Percepts due to electrical stimulation have characteristics corresponding approximately to the acoustic percepts of loudness, pitch, and timbre. To encode speech as a pattern of electrical stimulation, it is necessary to determine the effects of the stimulus parameters on these percepts. The effects of the three basic stimulus parameters of level, repetition rate, and stimulation location on subjects' percepts were examined. Pitch difference limens arising from changes in rate of stimulation increase as the stimulating rate increases, up to a saturation point of between 200 and 1000 pulses per second. Changes in pitch due to electrode selection depend upon the subject, but generally agree with a tonotopic organization of the human cochlea. Further, the discriminability of such place-pitch percepts seems to be dependent on the degree of current spread in the cochlea. The effect of stimulus level on perceived pitch is significant but is highly dependent on the individual tested. The results of these experiments are discussed in terms of their impact on speech-processing strategies and their relevance to acoustic pitch perception.     

Accurate vocal compensation for sound intensity loss with increasing distance in natural environments

Human abilities to adjust vocal output to compensate for intensity losses due to sound propagation over distance were investigated. Ten normally hearing adult participants were able to compensate for propagation losses ranging from -1.8 to -6.4 dBdoubling source distance over a range of distances from 1 to 8 m. The compensation was performed to within 1.2 dB of accuracy on average across all participants, distances, and propagation loss conditions with no practice or explicit training. These results suggest that natural vocal communication processes of humans may incorporate tacit knowledge of physical sound propagation properties more sophisticated than previously supposed.     

Reacquisition of contrastive stress in an adventitiously deaf speaker using a single-channel cochlear implant

Acoustic correlates of contrastive stress, i.e., fundamental frequency (F0), duration, and intensity, and listener perceptions of stress, were investigated in a profoundly deaf subject (RS) pre/post single-channel cochlear implant and longitudinally, and compared to the overall patterns of age-peer profoundly deaf (JM) and normally hearing subjects (DL). The stimuli were a group of general American English words in which a change of function from noun to verb is associated with a shift of stress from initial to final syllable, e.g., CON'trast versus conTRAST'. Precochlear implant, RS was unable to produce contrastive stress correctly. Hearing one day post-stimulation resulted in significantly higher F0 for initial and final stressed versus unstressed syllables. Four months post-stimulation, RS maintained significantly higher F0 on stressed syllables, as well as generalization of significantly increased intensity and longer syllable duration differences for all stressed versus unstressed syllables. Perceptually, listeners judged RS's contrastive stress placement as incorrect precochlear implant and as always correct post-cochlear implant. JM's contrastive stress was judged as 96% correct, and DL's contrastive stress placement was 100% correct. It was concluded that RS reacquired all acoustic correlates needed for appropriate differentiation of contrastive stress with longitudinal use of the cochlear implant.     

Effects of deafness on acoustic characteristics of American English tense/lax vowels in maternal speech to infants

Recent studies have demonstrated that mothers exaggerate phonetic properties of infant-directed (ID) speech. However, these studies focused on a single acoustic dimension (frequency), whereas speech sounds are composed of multiple acoustic cues. Moreover, little is known about how mothers adjust phonetic properties of speech to children with hearing loss. This study examined mothers' production of frequency and duration cues to the American English tense/lax vowel contrast in speech to profoundly deaf (N?=?14) and normal-hearing (N?=?14) infants, and to an adult experimenter. First and second formant frequencies and vowel duration of tense (/i/,?/u/) and lax (/I/,?/?/) vowels were measured. Results demonstrated that for both infant groups mothers hyperarticulated the acoustic vowel space and increased vowel duration in ID speech relative to adult-directed speech. Mean F2 values were decreased for the /u/ vowel and increased for the /I/ vowel, and vowel duration was longer for the /i/, /u/, and /I/ vowels in ID speech. However, neither acoustic cue differed in speech to hearing-impaired or normal-hearing infants. These results suggest that both formant frequencies and vowel duration that differentiate American English tense/lx vowel contrasts are modified in ID speech regardless of the hearing status of the addressee.     

The effect of superior auditory skills on vocal accuracy

The relationship between auditory perception and vocal production has been typically investigated by evaluating the effect of either altered or degraded auditory feedback on speech production in either normal hearing or hearing-impaired individuals. Our goal in the present study was to examine this relationship in individuals with superior auditory abilities. Thirteen professional musicians and thirteen nonmusicians, with no vocal or singing training, participated in this study. For vocal production accuracy, subjects were presented with three tones. They were asked to reproduce the pitch using the vowel /a/. This procedure was repeated three times. The fundamental frequency of each production was measured using an autocorrelation pitch detection algorithm designed for this study. The musicians' superior auditory abilities (compared to the nonmusicians) were established in a frequency discrimination task reported elsewhere. Results indicate that (a) musicians had better vocal production accuracy than nonmusicians (production errors of 1/2 a semitone compared to 1.3 semitones, respectively); (b) frequency discrimination thresholds explain 43% of the variance of the production data, and (c) all subjects with superior frequency discrimination thresholds showed accurate vocal production; the reverse relationship, however, does not hold true. In this study we provide empirical evidence to the importance of auditory feedback on vocal production in listeners with superior auditory skills.     

Hearing Aid Use and Auditory Verbal Therapy Improve Voice Quality of Deaf Children

BackgroundAdequate phonation is self-regulated by auditory feedback. Children with bilateral profound hearing loss (PHL) lack this feedback resulting in abnormal voice. Adequate hearing aid use and auditory-verbal therapy (AVT) may improve voice quality in deaf children.ObjectiveTo study whether hearing aid use and AVT approach improve acoustic parameters of voice of children with bilateral PHL.Materials and methodsNineteen children with bilateral PHL were studied. Age range 2–5 years (X = 53.04 months; SD = 9.54). All children were fitted with hearing aids according to auditory testing and they underwent a 1-year auditory habilitation period using the AVT approach. Acoustic analysis of voice including F0, shimmer, and jitter was performed at the onset and at the end of the auditory habilitation period. Final acoustic data were compared to a matched control group of 19 children, age range 2–5 years (X = 52.85; SD = 9.74) with normal hearing.ResultsMean fundamental frequency (F0) was significantly increased after AVT intervention. Shimmer and jitter significantly (P < 0.05) improved after the intervention period. However, despite the improvements, mean F0 at the end of the intervention period was still significantly (P < 0.05) decreased as compared to controls. Also, mean shimmer and jitter at the end of the habilitation period were still significantly (P < 0.05) higher as compared to controls.ConclusionsThe results of this preliminary study suggest that hearing aid use and auditory habilitation with AVT approach improved acoustic voice parameters of children with PHL. However, acoustic parameters persisted abnormal as compared to matched normal hearing controls. AVT approach and regular hearing aid use seem to be safe and reliable clinical tools for improving voice quality of children with PFL.     

The synergy between speech production and perception

Speech intelligibility is known to be relatively unaffected by certain deformations of the acoustic spectrum. These include translations, stretching or contracting dilations, and shearing of the spectrum (represented along the logarithmic frequency axis). It is argued here that such robustness reflects a synergy between vocal production and auditory perception. Thus, on the one hand, it is shown that these spectral distortions are produced by common and unavoidable variations among different speakers pertaining to the length, cross-sectional profile, and losses of their vocal tracts. On the other hand, it is argued that these spectral changes leave the auditory cortical representation of the spectrum largely unchanged except for translations along one of its representational axes. These assertions are supported by analyses of production and perception models. On the production side, a simplified sinusoidal model of the vocal tract is developed which analytically relates a few "articulatory" parameters, such as the extent and location of the vocal tract constriction, to the spectral peaks of the acoustic spectra synthesized from it. The model is evaluated by comparing the identification of synthesized sustained vowels to labeled natural vowels extracted from the TIMIT corpus. On the perception side a "multiscale" model of sound processing is utilized to elucidate the effects of the deformations on the representation of the acoustic spectrum in the primary auditory cortex. Finally, the implications of these results for the perception of generally identifiable classes of sound sources beyond the specific case of speech and the vocal tract are discussed.     

Infrasound and sound: differentiation of their psychophysiological effects through use of genetically deaf animals

The effects of steady-state acoustic stimulation on resistance of fatigue, as shown by reduction of swimming time, was studied on three sublines of mice, one of which is genetically deaf. High frequency (500-10000 Hz) reduce swimming time from 25% to 50% in mice with normal hearing at a 60-80-dB threshold, but have no effect on deaf mice. Low frequencies and infrasounds (6-50 Hz) reduce swimming time in all mice similarly, even deaf animals, but the threshold is higher (160-115 dB). The use of genetically deaf animals therefore permits elimination of the auditory component; differentiation of the effects of air-borne from those of mechanical vibrations are thus possible.     

The Influence of Auditory Feedback and Vocal Rehabilitation on Prelingual Hearing-Impaired Individuals Post Cochlear Implant

ObjectiveTo verify changes in the perceptual and acoustic vocal parameters in prelingual hearing-impaired adults with cochlear implants after vocal rehabilitation.HypothesisAuditory feedback restoration alone after cochlear implant is not enough for vocal adjustments. A targeted and specific voice therapy intervention is required.Study DesignProspective and pre–post repeated measures design.MethodsTwenty literate adults with severe to profound prelingual bilateral sensorineural hearing loss participated in the study; individuals were implanted late and were fluent users of oral language. Ages ranged from 17 to 48 years. All individuals presented normal results in laryngoscopy, and hearing thresholds with the cochlear implant were over 40 dB HL. Individuals were randomly distributed into two groups: Group 1 (treatment group) and Group 2 (control group), both with ten patients each, five men and five women, matching mean age and hearing deprivation time before the cochlear implantation. Patients from Group 1 underwent a protocol of vocal therapy including 12 individual sessions with the same clinician. Group 2 only underwent vocal recordings. The vocal recordings occurred before and after the participation in the therapy protocol for Group 1 and after the same period, 3 months later, without any intervention, for Group 2. The recording sessions used the Consensus Auditory-Perceptual Evaluation of Voice protocol sentence reading and emission of sustained vowel /a/. Auditory-perceptual evaluation of voices was performed by three judges, and the acoustical analysis used the Praat program.ResultsStatistically significant reductions in the overall vocal degree, vocal instability, and degree of resonance change were observed after vocal rehabilitation in Group 1. Statistically, individuals from Group 1 did not differ in regard to the modification of acoustic parameters. Group 2 did not present significant changes in any of the analyzed parameters.ConclusionsThe cochlear implanted adults submitted to vocal rehabilitation presented changes in the auditory-perceptual parameters, with reduction of the overall voice severity, vocal instability, and degree of resonance after vocal intervention. There were no changes in the acoustic parameters in the implanted prelingual hearing-impaired adult subjects.     

Encoding voice fundamental frequency into vibrotactile frequency.

Measured in this study was the ability of eight hearing and five deaf subjects to identify the stress pattern in a short sentence from the variation in voice fundamental frequency (F0), when presented aurally (for hearing subjects) and when transformed into vibrotactile pulse frequency. Various transformations from F0 to pulse frequency were tested in an attempt to determine an optimum transformation, the amount of F0 information that could be transmitted, and what the limitations in the tactile channel might be. The results indicated that a one- or two-octave reduction of F0 vibrotactile frequency (transmitting every second or third glottal pulse) might result in a significant ability to discriminate the intonation patterns associated with moderate-to-strong patterns of sentence stress in English. However, accurate reception of the details of the intonation pattern may require a slower than normal pronounciation because of an apparent temporal indeterminacy of about 200 ms in the perception of variations in vibrotactile frequency. A performance deficit noted for the two prelingually, profoundly deaf subjects with marginally discriminable encodings offers some support for our previous hypothesis that there is a natural association between auditory pitch and perceived vibrotactile frequency.     

Speech perception studies using a multichannel electrotactile speech processor, residual hearing, and lipreading

Three studies are reported on the speech perception of normally hearing and hearing-impaired adults using combinations of visual, auditory, and tactile input. In study 1, mean scores for four normally hearing subjects showed that addition of tactile information, provided through the multichannel electrotactile speech processor, to either audition alone (300-Hz low-pass-filtered speech) or lipreading plus audition resulted in significant improvements in phoneme and word discrimination scores. Information transmission analyses demonstrated the effectiveness of the tactile aid in providing cues to duration, F1 and F2 features for vowels, and manner of articulation features for consonants, especially features requiring detection and discrimination of high-frequency information. In study 2, six different cutoff frequencies were used for a low-pass-filtered auditory signal. Mean scores for vowel and consonant identification were significantly higher with the addition of tactile input to audition alone at each cutoff frequency up to 1500 Hz. The mean speechtracking rate was also significantly increased by the additional tactile input up to 1500 Hz. Study 3 examined speech discrimination of three hearing-impaired adults. Additional information available through the tactile aid was shown to improve speech discrimination scores; however, the degree of increase was inversely related to the level of residual hearing. Results indicate that the electrotactile aid may be useful for patients with little residual hearing and for the severely to profoundly hearing impaired, who could benefit from the high-frequency information presented through the tactile modality, but unavailable through hearing aids.     

Perception of acoustic scale and size in musical instrument sounds

There is size information in natural sounds. For example, as humans grow in height, their vocal tracts increase in length, producing a predictable decrease in the formant frequencies of speech sounds. Recent studies have shown that listeners can make fine discriminations about which of two speakers has the longer vocal tract, supporting the view that the auditory system discriminates changes on the acoustic-scale dimension. Listeners can also recognize vowels scaled well beyond the range of vocal tracts normally experienced, indicating that perception is robust to changes in acoustic scale. This paper reports two perceptual experiments designed to extend research on acoustic scale and size perception to the domain of musical sounds: The first study shows that listeners can discriminate the scale of musical instrument sounds reliably, although not quite as well as for voices. The second experiment shows that listeners can recognize the family of an instrument sound which has been modified in pitch and scale beyond the range of normal experience. We conclude that processing of acoustic scale in music perception is very similar to processing of acoustic scale in speech perception.     

Age-dependent plasticity in the superior temporal sulcus in deaf humans: a functional MRI study

Background  

Sign-language comprehension activates the auditory cortex in deaf subjects. It is not known whether this functional plasticity in the temporal cortex is age dependent. We conducted functional magnetic-resonance imaging in six deaf signers who lost their hearing before the age of 2 years, five deaf signers who were >5 years of age at the time of hearing loss and six signers with normal hearing. The task was sentence comprehension in Japanese sign language.     

Comparison of the Visual Performance of Deaf and Hearing Children and Adults in a Detection Task

Visual signal detection psychophysical experiments were done with hearing and deaf subjects, children and adults. Our participants were carefully selected in order to constitute samples of observers as homogeneous as possible. Criteria for selection included consistency as observers (determined by means of preliminary experiments) and age. Our experiments were done under the Two-Alternative-Forced Choice paradigm, using images with Gaussian noise of known energy as background and signals of predetermined energies. Our results suggest that the visual capabilities of deaf and hearing children are practically the same, while deaf adults, when compared to hearing adults, consistently showed higher performances, which tended to become significant as the signal energy was increased.