Identification and discrimination of bilingual talkers across languages

This study investigated the extent to which language familiarity affects the perception of the indexical properties of speech by testing listeners' identification and discrimination of bilingual talkers across two different languages. In one experiment, listeners were trained to identify bilingual talkers speaking in only one language and were then tested on their ability to identify the same talkers speaking in another language. In the second experiment, listeners discriminated between bilingual talkers across languages in an AX discrimination paradigm. The results of these experiments indicate that there is sufficient language-independent indexical information in speech for listeners to generalize knowledge of talkers' voices across languages and to successfully discriminate between bilingual talkers regardless of the language they are speaking. However, the results of these studies also revealed that listeners do not solely rely on language-independent information when performing these tasks. Listeners use language-dependent indexical cues to identify talkers who are speaking a familiar language. Moreover, the tendency to perceive two talkers as the "same" or "different" depends on whether the talkers are speaking in the same language. The combined results of these experiments thus suggest that indexical processing relies on both language-dependent and language-independent information in the speech signal.     

Perceptual weights in auditory level discrimination

Perceptual weights in level discrimination (also called intensity discrimination) were determined for 3-, 7-, 15-, and 24-component tone complexes with flat spectral envelopes using a correlational paradigm. Each frequency component was randomly and independently perturbed in level oneach presentation. For the target interval, frequency-component levels were additionally increased by the level increment to be detected, deltaL [= 201og10((p + deltap)/p), where p is pressure]. Weights were calculated from the across-trial correlation between the level perturbations for each frequency component and the interval chosen by the listener. Two conditions were investigated: (1) deltaL was equal across frequency components, and (2) deltaL increased progressively across frequency components. For both conditions, data for four listeners usually showed the greatest weight for the highest frequency component. The two-to-four highest frequency components generally were most important for level discrimination. The effect of increasing deltaL progressively with frequency was small and inconsistent. Additional measurements showed that flanking noise maskers designed to mask spread of excitation caused only small and generally unsystematic changes to the weights. Overall, these results indicate that listeners combine information across a wide range of auditory channels to arrive at a decision for level discrimination, but the weighting of channels appears to be suboptimal.     

Monaural and interaural intensity discrimination: level effects and the "binaural advantage"

This study examined whether the level effects seen in monaural intensity discrimination (Weber's law and the "near miss") in a two-interval task are also observed in discrimination of interaural intensity differences (IIDs) in a single-interval task. Both tasks were performed for various standard levels of 4-kHz pure tones and broadband noise. The Weber functions (10 log deltaI/I versus I in dB) in the monaural and binaural conditions were parallel. For noise, the Weber functions had slopes close to zero (Weber's law) while the Weber functions for the tones had a mean slope of -0.089 (near miss). The near miss for the monaural and binaural tasks with tones was eliminated when a high-pass masker was gated with the listening intervals. The near-miss was also observed for 250- and 1000-Hz tones in the binaural task despite overall decreased sensitivity to changes in IID at 1000 Hz. The binaural thresholds showed a small (about 2-dB) advantage over monaural thresholds only in the broadband noise conditions. More important, however, is the fact that the level effects seen monaurally are also seen binaurally. This suggests that the basic mechanisms responsible for Weber's law and the near miss are common to monaural and binaural processing.     

Detection and rate discrimination of amplitude modulation in electrical hearing

Three experiments were designed to examine temporal envelope processing by cochlear implant (CI) listeners. In experiment 1, the hypothesis that listeners' modulation sensitivity would in part determine their ability to discriminate between temporal modulation rates was examined. Temporal modulation transfer functions (TMTFs) obtained in an amplitude modulation detection (AMD) task were compared to threshold functions obtained in an amplitude modulation rate discrimination (AMRD) task. Statistically significant nonlinear correlations were observed between the two measures. In experiment 2, results of loudness-balancing showed small increases in the loudness of modulated over unmodulated stimuli beyond a modulation depth of 16%. Results of experiment 3 indicated small but statistically significant effects of level-roving on the overall gain of the TMTF, but no impact of level-roving on the average shape of the TMTF across subjects. This suggested that level-roving simply increased the task difficulty for most listeners, but did not indicate increased use of intensity cues under more challenging conditions. Data obtained with one subject, however, suggested that the most sensitive listeners may derive some benefit from intensity cues in these tasks. Overall, results indicated that intensity cues did not play an important role in temporal envelope processing by the average CI listener.     

Decision strategies of hearing-impaired listeners in spectral shape discrimination

The ability to discriminate between sounds with different spectral shapes was evaluated for normal-hearing and hearing-impaired listeners. Listeners detected a 920-Hz tone added in phase to a single component of a standard consisting of the sum of five tones spaced equally on a logarithmic frequency scale ranging from 200 to 4200 Hz. An overall level randomization of 10 dB was either present or absent. In one subset of conditions, the no-perturbation conditions, the standard stimulus was the sum of equal-amplitude tones. In the perturbation conditions, the amplitudes of the components within a stimulus were randomly altered on every presentation. For both perturbation and no-perturbation conditions, thresholds for the detection of the 920-Hz tone were measured to compare sensitivity to changes in spectral shape between normal-hearing and hearing-impaired listeners. To assess whether hearing-impaired listeners relied on different regions of the spectrum to discriminate between sounds, spectral weights were estimated from the perturbed standards by correlating the listener's responses with the level differences per component across two intervals of a two-alternative forced-choice task. Results showed that hearing-impaired and normal-hearing listeners had similar sensitivity to changes in spectral shape. On average, across-frequency correlation functions also were similar for both groups of listeners, suggesting that as long as all components are audible and well separated in frequency, hearing-impaired listeners can use information across frequency as well as normal-hearing listeners. Analysis of the individual data revealed, however, that normal-hearing listeners may be better able to adopt optimal weighting schemes. This conclusion is only tentative, as differences in internal noise may need to be considered to interpret the results obtained from weighting studies between normal-hearing and hearing-impaired listeners.     

Level discrimination of single tones in a multitone complex by normal-hearing and hearing-impaired listeners

A conditional-on-a-single-stimulus (COSS) analysis procedure [B. G. Berg, J. Acoust. Soc. Am. 86, 1743-1746 (1989)] was used to estimate how well normal-hearing and hearing-impaired listeners selectively attend to individual spectral components of a broadband signal in a level discrimination task. On each trial, two multitone complexes consisting of six octave frequencies from 250 to 8000 Hz were presented to listeners. The levels of the individual tones were chosen independently and at random on each presentation. The target tone was selected, within a block of trials, as the 250-, 1000-, or 4000-Hz component. On each trial, listeners were asked to indicate which of the two complex sounds contained the higher level target. As a group, normal-hearing listeners exhibited greater selectivity than hearing-impaired listeners to the 250-Hz target, while hearing-impaired listeners showed greater selectivity than normal-hearing listeners to the 4000-Hz target, which is in the region of their hearing loss. Both groups of listeners displayed large variability in their ability to selectively weight the 1000-Hz target. Trial-by-trial analysis showed a decrease in weighting efficiency with increasing frequency for normal-hearing listeners, but a relatively constant weighting efficiency across frequency for hearing-impaired listeners. Interestingly, hearing-impaired listeners selectively weighted the 4000-Hz target, which was in the region of their hearing loss, more efficiently than did the normal-hearing listeners.     

Sound segregation based on temporal envelope structure and binaural cues

The ability to segregate two spectrally and temporally overlapping signals based on differences in temporal envelope structure and binaural cues was investigated. Signals were a harmonic tone complex (HTC) with 20 Hz fundamental frequency and a bandpass noise (BPN). Both signals had interaural differences of the same absolute value, but with opposite signs to establish lateralization to different sides of the medial plane, such that their combination yielded two different spatial configurations. As an indication for segregation ability, threshold interaural time and level differences were measured for discrimination between these spatial configurations. Discrimination based on interaural level differences was good, although absolute thresholds depended on signal bandwidth and center frequency. Discrimination based on interaural time differences required the signals' temporal envelope structures to be sufficiently different. Long-term interaural cross-correlation patterns or long-term averaged patterns after equalization-cancellation of the combined signals did not provide information for the discrimination. The binaural system must, therefore, have been capable of processing changes in interaural time differences within the period of the harmonic tone complex, suggesting that monaural information from the temporal envelopes influences the use of binaural information in the perceptual organization of signal components.     

Context dependence of fundamental-frequency discrimination: lateralized temporal fringes

In a two-interval, two-alternative, forced-choice (2I-2AFC) adaptive procedure, listeners discriminated between the fundamental frequencies (F0s) of two 100-ms harmonic target complexes. This ability can be impaired substantially by the presence of another complex (the "fringe") immediately before and after each target complex. It has been shown that for the impairment to occur (i) target and fringes have to be in the same frequency region; (ii) if all harmonics of target and fringes are unresolved then they may differ in F0; otherwise, they have to be similar [C. Micheyl and R. P. Carlyon, J. Acoust. Soc. Am. 104, 3006-3018 (1998)]. These findings have been discussed in terms of information about the fringe's F0 being included in the estimate of the F0 of the target, and in terms of auditory streaming. The present study investigated the role of perceived location and ipsilateral versus contralateral presentation of the fringes on F0 discrimination of the target. Experiment 1 used interaural level differences (ILDs), and experiment 2 used interaural time differences (ITDs) to create a range of lateralized perceptions of the 200-ms harmonic fringes. Difference limens for the F0 of the monaural target complex were measured in the presence and absence of the fringes. The nominal F0 was 88 or 250 Hz and could be the same or different for target and fringes. Stimuli were bandpass filtered between 125-625, 1375-1875, or 3900-5400 Hz. In both experiments, the effect of the fringes was reduced when their subjective location differed from that of the target. This reduction depended on the resolvability of both the fringes and the target. The effect of the fringes was reduced most (but still present), when fringes were presented purely contralaterally to the target. The results are consistent with the idea that the fringes produce interference when the listeners have difficulty segregating the target from the fringes, and that a difference in perceived location enhances segregation of the sequentially presented stimuli.     

Performance in several binaural-interaction experiments

The relationship between interaural correlation discrimination and binaural detection was investigated using common experimental procedures and common subjects. Psychometric functions were obtained for four normal-hearing subjects at 500 and 4000 Hz using third-octave noise signals for the correlation discrimination experiment, and pure-tone signals and third-octave noise maskers for the detection experiment. Results from these two measurements, which were compared by expressing the signal-to-noise ratio as an equivalent change in interaural correlation, support the idea that interaural correlation discrimination and binaural detection are closely related. Since large intersubject differences in binaural performance were observed in these experiments, interaural-time, interaural-intensity, and monaural-intensity discrimination were measured in a second experiment. The results of the second experiment show large intersubject differences for the interaural tasks, but not for the monaural task.     

Evidence specifically favoring the equalization-cancellation theory of binaural unmasking

Three experiments investigated the roles of interaural correlation (rho) and of the monaural power spectrum in the detection and discrimination of narrow-band-noise signals (462-539 Hz) in broadband maskers (0-3 kHz). The power and rho of the target band were independently controlled, while the flanking noise was fixed and diotic. Experiments 1 and 2 involved rho and power values that would be produced by specific values of signal-to-noise ratio (SNR) in the NoSpi binaural configuration. Listeners were required to discriminate different SNRs via a 2I-FC loudness-discrimination task. At low reference SNRs, changes in rho fully accounted for listeners' performance, but as reference SNR increased, additional energy in the target band played an increasing role. Experiment 2 showed that at these higher SNRs the combination of information from the power spectrum and rho was superadditive and could not be explained by simple signal-detection models. The equalization-cancellation (EC) theory would explain these data using the output from interaural cancellation, Y, rather than rho. Experiment 3 attempted to foil binaural processing, by fixing either rho or Y across intervals. Consistent with EC theory, when Y was fixed, the contribution of the binaural system appeared negligible, while fixing rho did not have this effect.     

Monaural and interaural temporal modulation transfer functions measured with 5-kHz carriers

Temporal modulation transfer functions (TMTFs) were measured for detection of monaural sinusoidal amplitude modulation and dynamically varying interaural level differences for a single set of listeners. For the interaural TMTFs, thresholds are the modulation depths at which listeners can just discriminate interaural envelope-phase differences of 0 and 180 degrees. A 5-kHz pure tone and narrowband noises, 30- and 300-Hz wide centered at 5 kHz, were used as carriers. In the interaural conditions, the noise carriers were either diotic or interaurally uncorrelated. The interaural TMTFs with tonal and diotic noise carriers exhibited a low-pass characteristic but the cutoff frequencies changed nonmonotonically with increasing bandwidth. The interaural TMTFs for the tonal carrier began rolling off approximately a half-octave lower than the tonal monaural TMTF (approximately 80 Hz vs approximately 120 Hz). Monaural TMTFs obtained with noise carriers showed effects attributable to masking of the signal modulation by intrinsic fluctuations of the carrier. In the interaural task with dichotic noise carriers, similar masking due to the interaural carrier fluctuations was observed. Although the mechanisms responsible for differences between the monaural and interaural TMTFs are unknown, the lower binaural TMTF cutoff frequency suggests that binaural processing exhibits greater temporal limitation than monaural processing.     

Can basic auditory and cognitive measures predict hearing-impaired listeners' localization and spatial speech recognition abilities?

This study aimed to clarify the basic auditory and cognitive processes that affect listeners' performance on two spatial listening tasks: sound localization and speech recognition in spatially complex, multi-talker situations. Twenty-three elderly listeners with mild-to-moderate sensorineural hearing impairments were tested on the two spatial listening tasks, a measure of monaural spectral ripple discrimination, a measure of binaural temporal fine structure (TFS) sensitivity, and two (visual) cognitive measures indexing working memory and attention. All auditory test stimuli were spectrally shaped to restore (partial) audibility for each listener on each listening task. Eight younger normal-hearing listeners served as a control group. Data analyses revealed that the chosen auditory and cognitive measures could predict neither sound localization accuracy nor speech recognition when the target and maskers were separated along the front-back dimension. When the competing talkers were separated along the left-right dimension, however, speech recognition performance was significantly correlated with the attentional measure. Furthermore, supplementary analyses indicated additional effects of binaural TFS sensitivity and average low-frequency hearing thresholds. Altogether, these results are in support of the notion that both bottom-up and top-down deficits are responsible for the impaired functioning of elderly hearing-impaired listeners in cocktail party-like situations.     

Informational processing of complex sound. I: Intensity discrimination

This paper reports on some initial experiments using the sample discrimination paradigm to investigate normal-hearing listeners' ability to process information in complex, nonspeech sounds. An important feature of the sample discrimination experiment is that the value of the difference to be discriminated randomly varies from trial to trial. It is this variation that yields potential information. In the present study, listeners heard a pair of multitone complexes (or sequences) on each trial. The individual levels of the tones were drawn from two normal distributions differing only in mean. The listener's task was to identify the sound having the higher mean tone level. For an ideal observer in these experiments, performance in d' grows as the square root n, where n is the number of tones. Obtained d' grew more nearly as the cube root of n regardless of whether the tones were played sequentially or simultaneously or whether they were increased in number from high frequencies to low or from low frequencies to high. A preliminary model is proposed in which discrimination performance depends predominantly on the information content of the sounds and is largely independent of the physical dimensions along which the sounds vary. Information content is defined in terms of the variance of the underlying stimulus distributions and a stimulus equivocation factor that is derived from the data. Based on this model, transmitted information is estimated to be between 1.0 and 2.6 bits.     

Binaural weighting of monaural spectral cues for sound localization

For human listeners, cues for vertical-plane localization are provided by direction-dependent pinna filtering. This study quantified listeners' weighting of the spectral cues from each ear as a function of stimulus lateral angle, interaural time difference (ITD), and interaural level difference (ILD). Subjects indicated the apparent position of headphone-presented noise bursts synthesized in virtual auditory space. The synthesis filters for the two ears either corresponded to the same location or to two different locations separated vertically by 20 deg. Weighting of each ear's spectral information was determined by a multiple regression between the elevations to which each ear's spectrum corresponded and the vertical component of listeners' responses. The apparent horizontal source location was controlled either by choosing synthesis filters corresponding to locations on or 30 deg left or right of the median plane or by attenuating or delaying the signal at one ear. For broadband stimuli, spectral weighting and apparent lateral angle were determined primarily by ITD. Only for high-pass stimuli were weighting and lateral angle determined primarily by ILD. The results suggest that the weighting of monaural spectral cues and the perceived lateral angle of a sound source depend similarly on ITD, ILD, and stimulus spectral range.     

Factors affecting vowel formant discrimination by hearing-impaired listeners

The goal of this study was to measure the ability of adult hearing-impaired listeners to discriminate formant frequency for vowels in isolation, syllables, and sentences. Vowel formant discrimination for F1 and F2 for the vowels /I epsilon ae / was measured. Four experimental factors were manipulated including linguistic context (isolated vowels, syllables, and sentences), signal level (70 and 95 dB SPL), formant frequency, and cognitive load. A complex identification task was added to the formant discrimination task only for sentences to assess effects of cognitive load. Results showed significant elevation in formant thresholds as formant frequency and linguistic context increased. Higher signal level also elevated formant thresholds primarily for F2. However, no effect of the additional identification task on the formant discrimination was observed. In comparable conditions, these hearing-impaired listeners had elevated thresholds for formant discrimination compared to young normal-hearing listeners primarily for F2. Altogether, poorer performance for formant discrimination for these adult hearing-impaired listeners was mainly caused by hearing loss rather than cognitive difficulty for tasks implemented in this study.     

Comparing F0 discrimination in sequential and simultaneous conditions

In an influential study, Carlyon and Shackleton [J. Acoust. Soc. Am. 95, 3541-3554 (1994)] measured listeners' performance (d') in fundamental-frequency (F0) discrimination between harmonic complex tones (HCTs) presented simultaneously in different spectral regions and compared their performance with that found in a sequential-comparison task. In this Letter, it is suggested that Carlyon and Shackleton's analysis of the simultaneous-comparison data did not adequately reflect their assumption that listeners were effectively comparing F0's across regions. A reanalysis consistent with this assumption is described. The new results suggest that under the assumption that listeners were effectively comparing F0 across regions, their performance in this task was substantially higher than originally estimated by Carlyon and Shackleton, and in some conditions much higher than expected from the performances measured in a traditional F0-discrimination task with sequential HCTs. Possible explanations for this outcome, as well as alternative interpretations, are proposed.     

Temporal processing in the aging auditory system.

Measures of monaural temporal processing and binaural sensitivity were obtained from 12 young (mean age = 26.1 years) and 12 elderly (mean age = 70.9 years) adults with clinically normal hearing (pure-tone thresholds < or = 20 dB HL from 250 to 6000 Hz). Monaural temporal processing was measured by gap detection thresholds. Binaural sensitivity was measured by interaural time difference (ITD) thresholds. Gap and ITD thresholds were obtained at three sound levels (4, 8, or 16 dB above individual threshold). Subjects were also tested on two measures of speech perception, a masking level difference (MLD) task, and a syllable identification/discrimination task that included phonemes varying in voice onset time (VOT). Elderly listeners displayed poorer monaural temporal analysis (higher gap detection thresholds) and poorer binaural processing (higher ITD thresholds) at all sound levels. There were significant interactions between age and sound level, indicating that the age difference was larger at lower stimulus levels. Gap detection performance was found to correlate significantly with performance on the ITD task for young, but not elderly adult listeners. Elderly listeners also performed more poorly than younger listeners on both speech measures; however, there was no significant correlation between psychoacoustic and speech measures of temporal processing. Findings suggest that age-related factors other than peripheral hearing loss contribute to temporal processing deficits of elderly listeners.     

Perception of coarticulatory nasalization by speakers of English and Thai: evidence for partial compensation

The conditions under which listeners do and do not compensate for coarticulatory vowel nasalization were examined through a series of experiments of listeners' perception of naturally produced American English oral and nasal vowels spliced into three contexts: oral (C_C), nasal (N_N), and isolation. Two perceptual paradigms, a rating task in which listeners judged the relative nasality of stimulus pairs and a 4IAX discrimination task in which listeners judged vowel similarity, were used with two listener groups, native English speakers and native Thai speakers. Thai and English speakers were chosen because their languages differ in the temporal extent of anticipatory vowel nasalization. Listeners' responses were highly context dependent. For both perceptual paradigms and both language groups, listeners were less accurate at judging vowels in nasal than in non-nasal (oral or isolation) contexts; nasal vowels in nasal contexts were the most difficult to judge. Response patterns were generally consistent with the hypothesis that, given an appropriate and detectable nasal consonant context, listeners compensate for contextual vowel nasalization and attribute the acoustic effects of the nasal context to their coarticulatory source. However, the results also indicated that listeners do not hear nasal vowels in nasal contexts as oral; listeners retained some sensitivity to vowel nasalization in all contexts, indicating partial compensation for coarticulatory vowel nasalization. Moreover, there were small but systematic differences between the native Thai- and native English-speaking groups. These differences are as expected if perceptual compensation is partial and the extent of compensation is linked to patterns of coarticulatory nasalization in the listeners' native language.     

Speech perception from monaural and binaural information

Two experiments explored the concept of the binaural spectrogram [Culling and Colburn, J. Acoust. Soc. Am. 107, 517-527 (2000)] and its relationship to monaurally derived information. In each experiment, speech was added to noise at an adverse signal-to-noise ratio in the NoS pi binaural configuration. The resulting monaural and binaural cues were analyzed within an array of spectro-temporal bins and then these cues were resynthesized by modulating the intensity and/or interaural correlation of freshly generated noise. Experiment 1 measured the intelligibility of the resynthesized stimuli and compared them with the original NoSo and NoS pi stimuli at a fixed signal-to-noise ratio. While NoS pi stimuli were approximately equal to 50% intelligible, each cue in isolation produced similar (very low) intelligibility to the NoSo condition. The resynthesized combination produced approximately equal to 25% intelligibility. Modulation of interaural correlation below 1.2 kHz and of amplitude above 1.2 kHz was not as effective as their combination across all frequencies. Experiment 2 measured three-point psychometric functions in which the signal-to-noise ratio of the original NoS pi stimulus was increased in 3-dB steps from the level used in experiment 1. Modulation of interaural correlation alone proved to have a flat psychometric function. The functions for NoS pi and for combined monaural and binaural cues appeared similar in slope, but shifted horizontally. The results indicate that for sentence materials, neither fluctuations in interaural correlation nor in monaural intensity are sufficient to support speech recognition at signal-to-noise ratios where 50% intelligibility is achieved in the NoS pi configuration; listeners appear to synergistically combine monaural and binaural information in this task, to some extent within the same frequency region.     

Perception of intraphonemic differences by phoneticians, musicians, and inexperienced listeners

Several studies have shown that extensive training with synthetic speech sounds can result in substantial improvements in listeners' perception of intraphonemic differences. The purpose of the present study was to investigate the effects of listening experience on the perception of intraphonemic differences in the absence of specific training with the synthetic speech sounds being tested. Phonetically trained listeners, musicians, and untrained listeners were tested on a two-choice identification task, a three-choice identification task, and an ABX discrimination task using a synthetic [bi]-[phi] continuum and a synthetic [wei]-[rei] continuum. The three-choice identification task included the identification of stimuli with an "indefinite" or "ambiguous" quality in addition to clear instances of the opposing phonetic categories. Results included: (1) All three subject groups showed some ability to identify ambiguous stimuli; (2) phonetically trained listeners were better at identifying ambiguous stimuli than musicians and untrained listeners; (3) phonetically trained listeners performed better on the discrimination task than musicians and untrained listeners; (4) musicians and untrained listeners did not differ on any of the listening tasks; and (5) participation by the inexperienced listeners in a 10-week introductory phonetics course did not result in improvements in either the three-choice identification task or the discrimination task.