The effects of binaural spectral resolution mismatch on Mandarin speech perception in simulated electric hearing

This study assessed the effects of binaural spectral resolution mismatch on the intelligibility of Mandarin speech in noise using bilateral cochlear implant simulations. Noise-vocoded Mandarin speech, corrupted by speech-shaped noise at 0 and 5?dB signal-to-noise ratios, were presented unilaterally or bilaterally to normal-hearing listeners with mismatched spectral resolution between ears. Significant binaural benefits for Mandarin speech recognition were observed only with matched spectral resolution between ears. In addition, the performance of tone identification was more robust to noise than that of sentence recognition, suggesting factors other than tone identification might account more for the degraded sentence recognition in noise.     

Statistical bias in the assessment of binaural benefit relative to the better ear

The comparison of measured binaural performance with the better of two monaural measures (one from each ear) may lead to underestimated binaural benefit due to statistical sampling bias that favors the monaural condition. The mathematical basis of such bias is reviewed and applied to speech reception thresholds measured in 32 bilateral cochlear implant (CI) users for coincident and spatially separated speech and noise. It is shown that the bias increases with test-retest variation and is maximal for uncorrelated samples of identical underlying performance in each ear. When measured differences between ears were assumed to reflect actual underlying performance differences, the bias averaged across the CI users was about 0.2 dB for coincident target and noise, and 0.1 dB for spatially separated conditions. An upper-bound estimate of the bias, based on the assumption that both ears have the same underlying performance and observed differences were due to test-retest variation, was about 0.7 dB regardless of noise location. To the extent that the test-retest variation in these data is comparable to other studies, the results indicate that binaural benefits in bilateral cochlear implant users are not substantially underestimated (on for average) when binaural performance is compared with the better ear in each listening configuration.     

Modeling binaural loudness

A survey of data on the perception of binaurally presented sounds indicates that loudness summation across ears is less than perfect; a diotic sound is less than twice as loud as the same sound presented monaurally. The loudness model proposed by Moore et al. [J. Audio Eng. Soc. 45, 224-240 (1997)] determines the loudness of binaural stimuli by a simple summation of loudness across ears. It is described here how the model can be modified so as to give more accurate predictions of the loudness of binaurally presented sounds, including cases where the sounds at the two ears differ in level, frequency or both. The modification is based on the idea that there are inhibitory interactions between the internal representations of the signals at the two ears, such that a signal at the left ear inhibits (reduces) the loudness evoked by a signal at the right ear, and vice versa. The inhibition is assumed to spread across frequency channels. The modified model gives reasonably accurate predictions of a variety of data on the loudness of binaural stimuli, including data obtained using loudness scaling and loudness matching procedures.     

Binaural and monaural auditory filter bandwidths and time constants in probe tone detection experiments.

Auditory filter bandwidths and time constants were obtained with five normal-hearing subjects for different masker configurations both in the frequency and time domain for monaural and binaural listening conditions. Specifically, the masking level in the monaural condition and the interaural correlation in the binaural conditions, respectively, was changed in a sinusoidal, stepwise, and rectangular way in the frequency domain. In the corresponding experiments in the time domain, a sinusoidal and stepwise change of the masker was performed. From these results, a comparison was made across conditions to evaluate the influence of the factors "shape of transition," "monaural versus binaural," "frequency domain versus time domain," and "subject." Also, the respective data from the literature were considered using the same model assumptions and fitting strategy as used for the current data. The results indicate that the monaural auditory filter bandwidths and time constants fitted to the data are consistent across conditions both for the data included in this study and the data from the literature. No consistent relation between individual auditory filter bandwidths and time constants were found across subjects. For the binaural conditions, however, considerable differences were found in estimates of the bandwidths and time constants, respectively, across conditions. The reason for this mismatch seems to be the different detection strategies employed for the various tasks that are affected by the consistency of binaural information across frequency and time. While monaural detection performance appears to be modeled quite well with a linear filter or temporal integration window, this does not hold for the binaural conditions where both larger bandwidth and time constant estimates are found.     

Octave illusion elicited by overlapping narrowband noises

The octave or Deutsch illusion occurs when two tones, separated by about one octave, are presented simultaneously but alternating between ears, such that when the low tone is presented to the left ear the high tone is presented to the right ear and vice versa. Most subjects hear a single tone that alternates both between ears and in pitch; i.e., they hear a low pitched tone in one ear alternating with a high pitched tone in the other ear. The present study examined whether the illusion can be elicited by aperiodic signals consisting of low-frequency band-pass filtered noises with overlapping spectra. The amount of spectral overlap was held constant, but the high- and low-frequency content of the signals was systematically varied. The majority of subjects perceived an auditory illusion in terms of a dominant ear for pitch and lateralization by frequency, as proposed by Deutsch [(1975a) Sci. Am. 233, 92-104]. Furthermore, the salience of the illusion increased as the high frequency of the content in the signal increased. Since no harmonics were present in the stimuli, it is highly unlikely that this illusion is perceived on the basis of binaural diplacusis or harmonic binaural fusion.     

Binaural versus monaural loudness: supersummation of tone partially masked by noise

A series of three experiments used the method of magnitude estimation to examine binaural summation of the loudness of a 1000-Hz tone heard in the quiet and against various backgrounds of masking noise. In the quiet, binaural loudness as measured in sones, is twice monaural loudness. Two conditions of noise masking acted to increase the ratio of binaural/monaural loudness in sones above 2:1--that is, to produce supersummation. (1) When tone was presented to both ears, but masking noise to just one ear (dichotic stimulation), the loudness of the binaural tone was 30%-35% greater than the sum of the loudness of the monaural components. This increase in summation provides a suprathreshold analog to increases in threshold sensitivity observed with dichotic stimulation (masking-level differences). (2) Supersummation was also evident when tone and noise alike were presented to both ears (diotic stimulation); here, the binaural tone's loudness was 10%-25% greater than the sum of the monaural components. The increase in summation with diotic stimulation may be related to the characteristics of binaural summation of the noise masker itself.     

利用残差网络分析普氏蹄蝠耳朵对恒频声源定向的影响

为研究恒频蝙蝠耳朵与空间定位的关系,利用深度学习算法和仿蝙蝠静态双耳接收器,分析蝙蝠耳朵对恒频声源定向的影响。首先根据普氏蹄蝠耳朵模型设计不同双耳夹角和间距的仿生双耳接收器,并从多个空间方位采集声源发射的不同频率的恒频声呐信号,然后提取双耳同步采集信号的时频图并归一化作为输入特征,最后利用残差网络实现声源定向。实验结果表明,静态双耳接收器对恒频声源的定向误差平均值基本保持在3.5°以下,但高于动态单耳接收器的定向误差;定向精度与声源频率及声源所在空间方位有关,声源位于接收器水平方向±30°范围内时,定向精度相对较高;双耳夹角和间距也会影响定向精度,且前者影响较为显著。     

Tone-burst-evoked otoacoustic emissions from normal-hearing subjects

Tone-burst-evoked otoacoustic emissions were measured as a function of tone-burst sound pressure level and frequency in normally hearing ears. Although the spectral and temporal properties varied across individual ears, there was a close correspondence between stimulus and response spectra. Both the spectral and latency characteristics of tone-burst-evoked emissions are consistent with the hypothesis that they are generated at sites along the cochlear partition corresponding to their frequency.     

The contribution of the near and far ear toward localization of sound in the sagittal plane

Eight listeners were required to locate a train of 4.5-kHz high-pass noise bursts emanating from loudspeakers positioned +/- 30, +/- 20, +/- 10, and 0 deg re: interaural axis. The vertical array of loudspeakers was placed at 45, 90, and 135 deg left of midline. The various experimental conditions incorporated binaural and monaural listening with the latter utilizing the ear nearest or ear farthest from the sound source. While performance excelled when listening with only the near ear, the contribution of the far ear was statistically significant when compared to localization performance when both ears were occluded. Based on head related transfer functions for stimuli whose bandwidth was 1.0 kHz, four spectral cues were selected as candidates for influencing location judgments. Two of them associated relative changes in energy across center frequencies (CFs) with vertical source positions. The other two associated an absolute minimum (maximum) energy for specific CFs with a vertical source position. All but one cue when measured for the near ear could account for localization proficiency. On the other hand, when listening with the far ear, maximum energy at a specific CF outperformed the remaining cues in accounting for localization proficiency.     

Binaural loudness summation for speech presented via earphones and loudspeaker with and without visual cues

Preliminary data [M. Epstein and M. Florentine, Ear. Hear. 30, 234-237 (2009)] obtained using speech stimuli from a visually present talker heard via loudspeakers in a sound-attenuating chamber indicate little difference in loudness when listening with one or two ears (i.e., significantly reduced binaural loudness summation, BLS), which is known as "binaural loudness constancy." These data challenge current understanding drawn from laboratory measurements that indicate a tone presented binaurally is louder than the same tone presented monaurally. Twelve normal listeners were presented recorded spondees, monaurally and binaurally across a wide range of levels via earphones and a loudspeaker with and without visual cues. Statistical analyses of binaural-to-monaural ratios of magnitude estimates indicate that the amount of BLS is significantly less for speech presented via a loudspeaker with visual cues than for stimuli with any other combination of test parameters (i.e., speech presented via earphones or a loudspeaker without visual cues, and speech presented via earphones with visual cues). These results indicate that the loudness of a visually present talker in daily environments is little affected by switching between binaural and monaural listening. This supports the phenomenon of binaural loudness constancy and underscores the importance of ecological validity in loudness research.     

A central spectrum theory of binaural processing. Evidence from dichotic pitch

A theory is presented that describes the binaural processing of interaural time or phase differences. It is an elaboration of the central spectrum concept for the explanation of dichotic pitch phenomena [F. A. Bilsen, "Pitch of noise signals: Evidence for a 'central spectrum'," J. Acoust. Soc. Am. 61, 150-161 (1977)]. The generation is postulated for central activity patterns (CAP) due to binaural interaction. From these CAPs the central processor selects specific spectral information that constitutes the information for lateralization, dichotic pitch, binaural masking, etc. Here, a strategy is assumed to be based on central spectra (CS) rather than on interaural cross correlation. For the calculation of the central activity patterns a number of assumptions have been introduced. The peripheral filters are supposed to be infinitesimally narrow. The analog filter outputs from corresponding filters at both ears are thought to interact by means of a linear delay-and-add mechanism. The squared output (power) of such a binaural (addition) network constitutes the CAP. The theory has been tested with lateralization and BMLD measurements using dichotic stimulus configurations characteristic of the perception of dichotic pitch. The predictions of the model concerning the pitch and the lateralization of the pitch images as well as the BMLD patterns for this kind of stimuli are confirmed.     

Localization by interaural time difference (ITD): effects of interaural frequency mismatch.

A commonly accepted physiological model for lateralization of low-frequency sounds by interaural time delay (ITD) stipulates that binaural comparison neurons receive input from frequency-matched channels from each ear. Here, the effects of hypothetical interaural frequency mismatches on this model are reported. For this study, the cat's auditory system peripheral to the binaural comparison neurons was represented by a neurophysiologically derived model, and binaural comparison neurons were represented by cross-correlators. The results of the study indicate that, for binaural comparison neurons receiving input from one cochlear channel from each ear, interaural CF mismatches may serve to either augment or diminish the effective difference in ipsilateral and contralateral axonal time delays from the periphery to the binaural comparison neuron. The magnitude of this increase or decrease in the effective time delay difference can be up to 400 microseconds for CF mismatches of 0.2 octaves or less for binaural neurons with CFs between 250 Hz and 2.5 kHz. For binaural comparison neurons with nominal CFs near 500 Hz, the 25-microsecond effective time delay difference caused by a 0.012-octave CF mismatch is equal to the ITD previously shown to be behaviorally sufficient for the cat to lateralize a low-frequency sound source.     

Robustness to head misalignment of virtual sound imaging systems

When binaural sound signals are presented with two loudspeakers, the listener's ears are required to be in the relatively small region which is under control of the system. Misalignment of the head results in inaccurate synthesis of the binaural signals. Consequently, directional information associated with the acoustic signals is inaccurately reproduced. When the two loudspeakers are placed close together, the spatial rate of change of the generated sound field is much smaller than that generated by two loudspeakers spaced apart. Therefore, the performance of such a system is expected to be more robust to misalignment of the listener's head. Robustness of performance is investigated here with respect to head displacement in three translational and three rotational directions. A comparison is given between systems consisting of two loudspeakers either placed close together or spaced apart. The extent of effective control with head displacement and the resulting deterioration in directional information is investigated in the temporal and spectral domain by analyzing synthesized binaural signals. Subjective localization experiments are performed for cases in which notable differences in performance are expected from the previous analysis. It is shown that the system comprising two loudspeakers that are close together is very robust to misalignment of the listener's head.     

Mode matching and insertion loss in ultrabroadband Cr-doped multimode fibers

We investigate the fundamental insertion loss due to mode mismatch in an optical link involving a single-mode fiber-optic (SMF) transmission with the insertion of a segment of a multimode Cr(4+)-doped fiber (MMCDF). With an MMCDF core diameter of approximately 15.5 microm that matches the SMF, we obtained coupling efficiencies of 60.3% to 87.5% in the entire transmission spectral range of 1,300 to 1,600 nm. The high coupling efficiency (or low insertion loss) makes it possible for the employment of the MMCDF as an inline ultrabroadband optical amplifier in an optical link for the entire transmission spectral range.     

Microsecond temporal resolution in monaural hearing without spectral cues?

The auditory system encodes the timing of peaks in basilar-membrane motion with exquisite precision, and perceptual models of binaural processing indicate that the limit of temporal resolution in humans is as little as 10-20 microseconds. In these binaural studies, pairs of continuous sounds with microsecond differences are presented simultaneously, one sound to each ear. In this paper, a monaural masking experiment is described in which pairs of continuous sounds with microsecond time differences were combined and presented to both ears. The stimuli were matched in terms of the excitation patterns they produced, and a perceptual model of monaural processing indicates that the limit of temporal resolution in this case is similar to that in the binaural system.     

Late-onset auditory deprivation: effects of monaural versus binaural hearing aids

Performance on tests of pure-tone thresholds, speech-recognition thresholds, and speech-recognition scores for the two ears of each subject were evaluated in two groups of adults with bilateral hearing losses. One group was composed of individuals fitted with binaural hearing aids, and the other group included persons with monaural hearing aids. Performance prior to the use of hearing aids was compared to performance after 4-5 years of hearing aid use in order to determine whether the unaided ear would show effects of auditory deprivation. There were no differences over time for pure-tone thresholds or speech-recognition thresholds for both ears of both groups. Nevertheless, the results revealed that the speech-recognition difference scores of the binaurally fitted subjects remained stable over time whereas they increased for the monaurally fitted subjects. The findings reveal an auditory deprivation effect for the unfitted ears of the subjects with monaural hearing aids.     

The role of monaural frequency selectivity in binaural analysis

The relation between the monaural critical band and binaural analysis was examined using an NoSm MLD paradigm, in order to resolve ambiguities about the width of the masking spectrum important for binaural detection. A 500-Hz pure-tone signal was presented with a 600-Hz-wide band of masking noise to the signal ear. Bands of noise ranging in width from 25 to 600 Hz, or noise notches (imposed on a 600-Hz-wide band centered on the signal frequency) ranging in width from 0 to 600 Hz were presented to the nonsignal ear. All noise bands and notches were centered on 500 Hz, the frequency of the signal. The effects of varying bandwidth were radically different from those of varying notchwidth: the MLD changed from zero to approximately 8 dB over a bandwidth range of 400 Hz; for notchwidths, however, the MLD changed 8 dB over a range of only 50 Hz. The results support an interpretation that the fine frequency selectivity of monaural analysis is preserved in peripheral binaural interaction, but that a relatively wide frequency range of critical bands is scanned at a later stage of binaural processing. It was suggested that the wide spectral range of binaural analysis may provide a background against which binaural differences due to the signal are detected.     

The binaural performance of a cross-talk cancellation system with matched or mismatched setup and playback acoustics

Cross-talk cancellation is a method for synthesizing virtual auditory space using loudspeakers. One implementation is the "Optimal Source Distribution" technique [T. Takeuchi and P. Nelson, J. Acoust. Soc. Am. 112, 2786-2797 (2002)], in which the audio bandwidth is split across three pairs of loudspeakers, placed at azimuths of +/-90 degrees, +/-15 degrees, and +/-3 degrees, conveying low, mid, and high frequencies, respectively. A computational simulation of this system was developed and verified against measurements made on an acoustic system using a manikin. Both the acoustic system and the simulation gave a wideband average cancellation of almost 25 dB. The simulation showed that when there was a mismatch between the head-related transfer functions used to set up the system and those of the final listener, the cancellation was reduced to an average of 13 dB. Moreover, in this case the binaural interaural time differences and interaural level differences delivered by the simulation of the optimal source distribution (OSD) system often differed from the target values. It is concluded that only when the OSD system is set up with "matched" head-related transfer functions can it deliver accurate binaural cues.     

Speech perception,localization, and lateralization with bilateral cochlear implants

Five bilateral cochlear implant users were tested for their localization abilities and speech understanding in noise, for both monaural and binaural listening conditions. They also participated in lateralization tasks to assess the impact of variations in interaural time delays (ITDs) and interaural level differences (ILDs) for electrical pulse trains under direct computer control. The localization task used pink noise bursts presented from an eight-loudspeaker array spanning an arc of approximately 108 degrees in front of the listeners at ear level (0-degree elevation). Subjects showed large benefits from bilateral device use compared to either side alone. Typical root-mean-square (rms) averaged errors across all eight loudspeakers in the array were about 10 degrees for bilateral device use and ranged from 20 degrees to 60 degrees using either ear alone. Speech reception thresholds (SRTs) were measured for sentences presented from directly in front of the listeners (0 degrees) in spectrally matching speech-weighted noise at either 0 degrees, +90 degrees or -90 degrees for four subjects out of five tested who could perform the task. For noise to either side, bilateral device use showed a substantial benefit over unilateral device use when noise was ipsilateral to the unilateral device. This was primarily because of monaural head-shadow effects, which resulted in robust SRT improvements (P<0.001) of about 4 to 5 dB when ipsilateral and contralateral noise positions were compared. The additional benefit of using both ears compared to the shadowed ear (i.e., binaural unmasking) was only 1 or 2 dB and less robust (P = 0.04). Results from the lateralization studies showed consistently good sensitivity to ILDs; better than the smallest level adjustment available in the implants (0.17 dB) for some subjects. Sensitivity to ITDs was moderate on the other hand, typically of the order of 100 micros. ITD sensitivity deteriorated rapidly when stimulation rates for unmodulated pulse-trains increased above a few hundred Hz but at 800 pps showed sensitivity comparable to 50-pps pulse-trains when a 50-Hz modulation was applied. In our opinion, these results clearly demonstrate important benefits are available from bilateral implantation, both for localizing sounds (in quiet) and for listening in noise when signal and noise sources are spatially separated. The data do indicate, however, that effects of interaural timing cues are weaker than those from interaural level cues and according to our psychophysical findings rely on the availability of low-rate information below a few hundred Hz.     

Measurements of binaural echo suppression

The notion of binaural echo suppression that has persisted through the years states that when listening binaurally, the effects of reverberation (spectral modulation or coloration) are less noticeable than when listening with one ear only. This idea was tested in the present study by measuring thresholds for detection of an echo of a diotic noise masker with the echo presented with either a zero or a 500-musec interaural delay. With echo delays less than 5-10 msec, thresholds for the diotic echo were about 10 dB lower than for the dichotic signal, a finding opposite that of the usual binaural masking-level difference but consistent with the notion of binaural echo suppression. Additional echo-threshold measurements were made with echoes of interaurally reversed polarity, producing out-of-phase spectral modulations. The 10-15 dB increase in thresholds for the reverse-polarity echo, over those for the same-polarity echo, indicated that the apparent "hollowness" associated with spectral modulations can be partially canceled centrally. Overall, the results of this study are consistent with a model in which: (1) the monaural representations of spectral magnitude are nonlinearly compressed prior to being combined centrally; and (2) neither monaural channel can be isolated in order to perform the detection task.