Temporal weighting functions for interaural time and level differences. II. The effect of binaurally synchronous temporal jitter

Recent work has demonstrated that sensitivity to interaural time differences (ITD) carried by high-rate cochlear implant pulse trains or analogous acoustic signals can be enhanced by imposing random temporal variation on the stimulus rate [see Goupell et al. (2009). J. Acoust. Soc. Am. 126, 2511-2521]. The present study characterized the effect of such "temporal jitter" on normal-hearing listeners' weighting of ITD and interaural level differences (ILD) applied to brief trains of Gabor clicks (4 kHz center frequency) presented at nominal interclick intervals (ICI) of 1.25 and 2.5 ms. Lateral discrimination judgments were evaluated on the basis of the ITD or ILD carried by individual clicks in each train. Random perturbation of the ICI significantly reduced listeners' weighting of onset cues for both ITD and ILD discrimination compared to corresponding isochronous conditions, consistent with enhanced sensitivity to post-onset binaural cues in jittered stimuli, although the reduction of onset weighting was not statistically significant at 1.25 ms ICI. An additional analysis suggested greater weighting of ITD or ILD presented following lengthened versus shortened ICI, although weights for such "gaps" and "squeezes" were comparable to other post-onset weights. Results are discussed in terms of binaural information available in jittered versus isochronous stimuli.     

Temporal weighting of binaural cues revealed by detection of dynamic interaural differences in high-rate Gabor click trains

Listeners detected interaural differences of time (ITDs) or level (ILDs) carried by single 4000-Hz Gabor clicks (Gaussian-windowed tone bursts) and trains of 16 such clicks repeating at an interclick interval (ICI) of 2, 5, or 10 ms. In separate conditions, target interaural differences favored the right ear by a constant amount for all clicks (condition RR), attained their peak value at onset and diminished linearly to 0 at offset (condition R0), or grew linearly from 0 at onset to a peak value at offset (condition 0R). Threshold ITDs and ILDs were determined adaptively in separate experiments for each of these conditions and for single clicks. ITD thresholds were found to be lower for 16-click trains than for single clicks at 10-ms ICI, regardless of stimulus condition. At 2-ms ICI, thresholds in RR and R0 conditions were similar to single click thresholds at 2-ms ICI; thresholds in the 0R condition were significantly worse than for single clicks at 2-ms ICI, consistent with strong rate-dependent onset dominance in listeners' temporal weighting of ITD. ILD thresholds, in contrast, were predominantly unaffected by ICI, suggesting little or no onset dominance for ILD of high-rate stimuli.     

Binaural sensitivity as a function of interaural electrode position with a bilateral cochlear implant user

Experiments were conducted with a single, bilateral cochlear implant user to examine interaural level and time-delay cues that putatively underlie the design and efficacy of bilateral implant systems. The subject's two implants were of different types but custom equipment allowed presentation of controlled bilateral stimuli, particularly those with specified interaural time difference (ITD) and interaural level difference (ILD) cues. A lateralization task was used to measure the effect of these cues on the perceived location of the sensations elicited. For trains of fixed-amplitude, biphasic current pulses at 100 pps, the subject demonstrated sensitivity to an ITD of 300 micros, providing evidence of access to binaural information. The choice of bilateral electrode pair greatly influenced ITD sensitivity, suggesting that electrode pairings are likely to be an important consideration in the effort to provide binaural advantages. The selection of bilateral electrode pairs showing sensitivity to ITD was partially aided by comparisons of the pitch elicited by individual electrodes in each ear (when stimulated alone with fixed-amplitude current pulses at 813 pps): specifically, interaural electrodes with similar pitches were more likely (but not certain) to show ITD sensitivity. Significant changes in lateral position occurred with specific electrode pairs. With five bilateral electrode pairs of 14 tested, ITDs of 300 and 600 micros moved an auditory image significantly from right to left. With these same pairs, ILD changes of approximately 11% of the dynamic range (in microApp) moved an auditory image from the far left to the far right-significantly farther than the nine pairs not showing significant ITD sensitivity. However, even these nine pairs did show response changes as a function of the interaural (or confounding monaural) level cue. Overall, insofar as the access to bilateral cues demonstrated herein generalizes to other subjects, it provides hope that the normal binaural advantages for speech recognition and sound localization can be made available to bilateral implant users.     

Separation of concurrent broadband sound sources by human listeners

The effect of spatial separation on the ability of human listeners to resolve a pair of concurrent broadband sounds was examined. Stimuli were presented in a virtual auditory environment using individualized outer ear filter functions. Subjects were presented with two simultaneous noise bursts that were either spatially coincident or separated (horizontally or vertically), and responded as to whether they perceived one or two source locations. Testing was carried out at five reference locations on the audiovisual horizon (0 degrees, 22.5 degrees, 45 degrees, 67.5 degrees, and 90 degrees azimuth). Results from experiment 1 showed that at more lateral locations, a larger horizontal separation was required for the perception of two sounds. The reverse was true for vertical separation. Furthermore, it was observed that subjects were unable to separate stimulus pairs if they delivered the same interaural differences in time (ITD) and level (ILD). These findings suggested that the auditory system exploited differences in one or both of the binaural cues to resolve the sources, and could not use monaural spectral cues effectively for the task. In experiments 2 and 3, separation of concurrent noise sources was examined upon removal of low-frequency content (and ITDs), onset/offset ITDs, both of these in conjunction, and all ITD information. While onset and offset ITDs did not appear to play a major role, differences in ongoing ITDs were robust cues for separation under these conditions, including those in the envelopes of high-frequency channels.     

Influence of monaural spectral cues on binaural localization

Seven subjects located, monaurally and binaurally, narrow bands of noise originating in the horizontal plane. The stimuli were 1.0 kHz wide and centered at 4.0-14.0 kHz in steps of 0.5 kHz. The loudspeakers, 15 deg apart, were arranged in a semicircle (0-270-180 deg, azimuth). In the first part of the experiment all sounds emanated from the loudspeaker at 270 deg, but their apparent locations varied widely as a function of their center frequency. For each subject, the pattern of location judgments under the binaural listening condition corresponded to that recorded for the monaural condition. In the second part of the experiment the loudspeaker from which each of the same narrow bands of noise emanated was varied in irregular order. Again, monaural location judgments were governed by the frequency content of the noise bands. Binaural location judgments were strongly influenced by the sounds' frequency composition when the stimuli originated from 315-225 deg, notwithstanding the presence of interaural differences in time and intensity. For narrow bands of noise emanating off midline, monaural spectral cues significantly override binaural difference cues, and they also determine the resolution of front-back ambiguities.     

A model for sound lateralization.

Recent studies of multiple sclerosis (MS) and stroke patients suggested a correlation between two patterns of abnormal performance in lateralization tasks and two sites of pontine lesions. Most patients who had lesions below or at the superior olivary complex (SOC) perceived all interaural differences in binaural stimuli as small, while most patients who had lesions above the SOC perceived all interaural differences as large. The two abnormal performance patterns occurred for interaural time differences (ITD) and/or for interaural level differences (ILD). The present model proposes a multi-level hierarchical brainstem structure that estimates ITD and ILD. The first level seeks dissimilarity between the left and right inputs and a second level looks for similarity between the two sides' inputs. Each level is modeled as an ensemble of neural arrays in which each unit performs a logic or arithmetic function. The inputs are simulations of auditory nerve responses to broadband stimuli. Simulations yield good correspondence to the effect of both locations of pontine lesions on binaural performance.     

Mechanisms determining the salience of coloration in echoed sound: influence of interaural time and level differences

This study investigates whether the salience of the pitch associated with a single reflection of a broadband sound, such as noise, is determined by the monaural information mediated by the stimuli at the two ears, or by the relative locations of the primary sound and the reflection. Pitch strength was measured as a function of the reflection delay and the lateral displacement between the primary sound and the reflection. Thereby, lateral displacement was produced by means of interaural time differences (ITDs) in experiment 1 and interaural level differences (ILDs) in experiment 3. The results from both experiments are in accordance with the assumption that the strength of the pitch associated with a reflection is based on a central average of the internal representations of the stimuli at the two ears. This notion was corroborated by experiment 2, which showed that the results from experiment 1 could be mimicked by simply adding the stimuli from the two ears and presenting the merged stimulus identically to both ears.     

Source localization in complex listening situations: selection of binaural cues based on interaural coherence

In everyday complex listening situations, sound emanating from several different sources arrives at the ears of a listener both directly from the sources and as reflections from arbitrary directions. For localization of the active sources, the auditory system needs to determine the direction of each source, while ignoring the reflections and superposition effects of concurrently arriving sound. A modeling mechanism with these desired properties is proposed. Interaural time difference (ITD) and interaural level difference (ILD) cues are only considered at time instants when only the direct sound of a single source has non-negligible energy in the critical band and, thus, when the evoked ITD and ILD represent the direction of that source. It is shown how to identify such time instants as a function of the interaural coherence (IC). The source directions suggested by the selected ITD and ILD cues are shown to imply the results of a number of published psychophysical studies related to source localization in the presence of distracters, as well as in precedence effect conditions.     

Interaural spectral asymmetry and sensitivity to interaural time differences

Listeners' ability to discriminate interaural time difference (ITD) changes in low-frequency noise was determined as a function of differences in the noise spectra delivered to each ear. An ITD was applied to Gaussian noise, which was bandpass filtered using identical high-pass, but different low-pass cutoff frequencies across ears. Thus, one frequency region was dichotic, and a higher-frequency region monotic. ITD thresholds increased as bandwidth to one ear (i.e., monotic bandwidth) increased, despite the fact that the region of interaural spectral overlap remained constant. Results suggest that listeners can process ITD differences when the spectra at two ears are moderately different.     

Similar patterns of learning and performance variability for human discrimination of interaural time differences at high and low frequencies

Sound source localization on the horizontal plane is primarily determined by interaural time differences (ITDs) for low-frequency stimuli and by interaural level differences (ILDs) for high-frequency stimuli, but ITDs in high-frequency complex stimuli can also be used for localization. Of interest here is the relationship between the processing of high-frequency ITDs and that of low-frequency ITDs and high-frequency ILDs. A few similarities in human performance with high- and low-frequency ITDs have been taken as evidence for similar ITD processing across frequency regions. However, such similarities, unless accompanied by differences between ITD and ILD performance on the same measure, could potentially reflect processing attributes common to both ITDs and ILDs rather than to ITDs only. In the present experiment, both learning and variability patterns in human discrimination of ITDs in high-frequency amplitude-modulated tones were examined and compared to previously obtained data with low-frequency ITDs and high-frequency ILDs. Both patterns for high-frequency ITDs were more similar to those for low-frequency ITDs than for high-frequency ILDs. These results thus add to the evidence supporting similar ITD processing across frequency regions, and further suggest that both high- and low-frequency ITD processing is less modifiable and more noisy than ILD processing.     

Head-related transfer function database and its analyses

Based on the measurements from 52 Chinese subjects (26 males and 26 females), a high-spatial-resolution head-related transfer function (HRTF) database with corre- sponding anthropometric parameters is established. By using the database, cues relating to sound source localization, including interaural time difference (ITD), interaural level difference (ILD), and spectral features introduced by pinna, are analyzed. Moreover, the statistical relationship between ITD and anthropometric parameters is estimated. It is proved that the mean values of maximum ITD for male and female are significantly different, so are those for Chinese and western sub- jects. The difference in ITD is due to the difference in individual anthropometric parameters. It is further proved that the spectral features introduced by pinna strongly depend on individual; while at high frequencies (f≥ 5.5 kHz), HRTFs are left-right asymmetric. This work is instructive and helpful for the research on bin- aural hearing and applications on virtual auditory in future.     

Binaural speech intelligibility in noise for hearing-impaired listeners

The effect of head-induced interaural time delay (ITD) and interaural level differences (ILD) on binaural speech intelligibility in noise was studied for listeners with symmetrical and asymmetrical sensorineural hearing losses. The material, recorded with a KEMAR manikin in an anechoic room, consisted of speech, presented from the front (0 degree), and noise, presented at azimuths of 0 degree, 30 degrees, and 90 degrees. Derived noise signals, containing either only ITD or only ILD, were generated using a computer. For both groups of subjects, speech-reception thresholds (SRT) for sentences in noise were determined as a function of: (1) noise azimuth, (2) binaural cue, and (3) an interaural difference in overall presentation level, simulating the effect of a monaural hearing acid. Comparison of the mean results with corresponding data obtained previously from normal-hearing listeners shows that the hearing impaired have a 2.5 dB higher SRT in noise when both speech and noise are presented from the front, and 2.6-5.1 dB less binaural gain when the noise azimuth is changed from 0 degree to 90 degrees. The gain due to ILD varies among the hearing-impaired listeners between 0 dB and normal values of 7 dB or more. It depends on the high-frequency hearing loss at the side presented with the most favorable signal-to-noise (S/N) ratio. The gain due to ITD is nearly normal for the symmetrically impaired (4.2 dB, compared with 4.7 dB for the normal hearing), but only 2.5 dB in the case of asymmetrical impairment. When ITD is introduced in noise already containing ILD, the resulting gain is 2-2.5 dB for all groups. The only marked effect of the interaural difference in overall presentation level is a reduction of the gain due to ILD when the level at the ear with the better S/N ratio is decreased. This implies that an optimal monaural hearing aid (with a moderate gain) will hardly interfere with unmasking through ITD, while it may increase the gain due to ILD by preventing or diminishing threshold effects.     

Narrow-band sound localization related to external ear acoustics.

Human subjects localized brief 1/6-oct bandpassed noise bursts that were centered at 6, 8, 10, and 12 kHz. All testing was done under binaural conditions. The horizontal component of subjects' responses was accurate, comparable to that for broadband localization, but the vertical and front/back components exhibited systematic errors. Specifically, responses tended to cluster within restricted ranges that were specific for each center frequency. The directional transfer functions of the subjects' external ears were measured for 360 horizontal and vertical locations. The spectra of the sounds that were present in the subjects' ear canals, the "proximal stimulus" spectra, were computed by combining the spectra of the narrow-band sound sources with the directional transfer functions for particular stimulus locations. Subjects consistently localized sounds to regions within which the associated directional transfer function correlated most closely with the proximal stimulus spectrum. A quantitative model was constructed that successfully predicted subjects' responses based on interaural level difference and spectral cues. A test of the model, using techniques adapted from signal detection theory, indicated that subjects tend to use interaural level difference and spectral shape cues independently, limited only by a slight spatial correlation of the two cues. A testing procedure is described that provides a quantitative comparison of various predictive models of sound localization.     

Localization of sound in rooms. V. Binaural coherence and human sensitivity to interaural time differences in noise

Binaural recordings of noise in rooms were used to determine the relationship between binaural coherence and the effectiveness of the interaural time difference (ITD) as a cue for human sound localization. Experiments showed a strong, monotonic relationship between the coherence and a listener's ability to discriminate values of ITD. The relationship was found to be independent of other, widely varying acoustical properties of the rooms. However, the relationship varied dramatically with noise band center frequency. The ability to discriminate small ITD changes was greatest for a mid-frequency band. To achieve sensitivity comparable to mid-band, the binaural coherence had to be much larger at high frequency, where waveform ITD cues are imperceptible, and also at low frequency, where the binaural coherence in a room is necessarily large. Rivalry experiments with opposing interaural level differences (ILDs) found that the trading ratio between ITD and ILD increasingly favored the ILD as coherence decreased, suggesting that the perceptual weight of the ITD is decreased by increased reflections in rooms.     

Enhancement of interaural level differences improves sound localization in bimodal hearing

Users of a cochlear implant together with a contralateral hearing aid-so-called bimodal listeners-have difficulties with localizing sound sources. This is mainly due to the distortion of interaural time and level difference cues (ITD and ILD), and limited ITD sensitivity. An algorithm is presented that enhances ILD cues. Horizontal plane sound-source localization performance of six bimodal listeners was evaluated in (1) a real sound field with their clinical devices, (2) in a virtual sound field, under direct computer control, and (3) in a virtual sound field with ILD enhancement. The results in the real sound field did not differ significantly from the results in the virtual field, and ILD enhancement improved localization performance by 4°-10° absolute error, relative to a mean absolute error of 28° in the condition without ILD enhancement.     

人工头近场头相关传输函数及其特性

采用球形正十二面体声源及其空间定位系统,测量并建立了KEMAR人工头的近场头相关传输函数(HRTF)数据库。基于数据库分析了近场HRTF在频域和时域随声源距离变化的规律;讨论了用近场HRTF算得的双耳声级差(TLD)和双耳时间差(ITD)所包含的声源距离定位信息。结果表明,测量系统和所得数据具有较好的重复性和准确性,保留了1 kHz以下的低频定位信息。并且,近场HRTF幅度谱和ILD随声源距离的变化明显;用相关法算得2 kHz以下频段的ITD随声源距离略有变化。本文数据库及其分析结果将为声源距离定位的应用提供基础。      

The effect of head-induced interaural time and level differences on speech intelligibility in noise

A study was made of the effect of interaural time delay (ITD) and acoustic headshadow on binaural speech intelligibility in noise. A free-field condition was simulated by presenting recordings, made with a KEMAR manikin in an anechoic room, through earphones. Recordings were made of speech, reproduced in front of the manikin, and of noise, emanating from seven angles in the azimuthal plane, ranging from 0 degree (frontal) to 180 degrees in steps of 30 degrees. From this noise, two signals were derived, one containing only ITD, the other containing only interaural level differences (ILD) due to headshadow. Using this material, speech reception thresholds (SRT) for sentences in noise were determined for a group of normal-hearing subjects. Results show that (1) for noise azimuths between 30 degrees and 150 degrees, the gain due to ITD lies between 3.9 and 5.1 dB, while the gain due to ILD ranges from 3.5 to 7.8 dB, and (2) ILD decreases the effectiveness of binaural unmasking due to ITD (on the average, the threshold shift drops from 4.6 to 2.6 dB). In a second experiment, also conducted with normal-hearing subjects, similar stimuli were used, but now presented monaurally or with an overall 20-dB attenuation in one channel, in order to simulate hearing loss. In addition, SRTs were determined for noise with fixed ITDs, for comparison with the results obtained with head-induced (frequency dependent) ITDs.(ABSTRACT TRUNCATED AT 250 WORDS)     

The dominant role of low-frequency interaural time differences in sound localization.

Two experiments are described in which listeners judge the apparent directions of virtual sound sources-headphone-presented sounds that are processed in order to simulate free-field sounds. Previous results suggest that when the cues to sound direction are preserved by the simulation, the apparent directions of virtual sources are nearly the same as the apparent directions of real free-field sources. In the experiments reported here, the interaural phase relations in the processing algorithms are manipulated in order to produce stimuli in which the interaural time difference cues signal one direction and interaural intensity and pinna cues signal another direction. The apparent directions of these conflicting cue stimuli almost always follow the interaural time cue, as long as the wideband stimuli include low frequencies. With low frequencies removed from the stimuli, the dominance of interaural time difference disappears, and apparent direction is determined primarily by interaural intensity difference and pinna cues.     

Lateralization of complex binaural stimuli: a weighted-image model

This article describes a new model that predicts the subjective lateral position of bandpass stimuli. It is assumed, as in other models, that stimuli are bandpass filtered and rectified, and that the rectified outputs of filters with matching center frequencies undergo interaural cross correlation. The model specifies and utilizes the shape and location of assumed patterns of neural activity that describe the cross-correlation function. Individual modes of this function receive greater weighting if they are straighter (describing consistent interaural delay over frequency) and/or more central (describing interaural delays of smaller magnitude). This weighting of straightness and centrality is used by the model to predict the perceived laterality of several types of low-frequency bandpass stimuli with interaural time delays and/or phase shifts, including bandpass noise, amplitude-modulated stimuli with time-delayed envelopes, and bandpass-filtered clicks. This model is compared to other theories that describe lateralization in terms of the relative contributions of information in the envelopes and fine structures of binaural stimuli.     

Effect of stimulus spectrum on distance perception for nearby sources

The effects of stimulus frequency and bandwidth on distance perception were examined for nearby sources in simulated reverberant space. Sources to the side [containing reverberation-related cues and interaural level difference (ILD) cues] and to the front (without ILDs) were simulated. Listeners judged the distance of noise bursts presented at a randomly roving level from simulated distances ranging from 0.15 to 1.7 m. Six stimuli were tested, varying in center frequency (300-5700 Hz) and bandwidth (200-5400 Hz). Performance, measured as the correlation between simulated and response distances, was worse for frontal than for lateral sources. For both simulated directions, performance was inversely proportional to the low-frequency stimulus cutoff, independent of stimulus bandwidth. The dependence of performance on frequency was stronger for frontal sources. These correlation results were well summarized by considering how mean response, as opposed to response variance, changed with stimulus direction and spectrum: (1) little bias was observed for lateral sources, but listeners consistently overestimated distance for frontal nearby sources; (2) for both directions, increasing the low-frequency cut-off reduced the range of responses. These results are consistent with the hypothesis that listeners used a direction-independent but frequency-dependent mapping of a reverberation-related cue, not the ILD cue, to judge source distance.