Contrasting monaural and interaural spectral cues for human sound localization

A human psychoacoustical experiment is described that investigates the role of the monaural and interaural spectral cues in human sound localization. In particular, it focuses on the relative contribution of the monaural versus the interaural spectral cues towards resolving directions within a cone of confusion (i.e., directions with similar interaural time and level difference cues) in the auditory localization process. Broadband stimuli were presented in virtual space from 76 roughly equidistant locations around the listener. In the experimental conditions, a "false" flat spectrum was presented at the left eardrum. The sound spectrum at the right eardrum was then adjusted so that either the true right monaural spectrum or the true interaural spectrum was preserved. In both cases, the overall interaural time difference and overall interaural level difference were maintained at their natural values. With these virtual sound stimuli, the sound localization performance of four human subjects was examined. The localization performance results indicate that neither the preserved interaural spectral difference cue nor the preserved right monaural spectral cue was sufficient to maintain accurate elevation judgments in the presence of a flat monaural spectrum at the left eardrum. An explanation for the localization results is given in terms of the relative spectral information available for resolving directions within a cone of confusion.     

Lateralization of acoustic signals by dichotically listening budgerigars (Melopsittacus undulatus)

Sound localization allows humans and animals to determine the direction of objects to seek or avoid and indicates the appropriate position to direct visual attention. Interaural time differences (ITDs) and interaural level differences (ILDs) are two primary cues that humans use to localize or lateralize sound sources. There is limited information about behavioral cue sensitivity in animals, especially animals with poor sound localization acuity and small heads, like budgerigars. ITD and ILD thresholds were measured behaviorally in dichotically listening budgerigars equipped with headphones in an identification task. Budgerigars were less sensitive than humans and cats, and more similar to rabbits, barn owls, and monkeys, in their abilities to lateralize dichotic signals. Threshold ITDs were relatively constant for pure tones below 4 kHz, and were immeasurable at higher frequencies. Threshold ILDs were relatively constant over a wide range of frequencies, similar to humans. Thresholds in both experiments were best for broadband noise stimuli. These lateralization results are generally consistent with the free field localization abilities of these birds, and add support to the idea that budgerigars may be able to enhance their cues to directional hearing (e.g., via connected interaural pathways) beyond what would be expected based on head size.     

前方空间环绕声的四扬声器虚拟重放

考虑头部转动带来的动态因素对听觉垂直定位的贡献,提出了前方空间环绕声的四扬声器虚拟重放方法。4个扬声器分别布置在水平面左前、右前以及高仰角的左前上、右前上方向,并采用听觉传输信号处理的方法将多通路空间环绕声信号转换为4个扬声器的重放信号。以9.1通路空间环绕声虚拟重放为例,采用头相关传输函数对双耳声压及其包含的定位因素进行分析表明,该方法可以产生正确的双耳时间差及其随头部转动的变化,从而产生合适的侧向定位双耳因素和垂直定位的动态因素。而心理声学实验结果表明,该方法可以重放稳定的前方空间的水平和垂直虚拟源。因此,四扬声器布置结合听觉传输处理足以重放前方空间环绕声的垂直定位信息,实现多通路空间环绕声的向下混合与简化。      

Source localization in complex listening situations: selection of binaural cues based on interaural coherence

In everyday complex listening situations, sound emanating from several different sources arrives at the ears of a listener both directly from the sources and as reflections from arbitrary directions. For localization of the active sources, the auditory system needs to determine the direction of each source, while ignoring the reflections and superposition effects of concurrently arriving sound. A modeling mechanism with these desired properties is proposed. Interaural time difference (ITD) and interaural level difference (ILD) cues are only considered at time instants when only the direct sound of a single source has non-negligible energy in the critical band and, thus, when the evoked ITD and ILD represent the direction of that source. It is shown how to identify such time instants as a function of the interaural coherence (IC). The source directions suggested by the selected ITD and ILD cues are shown to imply the results of a number of published psychophysical studies related to source localization in the presence of distracters, as well as in precedence effect conditions.     

Auditory lateralization in monkeys: an examination of two cues serving directional hearing.

In assigning binaural ongoing time differences (phase) as the cue for localization of low frequencies, and binaural intensity differences as the cue for localization of high frequencies, the duplex theory has successfully accounted for human directional hearing of tones. Sensitivity of monkeys to these cues was examined in two experiments. The dependencies on frequency of interaural intensity difference thresholds (lateralization experiment I) and time difference thresholds (lateralization experiment II) were determined behaviorally on three monkeys (M. nemestrina). The range of frequencies was from 125 Hz to 8 kHz in experiment I and from 250 Hz to 2 kHz in experiment II. The results indicate that the duplex theory is applicable to monkeys. However, monkeys are less sensitive than man to both binaural cues. The shortest time disparity monkeys discriminate is 42 microseconds at 1.5 kHz and the smallest intensity difference is 3.5 dB at 500 Hz. Good agreement between the present findings and localization measurements [C. H. Brown et al., J. Acoust. Soc. Am. 63, 1484-1492 (1978)] suggests: (a) that monkeys utilize time disparity cues through higher frequencies than man; and (b) that inaccurate localization by monkeys at high frequencies reflects decreasing sensitivity to interaural intensity cues.     

Binaural weighting of monaural spectral cues for sound localization

For human listeners, cues for vertical-plane localization are provided by direction-dependent pinna filtering. This study quantified listeners' weighting of the spectral cues from each ear as a function of stimulus lateral angle, interaural time difference (ITD), and interaural level difference (ILD). Subjects indicated the apparent position of headphone-presented noise bursts synthesized in virtual auditory space. The synthesis filters for the two ears either corresponded to the same location or to two different locations separated vertically by 20 deg. Weighting of each ear's spectral information was determined by a multiple regression between the elevations to which each ear's spectrum corresponded and the vertical component of listeners' responses. The apparent horizontal source location was controlled either by choosing synthesis filters corresponding to locations on or 30 deg left or right of the median plane or by attenuating or delaying the signal at one ear. For broadband stimuli, spectral weighting and apparent lateral angle were determined primarily by ITD. Only for high-pass stimuli were weighting and lateral angle determined primarily by ILD. The results suggest that the weighting of monaural spectral cues and the perceived lateral angle of a sound source depend similarly on ITD, ILD, and stimulus spectral range.     

Localizing nearby sound sources in a classroom: binaural room impulse responses

Binaural room impulse responses (BRIRs) were measured in a classroom for sources at different azimuths and distances (up to 1 m) relative to a manikin located in four positions in a classroom. When the listener is far from all walls, reverberant energy distorts signal magnitude and phase independently at each frequency, altering monaural spectral cues, interaural phase differences, and interaural level differences. For the tested conditions, systematic distortion (comb-filtering) from an early intense reflection is only evident when a listener is very close to a wall, and then only in the ear facing the wall. Especially for a nearby source, interaural cues grow less reliable with increasing source laterality and monaural spectral cues are less reliable in the ear farther from the sound source. Reverberation reduces the magnitude of interaural level differences at all frequencies; however, the direct-sound interaural time difference can still be recovered from the BRIRs measured in these experiments. Results suggest that bias and variability in sound localization behavior may vary systematically with listener location in a room as well as source location relative to the listener, even for nearby sources where there is relatively little reverberant energy.     

Fidelity of three-dimensional-sound reproduction using a virtual auditory display

The fidelity of reproducing free-field sounds using a virtual auditory display was investigated in two experiments. In the first experiment, listeners directly compared stimuli from an actual loudspeaker in the free field with those from small headphones placed in front of the ears. Headphone stimuli were filtered using head-related transfer functions (HRTFs), recorded while listeners were wearing the headphones, in order to reproduce the pressure signatures of the free-field sounds at the eardrum. Discriminability was investigated for six sound-source positions using broadband noise as a stimulus. The results show that the acoustic percepts of real and virtual sounds were identical. In the second experiment, discrimination between virtual sounds generated with measured and interpolated HRTFs was investigated. Interpolation was performed using HRTFs measured for loudspeaker positions with different spatial resolutions. Broadband noise bursts with flat and scrambled spectra were used as stimuli. The results indicate that, for a spatial resolution of about 6 degrees, the interpolation does not introduce audible cues. For resolutions of 20 degrees or more, the interpolation introduces audible cues related to timbre and position. For intermediate resolutions (10 degrees - 15 degrees) the data suggest that only timbre cues were used.     

Acoustical cues for sound localization by the Mongolian gerbil, Meriones unguiculatus

The present study measured the head-related transfer functions (HRTFs) of the Mongolian gerbil for various sound-source directions, and explored acoustical cues for sound localization that could be available to the animals. The HRTF exhibited spectral notches for frequencies above 25 kHz. The notch frequency varied systematically with source direction, and thereby characterized the source directions well. The frequency dependence of the acoustical axis, the direction for which the HRTF amplitude was maximal, was relatively irregular and inconsistent between ears and animals. The frequency-by-frequency plot of the interaural level difference (ILD) exhibited positive and negative peaks, with maximum values of 30 dB at around 30 kHz. The ILD peak frequency had a relatively irregular spatial distribution, implying a poor sound localization cue. The binaural acoustical axis (the direction with the maximum ILD magnitude) showed relatively orderly clustering around certain frequencies, the pattern being fairly consistent among animals. The interaural time differences (ITDs) were also measured and fell in a +/- 120 micros range. When two different animal postures were compared (i.e., the animal was standing on its hind legs and prone), small but consistent differences were found for the lower rear directions on the HRTF amplitudes, the ILDs, and the ITDs.     

Resolution of front-back ambiguity in spatial hearing by listener and source movement.

Normally, the apparent position of a sound source corresponds closely to its actual position. However, in some experimental situations listeners make large errors, such as indicating that a source in the frontal hemifield appears to be in the rear hemifield, or vice versa. These front-back confusions are thought to be a result of the inherent ambiguity of the primary interaural difference cues, interaural time difference (ITD) in particular. A given ITD could have been produced by a sound source anywhere on the so-called "cone of confusion." More than 50 years ago Wallach [J. Exp. Psychol. 27, 339-368 (1940)] argued that small head movements could provide the information necessary to resolve the ambiguity. The direction of the change in ITD that accompanies a head rotation is an unambiguous indicator of the proper hemifield. The experiments reported here are a modern test of Wallach's hypothesis. Listeners indicated the apparent positions of real and virtual sound sources in conditions in which head movements were either restricted or encouraged. The front-back confusions made in the restricted condition nearly disappeared in the condition in which head movements were encouraged. In a second experiment head movements were restricted, but the sound source was moved, either by the experimenter or by the listener. Only when the listener moved the sound source did front-back confusions disappear. The results clearly support Wallach's hypothesis and suggest further that head movements are not required to produce the dynamic cues needed to resolve front-back ambiguity.     

多通路空间声的前方四扬声器局域Ambisonics信号馈给法*

典型的多通路空间声扬声器布置一般包含水平面左前、右前,高仰角左前上、右前上四个方向的扬声器。 本文提出一种利用该四个扬声器产生前方水平与垂直方向虚拟源的一阶局域Ambisonics 信号馈给法。该信号馈给法是通过对目标和重放声场进行球谐函数展开并取一阶近似得到。采用简化的头部模型和精确的头相关传输函数模型分析表明,一阶局域Ambisonics 信号馈给法可以产生合适的低频听觉定位因素,包括双耳时间差及其随头部转动的动态变化。虚拟源定位实验结果表明,该方法可以在扬声器布置的范围内,甚至在略超出扬声器布置的范围内产生不同方位角和仰角的虚拟源。因而本文的方法可用在多通路空间声重放中产生与图像配合的虚拟源定位效果。     

The effect of masker interaural phase on the detection of a monaural signal

The masking-level difference (MLD) for a 500-Hz monaural pure-tone signal was examined as a function of the interaural phase shift of a 100-Hz-wide noise band centered on 500 Hz. Results indicated that the MLD decreased in magnitude as the interaural phase shift of the masker increased. In a second experiment, the 100-Hz-wide noise band was used as both the masker and the signal in order to examine the detection cues of interaural time difference and interaural level difference separately. Again, the interaural phase of the masker was varied, and an Sm signal was presented. Results indicated that the MLD decreased as a function of increasing masker interaural temporal difference for the time cue, but that the MLD did not change systematically for the level cue. The deterioration of binaural detection as a function of increasing masker interaural phase difference was not as great as that which has been reported in localization and lateralization experiments.     

Interaural time sensitivity of high-frequency neurons in the inferior colliculus

Recent psychoacoustic experiments have shown that interaural time differences provide adequate cues for lateralizing high-frequency sounds, provided the stimuli are complex and not pure tones. We present here physiological evidence in support of these findings. Neurons of high best frequency in the cat inferior colliculus respond to interaural phase differences of amplitude modulated waveforms, and this response depends upon preservation of phase information of the modulating signal. Interaural phase differences were introduced in two ways: by interaural delays of the entire waveform and by binaural beats in which there was an interaural frequency difference in the modulating waveform. Results obtained with these two methods are similar. Our results show that high-frequency cells can respond to interaural time differences of amplitude modulated signals and that they do so by a sensitivity to interaural phase differences of the modulating waveform.     

Detection of combined changes in interaural time and intensity differences: Segregated mechanisms in cue type and in operating frequency range?

Although physiological studies have revealed segregated binaural pathways, namely the medial and lateral superior olives, it is unclear whether the human auditory system has separate mechanisms for different cue types (interaural time and intensity differences; ITD and IID, respectively) and for operating frequency ranges. This study hypothesized "channels" for ITD and IID processing, and examined channel interaction at low and high frequencies based on the signal detection theory. The stimuli were a 125- or 500-Hz tone and a 4-kHz tone amplitude-modulated with a half-wave-rectified 125-Hz sinusoid, presented dichotically with various baseline ITDs and IIDs. The detectability indices, d('), for ITD and IID changes, imposed individually or simultaneously in the same direction, were derived from the results of a forced-choice task. The degree of channel interaction was estimated by comparing d(') for combined cues with those for individual cues. The estimated interaction showed little effect of baseline ITD or IID. The results generally exhibited nonzero interaction, indicating that the cue processes are not completely independent. The interaction was stronger for high frequencies than for low frequencies. The results can be interpreted as indicating the involvement of different binaural mechanisms for different frequency regions.     

Two-dimensional sound localization by human listeners

This study measured the ability of subjects to localize broadband sound sources that varied in both horizontal and vertical location. Brief (150 ms) sounds were presented in a free field, and subjects reported the apparent stimulus location by turning to face the sound source; head orientation was measured electromagnetically. Localization of continuous sounds also was tested to estimate errors in the motor act of orienting with the head. Localization performance was excellent for brief sounds presented in front of the subject. The smallest errors, averaged across subjects, were about 2 degrees and 3.5 degrees in the horizontal and vertical dimensions, respectively. The sizes of errors increased, for more peripheral stimulus locations, to maxima of about 20 degrees. Localization performance was better in the horizontal than in the vertical dimension for stimuli located on or near the frontal midline, but the opposite was true for most stimuli located further peripheral. Front/back confusions occurred in 6% of trials; the characteristics of those responses suggest that subjects derived horizontal localization information principally from interaural difference cues. The generally high level of performance obtained with the head orientation technique argues for its utility in continuing studies of sound localization.     

Dynamic-range compression affects the lateral position of sounds

Dynamic-range compression acting independently at each ear in a bilateral hearing-aid or cochlear-implant fitting can alter interaural level differences (ILDs) potentially affecting spatial perception. The influence of compression on the lateral position of sounds was studied in normal-hearing listeners using virtual acoustic stimuli. In a lateralization task, listeners indicated the leftmost and rightmost extents of the auditory event and reported whether they heard (1) a single, stationary image, (2) a moving/gradually broadening image, or (3) a split image. Fast-acting compression significantly affected the perceived position of high-pass sounds. For sounds with abrupt onsets and offsets, compression shifted the entire image to a more central position. For sounds containing gradual onsets and offsets, including speech, compression increased the occurrence of moving and split images by up to 57 percentage points and increased the perceived lateral extent of the auditory event. The severity of the effects was reduced when undisturbed low-frequency binaural cues were made available. At high frequencies, listeners gave increased weight to ILDs relative to interaural time differences carried in the envelope when compression caused ILDs to change dynamically at low rates, although individual differences were apparent. Specific conditions are identified in which compression is likely to affect spatial perception.     

Effect of stimulus spectrum on distance perception for nearby sources

The effects of stimulus frequency and bandwidth on distance perception were examined for nearby sources in simulated reverberant space. Sources to the side [containing reverberation-related cues and interaural level difference (ILD) cues] and to the front (without ILDs) were simulated. Listeners judged the distance of noise bursts presented at a randomly roving level from simulated distances ranging from 0.15 to 1.7 m. Six stimuli were tested, varying in center frequency (300-5700 Hz) and bandwidth (200-5400 Hz). Performance, measured as the correlation between simulated and response distances, was worse for frontal than for lateral sources. For both simulated directions, performance was inversely proportional to the low-frequency stimulus cutoff, independent of stimulus bandwidth. The dependence of performance on frequency was stronger for frontal sources. These correlation results were well summarized by considering how mean response, as opposed to response variance, changed with stimulus direction and spectrum: (1) little bias was observed for lateral sources, but listeners consistently overestimated distance for frontal nearby sources; (2) for both directions, increasing the low-frequency cut-off reduced the range of responses. These results are consistent with the hypothesis that listeners used a direction-independent but frequency-dependent mapping of a reverberation-related cue, not the ILD cue, to judge source distance.     

Auditory perception of sound source velocity

In this study we investigate the perception of the velocity of linearly moving sound sources passing in front of a listener. The binaural simulation of motion used in two psychoacoustical experiments includes changes in the overall sound pressure level, the Doppler effect, and changes in interaural time differences. These changes are considered as cues for the perception of velocity. The present experiments are an extension of the experiments performed by Lutfi and Wang [J. Acoust. Soc. Am. 106, 919-928 (1999)]. The results of Experiment I show that the differential velocity threshold is independent of the reference velocity (10, 20, 30, and 40 m/s), varying across listeners from 1.5 to 4.6 m/s. In Experiment II, a method based on the successive elimination of cues in compared pairs of signals was employed to estimate the weights of potential cues for velocity discrimination. The magnitudes of all underlying cues at thresholds are reported. The experimental results show the subject's preference for the Doppler cue and a weakest sensitivity to the cue related with interaural time differences. Finally, it was found that spatial differences in the source location at the endpoints of the motion trajectory are not a significant factor in the velocity discrimination task.     

Distance rendering and perception of nearby virtual sound sources with a near-field filter model

Headphone rendering of nearby virtual sound sources represents to date an open issue in 3-D audio, due to a number of technical challenges and temporal requirements involved in the measurement of individual Head-Related Transfer Functions (HRTFs). In order to tackle this problem, we propose a filter model of near-field effects based on the Distance Variation Function (Kan et al., 2009). Thanks to its simple structure and low order, the model can be applied to any far-field virtual auditory display to yield a realistic and computationally efficient near-field compensation of spectral and binaural effects. The model is subjectively evaluated in two psychophysical experiments where the relative distance of pairs of virtually rendered sound sources is judged. Results show that even though sound intensity overshadows subtler near-field effects when it is available as a cue for distance, the model is capable of offering relative distance information of near lateral virtual sources when intensity cues are removed. Furthermore, performances of the model in relative distance rendering are compared to those of alternative near-field rendering methods available in the literature.     

Speech perception from monaural and binaural information

Two experiments explored the concept of the binaural spectrogram [Culling and Colburn, J. Acoust. Soc. Am. 107, 517-527 (2000)] and its relationship to monaurally derived information. In each experiment, speech was added to noise at an adverse signal-to-noise ratio in the NoS pi binaural configuration. The resulting monaural and binaural cues were analyzed within an array of spectro-temporal bins and then these cues were resynthesized by modulating the intensity and/or interaural correlation of freshly generated noise. Experiment 1 measured the intelligibility of the resynthesized stimuli and compared them with the original NoSo and NoS pi stimuli at a fixed signal-to-noise ratio. While NoS pi stimuli were approximately equal to 50% intelligible, each cue in isolation produced similar (very low) intelligibility to the NoSo condition. The resynthesized combination produced approximately equal to 25% intelligibility. Modulation of interaural correlation below 1.2 kHz and of amplitude above 1.2 kHz was not as effective as their combination across all frequencies. Experiment 2 measured three-point psychometric functions in which the signal-to-noise ratio of the original NoS pi stimulus was increased in 3-dB steps from the level used in experiment 1. Modulation of interaural correlation alone proved to have a flat psychometric function. The functions for NoS pi and for combined monaural and binaural cues appeared similar in slope, but shifted horizontally. The results indicate that for sentence materials, neither fluctuations in interaural correlation nor in monaural intensity are sufficient to support speech recognition at signal-to-noise ratios where 50% intelligibility is achieved in the NoS pi configuration; listeners appear to synergistically combine monaural and binaural information in this task, to some extent within the same frequency region.