Binaural weighting of monaural spectral cues for sound localization

For human listeners, cues for vertical-plane localization are provided by direction-dependent pinna filtering. This study quantified listeners' weighting of the spectral cues from each ear as a function of stimulus lateral angle, interaural time difference (ITD), and interaural level difference (ILD). Subjects indicated the apparent position of headphone-presented noise bursts synthesized in virtual auditory space. The synthesis filters for the two ears either corresponded to the same location or to two different locations separated vertically by 20 deg. Weighting of each ear's spectral information was determined by a multiple regression between the elevations to which each ear's spectrum corresponded and the vertical component of listeners' responses. The apparent horizontal source location was controlled either by choosing synthesis filters corresponding to locations on or 30 deg left or right of the median plane or by attenuating or delaying the signal at one ear. For broadband stimuli, spectral weighting and apparent lateral angle were determined primarily by ITD. Only for high-pass stimuli were weighting and lateral angle determined primarily by ILD. The results suggest that the weighting of monaural spectral cues and the perceived lateral angle of a sound source depend similarly on ITD, ILD, and stimulus spectral range.     

Directional dependence of interaural envelope delays

Interaural envelope delays were measured in six human subjects as a function of the location of a movable sound source, bandpassed between 3 and 16 kHz. A total of 324 source locations were tested in horizontal and vertical increments of 10 degrees. A method is described for estimating the complex directional transfer function of the external ear, independent of the position of the recording microphone in the ear canal. To compute interaural envelope delays, directional transfer functions from the left and right ears were convolved with a critical-band filter, the envelopes were computed, and the envelopes were cross correlated. Interaural envelope delays, as well as interaural group delays, varied somewhat with the center frequency of the critical-band filter and with the vertical location of the sound source. Nevertheless, to a first approximation, envelope delays measured in the ear canals increased monotonically with increasing angle of incidence relative to the median plane, as they would for two microphones on the surface of a rigid sphere. The results are discussed in relation to the possible contribution of interaural envelope delays to sound localization behavior.     

The contribution of the near and far ear toward localization of sound in the sagittal plane

Eight listeners were required to locate a train of 4.5-kHz high-pass noise bursts emanating from loudspeakers positioned +/- 30, +/- 20, +/- 10, and 0 deg re: interaural axis. The vertical array of loudspeakers was placed at 45, 90, and 135 deg left of midline. The various experimental conditions incorporated binaural and monaural listening with the latter utilizing the ear nearest or ear farthest from the sound source. While performance excelled when listening with only the near ear, the contribution of the far ear was statistically significant when compared to localization performance when both ears were occluded. Based on head related transfer functions for stimuli whose bandwidth was 1.0 kHz, four spectral cues were selected as candidates for influencing location judgments. Two of them associated relative changes in energy across center frequencies (CFs) with vertical source positions. The other two associated an absolute minimum (maximum) energy for specific CFs with a vertical source position. All but one cue when measured for the near ear could account for localization proficiency. On the other hand, when listening with the far ear, maximum energy at a specific CF outperformed the remaining cues in accounting for localization proficiency.     

The bat head-related transfer function reveals binaural cues for sound localization in azimuth and elevation

Directional properties of the sound transformation at the ear of four intact echolocating bats, Eptesicus fuscus, were investigated via measurements of the head-related transfer function (HRTF). Contributions of external ear structures to directional features of the transfer functions were examined by remeasuring the HRTF in the absence of the pinna and tragus. The investigation mainly focused on the interactions between the spatial and the spectral features in the bat HRTF. The pinna provides gain and shapes these features over a large frequency band (20-90 kHz), and the tragus contributes gain and directionality at the high frequencies (60 to 90 kHz). Analysis of the spatial and spectral characteristics of the bat HRTF reveals that both interaural level differences (ILD) and monaural spectral features are subject to changes in sound source azimuth and elevation. Consequently, localization cues for horizontal and vertical components of the sound source location interact. Availability of multiple cues about sound source azimuth and elevation should enhance information to support reliable sound localization. These findings stress the importance of the acoustic information received at the two ears for sound localization of sonar target position in both azimuth and elevation.     

Study of vertical sound image control with parametric loudspeakers

A parametric loudspeaker utilizes nonlinearity of a medium and is known as a super-directive loudspeaker. In this paper, the sound localization in the vertical direction using the upper and lower parametric loudspeakers is confirmed by listening tests and physical measurements. The differences in levels between the upper and lower parametric loudspeakers are varied as a parameter. The direction of sound localization in the vertical plane can be controlled not only when the acoustical axis is set to the right ear but also when it is set to at 5 deg to the right of the right ear. The effect of the level difference between the upper and lower loudspeakers is weaker than the differences observed when using ordinary loudspeakers. We obtained interesting characteristics of the left-right sound localization in the horizontal plane with the upper and lower parametric loudspeakers in the vertical plane. It is found that by setting the parametric loudspeaker at the right ear (that is, the horizontal angle of a listener to it is only 3 deg to the right), the direction of sound localization in the horizontal plane moved approximately 10 deg to the right. Moreover, by setting the parametric loudspeaker 5 deg to the right, the direction of sound localization moves approximately 20 deg to the right. The ILD (Interaural Level Difference) using a dummy head is calculated from the measured left and right sound signals. It is determined that ILDs of the parametric loudspeaker are larger than those of the ordinary loudspeaker. A simple geometrical acoustic model is introduced and analyzed. The analysis helps to explain the measured characteristics.     

Influence of fundamental frequency and source elevation on the vertical localization of complex tones and complex tone pairs

This study investigates the vertical localization of single complex tones (monads) and simultaneous complex tone pairs (dyads), especially as it is affected by their fundamental frequency and source elevation. Two complex tone timbres are considered: one consisting of five low-order harmonics, and the other of all odd harmonics (a square wave). Sound sources were at -15, 0, 15, and 30 deg from the horizontal plane at ear height. For eight subjects, this source array was in the median plane, and for a further nine subjects, it was directly to the subject's left (lateral plane). The subjects localized the angle of the auditory image(s) of one or two complex tones around the vertical plane containing the sound sources. Mean responses for the five-harmonic complex tones show a systematic effect (referred to as Pratt's effect) of fundamental frequency on vertical localization--whereby high-frequency complex tones are localized to positions higher than low-frequency complex tones for equivalent source positions. For the square wave, the sound-source position dominates localization, although some effect of fundamental frequency is evident for median plane sources.     

前方空间环绕声的四扬声器虚拟重放

考虑头部转动带来的动态因素对听觉垂直定位的贡献,提出了前方空间环绕声的四扬声器虚拟重放方法。4个扬声器分别布置在水平面左前、右前以及高仰角的左前上、右前上方向,并采用听觉传输信号处理的方法将多通路空间环绕声信号转换为4个扬声器的重放信号。以9.1通路空间环绕声虚拟重放为例,采用头相关传输函数对双耳声压及其包含的定位因素进行分析表明,该方法可以产生正确的双耳时间差及其随头部转动的变化,从而产生合适的侧向定位双耳因素和垂直定位的动态因素。而心理声学实验结果表明,该方法可以重放稳定的前方空间的水平和垂直虚拟源。因此,四扬声器布置结合听觉传输处理足以重放前方空间环绕声的垂直定位信息,实现多通路空间环绕声的向下混合与简化。      

Role of spectral cues in median plane localization

The role of spectral cues in the sound source to ear transfer function in median plane sound localization is investigated in this paper. At first, transfer functions were measured and analyzed. Then, these transfer functions were used in experiments where sounds from a source on the median plane were simulated and presented to subjects through headphones. In these simulation experiments, the transfer functions were smoothed by ARMA models with different degrees of simplification to investigate the role of microscopic and macroscopic patterns in the transfer functions for median plane localization. The results of the study are summarized as follows: (1) For front-rear judgment, information derived from microscopic peaks and dips in the low-frequency region (below 2 kHz) and the macroscopic patterns in the high-frequency region seems to be utilized; (2) for judgment of elevation angle, major cues exist in the high-frequency region above 5 kHz. The information in macroscopic patterns is utilized instead of that in small peaks and dips.     

利用残差网络分析普氏蹄蝠耳朵对恒频声源定向的影响

为研究恒频蝙蝠耳朵与空间定位的关系,利用深度学习算法和仿蝙蝠静态双耳接收器,分析蝙蝠耳朵对恒频声源定向的影响。首先根据普氏蹄蝠耳朵模型设计不同双耳夹角和间距的仿生双耳接收器,并从多个空间方位采集声源发射的不同频率的恒频声呐信号,然后提取双耳同步采集信号的时频图并归一化作为输入特征,最后利用残差网络实现声源定向。实验结果表明,静态双耳接收器对恒频声源的定向误差平均值基本保持在3.5°以下,但高于动态单耳接收器的定向误差;定向精度与声源频率及声源所在空间方位有关,声源位于接收器水平方向±30°范围内时,定向精度相对较高;双耳夹角和间距也会影响定向精度,且前者影响较为显著。     

CORRELATION FACTORS DESCRIBING PRIMARY AND SPATIAL SENSATIONS OF SOUND FIELDS

The theory of subjective preference of the sound field in a concert hall is established based on the model of human auditory-brain system. The model consists of the autocorrelation function (ACF) mechanism and the interaural crosscorrelation function (IACF) mechanism for signals arriving at two ear entrances, and the specialization of human cerebral hemispheres. This theory can be developed to describe primary sensations such as pitch or missing fundamental, loudness, timbre and, in addition, duration sensation which is introduced here as a fourth. These four primary sensations may be formulated by the temporal factors extracted from the ACF associated with the left hemisphere and, spatial sensations such as localization in the horizontal plane, apparent source width and subjective diffuseness are described by the spatial factors extracted from the IACF associated with the right hemisphere. Any important subjective responses of sound fields may be described by both temporal and spatial factors.     

Auditory externalization in hearing-impaired listeners: the effect of pinna cues and number of talkers

Hearing-aid wearers have reported sound source locations as being perceptually internalized (i.e., inside their head). The contribution of hearing-aid design to internalization has, however, received little attention. This experiment compared the sensitivity of hearing-impaired (HI) and normal-hearing listeners to externalization cues when listening with their own ears and simulated behind-the-ear hearing-aids in increasingly complex listening situations and reduced pinna cues. Participants rated the degree of externalization using a multiple-stimulus listening test for mixes of internalized and externalized speech stimuli presented over headphones. The results showed that HI listeners had a contracted perception of externalization correlated with high-frequency hearing loss.     

The acoustical cues to sound location in the rat: measurements of directional transfer functions

The acoustical cues for sound location are generated by spatial- and frequency-dependent filtering of propagating sound waves by the head and external ears. Although rats have been a common model system for anatomy, physiology, and psychophysics of localization, there have been few studies of the acoustical cues available to rats. Here, directional transfer functions (DTFs), the directional components of the head-related transfer functions, were measured in six adult rats. The cues to location were computed from the DTFs. In the frontal hemisphere, spectral notches were present for frequencies from approximately 16 to 30 kHz; in general, the frequency corresponding to the notch increased with increases in source elevation and in azimuth toward the ipsilateral ear. The maximum high-frequency envelope-based interaural time differences (ITDs) were 130 mus, whereas low-frequency (<3.5 kHz) fine-structure ITDs were 160 mus; both types of ITDs were larger than predicted from spherical head models. Interaural level differences (ILDs) strongly depended on location and frequency. Maximum ILDs were <10 dB for frequencies <8 kHz and were as large as 20-40 dB for frequencies >20 kHz. Removal of the pinna eliminated the spectral notches, reduced the acoustic gain and ILDs, altered the acoustical axis, and reduced the ITDs.     

Assessing auditory distance perception using virtual acoustics

In most naturally occurring situations, multiple acoustic properties of the sound reaching a listener's ears change as sound source distance changes. Because many of these acoustic properties, or cues, can be confounded with variation in the acoustic properties of the source and the environment, the perceptual processes subserving distance localization likely combine and weight multiple cues in order to produce stable estimates of sound source distance. Here, this cue-weighting process is examined psychophysically, using a method of virtual acoustics that allows precise measurement and control of the acoustic cues thought to be salient for distance perception in a representative large-room environment. Though listeners' judgments of sound source distance are found to consistently and exponentially underestimate true distance, the perceptual weight assigned to two primary distance cues (intensity and direct-to-reverberant energy ratio) varies substantially as a function of both sound source type (noise and speech) and angular position (0 degrees and 90 degrees relative to the median plane). These results suggest that the cue-weighting process is flexible, and able to adapt to individual distance cues that vary as a result of source properties and environmental conditions.     

The impact of early reflections on binaural cues

Animals live in cluttered auditory environments, where sounds arrive at the two ears through several paths. Reflections make sound localization difficult, and it is thought that the auditory system deals with this issue by isolating the first wavefront and suppressing later signals. However, in many situations, reflections arrive too early to be suppressed, for example, reflections from the ground in small animals. This paper examines the implications of these early reflections on binaural cues to sound localization, using realistic models of reflecting surfaces and a spherical model of diffraction by the head. The fusion of direct and reflected signals at each ear results in interference patterns in binaural cues as a function of frequency. These cues are maximally modified at frequencies related to the delay between direct and reflected signals, and therefore to the spatial location of the sound source. Thus, natural binaural cues differ from anechoic cues. In particular, the range of interaural time differences is substantially larger than in anechoic environments. Reflections may potentially contribute binaural cues to distance and polar angle when the properties of the reflecting surface are known and stable, for example, for reflections on the ground.     

大耳蝠耳廓模型频扫特性的研究

以大耳蝠耳廓外形参数为基础,提出了一种由线、面结构得到的简化斜截式喇叭模型,应用有限单元法对该模型进行数值仿真计算,分析了其远场声场方向性随频率在垂直和水平方向的变化。结果表明,与大耳蝠耳廓模型相比,该模型具有更宽的频扫频带;水平方向上有更好的频扫方向性;垂直方向上有更大的扫描角度范围。并且,应用具有频扫特性的天线,可得到一种单基站无线定位方法。     

Infants' localization of sounds in the median sagittal plane: effects of signal frequency

The purpose of this research was to determine if infants, like adults, show differential localization performance in the median sagittal plane (MSP) as a function of the spectrum of the signal. Infants 6-18 months of age were seated in a dark room facing an array of nine loudspeakers, with one loudspeaker positioned at ear level, 0 degrees, and four each positioned above and below ear level at 4 degrees, 8 degrees, 12 degrees, and 16 degrees. A two-alternative, forced-choice procedure was used in which a sequence of noise bursts was presented at 0 degrees and then shifted vertically, above or below 0 degrees, and continued to be presented until the infant made a directional head and/or eye movement; correct responses were visually reinforced. For each of three bandpass noise conditions (less than 4 kHz, 4-8 kHz, 8-12 kHz), minimum audible angle (MAA) for each listener, i.e., the smallest of the four angular shifts in vertical sound location that the listener could reliably detect, was estimated. Results indicated that MAA systematically decreased with increasing age, revealing an increasingly finer partitioning of auditory space. Moreover, performance at each age revealed the importance of high frequencies for localization in the MSP. Infants did not reliably localize the low-pass signal (less than 4 kHz) and showed the best performance to the signal comprising the highest frequencies (8-12 kHz). These findings reveal systematic age-related improvements in sound localization abilities during infancy, and suggest that spectral cues similar to those for adults operate for infants in vertical localization.     

Features of the Sound Field Structure in a Two-Channel Oceanic Waveguide

The results of experimental studies of the energy and angular structure of a sound field in the region of the Iberian Basin in the northeastern Atlantic are discussed. The experiments are carried out in a two-channel waveguide whose axes are located at depths of approximately 450 and 2000 m. A continuous pseudonoise signal in the frequency range 2.52–4.0 kHz is emitted. The signals are received by the omnidirectional hydrophones and, simultaneously, by a 10-m-long vertical array, which allows one to realize a narrow beam reception (～2.5°) in the vertical plane. The source and the receiver are located in a 500-m-thick layer within the upper sound channel. The field characteristics are measured in the course of a continuous change of distance from 1 to 65 km. The comparison of the experimental data with calculations shows that the sound field structure formed by the lower channel is much closer to the theoretical results than the structure formed by the upper channel. In the upper sound channel, the shadow zone manifests itself only slightly and the first convergence zone begins approximately 72–11 km nearer to the source than predicted by the calculations. The corresponding angular sound field structure is fairly pronounced in the vertical plane and bears no evidence of the random behavior that is peculiar to the fields scattered by the inhomogeneities.     

阵列式双水听器平面扫描声强分布测量和声功率计算实验研究

根据双水听器法测量声强的基本原理，本文提出了基阵在湖中的布放及测量声强分布的实施步骤。通过对试验数据的处理与分析，给出了声强分布的三维力和等值曲线图，并利用扫描平面上的声强分布。计算出声源辐射的声功率。实验表明，本文提出的用列阵式双水听器声强测量系统，作平面扫描测量声强分布的方案是合理的；利用所测得的双平面近场声强分布来计算源的辐射也是可行的。     

The influence of pinnae-based spectral cues on sound localization

The role of pinnae-based spectral cues was investigated by requiring listeners to locate sound, binaurally, in the horizontal plane with and without partial occlusion of their external ears. The main finding was that the high frequencies were necessary for optimal performance. When the stimulus contained the higher audio frequencies, e.g., broadband and 4.0-kHz high-pass noise, localization accuracy was significantly superior to that recorded for stimuli consisting only of the lower frequencies (4.0- and 1.0-kHz low-pass noise). This finding was attributed to the influence of the spectral cues furnished by the pinnae, for when the stimulus composition included high frequencies, pinnae occlusion resulted in a marked decline in localization accuracy. Numerous front-rear reversals occurred. Moreover, the ability to distinguish among sounds originating within the same quadrant also suffered. Performance proficiency for the low-pass stimuli was not further degraded under conditions of pinnae occlusion. In locating the 4.0-kHz high-pass noise when both, neither, or only one ear was occluded, the data demonstrated unequivocally that the pinna-based cues of the "near" ear contributed powerfully toward localization accuracy.     

Effect of source spectrum on sound localization in an everyday reverberant room

Two experiments explored how frequency content impacts sound localization for sounds containing reverberant energy. Virtual sound sources from thirteen lateral angles and four distances were simulated in the frontal horizontal plane using binaural room impulse responses measured in an everyday office. Experiment 1 compared localization judgments for one-octave-wide noise centered at either 750 Hz (low) or 6000 Hz (high). For both band-limited noises, perceived lateral angle varied monotonically with source angle. For frontal sources, perceived locations were similar for low- and high-frequency noise; however, for lateral sources, localization was less accurate for low-frequency noise than for high-frequency noise. With increasing source distance, judgments of both noises became more biased toward the median plane, an effect that was greater for low-frequency noise than for high-frequency noise. In Experiment 2, simultaneous presentation of low- and high-frequency noises yielded performance that was less accurate than that for high-frequency noise, but equal to or better than for low-frequency noise. Results suggest that listeners perceptually weight low-frequency information heavily, even in reverberant conditions where high-frequency stimuli are localized more accurately. These findings show that listeners do not always optimally adjust how localization cues are integrated over frequency in reverberant settings.