Study of vertical sound image control with parametric loudspeakers

A parametric loudspeaker utilizes nonlinearity of a medium and is known as a super-directive loudspeaker. In this paper, the sound localization in the vertical direction using the upper and lower parametric loudspeakers is confirmed by listening tests and physical measurements. The differences in levels between the upper and lower parametric loudspeakers are varied as a parameter. The direction of sound localization in the vertical plane can be controlled not only when the acoustical axis is set to the right ear but also when it is set to at 5 deg to the right of the right ear. The effect of the level difference between the upper and lower loudspeakers is weaker than the differences observed when using ordinary loudspeakers. We obtained interesting characteristics of the left-right sound localization in the horizontal plane with the upper and lower parametric loudspeakers in the vertical plane. It is found that by setting the parametric loudspeaker at the right ear (that is, the horizontal angle of a listener to it is only 3 deg to the right), the direction of sound localization in the horizontal plane moved approximately 10 deg to the right. Moreover, by setting the parametric loudspeaker 5 deg to the right, the direction of sound localization moves approximately 20 deg to the right. The ILD (Interaural Level Difference) using a dummy head is calculated from the measured left and right sound signals. It is determined that ILDs of the parametric loudspeaker are larger than those of the ordinary loudspeaker. A simple geometrical acoustic model is introduced and analyzed. The analysis helps to explain the measured characteristics.     

Sound localization in noise in normal-hearing listeners

The ability to localize a click train in the frontal-horizontal plane was measured in quiet and in the presence of a white-noise masker. The experiment tested the effects of signal frequency, signal-to-noise ratio (S/N), and masker location. Clicks were low-pass filtered at 11 kHz in the broadband condition, low-pass filtered at 1.6 kHz in the low-pass condition, and bandpass filtered between 1.6 and 11 kHz in the high-pass condition. The masker was presented at either -90, 0, or +90 deg azimuth. Six signal-to-noise ratios were used, ranging from -9 to +18 dB. Results obtained with four normal-hearing listeners show that (1) for all masker locations and filtering conditions, localization accuracy remains unaffected by noise until 0-6 dB S/N and decreases at more adverse signal-to-noise ratios, (2) for all filtering conditions and at low signal-to-noise ratios, the effect of noise is greater when noise is presented at +/- 90 deg azimuth than at 0 deg azimuth, (3) the effect of noise is similar for all filtering conditions when noise is presented at 0 deg azimuth, and (4) when noise is presented at +/- 90 deg azimuth, the effect of noise is similar for the broadband and high-pass conditions, but greater for the low-pass condition. These results suggest that the low- and high-frequency cues used to localize sounds are equally affected when noise is presented at 0 deg azimuth. However, low-frequency cues are less resistant to noise than high-frequency cues when noise is presented at +/- 90 deg azimuth. When both low- and high-frequency cues are available, listeners base their decision on the cues providing the most accurate estimation of the direction of the sound source (high-frequency cues). Parallel measures of click detectability suggest that the poorer localization accuracy observed when noise is at +/- 90 deg azimuth may be caused by a reduction in the detectability of the signal at the ear ipsilateral to the noise.     

The influence of pinnae-based spectral cues on sound localization

The role of pinnae-based spectral cues was investigated by requiring listeners to locate sound, binaurally, in the horizontal plane with and without partial occlusion of their external ears. The main finding was that the high frequencies were necessary for optimal performance. When the stimulus contained the higher audio frequencies, e.g., broadband and 4.0-kHz high-pass noise, localization accuracy was significantly superior to that recorded for stimuli consisting only of the lower frequencies (4.0- and 1.0-kHz low-pass noise). This finding was attributed to the influence of the spectral cues furnished by the pinnae, for when the stimulus composition included high frequencies, pinnae occlusion resulted in a marked decline in localization accuracy. Numerous front-rear reversals occurred. Moreover, the ability to distinguish among sounds originating within the same quadrant also suffered. Performance proficiency for the low-pass stimuli was not further degraded under conditions of pinnae occlusion. In locating the 4.0-kHz high-pass noise when both, neither, or only one ear was occluded, the data demonstrated unequivocally that the pinna-based cues of the "near" ear contributed powerfully toward localization accuracy.     

The contribution of two ears to the perception of vertical angle in sagittal planes

Because the input signals to the left and right ears are not identical, it is important to clarify the role of these signals in the perception of the vertical angle of a sound source at any position in the upper hemisphere. To obtain basic findings on upper hemisphere localization, this paper investigates the contribution of each pinna to the perception of vertical angle. Tests measured localization of the vertical angle in five planes parallel to the median plane. In the localization tests, the pinna cavities of one or both ears were occluded. Results showed that pinna cavities of both the near and far ears play a role in determining the perceived vertical angle of a sound source in any plane, including the median plane. As a sound source shifts laterally away from the median plane, the contribution of the near ear increases and, conversely, that of the far ear decreases. For saggital planes at azimuths greater than 60 degrees from midline, the far ear no longer contributes measurably to the determination of vertical angle.     

Infants' localization of sounds in the median sagittal plane: effects of signal frequency

The purpose of this research was to determine if infants, like adults, show differential localization performance in the median sagittal plane (MSP) as a function of the spectrum of the signal. Infants 6-18 months of age were seated in a dark room facing an array of nine loudspeakers, with one loudspeaker positioned at ear level, 0 degrees, and four each positioned above and below ear level at 4 degrees, 8 degrees, 12 degrees, and 16 degrees. A two-alternative, forced-choice procedure was used in which a sequence of noise bursts was presented at 0 degrees and then shifted vertically, above or below 0 degrees, and continued to be presented until the infant made a directional head and/or eye movement; correct responses were visually reinforced. For each of three bandpass noise conditions (less than 4 kHz, 4-8 kHz, 8-12 kHz), minimum audible angle (MAA) for each listener, i.e., the smallest of the four angular shifts in vertical sound location that the listener could reliably detect, was estimated. Results indicated that MAA systematically decreased with increasing age, revealing an increasingly finer partitioning of auditory space. Moreover, performance at each age revealed the importance of high frequencies for localization in the MSP. Infants did not reliably localize the low-pass signal (less than 4 kHz) and showed the best performance to the signal comprising the highest frequencies (8-12 kHz). These findings reveal systematic age-related improvements in sound localization abilities during infancy, and suggest that spectral cues similar to those for adults operate for infants in vertical localization.     

前方空间环绕声的四扬声器虚拟重放

考虑头部转动带来的动态因素对听觉垂直定位的贡献,提出了前方空间环绕声的四扬声器虚拟重放方法。4个扬声器分别布置在水平面左前、右前以及高仰角的左前上、右前上方向,并采用听觉传输信号处理的方法将多通路空间环绕声信号转换为4个扬声器的重放信号。以9.1通路空间环绕声虚拟重放为例,采用头相关传输函数对双耳声压及其包含的定位因素进行分析表明,该方法可以产生正确的双耳时间差及其随头部转动的变化,从而产生合适的侧向定位双耳因素和垂直定位的动态因素。而心理声学实验结果表明,该方法可以重放稳定的前方空间的水平和垂直虚拟源。因此,四扬声器布置结合听觉传输处理足以重放前方空间环绕声的垂直定位信息,实现多通路空间环绕声的向下混合与简化。      

Speech perception,localization, and lateralization with bilateral cochlear implants

Five bilateral cochlear implant users were tested for their localization abilities and speech understanding in noise, for both monaural and binaural listening conditions. They also participated in lateralization tasks to assess the impact of variations in interaural time delays (ITDs) and interaural level differences (ILDs) for electrical pulse trains under direct computer control. The localization task used pink noise bursts presented from an eight-loudspeaker array spanning an arc of approximately 108 degrees in front of the listeners at ear level (0-degree elevation). Subjects showed large benefits from bilateral device use compared to either side alone. Typical root-mean-square (rms) averaged errors across all eight loudspeakers in the array were about 10 degrees for bilateral device use and ranged from 20 degrees to 60 degrees using either ear alone. Speech reception thresholds (SRTs) were measured for sentences presented from directly in front of the listeners (0 degrees) in spectrally matching speech-weighted noise at either 0 degrees, +90 degrees or -90 degrees for four subjects out of five tested who could perform the task. For noise to either side, bilateral device use showed a substantial benefit over unilateral device use when noise was ipsilateral to the unilateral device. This was primarily because of monaural head-shadow effects, which resulted in robust SRT improvements (P<0.001) of about 4 to 5 dB when ipsilateral and contralateral noise positions were compared. The additional benefit of using both ears compared to the shadowed ear (i.e., binaural unmasking) was only 1 or 2 dB and less robust (P = 0.04). Results from the lateralization studies showed consistently good sensitivity to ILDs; better than the smallest level adjustment available in the implants (0.17 dB) for some subjects. Sensitivity to ITDs was moderate on the other hand, typically of the order of 100 micros. ITD sensitivity deteriorated rapidly when stimulation rates for unmodulated pulse-trains increased above a few hundred Hz but at 800 pps showed sensitivity comparable to 50-pps pulse-trains when a 50-Hz modulation was applied. In our opinion, these results clearly demonstrate important benefits are available from bilateral implantation, both for localizing sounds (in quiet) and for listening in noise when signal and noise sources are spatially separated. The data do indicate, however, that effects of interaural timing cues are weaker than those from interaural level cues and according to our psychophysical findings rely on the availability of low-rate information below a few hundred Hz.     

Sound localization of stereo reproduction with parametric loudspeakers

A parametric loudspeaker radiates an audible signal by the interaction of the primary wave that is amplitude modulated and is known as a super-directivity loudspeaker. The parametric loudspeaker is one of the prominent applications of nonlinear acoustics. So far, the applications have been limited monaural reproduction sound system for public address in museum, station, street etc. In this paper, we investigated sound localization of stereo reproduction using two parametric loudspeakers in comparison with that using two ordinary dynamic loudspeakers. In subjective tests, the binaural information ILD (Interaural Level Difference) or ITD (Interaural Time Delay) was focused on. To investigate the characteristics of sound localization in a wide listening area, three typical listening positions were picked up. Signals were 500 Hz, 1 kHz, 2 kHz and 4 kHz pure tones and pink noise. The used parametric loudspeaker was an equilateral hexagon. The subjective test led to the results that when the parametric loudspeakers were used, the listeners at the three typical listening positions perceived the correct sound localization of not only pure tone but also pink noise and when the ordinary dynamic loudspeakers were used, except for the case of pure tone with ITD, the tendency was almost similar to those using the parametric loudspeakers. The second subjective tests were conducted in order to investigate in details the difference between parametric loudspeakers and ordinary dynamic loudspeakers by increasing the number of subjects. In the case of ITD and 500 Hz using the ordinary dynamic loudspeakers, three types of sound localization were categorized, in which the reversed type was major and the normal and the other types were minor. The ILDs which were measured with a dummy head and were calculated with several formulas were almost the same and indicated the reasons of the reversed typed sound localization and a serious influence of the crosstalk. It was found that in the case of pure tone with ITD, the contradiction between the binaural information ILD and ITD is remarkable, because the directivity of the ordinary dynamic loudspeakers was so dull that the crosstalk components had a serious influence on sound localization. It was determined the parametric loudspeaker could transmit correct binaural information to the listener, because the directivity of the parametric loudspeakers was so sharp that it suppressed the cross talk components.     

Localizing nearby sound sources in a classroom: binaural room impulse responses

Binaural room impulse responses (BRIRs) were measured in a classroom for sources at different azimuths and distances (up to 1 m) relative to a manikin located in four positions in a classroom. When the listener is far from all walls, reverberant energy distorts signal magnitude and phase independently at each frequency, altering monaural spectral cues, interaural phase differences, and interaural level differences. For the tested conditions, systematic distortion (comb-filtering) from an early intense reflection is only evident when a listener is very close to a wall, and then only in the ear facing the wall. Especially for a nearby source, interaural cues grow less reliable with increasing source laterality and monaural spectral cues are less reliable in the ear farther from the sound source. Reverberation reduces the magnitude of interaural level differences at all frequencies; however, the direct-sound interaural time difference can still be recovered from the BRIRs measured in these experiments. Results suggest that bias and variability in sound localization behavior may vary systematically with listener location in a room as well as source location relative to the listener, even for nearby sources where there is relatively little reverberant energy.     

Binaural weighting of monaural spectral cues for sound localization

For human listeners, cues for vertical-plane localization are provided by direction-dependent pinna filtering. This study quantified listeners' weighting of the spectral cues from each ear as a function of stimulus lateral angle, interaural time difference (ITD), and interaural level difference (ILD). Subjects indicated the apparent position of headphone-presented noise bursts synthesized in virtual auditory space. The synthesis filters for the two ears either corresponded to the same location or to two different locations separated vertically by 20 deg. Weighting of each ear's spectral information was determined by a multiple regression between the elevations to which each ear's spectrum corresponded and the vertical component of listeners' responses. The apparent horizontal source location was controlled either by choosing synthesis filters corresponding to locations on or 30 deg left or right of the median plane or by attenuating or delaying the signal at one ear. For broadband stimuli, spectral weighting and apparent lateral angle were determined primarily by ITD. Only for high-pass stimuli were weighting and lateral angle determined primarily by ILD. The results suggest that the weighting of monaural spectral cues and the perceived lateral angle of a sound source depend similarly on ITD, ILD, and stimulus spectral range.     

Influence of monaural spectral cues on binaural localization

Seven subjects located, monaurally and binaurally, narrow bands of noise originating in the horizontal plane. The stimuli were 1.0 kHz wide and centered at 4.0-14.0 kHz in steps of 0.5 kHz. The loudspeakers, 15 deg apart, were arranged in a semicircle (0-270-180 deg, azimuth). In the first part of the experiment all sounds emanated from the loudspeaker at 270 deg, but their apparent locations varied widely as a function of their center frequency. For each subject, the pattern of location judgments under the binaural listening condition corresponded to that recorded for the monaural condition. In the second part of the experiment the loudspeaker from which each of the same narrow bands of noise emanated was varied in irregular order. Again, monaural location judgments were governed by the frequency content of the noise bands. Binaural location judgments were strongly influenced by the sounds' frequency composition when the stimuli originated from 315-225 deg, notwithstanding the presence of interaural differences in time and intensity. For narrow bands of noise emanating off midline, monaural spectral cues significantly override binaural difference cues, and they also determine the resolution of front-back ambiguities.     

Impact of unilateral hearing loss on sound localization

The impact of unilateral hearing loss on the localization of horizontal plane sound sources ipsilateral and contralateral to the side of the unimpaired ear was examined. Normal-hearing listeners judged the direction of six loudspeakers, separated by 30° and arrayed frontally or laterally on the right side with the right or left ear occluded. The benefit of massed practice over three sequential days was assessed. For the frontal loudspeaker array, azimuthal discrimination on the occluded side was poor but only 30% of sounds were perceived to come from the unoccluded side. For the right lateral array, when the ipsilateral ear was unoccluded, front and back were rarely confused. Accuracy mainly decreased for speakers close to the midline axis, front and back. When the contralateral ear was unoccluded responses were biased toward the rearmost speaker. Practice did not improve performance. The findings were discussed within the context of military operations. They support the need for job-specific hearing standards.     

Speech intelligibility and localization in a multi-source environment.

Natural environments typically contain sound sources other than the source of interest that may interfere with the ability of listeners to extract information about the primary source. Studies of speech intelligibility and localization by normal-hearing listeners in the presence of competing speech are reported on in this work. One, two or three competing sentences [IEEE Trans. Audio Electroacoust. 17(3), 225-246 (1969)] were presented from various locations in the horizontal plane in several spatial configurations relative to a target sentence. Target and competing sentences were spoken by the same male talker and at the same level. All experiments were conducted both in an actual sound field and in a virtual sound field. In the virtual sound field, both binaural and monaural conditions were tested. In the speech intelligibility experiment, there were significant improvements in performance when the target and competing sentences were spatially separated. Performance was similar in the actual sound-field and virtual sound-field binaural listening conditions for speech intelligibility. Although most of these improvements are evident monaurally when using the better ear, binaural listening was necessary for large improvements in some situations. In the localization experiment, target source identification was measured in a seven-alternative absolute identification paradigm with the same competing sentence configurations as for the speech study. Performance in the localization experiment was significantly better in the actual sound-field than in the virtual sound-field binaural listening conditions. Under binaural conditions, localization performance was very good, even in the presence of three competing sentences. Under monaural conditions, performance was much worse. For the localization experiment, there was no significant effect of the number or configuration of the competing sentences tested. For these experiments, the performance in the speech intelligibility experiment was not limited by localization ability.     

Influence of the Number of Loudspeakers on the Timbre in Horizontal and Mixed-Order Ambisoncis Reproduction

Ambisonics is a series of flexible spatial sound reproduction systems based on spatial harmonics decomposition of sound field. Traditional horizontal and spatial Ambisonics reconstruct horizontal and spatial sound field with certain order of spatial harmonics, respectively. Both the Shannon-Nyquist spatial sampling frequency limit for accurately reconstructing sound field and the complexity of system increase with the increasing order of Ambisonics. Based on the fact that the horizontal localization resolution of human hearing is higher than vertical resolution, mixed-order Ambisonics (MOA) reconstructs horizontal sound field with higher order spatial harmonics, while reconstructs vertical sound field with lower order spatial harmonics, and thereby reaches a compromise between the perceptual performance and the complexity of system. For a given order horizontal Ambisoncis or MOA reproduction, the number of horizontal loudspeakers is flexible, providing that it exceeds some low limit. By using Moore’s revised loudness model, the present work analyzes the influence of the number of horizontal loudspeakers on timbre both in horizontal Ambisonics and MOA reproduction. The binaural loudness level spectra (BLLS) of Ambisoncis reproduction are calculated and then compared with those of target sound field. The results indicate that below the Shannon-Nyquist limit of spatial sampling, increasing the number of horizontal loudspeakers influence little on BLLS then timbre. Above the limit, however, the BLLS for Ambisoncis reproduction deviate from those of target sound field. The extent of deviation depends on both the direction of target sound field and the number of loudspeakers. Increasing the number of horizontal loudspeakers may increase the change of BLLS then timbre in some cases, but reduce the change in some other cases. For MOA, the influence of the number of horizontal loudspeakers on BLLS and timbre reduces when virtual source departs from horizontal plane to the high or low elevation. The subjective evaluation experiment also validates the analysis.     

Auditory localization of nearby sources. III. Stimulus effects

A series of experiments has examined the auditory localization of a nearby (< 1 m) sound source under four conditions: (1) a fixed-amplitude condition where loudness-based distance cues were available; (2) a monaural condition where the contralateral ear was occluded by an ear-plug and muff; (3) a high-pass condition where the stimulus bandwidth was 3 Hz to 15 kHz; and (4) a low-pass condition where the stimulus bandwidth was 200 Hz to 3 kHz. The results of these experiments were compared to those of a previous experiment that measured localization performance for a nearby broadband, random-amplitude source [Brungart et al., J. Acoust. Soc. Am. 106, 1956-1968 (1999)]. Directional localization performance in each condition was consistent with the results of previous far-field localization experiments. Distance localization accuracy improved slightly in the fixed-amplitude condition relative to the earlier broadband random-amplitude experiment, especially near the median plane, but was severely degraded in the monaural condition. Distance accuracy was also found to be highly dependent on the low-frequency energy of the stimulus: in the low-pass condition, distance accuracy was similar to that in the broadband condition, while in the high-pass condition, distance accuracy was significantly reduced. The results suggest that low-frequency interaural level differences are the dominant auditory distance cue in the proximal region.     

Experimental analysis of considering the sound pressure distribution pattern at the ear canal entrance as an unrevealed head-related localization clue

By analyzing the differences between binaural recording and real listening, it was deduced that there were some unrevealed auditory localization clues, and the sound pressure distribution pattern at the entrance of ear canal was probably a clue. It was proved through the listening test that the unrevealed auditory localization clues really exist with the reduction to absurdity. And the effective frequency bands of the unrevealed localization clues were induced and summed. The result of finite element based simulations showed that the pressure distribution at the entrance of ear canal was non-uniform, and the pattern was related to the direction of sound source. And it was proved that the sound pressure distribution pattern at the entrance of the ear canal carried the sound source direction information and could be used as an unrevealed localization clue. The frequency bands in which the sound pressure distribution patterns had significant differences between front and back sound source directions were roughly matched with the effective frequency bands of unrevealed localization clues obtained from the listening tests. To some extent, it supports the hypothesis that the sound pressure distribution pattern could be a kind of unrevealed auditory localization clues.     

The binaural performance of a cross-talk cancellation system with matched or mismatched setup and playback acoustics

Cross-talk cancellation is a method for synthesizing virtual auditory space using loudspeakers. One implementation is the "Optimal Source Distribution" technique [T. Takeuchi and P. Nelson, J. Acoust. Soc. Am. 112, 2786-2797 (2002)], in which the audio bandwidth is split across three pairs of loudspeakers, placed at azimuths of +/-90 degrees, +/-15 degrees, and +/-3 degrees, conveying low, mid, and high frequencies, respectively. A computational simulation of this system was developed and verified against measurements made on an acoustic system using a manikin. Both the acoustic system and the simulation gave a wideband average cancellation of almost 25 dB. The simulation showed that when there was a mismatch between the head-related transfer functions used to set up the system and those of the final listener, the cancellation was reduced to an average of 13 dB. Moreover, in this case the binaural interaural time differences and interaural level differences delivered by the simulation of the optimal source distribution (OSD) system often differed from the target values. It is concluded that only when the OSD system is set up with "matched" head-related transfer functions can it deliver accurate binaural cues.     

The bat head-related transfer function reveals binaural cues for sound localization in azimuth and elevation

Directional properties of the sound transformation at the ear of four intact echolocating bats, Eptesicus fuscus, were investigated via measurements of the head-related transfer function (HRTF). Contributions of external ear structures to directional features of the transfer functions were examined by remeasuring the HRTF in the absence of the pinna and tragus. The investigation mainly focused on the interactions between the spatial and the spectral features in the bat HRTF. The pinna provides gain and shapes these features over a large frequency band (20-90 kHz), and the tragus contributes gain and directionality at the high frequencies (60 to 90 kHz). Analysis of the spatial and spectral characteristics of the bat HRTF reveals that both interaural level differences (ILD) and monaural spectral features are subject to changes in sound source azimuth and elevation. Consequently, localization cues for horizontal and vertical components of the sound source location interact. Availability of multiple cues about sound source azimuth and elevation should enhance information to support reliable sound localization. These findings stress the importance of the acoustic information received at the two ears for sound localization of sonar target position in both azimuth and elevation.     

耳道入口处声压分布模态作为听觉方向感知隐性线索的实验分析

通过分析双耳录音与真实听音之间的差别,推断存在影响听觉方向感知的隐性线索,而由头部及外耳结构引起的耳道入口处截面声压分布模态可能是其中一种。首先,通过听音实验利用反证法证明听觉方向感知隐性线索确实存在,并归纳总结出隐性线索的有效作用频段;然后,利用有限元仿真方法计算耳道入口处的声压分布,仿真结果表明耳道入口处声压分布是不均匀的,且分布模态与声源方向有关,从数值仿真的角度验证了耳道入口处截面的声压分布模态携带了声源方向信息,可以作为一种隐性定位线索;仿真计算所得前、后声源方向耳道入口处声压分布模态差异显著的频段与听音实验所得的隐性线索有效频段基本相符,在一定程度上支持耳道入口处声压分布模态是一种方向感知隐性线索的推测。      

Tuning in the spatial dimension: evidence from a masked speech identification task

Spatial release from masking was studied in a three-talker soundfield listening experiment. The target talker was presented at 0 degrees azimuth and the maskers were either colocated or symmetrically positioned around the target, with a different masker talker on each side. The symmetric placement greatly reduced any "better ear" listening advantage. When the maskers were separated from the target by +/-15 degrees , the average spatial release from masking was 8 dB. Wider separations increased the release to more than 12 dB. This large effect was eliminated when binaural cues and perceived spatial separation were degraded by covering one ear with an earplug and earmuff. Increasing reverberation in the room increased the target-to-masker ratio (TM) for the separated, but not colocated, conditions reducing the release from masking, although a significant advantage of spatial separation remained. Time reversing the masker speech improved performance in both the colocated and spatially separated cases but lowered TM the most for the colocated condition, also resulting in a reduction in the spatial release from masking. Overall, the spatial tuning observed appears to depend on the presence of interaural differences that improve the perceptual segregation of sources and facilitate the focus of attention at a point in space.