Headphone simulation of free-field listening. I: Stimulus synthesis

This article describes techniques used to synthesize headphone-presented stimuli that simulate the ear-canal waveforms produced by free-field sources. The stimulus synthesis techniques involve measurement of each subject's free-field-to-eardrum transfer functions for sources at a large number of locations in free field, and measurement of headphone-to-eardrum transfer functions with the subject wearing headphones. Digital filters are then constructed from the transfer function measurements, and stimuli are passed through these digital filters. Transfer function data from ten subjects and 144 source positions are described in this article, along with estimates of the various sources of error in the measurements. The free-field-to-eardrum transfer function data are consistent with comparable data reported elsewhere in the literature. A comparison of ear-canal waveforms produced by free-field sources with ear-canal waveforms produced by headphone-presented simulations shows that the simulations duplicate free-field waveforms within a few dB of magnitude and a few degrees of phase at frequencies up to 14 kHz.     

Fidelity of three-dimensional-sound reproduction using a virtual auditory display

The fidelity of reproducing free-field sounds using a virtual auditory display was investigated in two experiments. In the first experiment, listeners directly compared stimuli from an actual loudspeaker in the free field with those from small headphones placed in front of the ears. Headphone stimuli were filtered using head-related transfer functions (HRTFs), recorded while listeners were wearing the headphones, in order to reproduce the pressure signatures of the free-field sounds at the eardrum. Discriminability was investigated for six sound-source positions using broadband noise as a stimulus. The results show that the acoustic percepts of real and virtual sounds were identical. In the second experiment, discrimination between virtual sounds generated with measured and interpolated HRTFs was investigated. Interpolation was performed using HRTFs measured for loudspeaker positions with different spatial resolutions. Broadband noise bursts with flat and scrambled spectra were used as stimuli. The results indicate that, for a spatial resolution of about 6 degrees, the interpolation does not introduce audible cues. For resolutions of 20 degrees or more, the interpolation introduces audible cues related to timbre and position. For intermediate resolutions (10 degrees - 15 degrees) the data suggest that only timbre cues were used.     

On the externalization of virtual sound images in headphone reproduction: a Wiener filter approach

In-head localization of sound images is a critical problem in headphone reproduction. The paper investigates the degree of externalization in terms of the distance of auditory images for various synthesis and reproduction cases. An effective binaural headphone system was constructed by way of binaural synthesis using head-related impulse responses and individual headphone equalization using Wiener filter theory. The headphone system designed had an average reproduction performance error of 2.4% for five subjects with a random noise input, and was used to perform some subjective tests with a set of virtual sources equally spaced and distanced from the center of each subject's head in the horizontal plane. The effects of individual and nonindividual binaural syntheses and those of equalized and nonequalized reproductions were separately investigated. In the tests, each subject was instructed to indicate the distance of auditory images. The results obtained demonstrate that individual equalization is important for externalization, and individual synthesis is important for consistent distance perception. Thus, a combined use of both individual equalization and individual synthesis resulted in externalized sound images of a consistent distance.     

Using beamforming and binaural synthesis for the psychoacoustical evaluation of target sources in noise

The potential of spherical-harmonics beamforming (SHB) techniques for the auralization of target sound sources in a background noise was investigated and contrasted with traditional head-related transfer function (HRTF)-based binaural synthesis. A scaling of SHB was theoretically derived to estimate the free-field pressure at the center of a spherical microphone array and verified by comparing simulated frequency response functions with directly measured ones. The results show that there is good agreement in the frequency range of interest. A listening experiment was conducted to evaluate the auralization method subjectively. A set of ten environmental and product sounds were processed for headphone presentation in three different ways: (1) binaural synthesis using dummy head measurements, (2) the same with background noise, and (3) SHB of the noisy condition in combination with binaural synthesis. Two levels of background noise (62, 72 dB SPL) were used and two independent groups of subjects (N=14) evaluated either the loudness or annoyance of the processed sounds. The results indicate that SHB almost entirely restored the loudness (or annoyance) of the target sounds to unmasked levels, even when presented with background noise, and thus may be a useful tool to psychoacoustically analyze composite sources.     

Influence of fundamental frequency and source elevation on the vertical localization of complex tones and complex tone pairs

This study investigates the vertical localization of single complex tones (monads) and simultaneous complex tone pairs (dyads), especially as it is affected by their fundamental frequency and source elevation. Two complex tone timbres are considered: one consisting of five low-order harmonics, and the other of all odd harmonics (a square wave). Sound sources were at -15, 0, 15, and 30 deg from the horizontal plane at ear height. For eight subjects, this source array was in the median plane, and for a further nine subjects, it was directly to the subject's left (lateral plane). The subjects localized the angle of the auditory image(s) of one or two complex tones around the vertical plane containing the sound sources. Mean responses for the five-harmonic complex tones show a systematic effect (referred to as Pratt's effect) of fundamental frequency on vertical localization--whereby high-frequency complex tones are localized to positions higher than low-frequency complex tones for equivalent source positions. For the square wave, the sound-source position dominates localization, although some effect of fundamental frequency is evident for median plane sources.     

Development of sound measurement systems for auditory functional magnetic resonance imaging

Auditory functional magnetic resonance imaging (fMRI) requires quantification of sound stimuli in the magnetic environment and adequate isolation of background noise. We report the development of two novel sound measurement systems that accurately measure the sound intensity inside the ear, which can simultaneously provide the similar or greater amount of scanner- noise protection than ear-muffs. First, we placed a 2.6 x 2.6-mm microphone in an insert phone that was connected to a headphone [microphone-integrated, foam-tipped insert-phone with a headphone (MIHP)]. This attenuated scanner noise by 37.8+/-4.6 dB, a level better than the reference amount obtained using earmuffs. The nonmetallic optical microphone was integrated with a headphone [optical microphone in a headphone (OMHP)] and it effectively detected the change of sound intensity caused by variable compression on the cushions of the headphone. Wearing the OMHP reduced the noise by 28.5+/-5.9 dB and did not affect echoplanar magnetic resonance images. We also performed an auditory fMRI study using the MIHP system and presented increase in the auditory cortical activation following 10-dB increment in the intensity of sound stimulation. These two newly developed sound measurement systems successfully achieved the accurate quantification of sound stimuli with maintaining the similar level of noise protection of wearing earmuffs in the auditory fMRI experiment.     

Effect of headphone position on absolute threshold measurements

Pure-tone audiometry (measurement of absolute thresholds using pure tones) is the main test for the diagnosis of hearing loss. The aim of the present study is to determine whether the headphone placement over a listener’s ears has an influence on pure-tone audiometric tests, for a large frequency range, for Sennheiser HD600 and Telephonics TDH39 headphones. Audiograms (with 1 dB step, and including 10 frequencies up to 14 kHz) were performed several times on normal-hearing subjects, for different – or not different – headphone positions (allowing to dissociate between effects of headphone position and cognitive factors). Globally, the results seem to indicate that the reliability without headphone removing was quite close to the one observed with removing. The influence of removing did not appear more crucial for high frequencies. The rare frequencies for which a removing effect was seen seem to be function of the headphone model. Finally the results were quite different among the subjects.     

Fast head-related transfer function measurement via reciprocity

An efficient method for head-related transfer function (HRTF) measurement is presented. By applying the acoustical principle of reciprocity, one can swap the speaker and the microphone positions in the traditional (direct) HRTF measurement setup, that is, insert a microspeaker into the subject's ear and position several microphones around the subject, enabling simultaneous HRTF acquisition at all microphone positions. The setup used for reciprocal HRTF measurement is described, and the obtained HRTFs are compared with the analytical solution for a sound-hard sphere and with KEMAR manikin HRTF obtained by the direct method. The reciprocally measured sphere HRTF agrees well with the analytical solution. The reciprocally measured and the directly measured KEMAR HRTFs are not exactly identical but agree well in spectrum shape and feature positions. To evaluate if the observed differences are significant, an auditory localization model based on work by J. C. Middlebrooks [J. Acoust. Soc. Am. 92, 2607-2624 (1992)] was used to predict where a virtual sound source synthesized with the reciprocally measured HRTF would be localized if the directly measured HRTF were used for the localization. It was found that the predicted localization direction generally lies close to the measurement direction, indicating that the HRTFs obtained via the two methods are in good agreement.     

Elevation localization and head-related transfer function analysis at low frequencies

Monaural spectral features due to pinna diffraction are the primary cues for elevation. Because these features appear above 3 kHz where the wavelength becomes comparable to pinna size, it is generally believed that accurate elevation estimation requires wideband sources. However, psychoacoustic tests show that subjects can estimate elevation for low-frequency sources. In the experiments reported, random noise bursts low-pass filtered to 3 kHz were processed with individualized head-related transfer functions (HRTFs), and six subjects were asked to report the elevation angle around four cones of confusion. The accuracy in estimating elevation was degraded when compared to a baseline test with wideband stimuli. The reduction in performance was a function of azimuth and was highest in the median plane. However, when the source was located away from the median plane, subjects were able to estimate elevation, often with surprisingly good accuracy. Analysis of the HRTFs reveals the existence of elevation-dependent features at low frequencies. The physical origin of the low-frequency features is attributed primarily to head diffraction and torso reflections. It is shown that simple geometrical approximations and models of the head and torso explain these low-frequency features and the corresponding elevations cues.     

The dominant role of low-frequency interaural time differences in sound localization.

Two experiments are described in which listeners judge the apparent directions of virtual sound sources-headphone-presented sounds that are processed in order to simulate free-field sounds. Previous results suggest that when the cues to sound direction are preserved by the simulation, the apparent directions of virtual sources are nearly the same as the apparent directions of real free-field sources. In the experiments reported here, the interaural phase relations in the processing algorithms are manipulated in order to produce stimuli in which the interaural time difference cues signal one direction and interaural intensity and pinna cues signal another direction. The apparent directions of these conflicting cue stimuli almost always follow the interaural time cue, as long as the wideband stimuli include low frequencies. With low frequencies removed from the stimuli, the dominance of interaural time difference disappears, and apparent direction is determined primarily by interaural intensity difference and pinna cues.     

Hydrophone calibration in the presence of reflecting elements with the use of matched spatial filtering

A method of determining the parameters of sources of reflected waves is considered. The method is used for precise free-field hydrophone calibration. It is based on expanding the dependence of the transfer impedance of the projector and the hydrophone on the distance between them in the spatial functions of sources of spherical waves. The expansion of the dependence of the transfer impedance is performed with the use of the matched filtering. It is shown that the method makes it possible to determine not only the parameters of a remote source, which is related to the underwater structure of the standard, but also the parameters of a closely located source formed by the hydrophone itself. The location of the source formed by the hydrophone determines the possibility of a precise calibration of the hydrophone in a standard calibration tank with specified dimensions of the working zone.     

The contribution of the near and far ear toward localization of sound in the sagittal plane

Eight listeners were required to locate a train of 4.5-kHz high-pass noise bursts emanating from loudspeakers positioned +/- 30, +/- 20, +/- 10, and 0 deg re: interaural axis. The vertical array of loudspeakers was placed at 45, 90, and 135 deg left of midline. The various experimental conditions incorporated binaural and monaural listening with the latter utilizing the ear nearest or ear farthest from the sound source. While performance excelled when listening with only the near ear, the contribution of the far ear was statistically significant when compared to localization performance when both ears were occluded. Based on head related transfer functions for stimuli whose bandwidth was 1.0 kHz, four spectral cues were selected as candidates for influencing location judgments. Two of them associated relative changes in energy across center frequencies (CFs) with vertical source positions. The other two associated an absolute minimum (maximum) energy for specific CFs with a vertical source position. All but one cue when measured for the near ear could account for localization proficiency. On the other hand, when listening with the far ear, maximum energy at a specific CF outperformed the remaining cues in accounting for localization proficiency.     

Effect of multiple speechlike maskers on binaural speech recognition in normal and impaired hearing.

Speech-reception thresholds (SRT) were measured for 17 normal-hearing and 17 hearing-impaired listeners in conditions simulating free-field situations with between one and six interfering talkers. The stimuli, speech and noise with identical long-term average spectra, were recorded with a KEMAR manikin in an anechoic room and presented to the subjects through headphones. The noise was modulated using the envelope fluctuations of the speech. Several conditions were simulated with the speaker always in front of the listener and the maskers either also in front, or positioned in a symmetrical or asymmetrical configuration around the listener. Results show that the hearing impaired have significantly poorer performance than the normal hearing in all conditions. The mean SRT differences between the groups range from 4.2-10 dB. It appears that the modulations in the masker act as an important cue for the normal-hearing listeners, who experience up to 5-dB release from masking, while being hardly beneficial for the hearing impaired listeners. The gain occurring when maskers are moved from the frontal position to positions around the listener varies from 1.5 to 8 dB for the normal hearing, and from 1 to 6.5 dB for the hearing impaired. It depends strongly on the number of maskers and their positions, but less on hearing impairment. The difference between the SRTs for binaural and best-ear listening (the "cocktail party effect") is approximately 3 dB in all conditions for both the normal-hearing and the hearing-impaired listeners.     

The bat head-related transfer function reveals binaural cues for sound localization in azimuth and elevation

Directional properties of the sound transformation at the ear of four intact echolocating bats, Eptesicus fuscus, were investigated via measurements of the head-related transfer function (HRTF). Contributions of external ear structures to directional features of the transfer functions were examined by remeasuring the HRTF in the absence of the pinna and tragus. The investigation mainly focused on the interactions between the spatial and the spectral features in the bat HRTF. The pinna provides gain and shapes these features over a large frequency band (20-90 kHz), and the tragus contributes gain and directionality at the high frequencies (60 to 90 kHz). Analysis of the spatial and spectral characteristics of the bat HRTF reveals that both interaural level differences (ILD) and monaural spectral features are subject to changes in sound source azimuth and elevation. Consequently, localization cues for horizontal and vertical components of the sound source location interact. Availability of multiple cues about sound source azimuth and elevation should enhance information to support reliable sound localization. These findings stress the importance of the acoustic information received at the two ears for sound localization of sonar target position in both azimuth and elevation.     

Estimating bottlenose dolphin (Tursiops truncatus) hearing thresholds from single and multiple simultaneous auditory evoked potentials

Hearing thresholds were estimated in four bottlenose dolphins by measuring auditory evoked responses to single and multiple sinusoidal amplitude modulated tones. Subjects consisted of two males and two females with ages from 4 to 22 years. Testing was conducted in air using a "jawphone" transducer to couple sound into each subject's lower right jaw. Carrier frequencies ranged from 10 to 160 kHz in one-half octave steps. Amplitude modulated stimuli were presented individually and as the sum of four, five, and nine simultaneous tones with unique carrier and modulation frequencies. Evoked potentials were noninvasively recorded using surface electrodes embedded in silicon suction cups. The presence or absence of an evoked response at each modulation frequency was assessed by calculating the magnitude-squared coherence from the frequency spectra of the recorded sweeps. All subjects exhibited traditional "U-shaped" audiograms with upper cutoff frequencies above 113 kHz. The time required for threshold estimates ranged from 23 to 37 min for single stimuli to 5-9 min for nine simultaneous stimuli. Agreement between thresholds estimated from single stimuli and multiple, simultaneous stimuli was generally good, indicating that multiple stimuli may be used for quick hearing assessment when time is limited.     

Vertical-plane sound localization probed with ripple-spectrum noise

Ripple-spectrum stimuli were used to investigate the scale of spectral detail used by listeners in interpreting spectral cues for vertical-plane localization. In three experiments, free-field localization judgments were obtained for 250-ms, 0.6-16-kHz noise bursts with log-ripple spectra that varied in ripple density, peak-to-trough depth, and phase. When ripple density was varied and depth was held constant at 40 dB, listeners' localization error rates increased most (relative to rates for flat-spectrum targets) for densities of 0.5-2 ripples/oct. When depth was varied and density was held constant at 1 ripple/oct, localization accuracy was degraded only for ripple depths > or = 20 dB. When phase was varied and density was held constant at 1 ripple/oct and depth at 40 dB, three of five listeners made errors at consistent locations unrelated to the ripple phase, whereas two listeners made errors at locations systematically modulated by ripple phase. Although the reported upper limit for ripple discrimination is 10 ripples/oct [Supin et al., J. Acoust. Soc. Am. 106, 2800-2804 (1999)], present results indicate that details finer than 2 ripples/oct or coarser than 0.5 ripples/oct do not strongly influence processing of spectral cues for sound localization. The low spectral-frequency limit suggests that broad-scale spectral variation is discounted, even though components at this scale are among those contributing the most to the shapes of directional transfer functions.     

重放自由场虚拟源距离信息的动态双耳Ambisonics方法

双耳重放的目标之一是在耳机重放中产生不同方向和距离的虚拟源感知。本文研究了动态双耳Ambisonics重放自由场虚拟源方向和距离信息的简化信号处理方法。该信号处理方法包括两步:第1步是基于目标声场的球谐函数分解,合成采用扬声器的近场Ambisonics重放中逐级重构目标声场的信号;第2步是采用虚拟扬声器重放的方法,用动态头相关函数滤波处理将Ambisonics的扬声器重放信号转换为双耳重放信号并用耳机重放。进一步研究了动态双耳Ambisonics的阶数对定位效果的影响,为简化信号处理提供依据。对重放产生的双耳声压分析表明,5阶动态双耳Ambisonics重放足以提供听觉方向定位和距离感知的重要信息。同时心理声学的实验结果表明,结合声源距离相关的响度因素,5阶动态双耳Ambisonics重放可产生不同方向和1.0 m以下不同近场距离的自由场虚拟源的听觉感知。本文的方法仅需要固定距离的48个均匀空间方向的远场非个性化HRTF处理,实现了信号处理的简化。      

Free-field representation of permutation branes in Gepner models

We consider a free-field realization of Gepner models based on the free-field realization of N = 2 superconformal minimal models. Using this realization, we analyze the A/B-type boundary conditions starting from the ansatz with the left-moving and right-moving free-field degrees of freedom glued at the boundary by an arbitrary constant matrix. We show that the only boundary conditions consistent with the singular vector structure of unitary minimal model representations are given by permutation matrices, thereby yielding an explicit free-field construction of the permutation branes of Recknagel. The text was submitted by the author in English.     

Phase effects on the perceived elevation of complex tones

Free-field source localization experiments with 30 source locations, symmetrically distributed in azimuth, elevation, and front-back location, were performed with periodic tones having different phase relationships among their components. Although the amplitude spectra were the same for these different kinds of stimuli, the tones with certain phase relationships were successfully localized while the tones with other phases led to large elevation errors and front-back reversals, normally growing with stimulus level. The results show that it is not enough to have a smooth, broadband, long-term signal spectrum for successful sagittal-plane localization. Instead, temporal factors are important. A model calculation investigates the idea that the tonotopic details that mediate localization need to be simultaneously, or almost simultaneously, accessible in the auditory system in order to achieve normal elevation perception. A qualitative model based on lateral inhibition seems capable in principle of accounting for both the phase effects and level effects.