Ambisonics声捡拾与重放音色的双耳听觉模型分析与实验

提出用双耳听觉模型对空间声音色进行分析的普遍方法,并以Ambisonics为例进行了分析。Ambisonics是基于物理声场重构的空间声系统,其最终重构声场误差以及音色改变是由传声器捡拾和重放空间混叠误差共同引起的。采用修正的Moore双耳响度模型计算了Ambisonics重构声场的双耳响度级谱并和目标声场的情况比较,从而定量评价重构声场的音色改变。结果表明,在理想捡拾信号的情况下,无音色改变重放的上限频率和区域大小随Ambisonics的阶数而增加。而对于传声器阵列捡拾的情况,只要阵列的上限频率大于Ambisonics重放的上限频率,在重放的上限频率以下,传声器阵列空间混叠误差对最终重构声场及其感知音色的影响就可以忽略。在此基础上,提出了一种综合考虑捡拾与重放性能的Ambisonics系统优化设计方法。心理声学实验得到了和双耳听觉模型一致的结果,从而也验证了模型分析的有效性。     

重放自由场虚拟源距离信息的动态双耳Ambisonics方法

双耳重放的目标之一是在耳机重放中产生不同方向和距离的虚拟源感知。本文研究了动态双耳Ambisonics重放自由场虚拟源方向和距离信息的简化信号处理方法。该信号处理方法包括两步:第1步是基于目标声场的球谐函数分解,合成采用扬声器的近场Ambisonics重放中逐级重构目标声场的信号;第2步是采用虚拟扬声器重放的方法,用动态头相关函数滤波处理将Ambisonics的扬声器重放信号转换为双耳重放信号并用耳机重放。进一步研究了动态双耳Ambisonics的阶数对定位效果的影响,为简化信号处理提供依据。对重放产生的双耳声压分析表明,5阶动态双耳Ambisonics重放足以提供听觉方向定位和距离感知的重要信息。同时心理声学的实验结果表明,结合声源距离相关的响度因素,5阶动态双耳Ambisonics重放可产生不同方向和1.0 m以下不同近场距离的自由场虚拟源的听觉感知。本文的方法仅需要固定距离的48个均匀空间方向的远场非个性化HRTF处理,实现了信号处理的简化。      

头相关传输函数幅度谱的听觉空间分辨阈值的分析

提出一种分析头相关传输函数(head-related transfer function,HRTF)幅度谱的听觉空间分辨阈值模型。采用数值计算得到的高空间分辨率HRTF数据,计算了声源空间位置变化引起的HRTF幅度谱的变化,进一步利用Moore响度模型分析双耳响度级差、双耳响度级谱和总响度级等三个听觉感知量的变化。根据现有的3个听觉感知量最小可察觉差异,模型利用双耳响度级差和双耳响度级谱的变化得到的估计结果与心理声学实验一致,因此是一种有效预测听觉空间分辨阈值的方法,可用于为简化虚拟听觉信号处理和数据储存。      

头相关传输函数幅度谱的听觉空间分辨阈值的分析

提出一种分析头相关传输函数(head-related transfer function,HRTF)幅度谱的听觉空间分辨阈值模型。采用数值计算得到的高空间分辨率HRTF数据,计算了声源空间位置变化引起的HRTF幅度谱的变化,进一步利用Moore响度模型分析双耳响度级差、双耳响度级谱和总响度级等三个听觉感知量的变化。根据现有的3个听觉感知量最小可察觉差异,模型利用双耳响度级差和双耳响度级谱的变化得到的估计结果与心理声学实验一致,因此是一种有效预测听觉空间分辨阈值的方法,可用于为简化虚拟听觉信号处理和数据储存。     

中西方典型乐器音高响度与音色明亮度的研究

为了客观地评价民族乐器与西洋乐器在听觉感知方面的差异,本文利用15种典型的中西方乐器声样本,建立了与音色、响度和音色明亮度有关的15种乐器的感知空间模型,通过这些模型可以预测不同乐器在音高、响度一定时,音色明亮度的感知情况。此外,根据已建立的感知空间模型分别对比弹拨乐器、拉弦乐器和不同类型的吹奏乐器中三种听觉感知属性的变化差异。结果表明,对于中西方典型乐器,音色明亮度随响度的增加而增大,但是响度对音色明亮度的影响程度受到音域和响度范围的影响。民族乐器的音色明亮度随音高的增加而增大,但是西洋乐器的音色明亮度并没有随音高的增加而发生明显的变化。     

《空间声原理》

正谢菠荪著科学出版社,北京,2019年6月,818页,定价:249元听觉是我们感知外界信息的重要途径之一。人的听觉中,除了对声音的响度、音调和音色等主观属性的感觉外,还包括对声音的空间听觉,也就是对声音空间属性或特性的感知。这赋予了我们的听觉系统在一定的条件下,可以对声源进行定位,可以产生对周围声学环境的空间印象的可能。空间声的目的是重放声场的空间信息,给倾听者产生特定的空间听觉事件或感知。近年来,其应用已由传统的影院和家用声重放等文化娱乐领域,拓展到听觉心理和生理、室内声学设计、通信、互联网与计算机、多媒体与虚拟现实、医学等科学研究及工程技术领域。可见应用价值之重要。     

单层传声器阵列信号空间重采样的声波分离方法

为了重构非自由声场中目标声源的声场响应,提出单层传声器阵列信号空间重采样的声波分离方法.以球面波函数为基函数,建立由系列球面波函数叠加表达的声场数学模型.基于近场声全息原理,利用单层传声器阵列面上空间重采样形成的两组声压测量信号,求解基函数系数,并重构出传声器阵列两侧声源各自的声场响应,实现声波分离.使用脉动球和振动球共同作用的非自由声场,检验了数学模型以及传声器信号信噪比、传声器阵列形状和面积、声源中心位置、频率等关键参数对声波分离精度的影响,并在全消声室内进行了实验验证.最后,对单层传声器阵列重采样的声波分离方法的实施给出了建议.     

多通路空间声的前方四扬声器局域Ambisonics信号馈给法*

典型的多通路空间声扬声器布置一般包含水平面左前、右前,高仰角左前上、右前上四个方向的扬声器。 本文提出一种利用该四个扬声器产生前方水平与垂直方向虚拟源的一阶局域Ambisonics 信号馈给法。该信号馈给法是通过对目标和重放声场进行球谐函数展开并取一阶近似得到。采用简化的头部模型和精确的头相关传输函数模型分析表明,一阶局域Ambisonics 信号馈给法可以产生合适的低频听觉定位因素,包括双耳时间差及其随头部转动的动态变化。虚拟源定位实验结果表明,该方法可以在扬声器布置的范围内,甚至在略超出扬声器布置的范围内产生不同方位角和仰角的虚拟源。因而本文的方法可用在多通路空间声重放中产生与图像配合的虚拟源定位效果。     

前方空间环绕声的四扬声器虚拟重放

考虑头部转动带来的动态因素对听觉垂直定位的贡献,提出了前方空间环绕声的四扬声器虚拟重放方法。4个扬声器分别布置在水平面左前、右前以及高仰角的左前上、右前上方向,并采用听觉传输信号处理的方法将多通路空间环绕声信号转换为4个扬声器的重放信号。以9.1通路空间环绕声虚拟重放为例,采用头相关传输函数对双耳声压及其包含的定位因素进行分析表明,该方法可以产生正确的双耳时间差及其随头部转动的变化,从而产生合适的侧向定位双耳因素和垂直定位的动态因素。而心理声学实验结果表明,该方法可以重放稳定的前方空间的水平和垂直虚拟源。因此,四扬声器布置结合听觉传输处理足以重放前方空间环绕声的垂直定位信息,实现多通路空间环绕声的向下混合与简化。      

两扬声器虚拟声重放的双耳声压控制与定位性能

在两扬声器虚拟声重放中,通过精确重构双耳声压而产生不同的空间听觉感知。其重放的定位性能应该是由双耳声压控制的代价和稳定性所共同决定的。过去研究主要对双耳声压控制的稳定性进行分析,并以此作为扬声器布置和信号处理的依据。该文研究表明仅对双耳声压的稳定性分析是不足以完全衡量扬声器虚拟声重放的定位性能的。进一步采用虚拟声信号处理滤波器响应平均功率对双耳声压控制的代价进行分析。结果表明,缩窄左右对称扬声器布置的张角或采用非对称扬声器布置会明显增加产生侧向目标虚拟源时的双耳声压控制代价。虚拟源(虚拟声像)定位实验表明,双耳声压控制代价增加会引起虚拟源定位缺陷。实际应用中,为了有效产生侧向虚拟源,应避免采用过窄张角(如立体声偶极)和非对称的扬声器布置。     

Analysis with binaural auditory model and experiment on the timbre of Ambisonics recording and reproduction

A scheme for analyzing the timbre in spatial sound with binaural auditory model is proposed and the Ambisonics is taken as an example for analysis.Ambisonics is a spatial sound system based on physical sound field reconstruction.The errors and timbre colorations in the final reconstructed sound field depend on the spatial aliasing errors on both the recording and reproducing stages of Ambisonics.The binaural loudness level spectra in Ambisonics reconstruction is calculated by using Moore's revised loudness model and then compared with the result of real sound source,so as to evaluate the timbre coloration in Ambisonics quantitatively.The results indicate that,in the case of ideal independent signals,the high-frequency limit and radius of region without perceived timbre coloration increase with the order of Ambisonics.On the other hand,in the case of recording by microphone array,once the high-frequency limit of microphone array exceeds that of sound field reconstruction,array recording influences little on the binaural loudness level spectra and thus timbre in final reconstruction up to the highfrequency limit of reproduction.Based on the binaural auditory model analysis,a scheme for optimizing design of Ambisonics recording and reproduction is also suggested.The subjective experiment yields consistent results with those of binaural model,thus verifies the effectiveness of the model analysis.     

Influence of the Number of Loudspeakers on the Timbre in Horizontal and Mixed-Order Ambisoncis Reproduction

Ambisonics is a series of flexible spatial sound reproduction systems based on spatial harmonics decomposition of sound field. Traditional horizontal and spatial Ambisonics reconstruct horizontal and spatial sound field with certain order of spatial harmonics, respectively. Both the Shannon-Nyquist spatial sampling frequency limit for accurately reconstructing sound field and the complexity of system increase with the increasing order of Ambisonics. Based on the fact that the horizontal localization resolution of human hearing is higher than vertical resolution, mixed-order Ambisonics (MOA) reconstructs horizontal sound field with higher order spatial harmonics, while reconstructs vertical sound field with lower order spatial harmonics, and thereby reaches a compromise between the perceptual performance and the complexity of system. For a given order horizontal Ambisoncis or MOA reproduction, the number of horizontal loudspeakers is flexible, providing that it exceeds some low limit. By using Moore’s revised loudness model, the present work analyzes the influence of the number of horizontal loudspeakers on timbre both in horizontal Ambisonics and MOA reproduction. The binaural loudness level spectra (BLLS) of Ambisoncis reproduction are calculated and then compared with those of target sound field. The results indicate that below the Shannon-Nyquist limit of spatial sampling, increasing the number of horizontal loudspeakers influence little on BLLS then timbre. Above the limit, however, the BLLS for Ambisoncis reproduction deviate from those of target sound field. The extent of deviation depends on both the direction of target sound field and the number of loudspeakers. Increasing the number of horizontal loudspeakers may increase the change of BLLS then timbre in some cases, but reduce the change in some other cases. For MOA, the influence of the number of horizontal loudspeakers on BLLS and timbre reduces when virtual source departs from horizontal plane to the high or low elevation. The subjective evaluation experiment also validates the analysis.     

A Comparison on the Localization Performance of Static and Dynamic Binaural Ambisonics Reproduction with Different Order

Ambisonics is a series of spatial sound reproduction system based on spatial harmonics decomposition and each order approximation of sound field. Ambisonics signals are originally intended for loudspeakers reproduction. By using head-related transfer functions (HRTFs) filters, binaural Ambisonics converts the Ambisonics signals for static or dynamic headphone reproduction. In present work, the performances of static and dynamic binaural Ambisonics reproduction are evaluated and compared. The mean binaural pressure errors across target source directions are first analyzed. Then a virtual source localization experiment is conducted, and the localization performances are evaluated by analyzing the percentages of front-back and up-down confusion, the mean angle error and discreteness in the localization results. The results indicate that binaural Ambsonics reproduction with insufficiently high order (for example, 5-10 order) is unable to recreate correct high-frequency magnitude spectra in binaural pressures, resulting in degradation in localization for static reproduction. Because dynamic localization cue is included, dynamic binaural Ambisoncis reproduction yields obviously better localization performance than static reproduction with the same order. Even a 3-order dynamic binaural Ambisoncis reproduction exhibits appropriate localizations performance.     

Least squares approach in wavenumber domain for sound field recording and reproduction using multiple parallel linear arrays

A novel signal processing method is proposed for sound field recording and reproduction using multiple parallel linear microphone and loudspeaker arrays. In sound field recording and reproduction, the problem is how to calculate the transfer filters that transform the signals recorded by microphones into the driving signals of the loudspeakers. The proposed method is based on the spatial Fourier transform in the horizontal angle combined with the least squares (LS) approach in the elevation angle. In the proposed method, the signals recorded by each linear microphone array and those that drive each loudspeaker array are decomposed into the wavenumber domain by the spatial Fourier transform in the horizontal direction. The transfer filters are then calculated by the LS approach in the wavenumber domain. As a result, the size of the matrix of each transfer function in the wavenumber domain is much smaller than that of the conventional LS approach in the temporal frequency domain (LSTF), and well-conditioned stable transfer filters can be obtained with low computational cost without regularization. Computer simulation results show that the proposed method reconstructed a sound field around the control points as accurately as the conventional LSTF.     

Experiments on authenticity and plausibility of binaural reproduction via headphones employing different recording methods

Major criteria for a successful binaural reproduction are not only a suitable localization performance, but also the authenticity and plausibility of the presented scene. It is therefore interesting to examine whether the binaural reproduction can be perceptually distinguished from a real source. The aim of the presented investigation is to compare the quality of the binaural reproduction via headphones with two different microphone setups (miniature microphone in Open-Dome and ear plug) for individual head-related-transfer-function (HRTF) and headphone-transfer-function (HpTF) measurements. Listening tests with a total of 80 subjects were carried out focusing on plausibility and authenticity. In the examination of plausibility detection rates showed that subjects were not able to match the reproduced pink noise to its reproduction system (real source vs. binaural reproduction via headphones). The authenticity of the static binaural reproduction was highly dependent on the stimulus. Pink noise could often be distinguished due to coloration in higher frequencies and small differences in location. A difference between microphone setups could not be found in neither of the listening tests.