Measurement of the binaural auditory filter using a detection task

The spectral resolution of the binaural system was measured using a tone-detection task in a binaural analog of the notched-noise technique. Three listeners performed 2-interval, 2-alternative, forced choice tasks with a 500-ms out-of-phase signal within 500 ms of broadband masking noise consisting of an "outer" band of either interaurally uncorrelated or anticorrelated noise, and an "inner" band of interaurally correlated noise. Three signal frequencies were tested (250, 500, and 750 Hz), and the asymmetry of the filter was measured by keeping the signal at a constant frequency and moving the correlated noise band relative to the signal. Thresholds were taken for bandwidths of correlated noise ranging from 0 to 400 Hz. The equivalent rectangular bandwidth of the binaural filter was found to increase with signal frequency, and estimates tended to be larger than monaural bandwidths measured for the same listeners using equivalent techniques.     

Effects of categorization and discrimination training on auditory perceptual space

Psychophysical phenomena such as categorical perception and the perceptual magnet effect indicate that our auditory perceptual spaces are warped for some stimuli. This paper investigates the effects of two different kinds of training on auditory perceptual space. It is first shown that categorization training using nonspeech stimuli, in which subjects learn to identify stimuli within a particular frequency range as members of the same category, can lead to a decrease in sensitivity to stimuli in that category. This phenomenon is an example of acquired similarity and apparently has not been previously demonstrated for a category-relevant dimension. Discrimination training with the same set of stimuli was shown to have the opposite effect: subjects became more sensitive to differences in the stimuli presented during training. Further experiments investigated some of the conditions that are necessary to generate the acquired similarity found in the first experiment. The results of these experiments are used to evaluate two neural network models of the perceptual magnet effect. These models, in combination with our experimental results, are used to generate an experimentally testable prediction concerning changes in the brain's auditory maps under different training conditions.     

Lateralization of complex binaural stimuli: a weighted-image model

This article describes a new model that predicts the subjective lateral position of bandpass stimuli. It is assumed, as in other models, that stimuli are bandpass filtered and rectified, and that the rectified outputs of filters with matching center frequencies undergo interaural cross correlation. The model specifies and utilizes the shape and location of assumed patterns of neural activity that describe the cross-correlation function. Individual modes of this function receive greater weighting if they are straighter (describing consistent interaural delay over frequency) and/or more central (describing interaural delays of smaller magnitude). This weighting of straightness and centrality is used by the model to predict the perceived laterality of several types of low-frequency bandpass stimuli with interaural time delays and/or phase shifts, including bandpass noise, amplitude-modulated stimuli with time-delayed envelopes, and bandpass-filtered clicks. This model is compared to other theories that describe lateralization in terms of the relative contributions of information in the envelopes and fine structures of binaural stimuli.     

Transfer effects on communication and collision avoidance behavior from playing a three-dimensional auditory game based on a virtual auditory display

Transfer effects on two everyday auditory skills from playing an auditory game using a virtual auditory display (VAD) were investigated using two groups of 20 normally sighted participants. Representative auditory skills of blindfolded participants were pre-tested using communication and collision avoidance tasks. They performed the tasks two weeks later. Participants in a training group played the VAD-based game on seven days (30 min/day) during the two weeks: control group participants did not. Playing the VAD-based game significantly increased face-contacts in the communication task and significantly improved participants’ collision avoidance. No significant differences were found between the groups’ subjective ratings of the rated tension levels during the communication task or between rated levels for the collision threat. Performance revealed transfer effects of playing the VAD-based game on communication behaviors in social interaction and on avoidance of approaching objects: VAD-based games are effective training tools for auditory skills used in daily life.     

Detection of spectrally complex signals in comodulated maskers: effect of temporal fringe

This study tested the hypothesis that masking release for a complex signal under conditions where signal energy is present in all frequency regions occupied by the masker is attributable to an across-frequency-channel comodulation masking release (CMR) process. The approach was to identify a signature CMR trait, and to then determine if that trait was associated with the detection advantage for complex signals. The selected trait was the decline of CMR in the presence of a random temporal fringe. In experiment 1, a masking release was observed for a four-component harmonic signal presented in a comodulated masker, and this masking release was diminished by the random temporal fringe. A similar effect was observed in experiment 2 for a four-component inharmonic signal. These results support the hypothesis that a CMR can be measured for a complex signal even when there is substantial spectral overlap between the signal and its comodulated masker. This finding has consequences for CMR models since it demonstrates that the presence of "signal-free" cue bands is not a prerequisite for CMR, and that the presence of comodulation during the signal window is not sufficient to result in CMR.     

Perceptual interactions in the loudness of combined auditory and vibrotactile stimuli

The loudness of auditory (A), tactile (T), and auditory-tactile (A+T) stimuli was measured at supra-threshold levels. Auditory stimuli were pure tones presented binaurally through headphones; tactile stimuli were sinusoids delivered through a single-channel vibrator to the left middle fingertip. All stimuli were presented together with a broadband auditory noise. The A and T stimuli were presented at levels that were matched in loudness to that of the 200-Hz auditory tone at 25 dB sensation level. The 200-Hz auditory tone was then matched in loudness to various combinations of auditory and tactile stimuli (A+T), and purely auditory stimuli (A+A). The results indicate that the matched intensity of the 200-Hz auditory tone is less when the A+T and A+A stimuli are close together in frequency than when they are separated by an octave or more. This suggests that A+T integration may operate in a manner similar to that found in auditory critical band studies, further supporting a strong frequency relationship between the auditory and somatosensory systems.     

Transfer effects on sound localization performances from playing a virtual three-dimensional auditory game

Transfer effects of playing an auditory game with a virtual auditory display (VAD) were investigated. Furthermore, we analyzed the effects of playing the VAD game on sound localization performance under subjects’ own head-related transfer functions (HRTFs) and HRTFs fitted from those of 16 other adults. Participants performed sound localization tasks initially and 2 weeks later to show the effects. The VAD game players were of three groups, using own HRTFs, fitted HRTFs, and no playing (control). The VAD game-playing results revealed that: (1) the hit rate of the sound localization task for real sound sources increased approximately 20%; (2) the vertical and horizontal localization error decreased significantly; (3) sound localization performance using fitted HRTFs was similar to performance using own HRTFs. Follow-up tests revealed that transfer effects persisted more than 1 month, suggesting that the effects of playing the VAD game transfer to sound localization performance.     

Auditory-nerve first-spike latency and auditory absolute threshold: a computer model

A computer model of the auditory periphery was used to address the question of what constitutes the physiological substrate of absolute auditory threshold. The model was first evaluated to show that it is consistent with experimental findings that auditory-nerve fiber spikes can be predicted to occur when the running integral of stimulus pressure reaches some critical value [P. Heil and H. Neubauer, J. Neurosci. 15, 7404-7415 (2001)]. It was then modified to examine two ways in which the accumulation and clearance of receptor presynaptic calcium might explain this effect. Both methods gave results that matched the animal data. It was also shown how the rate of clearance of presynaptic calcium could be used to explain the origin of differences between low and high spontaneous-rate fiber types. When spiking activity is aggregated across a number of similar high spontaneous-rate fibers and used as the input to a model of a cochlear nucleus coincidence neuron, its response can be used to judge whether or not a stimulus is present. A simulated psychophysical experiment then demonstrated that this simple decision procedure can reproduce measurements of absolute auditory threshold for tones in quiet where the threshold is a joint function of both time and level.     

Integration of auditory and vibrotactile stimuli: effects of frequency

Perceptual integration of vibrotactile and auditory sinusoidal tone pulses was studied in detection experiments as a function of stimulation frequency. Vibrotactile stimuli were delivered through a single channel vibrator to the left middle fingertip. Auditory stimuli were presented diotically through headphones in a background of 50 dB sound pressure level broadband noise. Detection performance for combined auditory-tactile presentations was measured using stimulus levels that yielded 63% to 77% correct unimodal performance. In Experiment 1, the vibrotactile stimulus was 250 Hz and the auditory stimulus varied between 125 and 2000 Hz. In Experiment 2, the auditory stimulus was 250 Hz and the tactile stimulus varied between 50 and 400 Hz. In Experiment 3, the auditory and tactile stimuli were always equal in frequency and ranged from 50 to 400 Hz. The highest rates of detection for the combined-modality stimulus were obtained when stimulating frequencies in the two modalities were equal or closely spaced (and within the Pacinian range). Combined-modality detection for closely spaced frequencies was generally consistent with an algebraic sum model of perceptual integration; wider-frequency spacings were generally better fit by a Pythagorean sum model. Thus, perceptual integration of auditory and tactile stimuli at near-threshold levels appears to depend both on absolute frequency and relative frequency of stimulation within each modality.     

Design of a computer game using an eye-tracking device for eye's activity rehabilitation

An eye mouse interface that can be used to operate a computer using the movement of the eyes is described. We developed this eye-tracking system for eye motion disability rehabilitation. When the user watches the screen of a computer, a charge-coupled device will catch images of the user's eye and transmit it to the computer. A program, based on a new cross-line tracking and stabilizing algorithm, will locate the center point of the pupil in the images. The calibration factors and energy factors are designed for coordinate mapping and blink functions. After the system transfers the coordinates of pupil center in the images to the display coordinate, it will determine the point at which the user gazed on the display, then transfer that location to the game subroutine program. We used this eye-tracking system as a joystick to play a game with an application program in a multimedia environment. The experimental results verify the feasibility and validity of this eye-game system and the rehabilitation effects for the user's visual movement.     

Demonstration of a spectrally scanned holographic Stokesmeter

A holographic Stokesmeter (HSM) utilizes the inherent polarization sensitivity of volume gratings to determine all the Stokes parameters of input beams. A unique feature of the HSM is that it can be designed for spectral multiplexing at a high speed. Here, we report the demonstration of such a spectrally scanning HSM for two different wavelengths. Integration of such an HSM with a polarimetric imaging system will produce a device of potentially significant practical usage: a multi-spectral Stokes parameter camera (MSPC).     

Latency of auditory brain-stem responses and otoacoustic emissions using tone-burst stimuli

A comparison of the latency of auditory brain-stem responses (ABR) and evoked otoacoustic emissions (EOAE) has led to an interpretation for the travel of transients in the peripheral auditory system that is consistent with both sets of data. The "cochlear echo" theory for the origin of the EOAE indicates that the latency of a particular frequency component back to the ear canal should be twice the forward latency of its characteristic place in the cochlea. The latency of wave V of the ABR to tone-burst stimuli can be described as the sum of two components: (1) a component that varies with intensity and frequency in an orderly and predictable manner and (2) a component that is independent of both intensity and frequency. Because the EOAE data can be predicted by taking twice the value of component (1) of the ABR latency, this component is interpreted to be due to mechanical travel through the cochlea. A consequence of this interpretation is that the remaining neural component of the ABR latency must be relatively independent of frequency and intensity.     

Measurement on just noticeable difference of auditory perception with visual stimuli

This paper addresses the JND（Just Noticeable Difference）change of auditory perception with synchronous visual stimuli.Through psychoacoustics experimentS,loudness JND,subjective duration JND and pitch JND of pure tone were measured in auditory-only mode and visual_auditory mode with different visual stimuli which have different attributes such as color,illumination,quality and moving state.Statistical analyses of the experimental data indicare that,comparing with JND in auditory-only mode,the amount of JND with visual stimuli is often larger.The JND＇S average increment of subjective duration,pitch and loudness are 45.1%,14.8%and 12.3%,respectively.The conclusion is that the ability of JNDbased auditory perception often decreases with visual stimuli.The incremental amount of JND is afiected bv the attributes of visual stimuli.If the visual stimuli make subjects feel more comfortable,the JND of auditory perception will change smaller.     

视觉刺激条件下的听感差别阈限测量

视听交互的重要性日益突出,但视觉刺激对听觉感知的影响尚缺乏全面深入的研究。以视觉刺激下人耳对声音的主观听感差别阈限变化为研究对象,在主观听觉实验中施加颜色、质量、亮度、运动状态四个不同属性视觉刺激,同时测量纯音信号的响度、主观音长和音高的听感差别阈限。通过与无视觉刺激下相应差别阈限的比较,分析不同视觉条件对响度感知、主观音长感知、音高感知能力的影响。实验数据显示,施加视觉刺激后主观听觉感知的差别阈限值增大,主观音长、音高和响度的差别阈限值平均分别提高了45.1%,14.8%和12.3%。进一步分析的结果表明,施加视觉刺激后基本的听觉感知能力呈下降趋势。同一视觉属性的不同水平视觉条件对听觉感知的影响程度不同,主观听感的变化呈现出一定的规律性,即视觉刺激越舒适,听感的差别阈限变化越小。     

A computer model of the auditory-nerve response to forward-masking stimuli

A computer model of the auditory periphery is used to study the involvement of auditory-nerve (AN) adaptation in forward-masking effects. An existing model is shown to simulate published AN recovery functions both qualitatively and quantitatively after appropriate parameter adjustments. It also simulates published data showing only small threshold shifts when a psychophysical forward-masking paradigm is applied to AN responses. The model is extended to simulate a simple but physiologically plausible mechanism for making threshold decisions based on coincidental firing of a number of AN fibers. When this is used, much larger threshold shifts are observed of a size consistent with published psychophysical observations. The problem of how stimulus-driven firing can be distinguished from spontaneous activity near threshold is also addressed by the same decision mechanism. Overall, the modeling results suggest that poststimulatory reductions in AN activity can make a substantial contribution to the raised thresholds observed in many psychophysical studies of forward masking.     

A computer model of medial efferent suppression in the mammalian auditory system

Stimulation of the olivocochlear bundle reduces basilar membrane displacement, driven auditory nerve activity, and compound action potential (CAP) response to acoustic stimulation. These effects were simulated using a computer model of the auditory periphery. The model simulates the medial efferent activity by attenuating the basilar membrane response. The model was evaluated against three animal studies reporting measurements at three levels of the auditory system; basilar membrane, single auditory nerve fibers and whole auditory nerve CAP. The CAP data included conditions where tones were masked by noise and "unmasked" by stimulation of the olivocochlear bundle. The model was able to simulate the data both qualitatively and quantitatively. As a consequence, it may be a suitable platform for studying the contribution of the efferent system to auditory processing of more complex auditory sounds in distracting backgrounds.