Lateralization produced by envelope-based interaural temporal disparities of high-frequency, raised-sine stimuli: empirical data and modeling

An acoustic pointing task was used to measure extents of laterality produced by ongoing interaural temporal disparities (ITDs) conveyed by the envelopes of 4-kHz-centered raised-sine stimuli while varying, parametrically, their peakedness, depth of modulation, and frequency of modulation. One purpose of the study was to determine whether such manipulations would produce changes in laterality logically consistent with those found for ITD-discrimination thresholds reported by Bernstein and Trahiotis [J. Acoust. Soc. Am. 125, 3234-3242 (2009)]. The data obtained revealed that they did in that (1) increasing depth of modulation, peakedness, or frequency of modulation between 32 and 128 Hz produced smaller threshold ITDs and greater laterality and (2) increasing frequency of modulation to 256 Hz produced modest increases in threshold ITDs and modest decreases in laterality. The extents of laterality measured were successfully accounted for via an augmentation of the cross-correlation-based "position-variable" modeling approach developed by Stern and Shear [J. Acoust. Soc. Am. 100, 2278-2288 (1996)] to account for ITD-based extents of laterality obtained at low spectral frequencies.     

Lateralization of low-frequency, complex waveforms: the use of envelope-based temporal disparities

Several recent investigations suggest that listeners either cannot or do not use envelope-based interaural temporal disparities (ITDs) to lateralize low-frequency sounds [G.B. Henning, J. Acoust. Soc. Am. 68, 446-453 (1980); G.B. Henning and J. Ashton, Hear. Res. 4, 185-194 (1981); G.B. Henning, Hear. Res. 9, 153-172 (1983)]. We believe listeners in those studies may have been unable to process envelope-based ITDs principally because of the types of stimuli utilized. In this study we employed an acoustic "pointing" task in which listeners varied the interaural intensitive difference of a 500-Hz narrow-band noise (the pointer) so that it matched the intracranial position of a second, experimenter-controlled stimulus (the target). Targets were sinusoidally amplitude-modulated tones centered on 500 Hz or 1 kHz, and modulated at 25, 50, or 100 Hz. Targets were presented with either the entire waveform delayed or with only the envelope delayed. The results suggest that delays of the envelope do affect the lateral position of low-frequency targets. However, the envelope-based cues appear to interact with those provided by the dominant fine structure.     

Sensitivity to brief changes of interaural time and interaural intensity

The purpose of this study was to measure listeners' abilities to detect brief changes in interaural temporal disparities (ITDs) or interaural intensitive disparities (IIDs) conveyed by bursts of noise (probes) temporally and symmetrically flanked by segments of diotic or uncorrelated noise. Thresholds were measured using a four-interval, two-alternative, forced-choice adaptive task and the total duration of the bursts of noise was either 20, 40, or 100 ms. Probes were temporally centered within each burst and the durations of the probes ranged from 2 to 100 ms, depending upon the duration of the (longer) total burst of noise within which they were embedded. The results indicate that, for a given total duration of noise, there is a rapid decrease in threshold ITD or threshold IID as the duration of the probe is increased so that it occupies a larger portion of the total burst of noise. Mathematical analyses revealed that both threshold ITDs and threshold IIDs could be well accounted for by assuming that the listener processes both types of binaural cues via a single, symmetric, double-exponential temporal window. Interestingly, the shapes of the temporal windows that fit the data obtained from the human listeners resemble the shapes of the temporal windows derived by Wagner [H. Wagner, J. Comp. Physiol. A 169, 281-289 (1991)], who studied the barn owl. The time constants and relative weightings yielded temporal window functions that heavily emphasize information occurring within the very temporal center of the window. This temporal window function was found to be generalizable in the sense that it also accounts for classic data reported by Grantham and Wightman [D.W. Gratham and F.L. Wightman, J. Acoust. Soc. Am. 63, 511-523 (1978)] concerning sensitivity to dynamically changing interaural disparities.     

Illusory spectrotemporal ripples created with binaurally correlated noise

Binaural disparities are the primary acoustic cues employed in sound localization tasks. However, the degree of binaural correlation in a sound serves as a complementary cue for detecting competing sound sources [J. F. Culling, H. S. Colburn, and M. Spurchise, "Interaural correlation sensitivity," J. Acoust. Soc. Am. 110(2), 1020-1029 (2001) and L. R. Bernstein and C. Trahiotis, "On the use of the normalized correlation as an index of interaural envelope correlation," J. Acoust. Soc. Am. 100, 1754-1763 (1996)]. Here a random chord stereogram (RCS) sound is developed that produces a salient pop-out illusion of a slowly varying ripple sound [T. Chi et al., "Spectro-temporal modulation transfer functions and speech intelligibility," J. Acoust. Soc. Am. 106(5), 2719-2732 (1999)], even though the left and right ear sounds alone consist of noise-like random modulations. The quality and resolution of this percept is systematically controlled by adjusting the spectrotemporal correlation pattern between the left and right sounds. The prominence and limited time-frequency resolution for resolving the RCS suggests that envelope correlations are a dominant binaural cue for grouping acoustic objects.     

Lateralization of sinusoidally amplitude-modulated tones: effects of spectral locus and temporal variation

It has long been recognized that listeners are sensitive to interaural temporal disparities (ITDs) of low-frequency (i.e., below 1600 Hz) stimuli. Within the last three decades, it has often been demonstrated that listeners are also sensitive to ITDs within the envelope of high-frequency, complex stimuli. Because these studies, for the most part, employed discrimination tasks, few data exist concerning the extent of laterality produced by ITDs as a function of the spectral locus of the stimulus. To this end, we employed an acoustic "pointing" task in which listeners varied the interaural intensity difference of a 500-Hz narrow-band noise (the pointer) so that it matched the intracranial position of a second, experimenter-controlled stimulus (the target). Targets were sinusoidally amplitude-modulated tones centered on 500 Hz, 1, 2, 3, or 4 kHz and modulated at rates ranging from 50 to 800 Hz. Targets were presented with either the entire waveform delayed or with only the envelope delayed. Our results suggest that: (1) for low-frequency targets, lateralization is influenced by ITDs in the envelope but is dominated by ITDs in the fine structure; (2) for high-frequency targets, envelope-based delays produce displacements of the acoustic images which are affected greatly by the rate of modulation; rather large extents of laterality could be produced with high rates of modulation; these data are consistent with those obtained previously in discrimination experiments; (3) for low rates of modulation (e.g., 100 Hz), delays of the entire waveform (both envelope and fine structure) produce much greater displacements of the acoustic image for low-frequency than for high-frequency targets (where fine-structure-based cues are not utilizable); (4) there appear to be no consistent relations among extent of laterality, rate of modulation, and the frequency of the carrier within and across listeners.     

The normalized interaural correlation: accounting for NoS pi thresholds obtained with Gaussian and "low-noise" masking noise.

Recently, Eddins and Barber [J. Acoust. Soc. Am. 103, 2578-2589 (1998)] and Hall et al. [J. Acoust. Soc. Am. 103, 2573-2577 (1998)] independently reported that greater masking of interaurally phase-reversed (S pi) tones was produced by diotic low-noise noise than by diotic Gaussian noise. Based on quantitative analyses, Eddins and Barber suggested that their results could not be accounted for by assuming that listeners' judgments were based on constant-criterion changes in the normalized interaural correlation produced by adding the S pi signal to the diotic masker. In particular, they showed that a model like the one previously employed by Bernstein and Trahiotis [J. Acoust. Soc. Am. 100, 3774-3784 (1996)] predicted an ordering of thresholds between the conditions of interest that was opposite to that observed. Bernstein and Trahiotis computed the normalized interaural correlation subsequent to half-wave, square-law rectification and low-pass filtering, the parameters of which were chosen to mimic peripheral auditory processing. In this report, it is demonstrated that augmenting the model by adding a physiologically valid stage of "envelope compression" prior to rectification and low-pass filtering provides a remedy. The new model not only accounts for the data obtained by Eddins and Barber (and the similar data obtained by Hall et al.), but also does not diminish the highly successful account of the comprehensive set of data that gave rise to the original form of the model. Therefore, models based on the computation of the normalized interaural correlation appear to remain valid because they can account, both quantitatively and qualitatively, for a wide variety of binaural detection and discrimination data.     

Detectability of interaural delays over select spectral regions: effects of flanking noise

Zurek [P. M. Zurek, J. Acoust. Soc. Am. Suppl. 1 78, S18 (1985)] noted what he termed "spectral dominance" in sensitivity to interaural delay for broadband stimuli. He found that interaural delays presented solely within high-frequency spectral regions were difficult, if not impossible, to detect in the presence of spectrally flanking, gated, diotic noise. In order to see if spectral dominance is a general result of the processing of interaural delays in broadband stimuli, similar experiments were conducted utilizing both gated and continuous flanking noises that were interaurally identical (diotic) or completely uncorrelated. Beyond replicating Zurek's basic findings, the data strongly suggest that the processing of interaural delays was largely unaffected when the flanking sounds were continuous and diotic. When the flanking sounds were interaurally uncorrelated, sensitivity was affected, but not drastically, for both gated and continuous conditions. Consequently, it appears that any inability to cope with conflicting interaural cues across spectral regions may be observed only under restricted conditions.     

Interaural intensity discrimination: insensitivity at 1000 Hz

Recent data from three laboratories have replicated Mills' [J. Acoust. Soc. Am. 32, 132-134 (1960)] finding that interaural intensity discrimination is relatively poorer for tones of 1000 Hz than for tones of either higher or lower frequencies. To get a finer look at this frequency effect, interaural intensity difference thresholds were obtained from four subjects for tones of several frequencies around 1000 Hz. An adaptive two-interval forced-choice procedure was employed, in which the overall intensity of the signals was varied randomly in order to prevent subjects from listening to monaural loudness changes. Despite large intersubject differences in overall sensitivity to interaural intensity differences, all four subjects showed a local peak in their threshold functions at or near 1000 Hz. This curious "1000-Hz effect" might be explained by imagining that an interaural intensity comparator operates more efficiently as frequency increases, but that a peripheral interaural intensity difference to interaural-time difference conversion contributes to laterality judgments for low-frequency tones, thus acting to lower thresholds again for frequencies below 1000 Hz.     

Why do transposed stimuli enhance binaural processing?: Interaural envelope correlation vs envelope normalized fourth moment

High-frequency, "transposed" stimuli have been shown to yield enhanced processing of ongoing interaural temporal disparities (ITDs). This paper concerns determining which aspect or aspects of the envelopes of such stimuli mediate enhanced resolution of ITD. Behavioral measures and quantitative analyses utilizing special classes of transposed stimuli show that the "internal" interaural envelope correlation accounts both qualitatively and quantitatively for the enhancement. In contrast, the normalized fourth moment of the envelope (Y), which provides an index of the degree to which the envelopes of high-frequency stimuli fluctuate, does not lead to a successful accounting of the data.     

Models of auditory masking: a molecular psychophysical approach

Gilkey et al. [J. Acoust. Soc. Am. 78, 1207-1219 (1985)] measured hit proportions and false alarm proportions for detecting a 500-Hz tone at each of four starting phase angles in each of 25 reproducible noise samples. In the present paper, their results are modeled by fitting the general form of the electrical analog model of Jeffress [J. Acoust. Soc. Am. 48, 480-488 (1967)] to the diotic data. The best-fitting configurations of this model do not correspond to energy detectors or to envelope detectors. A detector composed of a 50-Hz-wide single-tuned filter, followed by a half-wave rectifier and an integrator with an integration time of 100 to 200 ms fits the data of all four subjects relatively well. Linear combinations of the outputs of several detectors that differ in center frequency or integration window provide even better fits to the data. These linear combinations assign negative weights to some frequencies or to some time intervals, suggesting that a subject's decision is based on a comparison of information in different spectral or temporal portions of the stimulus.     

Binaural processing model based on contralateral inhibition. III. Dependence on temporal parameters

This paper and two accompanying papers [Breebaart et al., J. Acoust. Soc. Am. 110, 1074-1088 (2001); 110, 1089-1104 (2001)] describe a computational model for the signal processing of the binaural auditory system. The model consists of several stages of monaural and binaural preprocessing combined with an optimal detector. Simulations of binaural masking experiments were performed as a function of temporal stimulus parameters and compared to psychophysical data adapted from literature. For this purpose, the model was used as an artificial observer in a three-interval, forced-choice procedure. All model parameters were kept constant for all simulations. Model predictions were obtained as a function of the interaural correlation of a masking noise and as a function of both masker and signal duration. Furthermore, maskers with a time-varying interaural correlation were used. Predictions were also obtained for stimuli with time-varying interaural time or intensity differences. Finally, binaural forward-masking conditions were simulated. The results show that the combination of a temporal integrator followed by an optimal detector in the time domain can account for all conditions that were tested, except for those using periodically varying interaural time differences (ITDs) and those measuring interaural correlation just-noticeable differences (jnd's) as a function of bandwidth.     

The effect of bone conduction on the intensity independence of dichotic chords.

The relative salience of the pitch components of a two-tone dichotic chord is invariant with respect to the relative intensity of the two tones over a wide range of interaural intensity differences [R. Efron and E. W. Yund, J. Acoust, Soc. Am. 889--898 (1976)]. According to a recently developed model, the range of intensity independence is limited by the bone-conducted energy from the more intense tone [E. W. Yund and R. Efron, J. Acoust. Soc. Am. 62, 607--617 (1977)]. The model predicts that a decrease in bone conduction such as the one achieved by using insertion earphones, must increase the range of intensity independence. This prediction is confirmed.     

Enhancing interaural-delay-based extents of laterality at high frequencies by using "transposed stimuli"

An acoustic pointing task was used to determine whether interaural temporal disparities (ITDs) conveyed by high-frequency "transposed" stimuli would produce larger extents of laterality than ITDs conveyed by bands of high-frequency Gaussian noise. The envelopes of transposed stimuli are designed to provide high-frequency channels with information similar to that conveyed by the waveforms of low-frequency stimuli. Lateralization was measured for low-frequency Gaussian noises, the same noises transposed to 4 kHz, and high-frequency Gaussian bands of noise centered at 4 kHz. Extents of laterality obtained with the transposed stimuli were greater than those obtained with bands of Gaussian noise centered at 4 kHz and, in some cases, were equivalent to those obtained with low-frequency stimuli. In a second experiment, the general effects on lateral position produced by imposed combinations of bandwidth, ITD, and interaural phase disparities (IPDs) on low-frequency stimuli remained when those stimuli were transposed to 4 kHz. Overall, the data were fairly well accounted for by a model that computes the cross-correlation subsequent to known stages of peripheral auditory processing augmented by low-pass filtering of the envelopes within the high-frequency channels of each ear.     

Binaural modulation masking

Modulation thresholds were measured in three subjects for a sinusoidally amplitude-modulated (SAM) wideband noise (the signal) in the presence of a second amplitude-modulated wideband noise (the masker). In monaural conditions (Mm-Sm) masker and signal were presented to only one ear; in binaural conditions (M0-S pi) the masker was presented diotically while the phase of modulation of the SAM noise signal was inverted in one ear relative to the other. In experiment 1 masker modulation frequency (fm) was fixed at 16 Hz, and signal modulation frequency (fs) was varied from 2-512 Hz. For monaural presentation, masking generally decreased as fs diverged from fm, although there was a secondary increase in masking for very low signal modulation frequencies, as reported previously [Bacon and Grantham, J. Acoust. Soc. Am. 85, 2575-2580 (1989)]. The binaural masking patterns did not show this low-frequency upturn: binaural thresholds continued to improve as fs decreased from 16 to 2 Hz. Thus, comparing masked monaural and masked binaural thresholds, there was an average binaural advantage, or masking-level difference (MLD) of 9.4 dB at fs = 2 Hz and 5.3 dB at fs = 4 Hz. In addition, there were positive MLDs for the on-frequency condition (fm = fs = 16 Hz: average MLD = 4.4 dB) and for the highest signal frequency tested (fs = 512 Hz: average MLD = 7.3 dB). In experiment 2 the signal was a SAM noise (fs = 16 Hz), and the masker was a wideband noise, amplitude-modulated by a narrow band of noise centered at fs. There was no effect on monaural or binaural thresholds as masker modulator bandwidth was varied from 4 to 20 Hz (the average MLD remained constant at 8.0 dB), which suggests that the observed "tuning" for modulation may be based on temporal pattern discrimination and not on a critical-band-like filtering mechanism. In a final condition the masker modulator was a 10-Hz-wide band of noise centered at the 64-Hz signal modulation frequency. The average MLD in this case was 7.4 dB. The results are discussed in terms of various binaural capacities that probably play a role in binaural release from modulation masking, including detection of varying interaural intensity differences (IIDs) and discrimination of interaural correlation.     

Extension of a binaural cross-correlation model by contralateral inhibition. I. Simulation of lateralization for stationary signals

Running interaural cross correlation is a basic assumption to model the performance of the binaural auditory system. Although this concept is particularly suited to simulate psychoacoustic localization phenomena, there exist some localization effects which cannot be explained by pure cross correlation. In this paper a model of interaural cross correlation is extended by a "contralateral-inhibition mechanism" and by "monaural detectors" in order to simulate a wide range of psychoacoustic lateralization data. The extended model explains lateralization of pure tones with interaural time differences as well as with interaural level differences. Multiple images are predicted for tones with characteristic combinations of interaural signal parameters and for noise signals with different degrees of interaural cross correlation. The model is also capable of simulating dynamic lateralization phenomena, such as the "law of the first wave front" which is dealt with in a companion paper [Lindemann, J. Acoust. Soc. Am. 80, 1623-1630 (1986)]. The present paper is restricted to a comparison of the model predictions for stationary signals with the results of dichotic listening experiments.     

The auditory periphery of the ferret. II: The spectral transformations of the external ear and their implications for sound localization

In the previous paper the directional response characteristics of the ferret auditory periphery were examined. In this study further measurements of the spectral transfer functions (STFs) of the auditory periphery were obtained at locations close to the tympanic membrane. There was considerable variation in the STFs recorded from different animals and between recordings made at each end of the auditory canal in the same animal. However, calculation of the so called "location dependency function" demonstrated that changes in the location of the stimulus produced the same pattern of changes in the STFs in all recordings. Changes in the spectral transformation for azimuth locations in the ipsilateral auditory field were examined by calculating the horizon STF. The gain transformations of frequencies below 20 kHz were found to be asymmetrical about the interaural axis so that maximum gain was obtained for anterior stimulus locations. In contrast, the maximum gain for frequencies above 20 kHz was obtained for stimulus locations about the interaural axis, and movement of the stimulus location into either the anterior or posterior fields produced symmetrical reductions in gain. These changes were related to the directional properties of the periphery examined in the previous paper [S. Carlile, J. Acoust. Soc. Am. 88, 2180-2195 (1990)]. The spatial resolution of the monaural information provided by the peripheral STFs is dependent on the rate of change of the transformations as a function of azimuthal displacement of the stimulus location. This was examined by calculating the unsigned first spatial derivative for each frequency in the horizon STF.(ABSTRACT TRUNCATED AT 250 WORDS)     

Transmission mode time-reversal super-resolution imaging

The theory of time-reversal super-resolution imaging of point targets embedded in a reciprocal background medium [A. J. Devaney, "Super-resolution imaging using time-reversal and MUSIC," J. Acoust. Soc. Am. (to be published)] is generalized to the case where the transmitter and receiver sensor arrays need not be coincident and for cases where the background medium can be nonreciprocal. The new theory developed herein is based on the singular value decomposition of the generalized multistatic data matrix of the sensor system rather than the standard eigenvector/eigenvalue decomposition of the time-reversal matrix as was employed in the above-mentioned work and other treatments of time-reversal imaging [Prada, Thomas, and Fink, "The iterative time reversal process: Analysis of the convergence," J. Acoust. Soc. Am. 97, 62 (1995); Prada et al., "Decomposition of the time reversal operator: Detection and selective focusing on two scatterers," J. Acoust. Soc. Am. 99, 2067 (1996)]. A generalized multiple signal classification (MUSIC) algorithm is derived that allows super-resolution imaging of both well-resolved and non-well-resolved point targets from arbitrary sensor array geometries. MUSIC exploits the orthogonal nature of the scatterer and noise subspaces defined by the singular vectors of the multistatic data matrix to form scatterer images. The time-reversal/MUSIC algorithm is tested and validated in two computer simulations of offset vertical seismic profiling where the sensor sources are aligned along the earth's surface and the receiver array is aligned along a subsurface borehole. All results demonstrate the high contrast, high resolution imaging capabilities of this new algorithm combination when compared with "classical" backpropagation or field focusing. Above and beyond the application of seismo-acoustic imaging, the time-reversal super-resolution theory has applications in ocean acoustics for target location, and ultrasonic nondestructive evaluation of parts.     

Temporal weighting functions for interaural time and level differences. II. The effect of binaurally synchronous temporal jitter

Recent work has demonstrated that sensitivity to interaural time differences (ITD) carried by high-rate cochlear implant pulse trains or analogous acoustic signals can be enhanced by imposing random temporal variation on the stimulus rate [see Goupell et al. (2009). J. Acoust. Soc. Am. 126, 2511-2521]. The present study characterized the effect of such "temporal jitter" on normal-hearing listeners' weighting of ITD and interaural level differences (ILD) applied to brief trains of Gabor clicks (4 kHz center frequency) presented at nominal interclick intervals (ICI) of 1.25 and 2.5 ms. Lateral discrimination judgments were evaluated on the basis of the ITD or ILD carried by individual clicks in each train. Random perturbation of the ICI significantly reduced listeners' weighting of onset cues for both ITD and ILD discrimination compared to corresponding isochronous conditions, consistent with enhanced sensitivity to post-onset binaural cues in jittered stimuli, although the reduction of onset weighting was not statistically significant at 1.25 ms ICI. An additional analysis suggested greater weighting of ITD or ILD presented following lengthened versus shortened ICI, although weights for such "gaps" and "squeezes" were comparable to other post-onset weights. Results are discussed in terms of binaural information available in jittered versus isochronous stimuli.