Integration of EEG source imaging and fMRI during continuous viewing of natural movies

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are noninvasive neuroimaging tools which can be used to measure brain activity with excellent temporal and spatial resolution, respectively. By combining the neural and hemodynamic recordings from these modalities, we can gain better insight into how and where the brain processes complex stimuli, which may be especially useful in patients with different neural diseases. However, due to their vastly different spatial and temporal resolutions, the integration of EEG and fMRI recordings is not always straightforward. One fundamental obstacle has been that paradigms used for EEG experiments usually rely on event-related paradigms, while fMRI is not limited in this regard. Therefore, here we ask whether one can reliably localize stimulus-driven EEG activity using the continuously varying feature intensities occurring in natural movie stimuli presented over relatively long periods of time. Specifically, we asked whether stimulus-driven aspects in the EEG signal would be co-localized with the corresponding stimulus-driven BOLD signal during free viewing of a movie. Secondly, we wanted to integrate the EEG signal directly with the BOLD signal, by estimating the underlying impulse response function (IRF) that relates the BOLD signal to the underlying current density in the primary visual area (V1). We made sequential fMRI and 64-channel EEG recordings in seven subjects who passively watched 2-min-long segments of a James Bond movie. To analyze EEG data in this natural setting, we developed a method based on independent component analysis (ICA) to reject EEG artifacts due to blinks, subject movement, etc., in a way unbiased by human judgment. We then calculated the EEG source strength of this artifact-free data at each time point of the movie within the entire brain volume using low-resolution electromagnetic tomography (LORETA). This provided for every voxel in the brain (i.e., in 3D space) an estimate of the current density at every time point. We then carried out a correlation between the time series of visual contrast changes in the movie with that of EEG voxels. We found the most significant correlations in visual area V1, just as seen in previous fMRI studies (Bartels A, Zeki, S, Logothetis NK. Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain. Cereb Cortex 2008;18(3):705–717), but on the time scale of milliseconds rather than of seconds. To obtain an estimate of how the EEG signal relates to the BOLD signal, we calculated the IRF between the BOLD signal and the estimated current density in area V1. We found that this IRF was very similar to that observed using combined intracortical recordings and fMRI experiments in nonhuman primates. Taken together, these findings open a new approach to noninvasive mapping of the brain. It allows, firstly, the localization of feature-selective brain areas during natural viewing conditions with the temporal resolution of EEG. Secondly, it provides a tool to assess EEG/BOLD transfer functions during processing of more natural stimuli. This is especially useful in combined EEG/fMRI experiments, where one can now potentially study neural-hemodynamic relationships across the whole brain volume in a noninvasive manner.     

Dynamics of the brain: Mathematical models and non-invasive experimental studies

Dynamics is an essential aspect of the brain function. In this article we review theoretical models of neural and haemodynamic processes in the human brain and experimental non-invasive techniques developed to study brain functions and to measure dynamic characteristics, such as neurodynamics, neurovascular coupling, haemodynamic changes due to brain activity and autoregulation, and cerebral metabolic rate of oxygen. We focus on emerging theoretical biophysical models and experimental functional neuroimaging results, obtained mostly by functional magnetic resonance imaging (fMRI) and near-infrared spectroscopy (NIRS). We also included our current results on the effects of blood pressure variations on cerebral haemodynamics and simultaneous measurements of fast processes in the brain by near-infrared spectroscopy and a very novel functional MRI technique called magnetic resonance encephalography. Based on a rapid progress in theoretical and experimental techniques and due to the growing computational capacities and combined use of rapidly improving and emerging neuroimaging techniques we anticipate during next decade great achievements in the overall knowledge of the human brain.     

Functional MRI using intravascular contrast agents: detrending of the relative cerebrovascular (rCBV) time course

In pharmacological fMRI experiments in animal models, blood pool contrast agents may be used to map cerebral blood volume change as a surrogate for neural activation. When the background signal drift due to contrast agent washout is non-negligible over the duration of the signal changes of interest, time-course detrending is essential for accurate interpretation of the experiment. Detrending approaches based on estimation of the background signal from a baseline period of the time course prior to pharmacological (or functional) challenge were evaluated with the aim of identifying a robust method of estimating the contrast agent washout contribution to the background signal drift. For fMRI studies in the rat, it was found that a constrained fit of a mono-exponential washout model was more accurate than a constant background approximation and unconstrained fits for experiments investigating the functional response to rapid pharmacological challenges such as cocaine and amphetamine. Moreover, the constrained fitting approach allows shorter baseline periods than unconstrained extrapolation, reducing the required duration of the experiment.     

Failure to direct detect magnetic field dephasing corresponding to ERP generation

Functional magnetic resonance imaging (fMRI) has become the method of choice for mapping brain activity in human subjects and detects changes in regional blood oxygenation and volume associated with local changes in neuronal activity. While imaging based on blood oxygenation level dependent (BOLD) contrast has good spatial resolution and sensitivity, the hemodynamic signal develops relatively slowly and is only indirectly related to neuronal activity. An alternative approach termed magnetic source magnetic resonance imaging (msMRI) is based on the premise that neural activity may be mapped by magnetic resonance imaging (MRI) with greater temporal resolution by detecting the local magnetic field perturbations associated with local neuronal electric currents. We used a hybrid ms/BOLD MRI method to investigate whether msMRI could detect signal changes that occur simultaneously at the time of the production of well-defined event-related potentials, the P300 and N170, in regions that previously have been identified as generators of these electrical signals. Robust BOLD activations occurred after some seconds, but we were unable to detect any significant changes in the T2*-weighted signal in these locations that correlated temporally with the timings of the evoked response potentials (ERPs).     

Sources of functional magnetic resonance imaging signal fluctuations in the human brain at rest: a 7 T study

Signal fluctuations in functional magnetic resonance imaging (fMRI) can result from a number of sources that may have a neuronal, physiologic or instrumental origin. To determine the relative contribution of these sources, we recorded physiological (respiration and cardiac) signals simultaneously with fMRI in human volunteers at rest with their eyes closed. State-of-the-art technology was used including high magnetic field (7 T), a multichannel detector array and high-resolution (3 mm³) echo-planar imaging. We investigated the relative contribution of thermal noise and other sources of variance to the observed fMRI signal fluctuations both in the visual cortex and in the whole brain gray matter. The following sources of variance were evaluated separately: low-frequency drifts due to scanner instability, effects correlated with respiratory and cardiac cycles, effects due to variability in the respiratory flow rate and cardiac rate, and other sources, tentatively attributed to spontaneous neuronal activity. We found that low-frequency drifts are the most significant source of fMRI signal fluctuations (3.0% signal change in the visual cortex, TE=32 ms), followed by spontaneous neuronal activity (2.9%), thermal noise (2.1%), effects due to variability in physiological rates (respiration 0.9%, heartbeat 0.9%), and correlated with physiological cycles (0.6%). We suggest the selection and use of four lagged physiological noise regressors as an effective model to explain the variance related to fluctuations in the rates of respiration volume change and cardiac pulsation. Our results also indicate that, compared to the whole brain gray matter, the visual cortex has higher sensitivity to changes in both the rate of respiration and the spontaneous resting-state activity. Under the conditions of this study, spontaneous neuronal activity is one of the major contributors to the measured fMRI signal fluctuations, increasing almost twofold relative to earlier experiments under similar conditions at 3 T.     

Illuminating the BOLD signal: combined fMRI-fNIRS studies

Functional magnetic resonance imaging (fMRI) is currently combined with electrophysiological methods to identify the relationship between neuronal activity and the blood oxygenation level-dependent (BOLD) signal. Several processes like neuronal activity, synaptic activity, vascular dilation, blood volume and oxygenation changes underlie both response modalities, that is, the electrophysiological signal and the vascular response. However, accessing single process relationships is absolutely mandatory when aiming at a deeper understanding of neurovascular coupling and necessitates studies on the individual building blocks of the vascular response. Combined fMRI and functional near-infrared spectroscopy studies have been performed to validate the correlation of the BOLD signal to the hemodynamic changes in the brain. Here we review the current status of the integration of both technologies and judge these studies in the light of recent findings on neurovascular coupling.     

Component structure of event-related fMRI responses in the different neurovascular compartments

In most functional magnetic resonance imaging (fMRI) studies, brain activity is localized by observing changes in the blood oxygenation level-dependent (BOLD) signal that are believed to arise from capillaries, venules and veins in and around the active neuronal population. However, the contribution from veins can be relatively far downstream from active neurons, thereby limiting the ability of BOLD imaging methods to precisely pinpoint neural generators. Hemodynamic measures based on apparent diffusion coefficients (ADCs) have recently been used to identify more upstream functional blood flow changes in the capillaries, arterioles and arteries. In particular, we recently showed that, due to the complementary vascular sensitivities of ADC and BOLD signals, the voxels conjointly activated by both measures may identify the capillary networks of the active neuronal areas. In this study, we first used simultaneously acquired ADC and BOLD functional imaging signals to identify brain voxels activated by ADC only, by both ADC and BOLD and by BOLD only, thereby delineating voxels relatively dominated by the arterial, capillary, and draining venous neurovascular compartments, respectively. We then examined the event-related fMRI BOLD responses in each of these delineated neurovascular compartments, hypothesizing that their event-related responses would show different temporal componentries. In the regions activated by both the BOLD and ADC contrasts, but not in the BOLD-only areas, we observed an initial transient signal reduction (an initial dip), consistent with the local production of deoxyhemoglobin by the active neuronal population. In addition, the BOLD-ADC overlap areas and the BOLD-only areas showed a clear poststimulus undershoot, whereas the compartment activated by only ADC did not show this component. These results indicate that using ADC contrast in conjunction with BOLD imaging can help delineate the various neurovascular compartments, improve the localization of active neural populations, and provide insight into the physiological mechanisms underlying the hemodynamic signals.     

Nonlinear responses of cerebral blood volume, blood flow and blood oxygenation signals during visual stimulation

Hemodynamic-based functional magnetic resonance imaging (fMRI) techniques provide a great utility for noninvasive functional brain mapping. However, because the hemodynamic signals reflect underlying neural activity indirectly, characterization of these signals following brain activation is essential for experimental design and data interpretation. In this report, the linear (or nonlinear) responses to neuronal activation of three hemodynamic parameters based primarily on changes of cerebral blood volume, blood flow and blood oxygenation were investigated by testing these hemodynamic responses' additivity property. Using a recently developed fMRI technique that acquires vascular space occupancy (VASO), arterial spin labeling (ASL) perfusion and blood oxygenation level-dependent (BOLD) signals simultaneously, the additivity property of the three hemodynamic responses in human visual cortex was assessed using various visual stimulus durations. Experiments on healthy volunteers showed that all three hemodynamic-weighted signals responded nonlinearly to stimulus durations less than 4 s, with the degree of nonlinearity becoming more severe as the stimulus duration decreased. Vascular space occupancy and ASL perfusion signals showed similar nonlinearity properties, whereas the BOLD signal was the most nonlinear. These data suggest that caution should be taken in the interpretation of hemodynamic-based signals in fMRI.     

Percept-related activity in the human somatosensory system: functional magnetic resonance imaging studies

In this paper, we review blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) studies addressing the neural correlates of touch, thermosensation, pain and the mechanisms of their cognitive modulation in healthy human subjects. There is evidence that fMRI signal changes can be elicited in the parietal cortex by stimulation of single mechanoceptive afferent fibers at suprathreshold intensities for conscious perception. Positive linear relationships between the amplitude or the spatial extents of BOLD fMRI signal changes, stimulus intensity and the perceived touch or pain intensity have been described in different brain areas. Some recent fMRI studies addressed the role of cortical areas in somatosensory perception by comparing the time course of cortical activity evoked by different kinds of stimuli with the temporal features of touch, heat or pain perception. Moreover, parametric single-trial functional MRI designs have been adopted in order to disentangle subprocesses within the nociceptive system.

Available evidence suggest that studies that combine fMRI with psychophysical methods may provide a valuable approach for understanding complex perceptual mechanisms and top-down modulation of the somatosensory system by cognitive factors specifically related to selective attention and to anticipation. The brain networks underlying somatosensory perception are complex and highly distributed. A deeper understanding of perceptual-related brain mechanisms therefore requires new approaches suited to investigate the spatial and temporal dynamics of activation in different brain regions and their functional interaction.     

Imaging the neural circuitry and chemical control of aggressive motivation

Background  

With the advent of functional magnetic resonance imaging (fMRI) in awake animals it is possible to resolve patterns of neuronal activity across the entire brain with high spatial and temporal resolution. Synchronized changes in neuronal activity across multiple brain areas can be viewed as functional neuroanatomical circuits coordinating the thoughts, memories and emotions for particular behaviors. To this end, fMRI in conscious rats combined with 3D computational analysis was used to identifying the putative distributed neural circuit involved in aggressive motivation and how this circuit is affected by drugs that block aggressive behavior.     

Fast functional brain signal changes detected by diffusion weighted fMRI

Functional magnetic resonance imaging (fMRI) has become the method of choice in the study of system neuroscience, as evidenced by an explosion of such literature in the past decade. Contrast mechanisms based on the blood oxygenation level, volume, and flow changes have been used to non-invasively detect brain activation secondary to the neuronal activity. However, because of the hemodynamic modulations inherent in these signals, their spatial and temporal characteristics are influenced by the complex geometry and varying delivery speed of the brain vasculature. Consequently, spatial dispersions and temporal delays are commonly seen in the brain activity using fMRI. It is thus of critical importance to investigate alternative contrast mechanisms that may offer shorter temporal delays and more direct spatial localization. In light of a recent phantom study which demonstrated the possibility to detect the destructive phase addition from the spatially incoherent, yet temporally synchronized, displacements caused by the Lorentz force experienced during electrical conduction within a strong magnetic field, we seek to apply similar imaging technique to investigate the functional signal changes that may provide alternative temporal and spatial characteristics. It is found that by using heavy diffusion weighting, which is one form of displacement encoding strategies, to remove the vascular signal and sensitize the minute and incoherent displacement, one can detect fast dynamic signal changes synchronized to the task. This finding may help take an initial step toward direct non-invasive MRI detection of the neuronal activity with improved temporal accuracy.     

Microtesla MRI of the human brain combined with MEG

One of the challenges in functional brain imaging is integration of complementary imaging modalities, such as magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI). MEG, which uses highly sensitive superconducting quantum interference devices (SQUIDs) to directly measure magnetic fields of neuronal currents, cannot be combined with conventional high-field MRI in a single instrument. Indirect matching of MEG and MRI data leads to significant co-registration errors. A recently proposed imaging method--SQUID-based microtesla MRI--can be naturally combined with MEG in the same system to directly provide structural maps for MEG-localized sources. It enables easy and accurate integration of MEG and MRI/fMRI, because microtesla MR images can be precisely matched to structural images provided by high-field MRI and other techniques. Here we report the first images of the human brain by microtesla MRI, together with auditory MEG (functional) data, recorded using the same seven-channel SQUID system during the same imaging session. The images were acquired at 46 microT measurement field with pre-polarization at 30 mT. We also estimated transverse relaxation times for different tissues at microtesla fields. Our results demonstrate feasibility and potential of human brain imaging by microtesla MRI. They also show that two new types of imaging equipment--low-cost systems for anatomical MRI of the human brain at microtesla fields, and more advanced instruments for combined functional (MEG) and structural (microtesla MRI) brain imaging--are practical.     

Brain oscillatory activity during motor imagery in EEG-fMRI coregistration

The purpose of the present work was to investigate the correlation between topographical changes in brain oscillatory activity and the blood oxygenation level-dependent (BOLD) signal during a motor imagery (MI) task using electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) coregistration.     

Comparison of α-chloralose,medetomidine and isoflurane anesthesia for functional connectivity mapping in the rat

Functional connectivity measures based upon low-frequency blood-oxygenation-level-dependent functional magnetic resonance imaging (BOLD fMRI) signal fluctuations have become a widely used tool for investigating spontaneous brain activity in humans. Still unknown, however, is the precise relationship between neural activity, the hemodynamic response and fluctuations in the MRI signal. Recent work from several groups had shown that correlated low-frequency fluctuations in the BOLD signal can be detected in the anesthetized rat — a first step toward elucidating this relationship. Building on this preliminary work, through this study, we demonstrate that functional connectivity observed in the rat depends strongly on the type of anesthesia used. Power spectra of spontaneous fluctuations and the cross-correlation-based connectivity maps from rats anesthetized with α-chloralose, medetomidine or isoflurane are presented using a high-temporal-resolution imaging sequence that ensures minimal contamination from physiological noise. The results show less localized correlation in rats anesthetized with isoflurane as compared with rats anesthetized with α-chloralose or medetomidine. These experiments highlight the utility of using different types of anesthesia to explore the fundamental physiological relationships of the BOLD signal and suggest that the mechanisms contributing to functional connectivity involve a complicated relationship between changes in neural activity, neurovascular coupling and vascular reactivity.     

The relationship between BOLD signal and autonomic nervous system functions: implications for processing of "physiological noise"

Functional magnetic resonance imaging (fMRI) research has revealed not only important aspects of the neural basis of cognitive and perceptual functions, but also important information on the relation between high-level brain functions and physiology. One of the central outstanding questions, given the features of the blood oxygenation level-dependent (BOLD) signal, is whether and how autonomic nervous system (ANS) functions are related to changes in brain states as measured in the human brain. A straightforward way to address this question has been to acquire external measurements of ANS activity such as cardiac and respiratory data, and examine their relation to the BOLD signal. In this article, we describe two conceptual approaches to the treatment of ANS measures in the context of BOLD fMRI analysis. On the one hand, several research lines have treated ANS activity measures as noise, considering them as nothing but a confounding factor that reduces the power of fMRI analysis or its validity. Work in this line has developed powerful methods to remove ANS effects from the BOLD signal. On the other hand, a different line of work has made important progress in showing that ANS functions such as cardiac pulsation, heart rate variability and breathing rate could be considered as a theoretically meaningful component of the signal that is useful for understanding brain function. Work within this latter framework suggests that caution should be exercised when employing procedures to remove correlations between BOLD data and physiological measures. We discuss these two positions and the reasoning underlying them. Thereafter, we draw on the reviewed literature in presenting practical guidelines for treatment of ANS data, which are based on the premise that ANS data should be considered as theoretically meaningful information. This holds particularly when studying cortical systems involved in regulation, monitoring and/or generation of ANS activity, such as those involved in decision making, conflict resolution and the experience of emotion.     

Relationship between neural and hemodynamic signals during spontaneous activity studied with temporal kernel CCA

Functional magnetic resonance imaging (fMRI) based on the so-called blood oxygen level-dependent (BOLD) contrast is a powerful tool for studying brain function not only locally but also on the large scale. Most studies assume a simple relationship between neural and BOLD activity, in spite of the fact that it is important to elucidate how the “when” and “what” components of neural activity are correlated to the “where” of fMRI data. Here we conducted simultaneous recordings of neural and BOLD signal fluctuations in primary visual (V1) cortex of anesthetized monkeys. We explored the neurovascular relationship during periods of spontaneous activity by using temporal kernel canonical correlation analysis (tkCCA). tkCCA is a multivariate method that can take into account any features in the signals that univariate analysis cannot. The method detects filters in voxel space (for fMRI data) and in frequency–time space (for neural data) that maximize the neurovascular correlation without any assumption of a hemodynamic response function (HRF). Our results showed a positive neurovascular coupling with a lag of 4–5 s and a larger contribution from local field potentials (LFPs) in the γ range than from low-frequency LFPs or spiking activity. The method also detected a higher correlation around the recording site in the concurrent spatial map, even though the pattern covered most of the occipital part of V1. These results are consistent with those of previous studies and represent the first multivariate analysis of intracranial electrophysiology and high-resolution fMRI.     

Activation of SC during electrical stimulation of LGN: retinal antidromic stimulation or corticocollicular activation?

We have recently used combined electrostimulation, neurophysiology, microinjection and functional magnetic resonance imaging (fMRI) to study the cortical activity patterns elicited during stimulation of cortical afferents in monkeys. We found that stimulation of a site in lateral geniculate nucleus (LGN) increases the fMRI signal in the regions of primary visual cortex receiving input from that site, but suppresses it in the retinotopically matched regions of extrastriate cortex. Intracortical injection experiments showed that such suppression is due to synaptic inhibition. During these experiments, we have consistently observed activation of superior colliculus (SC) following LGN stimulation. Since LGN does not directly project to SC, the current study investigated the origin of SC activation. By examining experimental manipulations inactivating the primary visual cortex, we present here evidence that the robust SC activation, which follows the stimulation of LGN, is due to the activation of corticocollicular pathway.     

BOLD functional MRI in disease and pharmacological studies: room for improvement?

In the past decade the use of blood oxygen level-dependent (BOLD) fMRI to investigate the effect of diseases and pharmacological agents on brain activity has increased greatly. BOLD fMRI does not measure neural activity directly, but relies on a cascade of physiological events linking neural activity to the generation of MRI signal. However, most of the disease and pharmacological studies performed so far have interpreted changes in BOLD fMRI as "brain activation," ignoring the potential confounds that can arise through drug- or disease-induced modulation of events downstream of the neural activity. This issue is especially serious in diseases (like multiple sclerosis, brain tumours and stroke) and drugs (like anaesthetics or those with a vascular action) that are known to influence these physiological events. Here we provide evidence that, to extract meaningful information on brain activity in patient and pharmacological BOLD fMRI studies, it is important to identify, characterise and possibly correct these influences that potentially confound the results. We suggest a series of experimental measures to improve the interpretability of BOLD fMRI studies. We have ranked these according to their potential information and current practical feasibility. First-line, necessary improvements consist of (1) the inclusion of one or more control tasks, and (2) the recording of physiological parameters during scanning and subsequent correction of possible between-group differences. Second-line, highly recommended important aim to make the results of a patient or drug BOLD study more interpretable and include the assessment of (1) baseline brain perfusion, (2) vascular reactivity, (3) the inclusion of stimulus-related perfusion fMRI and (4) the recording of electrophysiological responses to the stimulus of interest. Finally, third-line, desirable improvements consist of the inclusion of (1) simultaneous EEG-fMRI, (2) cerebral blood volume and (3) rate of metabolic oxygen consumption measurements and, when relevant, (4) animal studies investigating signalling between neural cells and blood vessels.     

Fine-scale functional connectivity in somatosensory cortex revealed by high-resolution fMRI

High-resolution functional magnetic resonance imaging (fMRI) at high field (9.4 T) has been used to measure functional connectivity between subregions within the primary somatosensory (SI) cortex of the squirrel monkey brain. The hand-face region within the SI cortex of the squirrel monkey has been previously well mapped with functional imaging and electrophysiological and anatomical methods, and the orderly topographic map of the hand region is characterized by a lateral to medial representation of individual digits in four subregions of areas 3a, 3b, 1 and 2. With submillimeter resolution, we are able to detect not only the separate islands of activation corresponding to vibrotactile stimulations of single digits but also, in subsequent acquisitions, the degree of correlation between voxels within the SI cortex in the resting state. The results suggest that connectivity patterns are very similar to stimulus-driven distributions of activity and that connectivity varies on the scale of millimeters within the same primary region. Connectivity strength is not a reflection of global larger-scale changes in blood flow and is not directly dependent on distance between regions. Preliminary electrophysiological recordings agree well with the fMRI data. In human studies at 7 T, high-resolution fMRI may also be used to identify the same subregions and assess responses to sensory as well as painful stimuli, and to measure connectivity dynamically before and after such stimulations.