Multimodal integration of EEG, MEG and fMRI data for the solution of the neuroimage puzzle

In this paper, advanced methods for the modeling of human cortical activity from combined high-resolution electroencephalography (EEG), magnetoencephalography (MEG) and functional magnetic resonance imaging (fMRI) data are presented. These methods include a subject's multicompartment head model (scalp, skull, dura mater, cortex) constructed from magnetic resonance images, multidipole source model and regularized linear inverse source estimates of cortical current density. Determination of the priors in the resolution of the linear inverse problem was performed with the use of information from the hemodynamic responses of the cortical areas as revealed by block-designed (strength of activated voxels) fMRI. Examples of the application of these methods to the estimation of the time varying cortical current density activity in selected region of interest (ROI) are presented for movement-related high-resolution EEG data.     

Simultaneous imaging of total cerebral hemoglobin concentration,oxygenation, and blood flow during functional activation

A simple instrument is demonstrated for high-resolution simultaneous imaging of total hemoglobin concentration and oxygenation and blood flow in the brain by combining rapid multiwavelength imaging with laser speckle contrast imaging. The instrument was used to image changes in oxyhemoglobin and deoxyhemoglobin and blood flow during cortical spreading depression and single whisker stimulation in rats through a thinned skull. The ability to image blood flow and hemoglobin concentration changes simultaneously with high resolution will permit detailed quantitative analysis of the spatiotemporal hemodynamics of functional brain activation, including imaging of oxygen metabolism. This is of significance to the neuroscience community and will lead to a better understanding of the interrelationship of neural, metabolic, and hemodynamic processes in normal and diseased brains.     

Modulation of brain functional connectivity with manual acupuncture in healthy subjects: An electroencephalograph case studying

Manual acupuncture is widely used for pain treatment and stress control. Previous studies on acupuncture have shown its modulatory effects on functional connectivity associated with one or a few preselected brain regions. To investigate how manual acupuncture modulates the organization of functional networks at a whole-brain level, we acupuncture at ST36 of right leg to obtain electroencephalograph (EEG) signals. By coherence estimation, we determine the synchronizations between all pairwise combinations of EEG channels in three acupuncture states. The resulting synchronization matrices are converted into functional networks by applying a threshold, and clustering coefficients and path lengths are computed as a function of threshold. The results show that acupuncture can increase functional connections and synchronizations between different brain areas. For a wide range of threshold, the clustering coefficient during acupuncture and post-acupuncture period is higher than that during the pre-acupuncture control period, whereas characteristic path length is shorter. We provide further support for the presence of "small-world" network characteristics in functional networks by acupuncture. These preliminary results highlight the beneficial modulations of functional connectivity by manual acupuncture, which could contribute to the understanding of acupuncture effects on the entire brain, as well as the neurophysiological mechanisms underlying acupuncture. Moreover, the proposed method may be a useful approach to the further investigation of the complexity of patterns of interrelations between EEG channels.     

Integration of EEG source imaging and fMRI during continuous viewing of natural movies

Electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) are noninvasive neuroimaging tools which can be used to measure brain activity with excellent temporal and spatial resolution, respectively. By combining the neural and hemodynamic recordings from these modalities, we can gain better insight into how and where the brain processes complex stimuli, which may be especially useful in patients with different neural diseases. However, due to their vastly different spatial and temporal resolutions, the integration of EEG and fMRI recordings is not always straightforward. One fundamental obstacle has been that paradigms used for EEG experiments usually rely on event-related paradigms, while fMRI is not limited in this regard. Therefore, here we ask whether one can reliably localize stimulus-driven EEG activity using the continuously varying feature intensities occurring in natural movie stimuli presented over relatively long periods of time. Specifically, we asked whether stimulus-driven aspects in the EEG signal would be co-localized with the corresponding stimulus-driven BOLD signal during free viewing of a movie. Secondly, we wanted to integrate the EEG signal directly with the BOLD signal, by estimating the underlying impulse response function (IRF) that relates the BOLD signal to the underlying current density in the primary visual area (V1). We made sequential fMRI and 64-channel EEG recordings in seven subjects who passively watched 2-min-long segments of a James Bond movie. To analyze EEG data in this natural setting, we developed a method based on independent component analysis (ICA) to reject EEG artifacts due to blinks, subject movement, etc., in a way unbiased by human judgment. We then calculated the EEG source strength of this artifact-free data at each time point of the movie within the entire brain volume using low-resolution electromagnetic tomography (LORETA). This provided for every voxel in the brain (i.e., in 3D space) an estimate of the current density at every time point. We then carried out a correlation between the time series of visual contrast changes in the movie with that of EEG voxels. We found the most significant correlations in visual area V1, just as seen in previous fMRI studies (Bartels A, Zeki, S, Logothetis NK. Natural vision reveals regional specialization to local motion and to contrast-invariant, global flow in the human brain. Cereb Cortex 2008;18(3):705–717), but on the time scale of milliseconds rather than of seconds. To obtain an estimate of how the EEG signal relates to the BOLD signal, we calculated the IRF between the BOLD signal and the estimated current density in area V1. We found that this IRF was very similar to that observed using combined intracortical recordings and fMRI experiments in nonhuman primates. Taken together, these findings open a new approach to noninvasive mapping of the brain. It allows, firstly, the localization of feature-selective brain areas during natural viewing conditions with the temporal resolution of EEG. Secondly, it provides a tool to assess EEG/BOLD transfer functions during processing of more natural stimuli. This is especially useful in combined EEG/fMRI experiments, where one can now potentially study neural-hemodynamic relationships across the whole brain volume in a noninvasive manner.     

A 16-channel loop array for in vivo macaque whole-brain imaging at 3 T

Non-human primates (NHPs) are vital models for neuroscience research. These animals have been widely used in behavioral, electrophysiological, molecular, and more recently, multimodal neuroimaging and neuro-engineering studies. Several RF coil arrays have been designed for functional, high-resolution brain magnetic resonance imaging (MRI), but few have been designed to accommodate multimodal devices. In the present study, a 16-channel array coil was constructed for brain imaging of macaques at 3 Tesla (3 T). To construct this coil, a close-fitting helmet-shaped form was designed to host 16 coil loops for whole-brain coverage. This assembly is mountable onto stereotaxic head frame bars, and the coil functions while the monkey is in the sphinx position with a clear line of vision of stimuli presented from outside of the MRI system. In addition, 4 openings were allocated in the coil housing, allowing multimodal devices to directly access visual cortical regions such as V1-V4 and MT. Coil performance was evaluated in an anesthetized macaque by quantifying and comparing signal-to-noise ratios (SNRs), noise correlations, and g-factor maps to a vendor-supplied human pediatric coil frequently used for NHP MRI. The result from in vivo experiments showed that the NHP coil was well-decoupled, had higher SNRs in cortical regions, and improved data acquisition acceleration capability compared with a vendor-supplied human pediatric coil that has been frequently used in macaque MRI studies. Furthermore, whole-brain anatomic imaging, diffusion tensor imaging and functional brain imaging have also been conducted: the details of brain anatomical structure, such as cerebellum and brainstem, can be clearly visualized in T2-SPACE images; b0 SNR calculated from b0 maps was higher than the human pediatric coil in all regions of interest (ROIs); the time-course SNR (tSNR) map calculated for GRE-EPI images demonstrates that the presented coil can be used for high-resolution functional imaging at 3 T.     

时变动态贝叶斯网络模型及其在皮层脑电网络连接中的应用

大脑执行语言的发音需要顶叶、颞叶、额叶等多个脑区协同完成.皮层脑电具有高时间分辨率、较高空间分辨率和高信噪比等优势,为研究大脑的电生理特性提供了重要的技术手段.为了探索大脑对语言的动态处理过程,利用多尺度皮层脑电(标准电极与微电极)分析了被试在执行音节朗读任务时的皮层脑电信号的高频gamma段特征,提出采用时变动态贝叶斯网络构建单次实验任务的有向网络.结果显示该方法能够快速有效地构建语言任务过程中标准电极、微电极以及二者之间的有向网络连接,且反映了大规模网络(标准电极之间的连接)、局部网络(微电极之间的连接)以及大规模网络与局部网络之间的连接(标准电极与微电极之间的连接)随语言任务发生的动态改变.研究还发现,发音时刻之前与之后的网络连接存在显著性差异,且发音方式不同的音节网络间也存在明显差异.该研究将有助于癫痫等神经疾病的术前临床评估以及理解大脑对语言加工的实时处理过程.     

The modulation of brain functional connectivity with manual acupuncture in healthy subjects:An electroencephalograph case study

Manual acupuncture is widely used for pain relief and stress control.Previous studies on acupuncture have shown its modulatory effects on the functional connectivity associated with one or a few preselected brain regions.To investigate how manual acupuncture modulates the organization of functional networks at a whole-brain level,we acupuncture at ST36 of a right leg to obtain electroencephalograph(EEG) signals.By coherence estimation,we determine the synchronizations between all pairwise combinations of EEG channels in three acupuncture states.The resulting synchronization matrices are converted into functional networks by applying a threshold,and the clustering coefficients and path lengths are computed as a function of threshold.The results show that acupuncture can increase functional connections and synchronizations between different brain areas.For a wide range of thresholds,the clustering coefficient during acupuncture and postacupuncture period is higher than that during the pre-acupuncture control period,whereas the characteristic path length is shorter.We provide further support for the presence of "small-world" network characteristics in functional networks by using acupuncture.These preliminary results highlight the beneficial modulations of functional connectivity by manual acupuncture,which could contribute to the understanding of the effects of acupuncture on the entire brain,as well as the neurophysiological mechanisms underlying acupuncture.Moreover,the proposed method may be a useful approach to the further investigation of the complexity of patterns of interrelations between EEG channels.     

Investigating the neural basis for fMRI-based functional connectivity in a blocked design: application to interregional correlations and psycho-physiological interactions

This paper investigates how well different kinds of fMRI functional connectivity analysis reflect the underlying interregional neural interactions. This is hard to evaluate using real experimental data where such relationships are unknown. Rather, we use a biologically realistic neural model to simulate both neuronal activities and multiregional fMRI data from a blocked design. Because we know how every element in the model is related to every other element, we can compare functional connectivity measurements across different spatial and temporal scales. We focus on (1) psycho-physiological interaction (PPI) analysis, which is a simple brain connectivity method that characterizes the activity in one brain region by the interaction between another region's activity and a psychological factor, and (2) interregional correlation analysis. We investigated the neurobiological underpinnings of PPI using simulated neural activities and fMRI signals generated by a large-scale neural model that performs a visual delayed match-to-sample task. Simulated fMRI data are generated by convolving integrated synaptic activities (ISAs) with a hemodynamic response function. The simulation was done under three task conditions: high-attention, low-attention and a control task ('passive viewing'). We investigated how biological and scanning parameters affect PPI and compared these with functional connectivity measures obtained using correlation analysis. We performed correlational and PPI analyses with three types of time-series data: ISA, fMRI and deconvolved fMRI (which yields estimated neural signals) obtained using a deconvolution algorithm. The simulated ISA can be considered as the 'gold standard' because it represents the underlying neural activity. Our main findings show (1) that evaluating the change in an interregional functional connection using the difference in regression coefficients (as is essentially done in the PPI method) produces results that better reflect the underlying changes in neural interrelationships than does evaluating the functional connectivity difference as a change in correlation coefficient; (2) that using fMRI and deconvolved fMRI data led to similar conclusions in the PPI-based functional connectivity results, and these generally agreed with the nature of the underlying neural interactions; and (3) the functional connectivity correlation measures often led to different conclusions regarding significance for different scanning and hemodynamic parameters, but the significances of the PPI regression parameters were relatively robust. These results highlight the way in which neural modeling can be used to help validate the inferences one can make about functional connectivity based on fMRI data.     

Biophysical and neural basis of resting state functional connectivity: Evidence from non-human primates

Functional MRI (fMRI) has evolved from simple observations of regional changes in MRI signals caused by cortical activity induced by a task or stimulus, to task-free acquisitions of images in a resting state. Such resting state signals contain low frequency fluctuations which may be correlated between voxels, and strongly correlated regions are deemed to reflect functional connectivity within synchronized circuits. Resting state functional connectivity (rsFC) measures have been widely adopted by the neuroscience community, and are being used and interpreted as indicators of intrinsic neural circuits and their functional states in a broad range of applications, both basic and clinical. However, there has been relatively little work reported that validates whether inter-regional correlations in resting state fluctuations of fMRI (rsfMRI) signals actually measure functional connectivity between brain regions, or to establish how MRI data correlate with other metrics of functional connectivity. In this mini-review, we summarize recent studies of rsFC within mesoscopic scale cortical networks (100 μm–10 mm) within a well defined functional region of primary somatosensory cortex (S1), as well as spinal cord and brain white matter in non-human primates, in which we have measured spatial patterns of resting state correlations and validated their interpretation with electrophysiological signals and anatomic connections. Moreover, we emphasize that low frequency correlations are a general feature of neural systems, as evidenced by their presence in the spinal cord as well as white matter. These studies demonstrate the valuable role of high field MRI and invasive measurements in an animal model to inform the interpretation of human imaging studies.     

基于LABVIEW的脑电信号虚拟采集系统设计

在神经科学研究领域,对大脑的观察主要来源于对脑电信号的收集与分析。当前对脑电信号收集的方法是通过专业脑电设备将信号收集保存,再由专业软件处理。由于这类仪器非常昂贵,系统体积也比较大,软件更新快,现在只能用在科学研究上,根本无法用于有规模的实验教学,更不可能一人一机。为此,提出了一种基于LABVIEW的脑电信号虚拟采集系统设计方法,使脑电收集与分析可以广泛地应用于教学。该方法首先对脑电信号虚拟采集系统的硬件进行构造,然后以硬件构造为依据,利用AR模型功率谱估计对脑电信号进行特征提取,在特征提取过程中,对模型类型与模型系数算法以及模型最佳阶数进行分析,最后通过将二阶低通滤波器与二阶高通滤波器进行串联,形成4阶Bessel带通滤波器,实现脑电信号的滤波,并以脑电信号传输电路的设计完成脑电信号虚拟采集系统的设计。实验结果证明,所提方法可以快速地对脑电信号虚拟采集系统进行设计,并为该领域的研究发展提供支撑。#$NL关键词：LABVIEW;脑电信号;虚拟采集系统;     

Functional MRI and multivariate autoregressive models

Connectivity refers to the relationships that exist between different regions of the brain. In the context of functional magnetic resonance imaging (fMRI), it implies a quantifiable relationship between hemodynamic signals from different regions. One aspect of this relationship is the existence of small timing differences in the signals in different regions. Delays of 100 ms or less may be measured with fMRI, and these may reflect important aspects of the manner in which brain circuits respond as well as the overall functional organization of the brain. The multivariate autoregressive time series model has features to recommend it for measuring these delays and is straightforward to apply to hemodynamic data. In this review, we describe the current usage of the multivariate autoregressive model for fMRI, discuss the issues that arise when it is applied to hemodynamic time series and consider several extensions. Connectivity measures like Granger causality that are based on the autoregressive model do not always reflect true neuronal connectivity; however, we conclude that careful experimental design could make this methodology quite useful in extending the information obtainable using fMRI.     

Analysis of a phase synchronized functional network based on the rhythm of brain activities

Rhythm of brain activities represents oscillations of postsynaptic potentials in neocortex, therefore it can serve as an indicator of the brain activity state. In order to check the connectivity of brain rhythm, this paper develops a new method of constructing functional network based on phase synchronization. Electroencephalogram (EEG) data were collected while subjects looking at a green cross in two states, performing an attention task and relaxing with eyes-open. The EEG from these two states was filtered by three band-pass filters to obtain signals of theta (4--7 Hz), alpha (8--13 Hz) and beta (14--30 Hz) bands. Mean resultant length was used to estimate strength of phase synchronization in three bands to construct networks of both states, and mean degree K and cluster coefficient C of networks were calculated as a function of threshold. The result shows higher cluster coefficient in the attention state than in the eyes-open state in all three bands, suggesting that cluster coefficient reflects brain state. In addition, an obvious fronto-parietal network is found in the attention state, which is a well-known attention network. These results indicate that attention modulates the fronto-parietal connectivity in different modes as compared with the eyes-open state. Taken together this method is an objective and important tool to study the properties of neural networks of brain rhythm.     

Estimation of time delay by coherence analysis

Using coherence analysis (which is an extensively used method to study the correlations in frequency domain, between two simultaneously measured signals) we estimate the time delay between two signals. This method is suitable for time delay estimation of narrow band coherence signals for which the conventional methods cannot be reliably applied. We show, by analysing coupled Rössler attractors with a known delay, that the method yields satisfactory results. Then, we apply this method to human pathologic tremor. The delay between simultaneously measured traces of electroencephalogram (EEG) and electromyogram (EMG) data of subjects with essential hand tremor is calculated. We find that there is a delay of 11–27 milli-seconds (ms) between the tremor correlated parts (cortex) of the brain (EEG) and the trembling hand (EMG) which is in agreement with the experimentally observed delay value of 15 ms for the cortico-muscular conduction time. By surrogate analysis we calculate error bars of the estimated delay.     

A Comparative Study of Functional Connectivity Measures for Brain Network Analysis in the Context of AD Detection with EEG

This work addresses brain network analysis considering different clinical severity stages of cognitive dysfunction, based on resting-state electroencephalography (EEG). We use a cohort acquired in real-life clinical conditions, which contains EEG data of subjective cognitive impairment (SCI) patients, mild cognitive impairment (MCI) patients, and Alzheimer’s disease (AD) patients. We propose to exploit an epoch-based entropy measure to quantify the connectivity links in the networks. This entropy measure relies on a refined statistical modeling of EEG signals with Hidden Markov Models, which allow a better estimation of the spatiotemporal characteristics of EEG signals. We also propose to conduct a comparative study by considering three other measures largely used in the literature: phase lag index, coherence, and mutual information. We calculated such measures at different frequency bands and computed different local graph parameters considering different proportional threshold values for a binary network analysis. After applying a feature selection procedure to determine the most relevant features for classification performance with a linear Support Vector Machine algorithm, our study demonstrates the effectiveness of the statistical entropy measure for analyzing the brain network in patients with different stages of cognitive dysfunction.     

On the nature of the BOLD fMRI contrast mechanism

Since its development about 15 years ago, functional magnetic resonance imaging (fMRI) has become the leading research tool for mapping brain activity. The technique works by detecting the levels of oxygen in the blood, point by point, throughout the brain. In other words, it relies on a surrogate signal, resulting from changes in oxygenation, blood volume and flow, and does not directly measure neural activity. Although a relationship between changes in brain activity and blood flow has long been speculated, indirectly examined and suggested and surely anticipated and expected, the neural basis of the fMRI signal was only recently demonstrated directly in experiments using combined imaging and intracortical recordings. In the present paper, we discuss the results obtained from such combined experiments. We also discuss our current knowledge of the extracellularly measured signals of the neural processes that they represent and of the structural and functional neurovascular coupling, which links such processes with the hemodynamic changes that offer the surrogate signal that we use to map brain activity. We conclude by considering applications of invasive MRI, including injections of paramagnetic tracers for the study of connectivity in the living animal and simultaneous imaging and electrical microstimulation.     

Principle of structural equation modeling for exploring functional interactivity within a putative network of interconnected brain areas

Functional neuroimaging first allowed researchers to describe the functional segregation of regionally activated areas during a variety of experimental tasks. More recently, functional integration studies have described how these functionally specialized areas, interact within a highly distributed neural network. When applied to the field of neurosciences, structural equation modeling (SEM) uses theoretical and/or empirical hypotheses to estimate the effects of an experimental task within a putative network. SEM represents a linear technique for multivariate analysis of neuroimaging data and has been developed to simultaneously examine ratios of multiple causality in an experimental design; the method attempts to explain a covariance structure within an anatomical constrained model. This method, when combined with the concept of effective connectivity, can provide information on the strength and direction of the functional interactions that take place between identified brain regions of a putative network.     

Functional neural network analysis in frontotemporal dementia and Alzheimer's disease using EEG and graph theory

Background  

Although a large body of knowledge about both brain structure and function has been gathered over the last decades, we still have a poor understanding of their exact relationship. Graph theory provides a method to study the relation between network structure and function, and its application to neuroscientific data is an emerging research field. We investigated topological changes in large-scale functional brain networks in patients with Alzheimer's disease (AD) and frontotemporal lobar degeneration (FTLD) by means of graph theoretical analysis of resting-state EEG recordings. EEGs of 20 patients with mild to moderate AD, 15 FTLD patients, and 23 non-demented individuals were recorded in an eyes-closed resting-state. The synchronization likelihood (SL), a measure of functional connectivity, was calculated for each sensor pair in 0.5–4 Hz, 4–8 Hz, 8–10 Hz, 10–13 Hz, 13–30 Hz and 30–45 Hz frequency bands. The resulting connectivity matrices were converted to unweighted graphs, whose structure was characterized with several measures: mean clustering coefficient (local connectivity), characteristic path length (global connectivity) and degree correlation (network 'assortativity'). All results were normalized for network size and compared with random control networks.     

Depth-resolved imaging of functional activation in the rat cerebral cortex using optical coherence tomography

Co-registered optical coherence tomography (OCT) and video microscopy of the rat somatosensory cortex were acquired simultaneously through a thinned skull during forepaw electrical stimulation. Fractional signal change measured by OCT revealed a functional signal time course corresponding to the hemodynamic signal measurement made with video microscopy. OCT can provide high-resolution, cross-sectional images of functional neurovascular activation and may offer a new tool for basic neuroscience research in the important rat cerebral cortex model.     

Quantification of the power changes in BOLD signals using Welch spectrum method during different single-hand motor imageries

Motor imagery is an experimental paradigm implemented in cognitive neuroscience and cognitive psychology. To investigate the asymmetry of the strength of cortical functional activity due to different single-hand motor imageries, functional magnetic resonance imaging (fMRI) data from right handed normal subjects were recorded and analyzed during both left-hand and right-hand motor imagery processes. Then the average power of blood oxygenation level-dependent (BOLD) signals in temporal domain was calculated using the developed tool that combines Welch power spectrum and the integral of power spectrum approach of BOLD signal changes during motor imagery. Power change analysis results indicated that cortical activity exhibited a stronger power in the precentral gyrus and medial frontal gyrus with left-hand motor imagery tasks compared with that from right-hand motor imagery tasks. These observations suggest that right handed normal subjects mobilize more cortical nerve cells for left-hand motor imagery. Our findings also suggest that the approach based on power differences of BOLD signals is a suitable quantitative analysis tool for quantification of asymmetry of brain activity intensity during motor imagery tasks.     

Stochastic qualifiers of epileptic brain dynamics

We evaluate the capability of reconstructing Fokker-Planck equations for an improved characterization of electroencephalographic (EEG) recordings from epilepsy patients. We derive stochastic qualifiers of brain dynamics that are based on specific characteristics of the Kramers-Moyal coefficients estimated from the EEG. Analyzing long-lasting multichannel EEG recordings from eight patients suffering from focal epilepsies we show that particularly the stochastic part of the dynamics can yield valuable information for diagnostic purposes.