Fatigue Detection with Spatial-Temporal Fusion Method on Covariance Manifolds of Electroencephalography |
| |
Authors: | Nan Zhao Dawei Lu Kechen Hou Meifei Chen Xiangyu Wei Xiaowei Zhang Bin Hu |
| |
Affiliation: | 1.Gansu Provincial Key Laboratory of Wearable Computing, School of Information Science and Engineering, Lanzhou University, Lanzhou 730000, China; (N.Z.); (K.H.); (M.C.); (X.W.);2.School of Optics and Electronics, Beijing Institute of Technology, Beijing 100081, China;3.CAS Center for Excellence in Brain Science and Institutes for Biological Sciences, Shanghai Institutes for Biological Sciences, Chinese Academy of Sciences, Shanghai 200031, China |
| |
Abstract: | With the increasing pressure of current life, fatigue caused by high-pressure work has deeply affected people and even threatened their lives. In particular, fatigue driving has become a leading cause of traffic accidents and deaths. This paper investigates electroencephalography (EEG)-based fatigue detection for driving by mining the latent information through the spatial-temporal changes in the relations between EEG channels. First, EEG data are partitioned into several segments to calculate the covariance matrices of each segment, and then we feed these matrices into a recurrent neural network to obtain high-level temporal information. Second, the covariance matrices of whole signals are leveraged to extract two kinds of spatial features, which will be fused with temporal characteristics to obtain comprehensive spatial-temporal information. Experiments on an open benchmark showed that our method achieved an excellent classification accuracy of 93.834% and performed better than several novel methods. These experimental results indicate that our method enables better reliability and feasibility in the detection of fatigued driving. |
| |
Keywords: | fatigue detection electroencephalography covariance matrices SPDNet stein divergence RNN |
|
|