Visual Speech Recognition with Lightweight Psychologically Motivated Gabor Features

Extraction of relevant lip features is of continuing interest in the visual speech domain. Using end-to-end feature extraction can produce good results, but at the cost of the results being difficult for humans to comprehend and relate to. We present a new, lightweight feature extraction approach, motivated by human-centric glimpse-based psychological research into facial barcodes, and demonstrate that these simple, easy to extract 3D geometric features (produced using Gabor-based image patches), can successfully be used for speech recognition with LSTM-based machine learning. This approach can successfully extract low dimensionality lip parameters with a minimum of processing. One key difference between using these Gabor-based features and using other features such as traditional DCT, or the current fashion for CNN features is that these are human-centric features that can be visualised and analysed by humans. This means that it is easier to explain and visualise the results. They can also be used for reliable speech recognition, as demonstrated using the Grid corpus. Results for overlapping speakers using our lightweight system gave a recognition rate of over 82%, which compares well to less explainable features in the literature.     

一种新的磁共振图像处理流水线的设计与实现

磁共振图像的重建、后处理及可视化是磁共振成像（MRI）系统的重要组成部分.本文开发了一个新的用于磁共振图像重建、后处理及可视化的开源框架YAP（Yet Another Pipeline），利用此框架可以方便地构建图像处理流水线.与现有的一些其他开源框架相比，本文开发的框架具有如下特点：（1）采用基于接口的设计，可使用基于接口的插件对流水线的功能进行扩展；（2）允许用户使用编写脚本的方式构建图像处理流水线，编辑与修改流水线都很方便；（3）支持带有分支结构的流水线，便于流水线的构建与调试.目前，该框架已经在商用系统中获得了应用.     

Two-scale image fusion of visible and infrared images using saliency detection

Military, navigation and concealed weapon detection need different imaging modalities such as visible and infrared to monitor a targeted scene. These modalities provide complementary information. For better situation awareness, complementary information of these images has to be integrated into a single image. Image fusion is the process of integrating complementary source information into a composite image. In this paper, we propose a new image fusion method based on saliency detection and two-scale image decomposition. This method is beneficial because the visual saliency extraction process introduced in this paper can highlight the saliency information of source images very well. A new weight map construction process based on visual saliency is proposed. This process is able to integrate the visually significant information of source images into the fused image. In contrast to most of the multi-scale image fusion techniques, proposed technique uses only two-scale image decomposition. So it is fast and efficient. Our method is tested on several image pairs and is evaluated qualitatively by visual inspection and quantitatively using objective fusion metrics. Outcomes of the proposed method are compared with the state-of-art multi-scale fusion techniques. Results reveal that the proposed method performance is comparable or superior to the existing methods.     

刀锋伪影校正技术在精神疾病患者海马MRI检查中的应用

为探讨磁共振刀锋伪影校正（BLADE）技术提升精神疾病患者海马磁共振图像质量的效果，本文分别使用结合了BLADE技术的BLADE T₂WI TSE、BLADE T₂WI FLAIR及传统T₂WI TSE、T₂WI FLAIR四种序列，对47例精神疾病患者和美国放射学院（ACR）标准模体在3.0 T磁共振成像（MRI）设备上分别进行常规海马斜冠状位扫描和ACR标准检测.患者的磁共振图像由2名放射科医师采用5分法对运动伪影、搏动伪影、颗粒度、海马磁共振图像质量进行评价，并应用Wilcoxon符号秩检验进行数据分析.模体图像通过识别图像的钻孔阵列和轮辐的数目，半定量评价各序列的高对比空间分辨力（HCSR）和低对比物体探测能力（LCD）.结果表明相比传统序列，结合BLADE技术的序列能够明显改善海马磁共振图像的运动伪影、搏动伪影（p<0.001），提高图像质量（p<0.05）；但在图像颗粒度方面，传统序列表现更优（p<0.001）.ACR模体半定量分析显示，结合BLADE技术序列与传统序列相比，在LCD检测方面结果更优、在HCSR检测方面结果相同或略逊.本文推荐将BLADE技术应用于不合作的精神疾病患者海马的MRI检查.     

A new class of conformable spectral observers for signal reconstruction

In this work, the design of spectral observers for signal reconstruction based on Kalman filters is performed and evaluated. The conformable derivative and the beta‐derivative were used to design the Kalman filters. Both derivatives satisfy the same formulas of the classical derivation, eg, the chain rule. The derivative order, the Ricatti equation parameters, and the observers tuning parameters were optimized using an optimization algorithm based on the bat's echolocation behavior (Bat algorithm). The simulation results showed the advantages of using the proposed observers for the signal reconstruction.     

不同调光方式LED照射下的人体非视觉效应

分别采用模拟调光和PWM调光方式实现LED光调节。采用生理参数法,以在校大学生为研究对象,选择3种色温(3 000,5 600,6 500 K)LED光源,在3种照度(300,500,800 lx)水平下,对8名(5男,3女)受测者在实验前后的脉搏和瞳孔进行测量。选择同样3种色温LED光源,分别采用两种调光方式添加蓝光(464nm,20 lx)实现300 lx的照明环境,对12名(8男,4女)受测者在实验前后的脉搏和瞳孔进行测量。结果表明:两种调光方式实现的LED光环境对人体脉搏变化率和瞳孔收缩率的影响均没有显著性差异;在测试照明环境中添加蓝光,可引起人体脉搏变化率和瞳孔收缩率增大,峰值处分别增加约6%和9%。