Artificial neural network‐based modeling of snow properties using field data and hyperspectral imagery

This study attempts to model snow wetness and snow density of Himalayan snow cover using a combination of Hyperspectral image processing and Artificial Neural Network (ANN). Initially, a total of 300 spectral signature measurements, synchronized with snow wetness and snow density, were collected in the field. The spectral reflectance of snow was then modeled as a function of snow properties using ANN. Four snow wetness and three snow density models were developed. A strong correlation was observed in near‐infrared and shortwave‐infrared region. The correlation analysis of ANN modeled snow density and snow wetness showed a strong linear relationship with field‐based data values ranging from 0.87–0.90 and 0.88–0.91, respectively. Our results indicate that an Artificial Intelligence (AI) approach, using a combination of Hyperspectral image processing and ANN, can be efficiently used to predict snow properties (wetness and density) in the Himalayan region. Recommendations for resource managers

• Snow properties, such as snow wetness and snow density are mainly investigated through field‐based survey but rugged terrains, difficult weather conditions, and logistics management issues establish remote sensing as an efficient alternative to monitor snow properties, especially in the mountain environment.
• Although Hyperspectral remote sensing is a powerful tool to conduct the quantitative analysis of the physical properties of snow, only a few studies have used hyperspectral data for the estimation of snow density and wetness in the Himalayan region. This could be because of the lack of synchronized snow properties data with field‐based spectral acquisitions.
• In combination with Hyperspectral image processing, Artificial Neural Network (ANN) can be a useful tool for effective snow modeling because of its ability to capture and represent complex input‐output relationships.
• Further research into understanding the applicability of neural networks to determine snow properties is required to obtain results from large snow cover areas of the Himalayan region.

     

Visual Speech Recognition with Lightweight Psychologically Motivated Gabor Features

Extraction of relevant lip features is of continuing interest in the visual speech domain. Using end-to-end feature extraction can produce good results, but at the cost of the results being difficult for humans to comprehend and relate to. We present a new, lightweight feature extraction approach, motivated by human-centric glimpse-based psychological research into facial barcodes, and demonstrate that these simple, easy to extract 3D geometric features (produced using Gabor-based image patches), can successfully be used for speech recognition with LSTM-based machine learning. This approach can successfully extract low dimensionality lip parameters with a minimum of processing. One key difference between using these Gabor-based features and using other features such as traditional DCT, or the current fashion for CNN features is that these are human-centric features that can be visualised and analysed by humans. This means that it is easier to explain and visualise the results. They can also be used for reliable speech recognition, as demonstrated using the Grid corpus. Results for overlapping speakers using our lightweight system gave a recognition rate of over 82%, which compares well to less explainable features in the literature.     

一种新的磁共振图像处理流水线的设计与实现

磁共振图像的重建、后处理及可视化是磁共振成像（MRI）系统的重要组成部分.本文开发了一个新的用于磁共振图像重建、后处理及可视化的开源框架YAP（Yet Another Pipeline），利用此框架可以方便地构建图像处理流水线.与现有的一些其他开源框架相比，本文开发的框架具有如下特点：（1）采用基于接口的设计，可使用基于接口的插件对流水线的功能进行扩展；（2）允许用户使用编写脚本的方式构建图像处理流水线，编辑与修改流水线都很方便；（3）支持带有分支结构的流水线，便于流水线的构建与调试.目前，该框架已经在商用系统中获得了应用.     

Two-scale image fusion of visible and infrared images using saliency detection

Military, navigation and concealed weapon detection need different imaging modalities such as visible and infrared to monitor a targeted scene. These modalities provide complementary information. For better situation awareness, complementary information of these images has to be integrated into a single image. Image fusion is the process of integrating complementary source information into a composite image. In this paper, we propose a new image fusion method based on saliency detection and two-scale image decomposition. This method is beneficial because the visual saliency extraction process introduced in this paper can highlight the saliency information of source images very well. A new weight map construction process based on visual saliency is proposed. This process is able to integrate the visually significant information of source images into the fused image. In contrast to most of the multi-scale image fusion techniques, proposed technique uses only two-scale image decomposition. So it is fast and efficient. Our method is tested on several image pairs and is evaluated qualitatively by visual inspection and quantitatively using objective fusion metrics. Outcomes of the proposed method are compared with the state-of-art multi-scale fusion techniques. Results reveal that the proposed method performance is comparable or superior to the existing methods.     

刀锋伪影校正技术在精神疾病患者海马MRI检查中的应用

为探讨磁共振刀锋伪影校正（BLADE）技术提升精神疾病患者海马磁共振图像质量的效果，本文分别使用结合了BLADE技术的BLADE T₂WI TSE、BLADE T₂WI FLAIR及传统T₂WI TSE、T₂WI FLAIR四种序列，对47例精神疾病患者和美国放射学院（ACR）标准模体在3.0 T磁共振成像（MRI）设备上分别进行常规海马斜冠状位扫描和ACR标准检测.患者的磁共振图像由2名放射科医师采用5分法对运动伪影、搏动伪影、颗粒度、海马磁共振图像质量进行评价，并应用Wilcoxon符号秩检验进行数据分析.模体图像通过识别图像的钻孔阵列和轮辐的数目，半定量评价各序列的高对比空间分辨力（HCSR）和低对比物体探测能力（LCD）.结果表明相比传统序列，结合BLADE技术的序列能够明显改善海马磁共振图像的运动伪影、搏动伪影（p<0.001），提高图像质量（p<0.05）；但在图像颗粒度方面，传统序列表现更优（p<0.001）.ACR模体半定量分析显示，结合BLADE技术序列与传统序列相比，在LCD检测方面结果更优、在HCSR检测方面结果相同或略逊.本文推荐将BLADE技术应用于不合作的精神疾病患者海马的MRI检查.     

A new class of conformable spectral observers for signal reconstruction

In this work, the design of spectral observers for signal reconstruction based on Kalman filters is performed and evaluated. The conformable derivative and the beta‐derivative were used to design the Kalman filters. Both derivatives satisfy the same formulas of the classical derivation, eg, the chain rule. The derivative order, the Ricatti equation parameters, and the observers tuning parameters were optimized using an optimization algorithm based on the bat's echolocation behavior (Bat algorithm). The simulation results showed the advantages of using the proposed observers for the signal reconstruction.