Left ventricle segmentation via two-layer level sets with circular shape constraint

This paper proposes a circular shape constraint and a novel two-layer level set method for the segmentation of the left ventricle (LV) from short-axis magnetic resonance images without training any shape models. Since the shape of LV throughout the apex-base axis is close to a ring shape, we propose a circle fitting term in the level set framework to detect the endocardium. The circle fitting term imposes a penalty on the evolving contour from its fitting circle, and thereby handles quite well with issues in LV segmentation, especially the presence of outflow track in basal slices and the intensity overlap between TPM and the myocardium. To extract the whole myocardium, the circle fitting term is incorporated into two-layer level set method. The endocardium and epicardium are respectively represented by two specified level contours of the level set function, which are evolved by an edge-based and a region-based active contour model. The proposed method has been quantitatively validated on the public data set from MICCAI 2009 challenge on the LV segmentation. Experimental results and comparisons with state-of-the-art demonstrate the accuracy and robustness of our method.     

Convexity preserving level set for left ventricle segmentation

In clinical applications of cardiac left ventricle (LV) segmentation, the segmented LV is desired to include the cavity, trabeculae, and papillary muscles, which form a convex shape. However, the intensities of trabeculae and papillary muscles are similar to myocardium. Consequently, segmentation algorithms may easily misclassify trabeculae and papillary muscles as myocardium. In this paper, we propose a level set method with a convexity preserving mechanism to ensure the convexity of the segmented LV. In the proposed level set method, the curvature of the level set contours is used to control their convexity, such that the level set contour is finally deformed as a convex shape. The experimental results and the comparison with other level set methods show the advantage of our method in terms of segmentation accuracy. Compared with the state-of-the-art methods using deep-learning, our method is able to achieve comparable segmentation accuracy without the need for training, while the deep-learning based method requires a large set of training data and high-quality manual segmentation. Therefore, our method can be conveniently used in situation where training data and their manual segmentation are not available.     

Dynamic pixel-wise weighting-based fully convolutional neural networks for left ventricle segmentation in short-axis MRI

Left ventricle (LV) segmentation in cardiac MRI is an essential procedure for quantitative diagnosis of various cardiovascular diseases. In this paper, we present a novel fully automatic left ventricle segmentation approach based on convolutional neural networks. The proposed network fully takes advantages of the hierarchical architecture and integrate the multi-scale feature together for segmenting the myocardial region of LV. Moreover, we put forward a dynamic pixel-wise weighting strategy, which can dynamically adjust the weight of each pixel according to the segmentation accuracy of upper layer and force the pixel classifier to take more attention on the misclassified ones. By this way, the LV segmentation performance of our method can be improved a lot especially for the apical and basal slices in cine MR images. The experiments on the CAP database demonstrate that our method achieves a substantial improvement compared with other well-know deep learning methods. Beside these, we discussed two major limitations in convolutional neural networks-based semantic segmentation methods for LV segmentation.     

分组全连接的近红外光谱定量分析网络

全连接网络作为深度学习中的一种典型结构,几乎在所有神经网络模型中均有出现。在近红外光谱定量分析中,光谱数据样本数量较少,但每个样本的维度高。导致了两个问题：将光谱直接输入网络,网络的参数量会十分庞大,训练模型需要更多的样本,否则模型容易进入过拟合状态;在输入网络前对光谱进行降维,虽解决了网络参数量过大的问题,但会丢失一部分信息,无法充分发挥网络的学习能力。针对近红外光谱的特性,提出了一种分组全连接的近红外光谱定量分析网络GFCN。该网络在传统的两层全连接网络的基础上,用若干个小的全连接层替代第一个全连接层,克服了直接输入光谱导致网络参数量过大的缺点。采用Tecator和IDRC2018数据集对该方法进行测试,同时与全连接网络FCN和偏最小二乘PLS两种方法进行对比。结果显示：在两个数据集上,GFCN预测效果均优于FCN和PLS。在只有少量样本参与建模的情况下,GFCN依然能够保持较高的预测效果。表明,GFCN可以用于近红外光谱的定量分析,并且适应样本较少的场景,具有重要的研究价值和广泛的应用场景。     

基于U-net和可见光谱图像的黄瓜褐斑病分割

褐斑病是黄瓜主要真菌性病害之一,适宜条件下,特别是在昼夜温差大及饱和湿度条件下发病迅速,病情加重,导致黄瓜减产,造成经济损失。对黄瓜褐斑病进行病斑分割与提取,可以为后续的病害识别与诊断提供有效依据,具有重要意义。结合黄瓜褐斑病可见光谱图像,利用U-net深度学习网络构建黄瓜褐斑病语义分割模型,实现了病斑分割。首先在采集到的黄瓜褐斑病可见光谱图像中截取病斑较为突出的区域作为样本,共在40幅图像中截取到135个像素区域,区域的像素分辨率为200×200,利用Matlab的Image Labeler工具对样本进行像素标记,分别标记出感病区域和健康区域。然后构建U-net网络,该网络包含46层和48个连接,通过卷积层和线性整流层以及最大池化法来完成病斑特征提取,通过深度连接层以及上卷积层和上线性整流层完成上采样,通过跳层连接来完成复制和剪裁操作,并进行病斑特征融合。利用所构建的U-net网络进行学习训练得到语义分割模型,在135个样本中,随机选取其中96个作为训练样本,剩余的39个作为测试样本,设置迭代次数为240次,L2正则化系数为0.000 1,初始学习率为0.05,动量参数为0.9,梯度阈值为0.05,进行样本训练和测试。经过10次重复训练和测试,结果表明,基于U-net和可见光谱图像的黄瓜褐斑病语义分割模型执行时间平均为46.4 s,内存占用平均为6 665.8 MB,执行效率较高;模型准确率PA为96.23%~97.98%,MPA为97.28%~97.87%,MIoU为86.10%~91.59%,FWIoU为93.33%~96.19%,模型的稳定性较好、泛化能力较强。该研究方法利用较少的训练样本,获得了准确率较高的分割模型,为小样本机器学习提供了参考,同时为其他蔬菜的病斑分割、病害识别与诊断提供了方法依据。     

Hybrid segmentation of left ventricle in cardiac MRI using gaussian-mixture model and region restricted dynamic programming

Segmentation of the left ventricle from cardiac magnetic resonance images (MRI) is very important to quantitatively analyze global and regional cardiac function. The aim of this study is to develop a novel and robust algorithm which can improve the accuracy of automatic left ventricle segmentation on short-axis cardiac MRI. The database used in this study consists of three data sets obtained from the Sunnybrook Health Sciences Centre. Each data set contains 15 cases (4 ischemic heart failures, 4 non-ischemic heart failures, 4 left ventricle (LV) hypertrophies and 3 normal cases). Three key techniques are developed in this segmentation algorithm: (1) ray scanning approach is designed for segmentation of images with left ventricular outflow tract (LVOT), (2) a region restricted technique is employed for epicardial contour extraction, and (3) an edge map with non-maxima gradient suppression approach is put forward to improve the dynamic programming to derive the epicardial boundary. The validation experiments were performed on a pool of data sets of 45 cases. For both endo- and epi-cardial contours of our results, percentage of good contours is about 91%, the average perpendicular distance is about 2 mm. The overlapping dice metric is about 0.92. The regression and determination coefficient between the experts and our proposed method on the ejection fraction (EF) is 1.01 and 0.9375, respectively; they are 0.9 and 0.8245 for LV mass. The proposed segmentation method shows the better performance and is very promising in improving the accuracy of computer-aided diagnosis systems in cardiovascular diseases.     

Reduced field-of-view DTI segmentation of cervical spine tissue

The number of diffusion tensor imaging (DTI) studies regarding the human spine has considerably increased and it is challenging because of the spine’s small size and artifacts associated with the most commonly used clinical imaging method. A novel segmentation method based on the reduced field-of-view (rFOV) DTI dataset is presented in cervical spinal canal cerebrospinal fluid, spinal cord grey matter and white matter classification in both healthy volunteers and patients with neuromyelitis optica (NMO) and multiple sclerosis (MS). Due to each channel based on high resolution rFOV DTI images providing complementary information on spinal tissue segmentation, we want to choose a different contribution map from multiple channel images. Via principal component analysis (PCA) and a hybrid diffusion filter with a continuous switch applied on fourteen channel features, eigen maps can be obtained and used for tissue segmentation based on the Bayesian discrimination method. Relative to segmentation by a pair of expert readers, all of the automated segmentation results in the experiment fall in the good segmentation area and performed well, giving an average segmentation accuracy of about 0.852 for cervical spinal cord grey matter in terms of volume overlap. Furthermore, this has important applications in defining more accurate human spinal cord tissue maps when fusing structural data with diffusion data. rFOV DTI and the proposed automatic segmentation outperform traditional manual segmentation methods in classifying MR cervical spinal images and might be potentially helpful for detecting cervical spine diseases in NMO and MS.     

Brain MRI lesion volume measurement reproducibility is not dependent on the disease burden in patients with multiple sclerosis

We evaluated the potential effect of the lesion burden on the reproducibility of repeated lesion volume (LV) measurements from brain magnetic resonance imaging (MRI) scans of patients with multiple sclerosis (MS). Dual-echo, conventional spin echo brain MRI scans were obtained from 107 patients with MS. On proton density-weighted images, LV was assessed three times by the same raters, using a semi-automated, local thresholding technique for lesion segmentation. Mean LV (MLV) was 16.1 mL (range = 0.7–57.3 mL). The mean intra-observer coefficient of variation (COV) for the three measurement replicates was 2.6% (range = 0.2–7.2%). The intra-observer measurement variance (Var) increased with MLV and the fitted model was Var = 0.00187 MLV^1.84. This indicates that LV measurements can be considered as measures whose variances are proportional to the square of their mean values, i.e., these measures have constant COV. Using a semi-automated, local thresholding segmentation technique, the reproducibility of LV measurements from brain MRI scans of patients with MS is not significantly influenced by varying lesion burdens.     

Supervised Domain Adaptation for Automated Semantic Segmentation of the Atrial Cavity

Atrial fibrillation (AF) is the most common cardiac arrhythmia. At present, cardiac ablation is the main treatment procedure for AF. To guide and plan this procedure, it is essential for clinicians to obtain patient-specific 3D geometrical models of the atria. For this, there is an interest in automatic image segmentation algorithms, such as deep learning (DL) methods, as opposed to manual segmentation, an error-prone and time-consuming method. However, to optimize DL algorithms, many annotated examples are required, increasing acquisition costs. The aim of this work is to develop automatic and high-performance computational models for left and right atrium (LA and RA) segmentation from a few labelled MRI volumetric images with a 3D Dual U-Net algorithm. For this, a supervised domain adaptation (SDA) method is introduced to infer knowledge from late gadolinium enhanced (LGE) MRI volumetric training samples (80 LA annotated samples) to a network trained with balanced steady-state free precession (bSSFP) MR images of limited number of annotations (19 RA and LA annotated samples). The resulting knowledge-transferred model SDA outperformed the same network trained from scratch in both RA (Dice equals 0.9160) and LA (Dice equals 0.8813) segmentation tasks.     

基于Dense-UNet++的关节滑膜磁共振图像分割

为解决以往基于深度学习的滑膜磁共振图像分割模型存在的分割精度较低、鲁棒性较差、训练耗时等问题,本文提出了一种基于Dense-UNet++网络的新模型,将DenseNet模块插入UNet++网络中,并使用Swish激活函数进行训练．利用1 036张滑膜磁共振图像数据增广后的14 512张滑膜图像对模型进行训练,并利用68张图像进行测试．结果显示,模型的平均DSC系数为0.819 9,交叉联合度量（IOU）为0.927 9．相较于UNet、ResUNet和VGG-UNet++网络结构,DSC系数和IOU均有提升,DSC振荡系数降低．另外在应用于相同滑膜图像数据集和使用相同的网络结构时,Swish函数相比ReLu函数有助于提升分割精度．实验结果表明,本文提出的算法对于滑膜磁共振图像的病灶区域的分割有较好的效果,能够辅助医生对病情做出判断．     

3D卷积自动编码网络的高光谱异常检测

高光谱图像包含丰富的地物光谱信息,在遥感图像领域有着巨大的发展前景.高光谱图像异常检测无需任何先验光谱信息,便可检测出图像中的异常目标.因此,在国防军事和民用领域都有广泛的应用,是现阶段高光谱图像处理领域的研究热点.然而,高光谱图像存在数据复杂、冗余性强、未标记以及样本数量少等特点,这给高光谱图像异常检测带来了很大的挑...     

A Crop Image Segmentation and Extraction Algorithm Based on Mask RCNN

The wide variety of crops in the image of agricultural products and the confusion with the surrounding environment information makes it difficult for traditional methods to extract crops accurately and efficiently. In this paper, an automatic extraction algorithm is proposed for crop images based on Mask RCNN. First, the Fruits 360 Dataset label is set with Labelme. Then, the Fruits 360 Dataset is preprocessed. Next, the data are divided into a training set and a test set. Additionally, an improved Mask RCNN network model structure is established using the PyTorch 1.8.1 deep learning framework, and path aggregation and features are added to the network design enhanced functions, optimized region extraction network, and feature pyramid network. The spatial information of the feature map is saved by the bilinear interpolation method in ROIAlign. Finally, the edge accuracy of the segmentation mask is further improved by adding a micro-fully connected layer to the mask branch of the ROI output, employing the Sobel operator to predict the target edge, and adding the edge loss to the loss function. Compared with FCN and Mask RCNN and other image extraction algorithms, the experimental results demonstrate that the improved Mask RCNN algorithm proposed in this paper is better in the precision, Recall, Average precision, Mean Average Precision, and F1 scores of crop image extraction results.     

基于级联神经网络的实用型三维复合不变性多目标识别

以三 飞机模型作为待识别目标,模型真实场景,对用于多目标分类识别的级联神经网络重新进行了研究。实验发现畜产品上降的主要原因是实际采集的目标发生的复杂畸变与计算机模拟产生的效果并不一样。用采集得到的目标图像作为训练样本,对网络重新构造和训练,取得了好的实验结果。分析了其中涉及到目标定位、图像分割等图像预处理问题,提出了一种基于二值图像开矿学腐蚀运算的快速目标检测位法,可快速有效地对目标进行检测定 。     

Cellular neural networks for welding arc thermograms segmentation

Machine vision systems are used in many areas for monitoring of technological processes. Among this processes welding takes important place, where often infrared cameras are used. Besides reliable hardware, successful application of vision systems requires suitable software based on proper algorithms. One of most important group of image processing algorithms is connected to image segmentation. Obtainment of exact boundary of an object that changes shape in time, such as the welding arc, represented on a thermogram is not a trivial task. In the paper a segmentation method using supervised approach based on a cellular neural networks is presented. Simulated annealing and genetic algorithm were used for training of the network (template optimization). Comparison of proposed method to a well elaborated segmentation method based on region growing approach was made. Obtained results prove that the cellular neural network can be a valuable tool for infrared welding pool images segmentation.     

面向心音分割的个性化高斯混合建模方法

准确的心音分割是分析和处理心音信号的基本前提。主流的心音分割算法采用监督式预先训练的方法构建统计模型,它不仅依赖于繁琐的手工标注,还存在模型与被分割数据之间的不匹配问题。提出了一种面向心音分割的个性化高斯混合建模方法,避免了手工标注和预先训练,而且在线训练获得的个性化模型能够高度匹配被分割的心音数据。由于心音信号的周期在一段短时间内很稳定,因此假设在包含若干心动周期的分析窗内,心音信号具有稳定的周期性,通过主成分分析提取本征心动周期信号,通过无监督学习构建个性化的统计模型,根据模型实现窗内每一心动周期的分割。实验表明,算法的平均分割准确率比主流的LRHSMM算法高3%。     

TERFDA: Tensor Embedding RF Domain Adaptation for varying noise interference

Radio frequency machine learning (RFML) can be loosely termed as a field that machine learning (ML) and deep learning (DL) techniques to applications related to wireless communications. However, traditional RFML basically assume that the data of training set and test set are independent and identically distributed and only a large number of labeled data can train a classification model which can effectively classify test set data. In other words, without enough training samples, it is impossible to learn an automatic modulation classifier that performs well in varying noise interference environment. Feature-based transfer learning minimizes the distribution difference between historical modulated signal data and new data by learning similarity-maximizing feature spaces. Therefore, in this paper, Dynamic Distribution Adaptation (DDA) is adopted to address the above challenges. We propose a Tensor Embedding RF Domain Adaptation (TERFDA) approach, which learns the latent subspace of the tensors formed by the time–frequency maps of the signals, so that use the multi-dimensional domain information of the signals to jointly learn the shared feature subspace of the source domain and the target domain, then perform DDA in the shared subspace. The experimental results show that under the modulated signal data, compared with the state-of-the-art DA algorithm, TERFDA has less requirements on the number of samples and categories, and has superior performance for confrontation the varying noise interference between source domain and target domain.     

基于多尺度滤波和线检测算子的视网膜血管检测

视网膜血管分割在眼底图像分析中具有重要作用。结合多尺度Hessian矩阵滤波和线检测算子,提出了一种有效的血管检测方法。首先利用多尺度Hessian矩阵的特征值构建血管相似性函数,实现血管增强;然后采用改进的线检测算子,提取反映血管测度的特征;最后采用SVM实现血管检测。实验结果表明,该方法只需要较少的训练样本即可达到与其他方法相当的准确率,且在灵敏性上具有更好的性能。     

基于BP神经网络的数码相机特性化

由于数码相机的颜色空间是依赖于设备的,对于一个具体的数码相机,其光谱响应与设备独立的CIE标准观察者颜色匹配函数是一个非线性关系,因此不能真实复制场景的颜色。特性化彩色图像设备是提高图像的颜色复制质量的一个重要方法。介绍一种基于BP神经网络数码相机特性化方法。采用Munsell颜色系统作为目标色,大样本训练空间。测试了不同的网络结构和样本空间分布。训练样本平均色差为1.75CMC(1∶1)色差单位,测试样本为2.16。该方法在数码相机颜色测量、光谱重建等领域有广泛的应用前景。     

基于3D VNetTrans的膝关节滑膜磁共振图像自动分割

膝关节是类风湿性关节炎（Rheumatoid Arthritis,RA）常见累及关节,膝关节滑膜的精准分割对RA诊断和治疗有重要影响,本文提出了一种基于VNet网络的改进算法对膝关节滑膜磁共振图像进行自动分割．首先对39名滑膜炎患者的膝关节磁共振图像进行数据预处理,通过将Transformer编码器嵌入VNet网络底部的方式构建VNetTrans网络,使用MemSwish激活函数进行训练. 最终模型平均Dice系数为0.758 5,HD为24.6 mm;相较于VNet,Dice系数提升0.083 6,HD距离减少10 mm．实验结果表明,该算法可对膝关节磁共振图像中滑膜增生区域实现较好的3D分割,具有诊断和监测RA发展过程的应用价值．     

深度神经网络和高光谱显微图像的二维材料纳米片识别

近年来,二维材料由于其独特的性质而受到了广泛关注。在制备二维层状晶体的各种方法中,机械剥离法获得的薄层二维材料晶体质量高,适用于基础研究及性能演示。然而用机械剥离法从衬底上获得的材料具有一定的随机性,可能包含了少许相对较厚的部分。实现对这些二维薄层材料有效、快速且智能化的表征有利于促进二维材料性能的进一步研究。提出了一种基于深度学习的表征方法,通过搭建的编解码结构的卷积神经网络语义分割算法,可以根据光学显微镜图像进行分割和快速识别二维材料纳米片。卷积神经网络作为深度学习在图像处理领域中的典型算法,能够对光学显微镜图像中的复杂信息进行特征提取。首先采用机械剥离制备MoS₂纳米片样本,通过光学显微镜采集高光谱图像并对样本进行标记,根据样本的厚度范围标记出不同的区域,对标记后的图像进一步处理,包括图像的颜色校准和剪切操作,得到用于网络训练和测试的数据集。针对光学图像中二维纳米薄片存在的低对比度、碎裂等特点,编码时加入残差结构和金字塔池化模型,有助于特征信息的提取;解码时融合编码路径中提取的浅层特征信息,以提高网络分割精度。实验中采用带权重的交叉熵损失函数解决类别数量不平衡问题和采用数据增强扩大数据集。对训练后的网络测试结果表明,模型像素精度为97.38%,平均像素精度为90.38%,均交并比为75.86%。之后通过迁移学习成功地对剥离的单层和双层石墨烯纳米片样本进行了识别,均交并比达到了81.63%,表明该方法具有普适性。通过MoS₂和石墨烯纳米片的识别演示,实现了深度学习在二维材料的光学显微镜图像中的成功应用。该方法有望在更多的二维材料上得到扩展并突破自动动态处理光学显微镜图像的问题,同时为其他纳米材料的高光谱图像处理提供参考。