Demosaicking for multispectral images based on vectorial total variation

Multispectral images (MSIs), which consist of more color components than RGB images, can be used in the field of vegetation analysis and medical imaging. A capturing system with multispectral filter array (MSFA) technology has been researched to shorten the capturing time and reduce the cost. In this system, the mosaicked image captured by the MSFA is demosaicked to reconstruct the MSI. We propose a demosaicking method using vectorial total variation (VTV) regularization for an MSI. This process is regarded as inverse problem of the image observation model. The reconstructed image is estimated by minimizing the VTV as a regularization term under the constraint condition. In the experimental results, the reconstructed image quality obtained using the proposed method is better than that of the conventional approaches in terms of both peak signal-to-noise ratio and structural similarity.     

基于梯度的医学图像伪彩色编码

根据医学图像的特点和人的视觉特性,提出了一种基于梯度的非线性伪彩色编码新方法。利用梯度算子得到图像的梯度场,并确定阈值。根据梯度值与阈值的比较,大于阈值的是基于梯度值的编码方法,用红色编码;否则是基于灰度值的编码方法。通过定义的两个阈值界定范围,设计非线性的正弦函数来进行伪彩色编码。由于映射函数中的三个参数k_1,k_2和k_3,所以增加了算法的灵活性。通过实验比较,处理后的医学图像轮廓更清晰,层次感更强,能有效地突出病灶区,有利于医生的诊断。     

基于提升方案的多光谱遥感图像有损压缩算法

在分析多光谱遥感图像谱间和空间数据特点的基础上,提出了一种DPCM线性预测与基于提升方案的整数小波变换相结合的多光谱遥感图像有损压缩算法。在谱间采用DPCM预测去除谱间相关性;在谱内采用整数小波变换去除空间相关性,根据不同子带对目标识别的重要程度,选择不同的量化阈值和量化步长进行量化,并分别对各个子带量化后的数据和重要图表采用固定比特平面编码和游程编码,实现高效的多光谱遥感图像压缩。实验结果表明,该算法在一定的压缩比下,重构图像具有较高的峰值信噪比,并且算法硬件实现简单,对内存的需求低。     

基于小波框架的红外/可见光图像融合

针对小波框架所具有的冗余性和平移不变性在图像处理中能较好保留图像细节特征的特点,提出了一种将l2上的离散小波框架和交叉子带像素融合方案(Cross band pixel selection)结合起来的融合算法,并用于红外和可见光图像的融合。仿真试验表明该算法较好地保留了源图像的细节信息,是一种行之有效的融合算法。     

基于重复编码的海上可见光通信大气信道建模

可见光通信作为一种新型无线通信技术,在海上舰船场景中的应用吸引了广泛的关注.海上可见光通信系统受多种因素的影响,包括海浪随机起伏和大气湍流,大气湍流将导致可见光信号的强度随机波动,降低可见光通信系统在大气中的链路质量.本文基于对数正态衰减分布,建立了采用重复编码的海上可见光通信的链路评估模型.在此基础上,根据Pierson-Moskowitz海谱,分析了海上风速、大气折射率结构常数、能见度、重复编码分集度以及接收器孔径对可见光通信系统平均误码率的影响.本文提出的海上大气链路评估模型可为海上可见光通信网络的搭建提供重要参考.     

有限离散剪切波域的红外可见光图像融合

针对目前图像融合过程中的不足之处,结合有限离散剪切波具有高的方向敏感性和抛物尺度化特性,提出了一种有限离散剪切波变换下的图像融合算法。首先对严格配准的多传感器图像进行有限离散剪切波变换,得到低频子带系数和不同尺度不同方向的高频子带系数;然后对低频子带系数采用全局特征值和像素点之间的差异性与区域空间频率匹配度相结合的融合算法,高频方向子带系数采用方向权重对比度与相对区域平均梯度和相对区域方差相结合的方案;最后通过有限离散剪切波逆变换得到融合图像。实验结果表明,与其他的融合算法相比较,本文算法不但有良好的主观视觉效果,而且3幅图像的客观评价指标分别平均提高了0.9%、3.8%、3.1%,2.6%、3.8%、2.9%和1.5%、125%、59%,充分说明了本文融合算法的优越性。     

Optimization of tissue segmentation of brain MR images based on multispectral 3D feature maps

The purpose of this work was to optimize and increase the accuracy of tissue segmentation of the brain magnetic resonance (MR) images based on multispectral 3D feature maps. We used three sets of MR images as input to the in-house developed semi-automated 3D tissue segmentation algorithm: proton density (PD) and T2-weighted fast spin echo and, T1-weighted spin echo. First, to eliminate the random noise, non-linear anisotropic diffusion type filtering was applied to all the images. Second, to reduce the nonuniformity of the images, we devised and applied a correction algorithm based on uniform phantoms. Following these steps, the qualified observer "seeded" (identified training points) the tissue of interest. To reduce the operator dependent errors, cluster optimization was also used; this clustering algorithm identifies the densest clusters pertaining to the tissues. Finally, the images were segmented using k-NN (k-Nearest Neighborhood) algorithm and a stack of color-coded segmented images were created along with the connectivity algorithm to generate the entire surface of the brain. The application of pre-processing optimization steps substantially improved the 3D tissue segmentation methodology.     

一种基于Canny边缘的红外与可见光图像配准算法

针对异源传感器在图像配准时如何精确地找到相应的匹配特征问题,结合红外图像与可见光图像的特征,利用2种传感器对同一场景成像时具有一定的边缘轮廓相似特性,提出了提取图像的Canny边缘,在边缘轮廓上根据边缘曲线上像素点的位置夹角的相似性寻找对应匹配点,通过仿真和实验数据与真实值的比较验证算法的有效性和配准的精度.     

Automated classification of multispectral MR images using unsupervised constrained energy minimization based on fuzzy logic

Constrained energy minimization (CEM) has proven highly effective for hyperspectral (or multispectral) target detection and classification. It requires a complete knowledge of the desired target signature in images. This work presents “Unsupervised CEM (UCEM),” a novel approach to automatically target detection and classification in multispectral magnetic resonance (MR) images. The UCEM involves two processes, namely, target generation process (TGP) and CEM. The TGP is a fuzzy-set process that generates a set of potential targets from unknown information and then applies these targets to be desired targets in CEM. Finally, two sets of images, namely, computer-generated phantom images and real MR images, are used in the experiments to evaluate the effectiveness of UCEM. Experimental results demonstrate that UCEM segments a multispectral MR image much more effectively than either Functional MRI of the Brain's (FMRIB's) automated segmentation tool or fuzzy C-means does.     

基于红外和可见光图像逐级自适应融合的场景深度估计

从图像中恢复场景的深度是计算机视觉领域中的一个关键问题。考虑到单一类型图像在深度估计中受场景不同光照的限制,提出了基于红外和可见光图像逐级自适应融合的场景深度估计方法（PF-CNN）。该方法包括双流滤波器部分耦合网络、自适应多模态特征融合网络以及自适应逐级特征融合网络。在双流卷积中红外和可见光图像的滤波器部分耦合使两者特征得到增强;自适应多模态特征融合网络学习红外和可见光图像的残差特征并将两者自适应加权融合,充分利用两者的互补信息;逐级特征融合网络学习多层融合特征的结合,充分利用不同卷积层的不同特征。实验结果表明:PF-CNN在测试集上获得了较好的效果,将阈值指标提高了5%,明显优于其他方法。     

A blind dual color images watermarking based on IWT and state coding

In this paper, a state-coding based blind watermarking algorithm is proposed to embed color image watermark to color host image. The technique of state coding, which makes the state code of data set be equal to the hiding watermark information, is introduced in this paper. When embedding watermark, using Integer Wavelet Transform (IWT) and the rules of state coding, these components, R, G and B, of color image watermark are embedded to these components, Y, Cr and Cb, of color host image. Moreover, the rules of state coding are also used to extract watermark from the watermarked image without resorting to the original watermark or original host image. Experimental results show that the proposed watermarking algorithm cannot only meet the demand on invisibility and robustness of the watermark, but also have well performance compared with other proposed methods considered in this work.     

An improved fusion algorithm for infrared and visible images based on multi-scale transform

In this paper, an improved fusion algorithm for infrared and visible images based on multi-scale transform is proposed. First of all, Morphology-Hat transform is used for an infrared image and a visible image separately. Then two images were decomposed into high-frequency and low-frequency images by contourlet transform (CT). The fusion strategy of high-frequency images is based on mean gradient and the fusion strategy of low-frequency images is based on Principal Component Analysis (PCA). Finally, the final fused image is obtained by using the inverse contourlet transform (ICT). The experiments and results demonstrate that the proposed method can significantly improve image fusion performance, accomplish notable target information and high contrast and preserve rich details information at the same time.     

Classification of visible and infrared hyperspectral images based on image segmentation and edge-preserving filtering

The classification of hyperspectral images with a few labeled samples is a major challenge which is difficult to meet unless some spatial characteristics can be exploited. In this study, we proposed a novel spectral-spatial hyperspectral image classification method that exploited spatial autocorrelation of hyperspectral images. First, image segmentation is performed on the hyperspectral image to assign each pixel to a homogeneous region. Second, the visible and infrared bands of hyperspectral image are partitioned into multiple subsets of adjacent bands, and each subset is merged into one band. Recursive edge-preserving filtering is performed on each merged band which utilizes the spectral information of neighborhood pixels. Third, the resulting spectral and spatial feature band set is classified using the SVM classifier. Finally, bilateral filtering is performed to remove “salt-and-pepper” noise in the classification result. To preserve the spatial structure of hyperspectral image, edge-preserving filtering is applied independently before and after the classification process. Experimental results on different hyperspectral images prove that the proposed spectral-spatial classification approach is robust and offers more classification accuracy than state-of-the-art methods when the number of labeled samples is small.     

红外和彩色可见光图像亮度-对比度传递融合算法

以红外和彩色可见光图像为研究对象,提出了一种基于亮度-对比度传递（LCT）技术的彩色图像融合算法。首先借助灰度融合方法将红外图像与彩色可见光图像亮度分量融合,然后用LCT技术改善灰度融合结果的亮度和对比度,最后利用快速YCBCR变换融合策略在RGB空间内直接生成彩色融合图像。文中利用像素平均融合法和多分辨率融合法作为不同的灰度融合措施以分别满足高实时性和高融合质量的需求。实验结果表明,提出算法的融合结果不仅具有与输入彩色可见光图像相近的自然色彩,而且具备令人满意的亮度和对比度,即使采用运算简单的像素平均法进行灰度融合,同样可以获得良好的融合效果。     

A fusion method for visible and infrared images based on contrast pyramid with teaching learning based optimization

This paper proposes a novel image fusion scheme based on contrast pyramid (CP) with teaching learning based optimization (TLBO) for visible and infrared images under different spectrum of complicated scene. Firstly, CP decomposition is employed into every level of each original image. Then, we introduce TLBO to optimizing fusion coefficients, which will be changed under teaching phase and learner phase of TLBO, so that the weighted coefficients can be automatically adjusted according to fitness function, namely the evaluation standards of image quality. At last, obtain fusion results by the inverse transformation of CP. Compared with existing methods, experimental results show that our method is effective and the fused images are more suitable for further human visual or machine perception.     

The infrared and visible image fusion algorithm based on target separation and sparse representation

Although the fused image of the infrared and visible image takes advantage of their complementary, the artifact of infrared targets and vague edges seriously interfere the fusion effect. To solve these problems, a fusion method based on infrared target extraction and sparse representation is proposed. Firstly, the infrared target is detected and separated from the background rely on the regional statistical properties. Secondly, DENCLUE (the kernel density estimation clustering method) is used to classify the source images into the target region and the background region, and the infrared target region is accurately located in the infrared image. Then the background regions of the source images are trained by Kernel Singular Value Decomposition (KSVD) dictionary to get their sparse representation, the details information is retained and the background noise is suppressed. Finally, fusion rules are built to select the fusion coefficients of two regions and coefficients are reconstructed to get the fused image. The fused image based on the proposed method not only contains a clear outline of the infrared target, but also has rich detail information.     

An operative quantitative analysis of multispectral images of the eyeground

In the approximation of a four-layer model of the eyeground, we have studied the information content of photographs of the eyeground obtained in different spectral intervals from the visible range of the spectrum. We have shown that, under conditions of a priori uncertainty of all parameters of the eyeground that affect spectral fluxes of light multiply scattered by the eyeground, the two-dimensional distributions of the following parameters can be determined: (i) the contents of hemoglobin and macular pigment in the retina; (ii) the contents of melanin in the pigment epithelium and choroid; (iii) the degree of blood oxygenation; and (iv) the structural parameter of the retina, which characterizes the volume concentration of its effective scatterers. Based on results of a numerical simulation of the light-transfer process in the medium under study, we have determined regression relationships between parameters of the eyeground and spectral characteristics of its image and have proposed a method for the operative retrieval of parameter maps of the eyeground, which uses the determined regressions.     

An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing

A novel nonsubsampled contourlet transform (NSCT) based image fusion approach, implementing an adaptive-Gaussian (AG) fuzzy membership method, compressed sensing (CS) technique, total variation (TV) based gradient descent reconstruction algorithm, is proposed for the fusion computation of infrared and visible images.Compared with wavelet, contourlet, or any other multi-resolution analysis method, NSCT has many evident advantages, such as multi-scale, multi-direction, and translation invariance. As is known, a fuzzy set is characterized by its membership function (MF), while the commonly known Gaussian fuzzy membership degree can be introduced to establish an adaptive control of the fusion processing. The compressed sensing technique can sparsely sample the image information in a certain sampling rate, and the sparse signal can be recovered by solving a convex problem employing gradient descent based iterative algorithm(s).In the proposed fusion process, the pre-enhanced infrared image and the visible image are decomposed into low-frequency subbands and high-frequency subbands, respectively, via the NSCT method as a first step. The low-frequency coefficients are fused using the adaptive regional average energy rule; the highest-frequency coefficients are fused using the maximum absolute selection rule; the other high-frequency coefficients are sparsely sampled, fused using the adaptive-Gaussian regional standard deviation rule, and then recovered by employing the total variation based gradient descent recovery algorithm.Experimental results and human visual perception illustrate the effectiveness and advantages of the proposed fusion approach. The efficiency and robustness are also analyzed and discussed through different evaluation methods, such as the standard deviation, Shannon entropy, root-mean-square error, mutual information and edge-based similarity index.