基于小波变换的不同融合规则的图像融合研究

提出了利用小波变换按照不同融合规则及融合算子去构造融合图像对应的小波系数,得到一种新的基于多尺度分解的像素的图像融合方法.通过对融合图像统计参数对比表明,所提出的基于小波变换的像素局部能量作为准则的融合效果更好,既可避免传统融合规则存在的信息损失,又提高了融合图像的空间分辨率和清晰度,融合图像符合人的视觉特性,更有利于机器视觉.     

基于亚像素区域加权能量特征的多尺度图像融合算法

对矩形和圆形区域中各像素进行亚像素划分,确定各亚像素的权值,得到基于哑像素的综合加权区域能量.融合箅法首先对源图像进行金字塔分解,然后对金字塔的高频细节分量使用基于哑像素加权区域能量特征的融合规则取大,对低频粗糙分量取平均.得到融合图像的塔形分解,最后重构融合图像.仿真结果表明,新算法融合效果较常规的区域能量特征作为融合规则的多分辨率图像融合算法效果更好,从清晰度和熵的评价来看,提高了融合图像的品质.     

改进的曲波变换图像融合方法

考虑将曲波变换引入图像融合能够更好地提取原始图像,对一种新的图像融合方法—曲波变换图像融合法进行了研究。将图像序列进行曲波变换后,通过对所有图像的高频进行逆变换及域值处理来获得区域图。根据区域图中高频区域的边界点在每张图层上的活跃度不同求得区域边界的图层分布,利用插值获得高频区域的区域分布图。通过高频区域的膨胀求得整幅图的区域分布图,然后在曲波变换的变换域,利用区域分布图对多尺度的高频系数采用高斯加权求和;对低频系数采用取平均值的规则完成图像的融合。进行了图像融合实验,实验结果表明,与传统的小波变换及基于像素的曲波变换相比,提出的方法获得的融合图像边缘更清晰,更接近参考图像。     

基于区域分割和Counterlet变换的图像融合算法

提出了一种基于区域分割和Contourlet变换的图像融合算法。首先,对各源图像做区域分割,并利用区域能量比和区域清晰比的概念来度量和提取区域信息;然后,对各源图像进行多尺度非子采样Contourlet分解,分解后的高频部分采用绝对值取大算子进行融合,低频部分则采用基于区域的融合规则和算子进行融合;最后进行重构得到融合图像。对红外与可见光图像进行了融合实验,并与基于像素的àtrous小波变换和Contourlet变换的融合效果进行了比较。结果表明,采用本文算法的融合图像既保留了可见光图像的光谱信息,又继承了红外图像的目标信息,其熵值高于基于像素的融合方法约10%,交叉熵仅为基于像素的融合方法的1%左右。     

卷积稀疏表示图像融合与超分辨率联合实现

为避免图像融合与超分辨率分步实现的不足,提出了基于卷积稀疏表示的融合与超分辨率重建联合实现方法。假设低分辨率与高分辨率图像之间具有相同的稀疏特征图,设计了一种高、低分辨率滤波器联合学习框架,实现对图像高低频成分的分离,并根据不同成分的形态特性设计了不同的融合规则:对于高频成分,根据稀疏特征图亮度信息和像素活跃性水平,设计了一种像素显著性度量方案来指导高频特征图的融合;对于低频成分,根据脉冲耦合神经网络能捕获邻域相似像素点火的特性,设计了低频成分融合方法。所提方法不需要将图像分割成重叠的块,避免块向量化的缺陷。实验结果表明,能有效提高图像融合的质量。     

基于嵌入式多尺度分解和可能性理论的多波段纹理图像融合

将多尺度变换和“高频取大、低频加权平均”融合规则相结合是融合双波段图像的有效方法。但用该类方法融合多波段图像时,序贯式加权常常会导致原图像间固有的差异信息在融合图像中被弱化,从而影响后续的目标识别和场景理解。该问题在融合具有纹理特征的多波段图像时更为突出。为此,提出了一个基于嵌入式多尺度分解和可能性理论的多波段纹理图像融合新方法。首先,利用一种多尺度变换方法把多波段原图像分别分解为高频和低频成分,并对多波段图像中标准差最大的一幅原图像的低频成分利用另一种多尺度方法进行分块,再以该分块图像的大小和位置为标准对其余波段的原图像进行分块。然后,基于可能性理论的相关融合规则逐一融合对应的多波段块图像,再把块融合图像进行拼接,以拼接结果作为低频融合图像。最后,将该低频融合图像和利用取大规则融合得到的高频成分一起通过多尺度逆变换获得最终的融合图像。这种方法不仅将像素级和特征级融合方法综合在一起, 而且将空间域和变换域技术综合在一起, 并通过对大小块采用不同融合规则解决了目标边缘的锯齿效应问题。实验表明该方法效果显著。     

图像融合方法在细胞图像处理中的应用

图像融合作为一项先进技术被引入到生物细胞图像处理中，可实现图像的信息融合，完成图像配准，提高图像置信度，改善检测性能和空间分辨能力，最大限度地发掘细胞图像的信息资源，本文采用像素级的图像融合方法，将细胞荧光图像和透射图像信息融为一体，操作简便，能准确地判断细胞内部荧光位置，有利于分析其生物机理和含义。     

光学图像与雷达图像的数据融合研究

利用可提取更多图像信息和细节的像素级数据融合方法实现光学图像和雷达图像的融合。试验表明，基于像素级的数据融合方法有效可行，生成的图像具有更好的图像质量和最小的均方误差。     

一种基于小波系数综合能量特征的多算子图像融合算法

提出了一种新的多算子小波分解图像融合算法,算法对输入图像进行多尺度小波分解,综合考虑同层各子带及相邻层子带小波系数图像特征描述的相关一致性,基于局部空间复合能量和局部相对能量差特征测度,采用多算子自适应融合规则构造融合图像,得到含有丰富细节特征的融合图像。     

一种基于区域的NSCT域多光谱与高分辨率图像融合算法

提出了一种基于多阈值分割和无下采样Contourlet变换(Nonsubsampled Contourlet Transform,NSCT)的多光谱与高分辨率图像融合算法.对多光谱图像进行多阈值分割,并利用提出的区域均值比指标将多光谱图像划分为需要进行空间细节增强及需要保持光谱特征的区域;然后利用NSCT对高分辨率图像和多光谱图像的强度分量进行多尺度、多方向分解.分解后的低频部分采用基于窗口邻域的融合规则和算子进行融合,高频部分按区域均值比指标进行区域融合;最后进行重构得到融合后的多光谱图像的强度分量,经IHS逆变换后得到高分辨率的多光谱图像.实验结果表明,该算法可获得较理想的融合图像,融合效果优于IHS变换法、基于像素的à trous小波变换法以及基于像素的NSCT法.     

The Multi-Focus-Image-Fusion Method Based on Convolutional Neural Network and Sparse Representation

Multi-focus-image-fusion is a crucial embranchment of image processing. Many methods have been developed from different perspectives to solve this problem. Among them, the sparse representation (SR)-based and convolutional neural network (CNN)-based fusion methods have been widely used. Fusing the source image patches, the SR-based model is essentially a local method with a nonlinear fusion rule. On the other hand, the direct mapping between the source images follows the decision map which is learned via CNN. The fusion is a global one with a linear fusion rule. Combining the advantages of the above two methods, a novel fusion method that applies CNN to assist SR is proposed for the purpose of gaining a fused image with more precise and abundant information. In the proposed method, source image patches were fused based on SR and the new weight obtained by CNN. Experimental results demonstrate that the proposed method clearly outperforms existing state-of-the-art methods in addition to SR and CNN in terms of both visual perception and objective evaluation metrics, and the computational complexity is greatly reduced. Experimental results demonstrate that the proposed method not only clearly outperforms the SR and CNN methods in terms of visual perception and objective evaluation indicators, but is also significantly better than other state-of-the-art methods since our computational complexity is greatly reduced.     

基于深度玻尔兹曼模型的红外与可见光图像融合

为了克服红外与可见光图像融合时噪声干扰及易产生伪影导致目标轮廓不鲜明、对比度低的缺点,提出一种基于深度模型分割的图像融合方法.首先,采用深度玻尔兹曼机学习红外与可见光的目标和背景轮廓先验,构建轮廓的深度分割模型,通过Split Bregman迭代算法获取最优能量分割后的红外与可见光图像轮廓;然后再使用非下采样轮廓波变换对源图像进行分解,并针对所分割的背景轮廓采用结构相似度的规则进行系数组合;最后进行非下采样轮廓波反变换重构出融合图像.数值试验证明,该算法可以有效获取目标和背景轮廓均清晰的融合图像,融合结果不但具有较高的对比度,还能抑制噪声影响,具有有效性.     

Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain

Multimodal medical image fusion aims to fuse images with complementary multisource information. In this paper, we propose a novel multimodal medical image fusion method using pulse coupled neural network (PCNN) and a weighted sum of eight-neighborhood-based modified Laplacian (WSEML) integrating guided image filtering (GIF) in non-subsampled contourlet transform (NSCT) domain. Firstly, the source images are decomposed by NSCT, several low- and high-frequency sub-bands are generated. Secondly, the PCNN-based fusion rule is used to process the low-frequency components, and the GIF-WSEML fusion model is used to process the high-frequency components. Finally, the fused image is obtained by integrating the fused low- and high-frequency sub-bands. The experimental results demonstrate that the proposed method can achieve better performance in terms of multimodal medical image fusion. The proposed algorithm also has obvious advantages in objective evaluation indexes VIFF, Q_W, API, SD, EN and time consumption.     

An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing

A novel nonsubsampled contourlet transform (NSCT) based image fusion approach, implementing an adaptive-Gaussian (AG) fuzzy membership method, compressed sensing (CS) technique, total variation (TV) based gradient descent reconstruction algorithm, is proposed for the fusion computation of infrared and visible images.Compared with wavelet, contourlet, or any other multi-resolution analysis method, NSCT has many evident advantages, such as multi-scale, multi-direction, and translation invariance. As is known, a fuzzy set is characterized by its membership function (MF), while the commonly known Gaussian fuzzy membership degree can be introduced to establish an adaptive control of the fusion processing. The compressed sensing technique can sparsely sample the image information in a certain sampling rate, and the sparse signal can be recovered by solving a convex problem employing gradient descent based iterative algorithm(s).In the proposed fusion process, the pre-enhanced infrared image and the visible image are decomposed into low-frequency subbands and high-frequency subbands, respectively, via the NSCT method as a first step. The low-frequency coefficients are fused using the adaptive regional average energy rule; the highest-frequency coefficients are fused using the maximum absolute selection rule; the other high-frequency coefficients are sparsely sampled, fused using the adaptive-Gaussian regional standard deviation rule, and then recovered by employing the total variation based gradient descent recovery algorithm.Experimental results and human visual perception illustrate the effectiveness and advantages of the proposed fusion approach. The efficiency and robustness are also analyzed and discussed through different evaluation methods, such as the standard deviation, Shannon entropy, root-mean-square error, mutual information and edge-based similarity index.     

基于Contourlet变换的区域特征自适应图像融合算法

Contourlet变换克服了小波变换在处理高维信号时的不足,比小波变换具有更好的方向性、较高的逼近精度和更好的稀疏表达性能.因此将Contourlet变换应用于图像融合领域,能更好的提取图像边缘特征,为融合提取更多的特征信息.基于Contourlet变换的区域特征自适应图像融合算法是将图像进行Contourlet变换分解后,针对不同的频率域特点选择不同的融合规则,针对高频系数特性选用了区域特征自适应的融合规则,最后通过重构得到融合图像.将基于小波变换的融合算法和本文所提算法进行了主观和客观的对比,结果表明,基于Contourlet变换区域特征自适应的图像融合算法是一种有效可行的图像融合算法.     

结合深度学习的非下采样剪切波遥感图像融合

遥感图像融合是指将不同传感器得到的具有不同观测特性的图像信息有选择、有策略地结合起来,以得到具有更优观测特性的新图像的方法。提出一种深度学习结合非下采样剪切波变换(NSST)的遥感图像融合算法,利用改进的超分辨率重建网络对多光谱图像(MS)进行空间分辨率增强,全色图像(PAN)参考重建后的多光谱图像的每个分量进行直方图匹配。将对应通道的图像进行NSST变换,分别得到低频子带和若干高频子带。低频子带通过使用基于梯度域的自适应加权平均规则来获得低频融合系数,高频子带采用局部空间频率最大值规则来获得高频融合系数,最后经逆NSST变换重构获得融合图像。对不同数据集中的City和Inland多光谱图像采用双三次插值方法进行上采样,作者提出算法的通用图像质量指数(UIQI)分别为0.988 6和0.932 1,光谱角映射(SAM)分别为1.872 1和2.143 2。实验结果表明,图像结构更加清晰,保存的光谱信息更加完整,融合图像质量优于对比算法,融合图像更利于人类视觉观察。     

基于小波概率估计的图像融合方法研究

在研究了已有的图像融合方法后,提出基于小波变换和最大似然概率估计(MLE)相综合的融合方法,利用概率估计融合模型,首先对不同的传感器图像进行小波分解,然后对相应的子带求解仿射变换参数,根据Bayes规则进行最大后验概率似然估计,得到估计子带系数,最后通过小波反变换得到融合图像.在仿射变换的假设条件下定义融合规则,更适合传感器图像具有局部相反对比度的情况,采用此方法对航空可见光图像和红外图像进行融合实验,其结果与采用其它方法进行了对比,表明该方法的有效性.     

Fusion of infrared-visible images using improved multi-scale top-hat transform and suitable fusion rules

Integration of infrared and visible images is an active and important topic in image understanding and interpretation. In this paper, a new fusion method is proposed based on the improved multi-scale center-surround top-hat transform, which can effectively extract the feature information and detail information of source images. Firstly, the multi-scale bright (dark) feature regions of infrared and visible images are respectively extracted at different scale levels by the improved multi-scale center-surround top-hat transform. Secondly, the feature regions at the same scale in both images are combined by multi-judgment contrast fusion rule, and the final feature images are obtained by simply adding all scales of feature images together. Then, a base image is calculated by performing Gaussian fuzzy logic combination rule on two smoothed source images. Finally, the fusion image is obtained by importing the extracted bright and dark feature images into the base image with a suitable strategy. Both objective assessment and subjective vision of the experimental results indicate that the proposed method is superior to current popular MST-based methods and morphology-based methods in the field of infrared-visible images fusion.