基于平移不变剪切波变换域图像融合算法

针对传统基于多尺度变换的图像融合方法存在的缺点,提出了一种基于平移不变剪切波变换域的自适应图像融合新方法.首先,使用平移不变剪切波变换对源图像进行分解,得到低频子带及方向带通子带系数.然后,对于低频子带系数采用梯度域奇异值分解方法估计图像的局部结构信息,提出了基于提取的特征与S函数的可变加权融合策略;对于各方向带通子带系数,提出了一种基于改进的拉普拉斯能量和匹配的"加权平均"和选择相结合的系数选择策略.最后,对得到的融合系数进行逆变换得到融合图像.通过实验可以发现相比于传统的图像融合方法,本文方法得到了更高的客观指标,融合图像视觉效果更好.     

Technique for gray-scale visual light and infrared image fusion based on non-subsampled shearlet transform

A novel image fusion technique based on NSST (non-subsampled shearlet transform) is presented, aiming at resolving the fusion problem of spatially gray-scale visual light and infrared images. NSST, as a new member of MGA (multi-scale geometric analysis) tools, possesses not only flexible direction features and optimal shift-invariance, but much better fusion performance and lower computational costs compared with several current popular MGA tools such as NSCT (non-subsampled contourlet transform). We specifically propose new rules for the fusion of low and high frequency sub-band coefficients of source images in the second step of the NSST-based image fusion algorithm. First, the source images are decomposed into different scales and directions using NSST. Then, the model of region average energy (RAE) is proposed and adopted to fuse the low frequency sub-band coefficients of the gray-scale visual light and infrared images. Third, the model of local directional contrast (LDC) is given and utilized to fuse the corresponding high frequency sub-band coefficients. Finally, the final fused image is obtained by using inverse NSST to all fused sub-images. In order to verify the effectiveness of the proposed technique, several current popular ones are compared over three different publicly available image sets using four evaluation metrics, and the experimental results demonstrate that the proposed technique performs better in both subjective and objective qualities.     

基于区域分维和非采样Contourlet变换的图像融合算法

针对源图像有用信息的提取,提出了基于区域分维和非下采样Contourlet变换相结合的红外与可见光图像融合算法.将图像的区域属性、区域大小、边缘强度以及纹理显著程度等特点用图像不同尺度上的区域分维进行描述,对于非下采样Contourlet变换低频系数,根据源图像不同尺度上的区域分维进行基于系数选择的融合.针对带通子带系数设计了系数局部匹配度算子,依据匹配度不同采用加权和系数选取相结合的融合规则.与其他常规融合方法进行比较,该算法可有效实现红外与可见光图像的融合.     

Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain

Multifocus image fusion aims at overcoming imaging cameras's finite depth of field by combining information from multiple images with the same scene. For the fusion problem of the multifocus image of the same scene, a novel algorithm is proposed based on multiscale products of the lifting stationary wavelet transform (LSWT) and the improved pulse coupled neural network (PCNN), where the linking strength of each neuron can be chosen adaptively. In order to select the coefficients of the fused image properly with the source multifocus images in a noisy environment, the selection principles of the low frequency subband coefficients and bandpass subband coefficients are discussed, respectively. For choosing the low frequency subband coefficients, a new sum modified-Laplacian (NSML) of the low frequency subband, which can effectively represent the salient features and sharp boundaries of the image in the LSWT domain, is an input to motivate the PCNN neurons; when choosing the high frequency subband coefficients, a novel local neighborhood sum of Laplacian of multiscale products is developed and taken as one type of feature of high frequency to motivate the PCNN neurons. The coefficients in the LSWT domain with large firing times are selected as coefficients of the fused image. Experimental results demonstrate that the proposed fusion approach outperforms the traditional discrete wavelet transform (DWT)-based, LSWT-based and LSWT-PCNN-based image fusion methods even though the source image is in a noisy environment in terms of both visual quality and objective evaluation.     

基于非抽样剪切波的加权区域图像融合

以提升遥感图像和多聚焦图像的融合精度为目的,结合非下采样剪切波变换（NSST）可以捕捉图像的细节特征,提出了一种NSST和加权区域特性的图像融合方法。利用非下采样剪切波变换对源图像进行多尺度、多方向分解,得到低频子带和高频子带,低频子带系数采用改进梯度投影的非负矩阵分解（NMF）,高频子带系数采用加权区域能量和区域方差相结合的融合策略,然后应用非下采样剪切波的逆变换得到融合的图像。实验结果表明:该方法从主观视觉方面很好地保留了多幅图像的有用信息,给出该方法与其他融合算法在客观评价指标应用信息熵EN、互信息MI和加权边缘信息量QAB/F的比较结果 。     

Technique for image fusion based on NSST domain INMF

A novel technique for image fusion based on non-subsampled shearlet transform (NSST) domain improved non-negative matrix factorization (INMF) is proposed. Firstly, NSST, which owns much lower computational complexity compared with other conventional typical multi-resolution tools, is adopted to perform the multi-scale and multi-directional decompositions of source images. Secondly, the traditional basic NMF model is updated to be an improved NMF (INMF). INMF is utilized to capture the marked characteristics in a series of sub-band components from the pure mathematical point of view and without destroying the two-dimensional structural information in the image. Thirdly, with INMF and the model of local directional contrast (LDC), the fused sub-images can be achieved. Finally, the final fused image can be obtained by using the inverse NSST. Experimental results demonstrate that the presented technique outperforms other typical NMF-based ones in both visual effect and objective evaluation criteria.     

一种基于非下采样Contourlet变换多聚焦图像融合算法

针对现有小波类图像融合算法的不足,提出了一种基于非下采样Contourlet变换多聚焦图像融合算法,并在Contourlet域中引入了局部区域可见度以及局部方向能量的概念.针对低频子带系数和各带通方向子带系数分别提出了基于局部区域可见度以及基于局部方向能量的系数选择方案.通过对多聚焦图像融合的仿真实验,表明该算法相对于传统的基于离散小波变换和离散小波框架变换融合算法能够有效减少有用信息的丢失以及虚假信息的引入,同时能够从源图像中提取更多的有用信息并注入到融合图像中, 得到更好视觉效果和更优量化指标的融合图像.     

基于可见光的多波段偏振图像融合新算法

采用了一种新的基于小波变换的偏振图像融合算法.首先,将两个波段中的每一波段三幅偏振图像利用小波变换分解成低频和高频部分,低频的小波系数平均值作为融合后的低频系数,高频细节系数根据不同区域特征选择方法以及对应输入图像小波系数的窗口区域方差来确定融合后高频小波系数,得到一个波段一幅图像.接着,将得到的图像再进行小波分解,采用低频图像的小波系数最小值作为融合后的低频系数,高频图像根据纹理一致性测度的纹理检测确定融合规则,用来调整高频小波系数,将来自不同图像的特征与细节融合在一起,并对融合图像质量进行了对比评价.实验结果表明,融合后的偏振图像不仅反映了场景的偏振信息,而且还包含了丰富的光谱信息,目标与背景的衬比度也得到了增强,为进一步的目标检测和识别提供了便利.     

结合深度学习的非下采样剪切波遥感图像融合

遥感图像融合是指将不同传感器得到的具有不同观测特性的图像信息有选择、有策略地结合起来,以得到具有更优观测特性的新图像的方法。提出一种深度学习结合非下采样剪切波变换(NSST)的遥感图像融合算法,利用改进的超分辨率重建网络对多光谱图像(MS)进行空间分辨率增强,全色图像(PAN)参考重建后的多光谱图像的每个分量进行直方图匹配。将对应通道的图像进行NSST变换,分别得到低频子带和若干高频子带。低频子带通过使用基于梯度域的自适应加权平均规则来获得低频融合系数,高频子带采用局部空间频率最大值规则来获得高频融合系数,最后经逆NSST变换重构获得融合图像。对不同数据集中的City和Inland多光谱图像采用双三次插值方法进行上采样,作者提出算法的通用图像质量指数(UIQI)分别为0.988 6和0.932 1,光谱角映射(SAM)分别为1.872 1和2.143 2。实验结果表明,图像结构更加清晰,保存的光谱信息更加完整,融合图像质量优于对比算法,融合图像更利于人类视觉观察。     

Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain

This paper presents a new multi-source image fusion scheme based on lifting stationary wavelet transform (LSWT) and a novel dual-channel pulse-coupled neural network (PCNN). By using LSWT, we can calculate a flexible multiscale and shift-invariant representation of registered images. After decomposing the original images using LSWT, a new dual-channel pulse coupled neural network, which can overcome some shortcomings of original PCNN for image fusion and putout the fusion image directly, is proposed and used for the fusion of sub-band coefficients of LSWT. In this fusion scheme, a new sum-modified-laplacian(NSML) of the low frequency sub-band image, which represent the edge-feature of the low frequency sub-band image in SLWT domain, is presented and input to motivate the dual-channel PCNN. For the fusion of high frequency sub-band coefficients, a novel local neighborhood modified-laplacian (LNML) measurement is developed and used as external stimulus to motivate the dual-channel PCNN. This fusion scheme is verified on several sets of multi-source images, and the experiments show that the algorithms proposed in the paper can significantly improve image fusion performance, compared with the fusion algorithms such as traditional wavelet, LSWT, and LSWT-PCNN in terms of objective criteria and visual appearance.     

基于非采样Contourlet变换的遥感图像融合算法

为了使融合后的多光谱图像在尽可能保持原始多光谱图像光谱特性的同时,显著提高空间分辨力,提出了一种基于非采样Contourlet变换(NSCT)的遥感图像融合算法。算法首先对全色波段图像进行非采样Contourlet变换,得到全色波段图像的低频子带系数和各带通方向子带系数;然后针对多光谱图像的每一个波段,将其进行双线性插值后作为融合后多光谱图像的低频子带系数,对全色波段图像的各带通方向子带系数采用基于成像系统物理特性的注入模型(调整系数)进行局部调整后,作为融合后多光谱图像的各带通方向子带系数,从而得到融合后多光谱图像的非采样Contourlet变换系数;最后再经非采样Contourlet逆变换得到该波段具有高空间分辨力的多光谱图像。采用IKONOS卫星遥感图像进行了仿真实验,实验结果表明,该算法在光谱保留和空间质量提高方面优于其它传统的遥感图像融合算法。     

Image fusion based on nonsubsampled contourlet transform for infrared and visible light image

In this paper, a new method based on nonsubsampled contourlet transform (NSCT) is proposed to fuse the infrared image and the visible light image, which will produce a new fused image by which the target can be identified more easily. Firstly, two original images were decomposed into low frequency subband coefficients and the bandpass direction subband coefficients by using NSCT. Secondly, the selection of the low frequency subband coefficient and the bandpass direction subband coefficient is discussed in detail. The low frequency subband coefficients are selected based on the regional visual characteristics. For the selection of bandpass direction subband coefficients, this paper proposes a minimum regional cross-gradient method, and the cross-gradient is gained by calculating the gradient between the pixel of bandpass subbands and the adjacent pixel in the fused image of the low-frequency components. Comparison experiments have been performed on different image sets, and experimental results demonstrate that the proposed method performs better in both subjective and objective qualities.     

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

The purpose of image fusion is to combine the source images of the same scene into a single composite image with more useful information and much better visual effects, which is undoubtedly suitable for further image processing tasks. This paper presented a novel fusion method for visible light and infrared images based on non-subsampled shearlet transform (NSST)–spatial frequency (SF)–pulse coupled neural network (PCNN). As a recently developed multi-resolution geometric analysis tool, NSST not only has remarked superiorities over other past conventional tools in terms of information capturing and computational costs saving, but also overcomes the lack of shift-invariance in shearlet transform (ST), so NSST applies to conducting the decompositions and reconstructions. Besides, traditional PCNN model is also upgraded to be an improved one called IPCNN in this paper to fuse the low-frequency and high-frequency subband coefficients. In the IPCNN structure, on the one hand, the value of the linking strength β is determined by the SF which represents the gradient features of the subband image; on the other hand, the time matrix is utilized to adaptively decide the iteration number of the IPCNN model, which is helpful to increase the function efficiency and save computational resources. Experimental results indicate that the proposed method performs well and has obvious superiorities over other current typical ones in both subjective visual performance and objective criteria.     

Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain

In this paper, an efficient multifocus image fusion approach is proposed based on local features contrast of multiscale products in nonsubsampled contourlet transform (NSCT) domain. In order to improve the robustness of the fusion algorithm to the noise and select the coefficients of the fused image properly, the multiscale products, which can distinguish edge structures from noise more effectively in NSCT domain, is developed and introduced into image fusion field. The selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail. To improve the quality of the fused image, novel different local features contrast measurements, which are proved to be more suitable for human vision system and can extract more useful detail information from source images and inject them into the fused image, are developed and used to select coefficients from the clear parts of subimages to compose coefficients of fused images. Experimental results demonstrate the proposed method performs very well in fusion both noisy and noise-free multifocus images, and outperform conventional methods in terms of both visual quality and objective evaluation criteria.     

A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain

This paper presents a multi-focus image fusion algorithm based on dual-channel PCNN in NSCT domain. The fusion algorithm based on multi-scale transform is likely to produce the pseudo-Gibbs effects and it is not effective to fuse the dim or partial bright images. To solve these problems, this algorithm will get a number of different frequency sub-image of the two images by using the NSCT transform, the selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail, and the images are fused based on the improved dual-channel PCNN in order to determine the band-pass sub-band coefficient, at last fused image is obtained by using the inverse NSCT transform. Fusion rules based on dual-channel PCNN are used to solve the complexity of the PCNN parameter settings and long computing time problems. The experimental results show that the algorithm has overcome the defects of the traditional multi-focus image fusion algorithm and improved the fusion effect.     

基于数学形态学的数字全息再现像融合方法

针对数字全息中不同再现距离获得的携带不同聚焦信息的再现像, 提出了一种基于数学形态学的多聚焦再现像融合方法, 以有效扩展成像景深。首先通过小波-Controulet变换获得源图像的高频和低频分量;然后, 针对数字全息中含散斑噪声的特点, 对高频分量采用基于数学形态学区域能量的方法进行融合, 对低频分量采用加权对比度法进行融合;最后, 将融合系数反变换得到融合图像。通过对算法的有效性分析和实验验证, 将本文提出的方法与不加入数学形态学的融合方法进行了对比研究。结果表明, 基于数学形态学的融合方法能充分抑制散斑噪声的影响, 保留更多细节信息, 有效扩展了成像景深范围达11.5 cm。其中, 对于表面粗糙且信息量较少的骰子, 基于数学形态学方法的空间梯度算子提高了11.8%, 熵值提高了2.7%;对于表面光滑且信息量较多的硬币, 其空间梯度算子提高了13.6%, 熵值提高了2.8%。     

一种基于NSCT变换的红外与可见光图像融合算法

针对红外与可见光图像融合,提出了一种基于NSCT变换的图像融合方法。对经NSCT变换的低频子带系数采用基于区域能量自适应加权的融合规则,对高频子带系数采用混合的融合方法,即对于低层,采用基于区域方差选大的融合方法,对于高层采用像素点的绝对值选大的融合方法。实验结果表明,该融合算法可以获得更多的细节信息,能获得较理想的融合图像。     

基于二代curvelet变换的图像融合研究

曲波(Curvelet)作为一种新的多尺度分析方法比小波更加适合分析二维图像中的曲线或直线状边缘特征,而且具有更高的逼近精度和更好的稀疏表达能力.将curvelet变换引入图像融合,能够更好地提取原始图像的特征,为融合图像提供更多的信息.第二代curvelet理论的提出也使得其理论更易理解和实现.因此,提出了一种基于第二代curvelet变换的图像融合方法,首先将图像进行curvelet变换,然后在相应尺度上利用融合规则将curvelet系数融合,最后进行重构得到融合结果.对多聚焦图像进行了实验,采用均方误差、偏差指数和相关系数对融合结果进行了客观评价,并与基于小波变换的融合进行了比较,实验结果表明该方法除分解2层时与小波性能相当,取其他分解层数时均获得更好的融合效果.     

有限离散剪切波域的红外可见光图像融合

针对目前图像融合过程中的不足之处,结合有限离散剪切波具有高的方向敏感性和抛物尺度化特性,提出了一种有限离散剪切波变换下的图像融合算法。首先对严格配准的多传感器图像进行有限离散剪切波变换,得到低频子带系数和不同尺度不同方向的高频子带系数;然后对低频子带系数采用全局特征值和像素点之间的差异性与区域空间频率匹配度相结合的融合算法,高频方向子带系数采用方向权重对比度与相对区域平均梯度和相对区域方差相结合的方案;最后通过有限离散剪切波逆变换得到融合图像。实验结果表明,与其他的融合算法相比较,本文算法不但有良好的主观视觉效果,而且3幅图像的客观评价指标分别平均提高了0.9%、3.8%、3.1%,2.6%、3.8%、2.9%和1.5%、125%、59%,充分说明了本文融合算法的优越性。     

基于PHLST的红外与可见光图像融合算法

针对图像融合过程中边缘处理和区域一致性的问题,提出一种基于多重调和局部正弦变换的红外与可见光图像融合新算法.多重调和局部正弦变换的多重调和分量μ代表了图像缓慢变化的"趋势",在空域进行加权融合;残差分量υ体现了源图像的"波动",在傅里叶正弦变换域进行融合,以充分提取可见光图像的细节信息.由于不存在边缘效应,同时残差分量...