非下采样变换的红外与可见光图像融合

基于非下采样Contourlet变换(NSCT),提出了一种红外和可见光图像融合算法。针对低频子带系数和各带通方向子带系数分别提出了基于图像物理特征的系数加权选择方式与基于区域能量匹配的系数选择方式,即低频基于区域梯度信息、高频基于区域特征因子的加权与选择结合的图像融合算法。实验结果表明:非下采样Contourlet变换具有较快的运算速度,且经非下采样变换后能量更加集中,可提供更多的图像信息。相对于基于像素的图像融合算法,本文的图像融合算法具有更高的融合性能,是一种更适合图像融合的多尺度几何分析(MGA)工具。     

基于区域分维和非采样Contourlet变换的图像融合算法

针对源图像有用信息的提取,提出了基于区域分维和非下采样Contourlet变换相结合的红外与可见光图像融合算法.将图像的区域属性、区域大小、边缘强度以及纹理显著程度等特点用图像不同尺度上的区域分维进行描述,对于非下采样Contourlet变换低频系数,根据源图像不同尺度上的区域分维进行基于系数选择的融合.针对带通子带系数设计了系数局部匹配度算子,依据匹配度不同采用加权和系数选取相结合的融合规则.与其他常规融合方法进行比较,该算法可有效实现红外与可见光图像的融合.     

基于区域分维和非采样Contourlet变换的图像融合算法

针对源图像有用信息的提取,提出了基于区域分维和非下采样Contourlet变换相结合的红外与可见光图像融合算法.将图像的区域属性、区域大小、边缘强度以及纹理显著程度等特点用图像不同尺度上的区域分维进行描述,对于非下采样Contourlet变换低频系数,根据源图像不同尺度上的区域分维进行基于系数选择的融合.针对带通子带系数设计了系数局部匹配度算子,依据匹配度不同采用加权和系数选取相结合的融合规则.与其他常规融合方法进行比较,该算法可有效实现红外与可见光图像的融合.     

一种基于非下采样Contourlet变换多聚焦图像融合算法

针对现有小波类图像融合算法的不足,提出了一种基于非下采样Contourlet变换多聚焦图像融合算法,并在Contourlet域中引入了局部区域可见度以及局部方向能量的概念.针对低频子带系数和各带通方向子带系数分别提出了基于局部区域可见度以及基于局部方向能量的系数选择方案.通过对多聚焦图像融合的仿真实验,表明该算法相对于传统的基于离散小波变换和离散小波框架变换融合算法能够有效减少有用信息的丢失以及虚假信息的引入,同时能够从源图像中提取更多的有用信息并注入到融合图像中, 得到更好视觉效果和更优量化指标的融合图像.     

基于非抽样剪切波的加权区域图像融合

以提升遥感图像和多聚焦图像的融合精度为目的,结合非下采样剪切波变换（NSST）可以捕捉图像的细节特征,提出了一种NSST和加权区域特性的图像融合方法。利用非下采样剪切波变换对源图像进行多尺度、多方向分解,得到低频子带和高频子带,低频子带系数采用改进梯度投影的非负矩阵分解（NMF）,高频子带系数采用加权区域能量和区域方差相结合的融合策略,然后应用非下采样剪切波的逆变换得到融合的图像。实验结果表明:该方法从主观视觉方面很好地保留了多幅图像的有用信息,给出该方法与其他融合算法在客观评价指标应用信息熵EN、互信息MI和加权边缘信息量QAB/F的比较结果 。     

基于纹理分割和Top-Hat变换的合成孔径雷达与可见光图像增强融合

针对目前合成孔径雷达(SAR)与可见光图像融合结果目标信息缺失、对比度不高的缺点,提出了一种基于纹理分割和top-hat变换的图像增强融合算法。将SAR图像灰度共生矩阵的熵纹理特征图进行阈值分割,提取SAR图像的感兴趣区域(ROI);并对SAR和可见光图像进行非下采样Contourlet变换(NSCT)分解,低频系数采用基于区域的融合规则,在感兴趣区域内选择SAR的低频系数。对低频系数进行top-hat变换得到显著化的图像亮、暗细节特征,并加入到低频系数上形成低频合成系数;高频子带系数采用局部方向信息熵显著性因子取大的融合规则;对融合系数进行NSCT逆变换得到最终的融合图像。实验证明了本算法的有效性。     

基于稀疏特征的红外与可见光图像融合

针对传统的红外与可见光图像融合算法提取目标信息不突出的问题,提出一种基于非下采样剪切波变换和稀疏结构特征的融合方法.首先用非下采样剪切波变换分解源图像;然后通过主成分分析提取低频子带系数中边缘和轮廓等显著特征,引导低频成分融合规则的设计,同时基于结构信息的稀疏性指导融合高频子带系数;最后经过非下采样剪切波变换逆变换得到融合后的图像.实验结果表明,该方法在保留可见光图像背景信息的基础上,突显了红外图像的结构信息,有效提高了融合效果.     

基于非采样Contourlet变换的遥感图像融合算法

为了使融合后的多光谱图像在尽可能保持原始多光谱图像光谱特性的同时,显著提高空间分辨力,提出了一种基于非采样Contourlet变换(NSCT)的遥感图像融合算法。算法首先对全色波段图像进行非采样Contourlet变换,得到全色波段图像的低频子带系数和各带通方向子带系数;然后针对多光谱图像的每一个波段,将其进行双线性插值后作为融合后多光谱图像的低频子带系数,对全色波段图像的各带通方向子带系数采用基于成像系统物理特性的注入模型(调整系数)进行局部调整后,作为融合后多光谱图像的各带通方向子带系数,从而得到融合后多光谱图像的非采样Contourlet变换系数;最后再经非采样Contourlet逆变换得到该波段具有高空间分辨力的多光谱图像。采用IKONOS卫星遥感图像进行了仿真实验,实验结果表明,该算法在光谱保留和空间质量提高方面优于其它传统的遥感图像融合算法。     

多尺度无监督彩色图像分割

非采样Contourlet变换是一种新的多尺度多分辨率分析工具.本文提出了一种基于非采样Contourlet变换的彩色图像无监督分割算法.首先利用非采样Contourlet变换的平移不变性在其变换域应用梯度向量法提取图像多尺度边缘|然后在Contourlet变换域的低频子带和高频子带中分别提取局部低频能量纹理特征与高频多尺度Zernike矩纹理特征,并将二种纹理特征融合.最后在边缘图像中映射种子像素点,利用纹理和颜色特征欧氏距离,对彩色图像采用区域生长和区域合并的方法进行分割.实验结果证明:该算法将图像空间域的颜色特征与非采样Contourlet变换域的多尺度边缘和纹理特征恰当结合在一起实现彩色图像无监督自动分割,与传统算法相比有更高的准确性和鲁棒性.     

一种基于非下采样Contourlet变换的运动点目标背景抑制算法

为了解决机载红外预警探测系统检测地面运动点目标时的结构化背景抑制,提出了一种基于非下采样Contourlet变换的新算法.算法采用非下采样Contourlet变换对原始图像进行多层分解,然后对低频子带和高频子带采用不同的方法处理,最后对各子带进行重构即可得到背景抑制后图像.与数学形态学Top-hat算法比较,实验结果表明本文所提算法能有效地抑制图像背景,从而较好地提高图像的信噪比和对比度.     

Image fusion based on nonsubsampled contourlet transform for infrared and visible light image

In this paper, a new method based on nonsubsampled contourlet transform (NSCT) is proposed to fuse the infrared image and the visible light image, which will produce a new fused image by which the target can be identified more easily. Firstly, two original images were decomposed into low frequency subband coefficients and the bandpass direction subband coefficients by using NSCT. Secondly, the selection of the low frequency subband coefficient and the bandpass direction subband coefficient is discussed in detail. The low frequency subband coefficients are selected based on the regional visual characteristics. For the selection of bandpass direction subband coefficients, this paper proposes a minimum regional cross-gradient method, and the cross-gradient is gained by calculating the gradient between the pixel of bandpass subbands and the adjacent pixel in the fused image of the low-frequency components. Comparison experiments have been performed on different image sets, and experimental results demonstrate that the proposed method performs better in both subjective and objective qualities.     

A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain

This paper presents a multi-focus image fusion algorithm based on dual-channel PCNN in NSCT domain. The fusion algorithm based on multi-scale transform is likely to produce the pseudo-Gibbs effects and it is not effective to fuse the dim or partial bright images. To solve these problems, this algorithm will get a number of different frequency sub-image of the two images by using the NSCT transform, the selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail, and the images are fused based on the improved dual-channel PCNN in order to determine the band-pass sub-band coefficient, at last fused image is obtained by using the inverse NSCT transform. Fusion rules based on dual-channel PCNN are used to solve the complexity of the PCNN parameter settings and long computing time problems. The experimental results show that the algorithm has overcome the defects of the traditional multi-focus image fusion algorithm and improved the fusion effect.     

Fusion method of infrared and visible images based on neighborhood characteristic and regionalization in NSCT domain

On fusing infrared and visible image, the traditional fusion method cannot get the better image quality. Based on neighborhood characteristic and regionalization in NSCT (Nonsubsampled Contourlet Transform) domain, the fusion algorithm was proposed. Firstly, NSCT was adopted to decompose infrared and visible images at different scales and directions for the low and high frequency coefficients, the low frequency coefficients which were fused with improving regional weighted fusion method based on neighborhood energy, and the high-frequency coefficients were fused with multi-judgment rule based on neighborhood characteristic regional process. Finally, the coefficients were reconstructed to obtain the fused image. The experimental results show that, compared with the other three related methods, the proposed method can get the biggest value of IE (information entropy), MI(VI,F) (mutual information from visible image), MI(VI,F) (mutual information from infrared image), MI (sum of mutual information), and Q^AB/F (edge retention). The proposed method can leave enough information in the original images and its details, and the fused images have better visual effects.     

基于区域检测与非下采样轮廓波变换的红外与彩色可见光图像融合

针对灰度图像融合的分辨率低及现有的彩色图像融合方法融合的图像色彩不自然、不符合人的视觉感受的特点,在此提出一种基于Snake模型的区域检测和非下采样轮廓波变换(NSCT)的红外与彩色可见光图像融合的方法。首先对彩色可见光图像进行亮度、色度和饱和度(IHS)颜色空间变换提取亮度分量,并用Snake模型对红外图像的目标区域进行检测;然后对亮度分量和目标替换的红外图像应用NSCT分解,对所得到的高频系数采用像素点"绝对值和取大"、低频系数采用基于"亮度重映射技术"的加权融合规则进行融合;通过对融合系数进行NSCT逆变换获得融合图像的亮度分量,最后运用颜色空间逆变换得到融合图像。实验结果表明,所提出的融合方法既能保持可见光图像的高分辨率和自然色彩,又能准确保留红外图像中检测出的目标信息,获得视觉效果较好、综合指标较优的融合图像。     

一种基于NSCT变换的红外与可见光图像融合算法

针对红外与可见光图像融合,提出了一种基于NSCT变换的图像融合方法。对经NSCT变换的低频子带系数采用基于区域能量自适应加权的融合规则,对高频子带系数采用混合的融合方法,即对于低层,采用基于区域方差选大的融合方法,对于高层采用像素点的绝对值选大的融合方法。实验结果表明,该融合算法可以获得更多的细节信息,能获得较理想的融合图像。     

An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing

A novel nonsubsampled contourlet transform (NSCT) based image fusion approach, implementing an adaptive-Gaussian (AG) fuzzy membership method, compressed sensing (CS) technique, total variation (TV) based gradient descent reconstruction algorithm, is proposed for the fusion computation of infrared and visible images.Compared with wavelet, contourlet, or any other multi-resolution analysis method, NSCT has many evident advantages, such as multi-scale, multi-direction, and translation invariance. As is known, a fuzzy set is characterized by its membership function (MF), while the commonly known Gaussian fuzzy membership degree can be introduced to establish an adaptive control of the fusion processing. The compressed sensing technique can sparsely sample the image information in a certain sampling rate, and the sparse signal can be recovered by solving a convex problem employing gradient descent based iterative algorithm(s).In the proposed fusion process, the pre-enhanced infrared image and the visible image are decomposed into low-frequency subbands and high-frequency subbands, respectively, via the NSCT method as a first step. The low-frequency coefficients are fused using the adaptive regional average energy rule; the highest-frequency coefficients are fused using the maximum absolute selection rule; the other high-frequency coefficients are sparsely sampled, fused using the adaptive-Gaussian regional standard deviation rule, and then recovered by employing the total variation based gradient descent recovery algorithm.Experimental results and human visual perception illustrate the effectiveness and advantages of the proposed fusion approach. The efficiency and robustness are also analyzed and discussed through different evaluation methods, such as the standard deviation, Shannon entropy, root-mean-square error, mutual information and edge-based similarity index.     

Infrared and visible image fusion scheme based on NSCT and low-level visual features

Multi-scale transform (MST) is an efficient tool for image fusion. Recently, many fusion methods have been developed based on different MSTs, and they have shown potential application in many fields. In this paper, we propose an effective infrared and visible image fusion scheme in nonsubsampled contourlet transform (NSCT) domain, in which the NSCT is firstly employed to decompose each of the source images into a series of high frequency subbands and one low frequency subband. To improve the fusion performance we designed two new activity measures for fusion of the lowpass subbands and the highpass subbands. These measures are developed based on the fact that the human visual system (HVS) percept the image quality mainly according to its some low-level features. Then, the selection principles of different subbands are presented based on the corresponding activity measures. Finally, the merged subbands are constructed according to the selection principles, and the final fused image is produced by applying the inverse NSCT on these merged subbands. Experimental results demonstrate the effectiveness and superiority of the proposed method over the state-of-the-art fusion methods in terms of both visual effect and objective evaluation results.