基于最小Hausdorff距离和NSST的遥感图像融合

为了最大限度地保留多光谱图像的光谱特性和全色图像的空间细节,提出基于最小Hausdorff距离和非下采样剪切波变换(NSST)的遥感图像融合方法.首先,将原多光谱图像进行主成分分析(PCA)获得其第一主分量,选择NSST对第一主分量和全色图像分别进行分解,得到相应的低频子带系数和高频子带系数.其次,对低频子带系数采用基于稀疏表示的融合策略,稀疏系数与区域空间频率相结合,根据区域空间频率选择权值,对稀疏系数进行加权;对于高频子带系数充分考虑其邻域系数相关性,提出采用最小Hausdorff距离表征相应区域相关性,根据相关性不同采用不同的融合策略.最后,对融合系数进行NSST逆变换得到融合后的第一主分量,再将新的第一主分量与其他高阶主分量进行PCA逆变换得到融合图像.选择三组QuickBird卫星图像和一组SPOT卫星图像进行测试,与传统的融合策略算法相比,本文方法获得的融合结果客观评价指标更优,且主观视觉效果更好.     

基于非采样Contourlet变换的遥感图像融合算法

为了使融合后的多光谱图像在尽可能保持原始多光谱图像光谱特性的同时,显著提高空间分辨力,提出了一种基于非采样Contourlet变换(NSCT)的遥感图像融合算法。算法首先对全色波段图像进行非采样Contourlet变换,得到全色波段图像的低频子带系数和各带通方向子带系数;然后针对多光谱图像的每一个波段,将其进行双线性插值后作为融合后多光谱图像的低频子带系数,对全色波段图像的各带通方向子带系数采用基于成像系统物理特性的注入模型(调整系数)进行局部调整后,作为融合后多光谱图像的各带通方向子带系数,从而得到融合后多光谱图像的非采样Contourlet变换系数;最后再经非采样Contourlet逆变换得到该波段具有高空间分辨力的多光谱图像。采用IKONOS卫星遥感图像进行了仿真实验,实验结果表明,该算法在光谱保留和空间质量提高方面优于其它传统的遥感图像融合算法。     

基于非抽样剪切波的加权区域图像融合

以提升遥感图像和多聚焦图像的融合精度为目的,结合非下采样剪切波变换（NSST）可以捕捉图像的细节特征,提出了一种NSST和加权区域特性的图像融合方法。利用非下采样剪切波变换对源图像进行多尺度、多方向分解,得到低频子带和高频子带,低频子带系数采用改进梯度投影的非负矩阵分解（NMF）,高频子带系数采用加权区域能量和区域方差相结合的融合策略,然后应用非下采样剪切波的逆变换得到融合的图像。实验结果表明:该方法从主观视觉方面很好地保留了多幅图像的有用信息,给出该方法与其他融合算法在客观评价指标应用信息熵EN、互信息MI和加权边缘信息量QAB/F的比较结果 。     

基于局部相关性的遥感图像全色锐化算法

为了增强多光谱图像的空间分辨率同时避免出现严重的光谱扭曲,对插值放大后的多光谱图像和原始全色图像分别作相同层数的非下采样轮廓波变换分解.在相应低频子带中,分别选取以待融合像素点为中心,大小为5×5的滑动窗口,计算待融合像素点的局部相关系数与四阶相关系数.如果局部相关系数大于四阶相关系数,说明该位置上的地物存在相似的光谱特征,因此用全色图像的高频系数替代多光谱图像的高频系数;反之,保持多光谱图像的高频系数不变.最后将多光谱图像的低频系数和替换后的高频系数进行非下采样轮廓波逆变换得到融合图像.采用Landsat 7遥感图像,对比给出了本文与现有同类最新文献融合结果及其主客观评价指标.实验结果表明,本文算法在提高空间分辨率与保持光谱信息两个方面都具有较好的效果.     

基于非下采样Shearlet变换与双重制约的遥感图像融合算法

为了提高遥感图像的融合质量,使其兼顾较好的纹理特征与对比度,提出了非下采样变换耦合双重制约模型的遥感图像融合算法(NSST)。通过IHS模型来解析多光谱图像(MS),提取其对应的强度(I)、色调(H)、饱和度(S)成分;借助NSST,从I成分和全色图像(PAN)中解析出低频和高频系数;通过信息熵和均值模型,计算出图像富含的信息及亮度丰富度,以完成低频系数的融合。利用高频系数与方向矩阵的卷积运算,得出图像的纹理特征,计算图像的标准差,获取对比度信息。在联合纹理特征和对比度,构造双重制约模型,完成高频系数的融合。再对融合系数完成逆NSST和逆IHS运算,得出融合图像。实验数据表明,较现有的融合技术而言,所提算法的融合图像含有更为丰富的纹理与更高的对比度。     

基于双正交小波变换耦合区域梯度特征的遥感图像融合算法

当前较多遥感图像融合算法是利用主成分分析方法来完成遥感图像的融合,由于主成分分析方法融合后的图像会产生光谱畸变,易导致所融合图像存在光谱失真的问题。对此,设计了一种采用双正交小波变换耦合区域梯度特征的遥感图像融合算法。对多光谱图像进行色调-饱和度-亮度变换,以获取多光谱图像的亮度分量,引入双正交小波变换将该亮度分量与全色图像进行小波域分解,以获取图像的低频与高频子带;通过低频子带中像素点的区域梯度特征构造均值梯度模型,用于求取低频子带融合系数,利用高频子带中像素点对应的区域方差构造相似度因子,用于求取高频子带融合系数;通过色调-饱和度-亮度与双正交小波的逆变换获取所融合遥感图像。仿真实验结果显示,所设计方法与当前遥感图像融合方法相比,融合的遥感图像具有更好的视觉效果。     

改进投影梯度NMF的NSST域多光谱与全色图像融合

为了有效结合多光谱图像的光谱信息和全色图像的空间细节信息,进一步改善融合后多光谱图像的质量,提出了基于改进投影梯度非负矩阵分解(NMF)和改进脉冲耦合神经网络(PCNN)的非下采样Shearlet变换(NSST)域多光谱和全色图像融合方法。对多光谱图像进行亮度-色度-饱和度(IHS)变换,将其亮度分量与全色图像进行直方图匹配,增强全色图像的对比度;分别对多光谱图像的亮度分量和全色图像进行NSST变换,对二者的低频系数利用改进投影梯度NMF进行融合,进一步提高融合后图像的空间信息;对于高频子带系数,采用基于改进PCNN的方法进行融合,增强图像的细节信息;经非下采样Shearlet逆变换得到融合后的亮度分量,进行IHS逆变换得到融合图像。大量实验结果表明,所提出的方法在保留多光谱图像光谱信息的同时,增强了融合图像的空间细节表现能力,优于现有的基于IHS变换、基于非下采样Contourlet变换(NSCT)和NMF、基于NSCT和PCNN等几种融合方法。     

基于NSSCT的红外与可见光图像融合

为了克服传统图像融合结果存在对比度不足和细节缺失的缺点,提出基于非下采样剪切波-对比度变换(NSSCT)的图像融合算法。分析了图像经非下采样剪切波变换(NSST)后高频系数间的关联性与差异性,构造了高频系数方向性基本一致的NSSCT变换,保留了融合图像的高频系数细节,并提升了对比度。基于图像的低频特点,采用显著性增强方法对低频系数进行融合,通过NSSCT逆变换得到对比度提升和细节增强的融合图像。实验结果表明,在图像对比度提升与细节保留方面,本文算法比基于小波、NSST和显著性等算法具有明显优势。     

基于纹理分割和Top-Hat变换的合成孔径雷达与可见光图像增强融合

针对目前合成孔径雷达(SAR)与可见光图像融合结果目标信息缺失、对比度不高的缺点,提出了一种基于纹理分割和top-hat变换的图像增强融合算法。将SAR图像灰度共生矩阵的熵纹理特征图进行阈值分割,提取SAR图像的感兴趣区域(ROI);并对SAR和可见光图像进行非下采样Contourlet变换(NSCT)分解,低频系数采用基于区域的融合规则,在感兴趣区域内选择SAR的低频系数。对低频系数进行top-hat变换得到显著化的图像亮、暗细节特征,并加入到低频系数上形成低频合成系数;高频子带系数采用局部方向信息熵显著性因子取大的融合规则;对融合系数进行NSCT逆变换得到最终的融合图像。实验证明了本算法的有效性。     

非下采样变换的红外与可见光图像融合

基于非下采样Contourlet变换(NSCT),提出了一种红外和可见光图像融合算法。针对低频子带系数和各带通方向子带系数分别提出了基于图像物理特征的系数加权选择方式与基于区域能量匹配的系数选择方式,即低频基于区域梯度信息、高频基于区域特征因子的加权与选择结合的图像融合算法。实验结果表明:非下采样Contourlet变换具有较快的运算速度,且经非下采样变换后能量更加集中,可提供更多的图像信息。相对于基于像素的图像融合算法,本文的图像融合算法具有更高的融合性能,是一种更适合图像融合的多尺度几何分析(MGA)工具。     

Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain

Multimodal medical image fusion aims to fuse images with complementary multisource information. In this paper, we propose a novel multimodal medical image fusion method using pulse coupled neural network (PCNN) and a weighted sum of eight-neighborhood-based modified Laplacian (WSEML) integrating guided image filtering (GIF) in non-subsampled contourlet transform (NSCT) domain. Firstly, the source images are decomposed by NSCT, several low- and high-frequency sub-bands are generated. Secondly, the PCNN-based fusion rule is used to process the low-frequency components, and the GIF-WSEML fusion model is used to process the high-frequency components. Finally, the fused image is obtained by integrating the fused low- and high-frequency sub-bands. The experimental results demonstrate that the proposed method can achieve better performance in terms of multimodal medical image fusion. The proposed algorithm also has obvious advantages in objective evaluation indexes VIFF, Q_W, API, SD, EN and time consumption.     

Image fusion algorithm based on redundant-lifting NSWMDA and adaptive PCNN

Pyramid decomposition in the NSCT transformation is a band-pass filtering process in the frequency domain where different scales of images are orthogonal. However, from the perspective of the image content, correlation is likely to exist between the fused images, and this kind of decomposition makes images of different scales contain redundant information, as a result of which the fused image may not capture the subtle information from the original images. In order to overcome the above-mentioned problem, an effective image fusion method based on redundant-lifting non-separable wavelet multi-directional analysis (NSWMDA) and adaptive pulse coupled neural network (PCNN) has been proposed. The original images are firstly decomposed by using the NSWMDA into several sub-bands in order to retain texture detail and contrast information of the images, and then adaptive PCNN algorithm is applied on the high-frequency directional sub-bands to extract the high-frequency information. The low-frequency sub-bands are evaluated by weighted average based on Gaussian kernel with a chosen maximum fusion rule. Results from experiments show that the proposed method can make the fused image maintains more texture details and contrast information.     

基于Shearlet变换的自适应图像融合算法

针对多聚焦图像与多光谱和全色图像的成像特点,结合Shearlet变换具有较好的稀疏表示图像特征的性质,提出了一种新的图像融合规则.并基于此融合规则,提出了基于Shearlet变换的自适应图像融合算法.在多聚焦图像的融合算法中,分别对聚焦不同的图像进行Shearlet变换,并基于本文提出的融合规则,对分解后的高低频系数进行融合处理. 通过与多种算法的比较实验证明了本文提出的算法融合的图像具有更高的清晰度和更加丰富的细节信息.在多光谱和全色图像的融合处理中,提出了一种基于Shearlet变换与HSV变换相结合的图像融合方法.该算法首先对多光谱图像作HSV变换,将得到的V分量与全色图像进行Shearlet分解与融合,在融合过程中对分解系数选用特定的融合准则进行融合,最后将融合生成新的分量与H、S分量进行HSV逆变换产生新的RGB融合图像. 该算法在空间分辨率和光谱特性两方面达到了良好的平衡,融合后的图像在减少光谱失真的同时,有效增强了空间分辨率. 仿真实验证明,本文算法融合的图像与传统的多光谱和全色图像融合算法相比,具有更佳的融合性能和视觉效果.     

An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing

A novel nonsubsampled contourlet transform (NSCT) based image fusion approach, implementing an adaptive-Gaussian (AG) fuzzy membership method, compressed sensing (CS) technique, total variation (TV) based gradient descent reconstruction algorithm, is proposed for the fusion computation of infrared and visible images.Compared with wavelet, contourlet, or any other multi-resolution analysis method, NSCT has many evident advantages, such as multi-scale, multi-direction, and translation invariance. As is known, a fuzzy set is characterized by its membership function (MF), while the commonly known Gaussian fuzzy membership degree can be introduced to establish an adaptive control of the fusion processing. The compressed sensing technique can sparsely sample the image information in a certain sampling rate, and the sparse signal can be recovered by solving a convex problem employing gradient descent based iterative algorithm(s).In the proposed fusion process, the pre-enhanced infrared image and the visible image are decomposed into low-frequency subbands and high-frequency subbands, respectively, via the NSCT method as a first step. The low-frequency coefficients are fused using the adaptive regional average energy rule; the highest-frequency coefficients are fused using the maximum absolute selection rule; the other high-frequency coefficients are sparsely sampled, fused using the adaptive-Gaussian regional standard deviation rule, and then recovered by employing the total variation based gradient descent recovery algorithm.Experimental results and human visual perception illustrate the effectiveness and advantages of the proposed fusion approach. The efficiency and robustness are also analyzed and discussed through different evaluation methods, such as the standard deviation, Shannon entropy, root-mean-square error, mutual information and edge-based similarity index.     

An infrared and visible image fusion method based upon multi-scale and top-hat transforms

The high-frequency components in the traditional multi-scale transform method are approximately sparse, which can represent different information of the details. But in the low-frequency component, the coefficients around the zero value are very few, so we cannot sparsely represent low-frequency image information. The low-frequency component contains the main energy of the image and depicts the profile of the image. Direct fusion of the low-frequency component will not be conducive to obtain highly accurate fusion result. Therefore, this paper presents an infrared and visible image fusion method combining the multi-scale and top-hat transforms. On one hand, the new top-hat-transform can effectively extract the salient features of the low-frequency component. On the other hand, the multi-scale transform can extract highfrequency detailed information in multiple scales and from diverse directions. The combination of the two methods is conducive to the acquisition of more characteristics and more accurate fusion results. Among them, for the low-frequency component, a new type of top-hat transform is used to extract low-frequency features, and then different fusion rules are applied to fuse the low-frequency features and low-frequency background; for high-frequency components, the product of characteristics method is used to integrate the detailed information in high-frequency. Experimental results show that the proposed algorithm can obtain more detailed information and clearer infrared target fusion results than the traditional multiscale transform methods. Compared with the state-of-the-art fusion methods based on sparse representation, the proposed algorithm is simple and efficacious, and the time consumption is significantly reduced.     

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

The purpose of image fusion is to combine the source images of the same scene into a single composite image with more useful information and much better visual effects, which is undoubtedly suitable for further image processing tasks. This paper presented a novel fusion method for visible light and infrared images based on non-subsampled shearlet transform (NSST)–spatial frequency (SF)–pulse coupled neural network (PCNN). As a recently developed multi-resolution geometric analysis tool, NSST not only has remarked superiorities over other past conventional tools in terms of information capturing and computational costs saving, but also overcomes the lack of shift-invariance in shearlet transform (ST), so NSST applies to conducting the decompositions and reconstructions. Besides, traditional PCNN model is also upgraded to be an improved one called IPCNN in this paper to fuse the low-frequency and high-frequency subband coefficients. In the IPCNN structure, on the one hand, the value of the linking strength β is determined by the SF which represents the gradient features of the subband image; on the other hand, the time matrix is utilized to adaptively decide the iteration number of the IPCNN model, which is helpful to increase the function efficiency and save computational resources. Experimental results indicate that the proposed method performs well and has obvious superiorities over other current typical ones in both subjective visual performance and objective criteria.     

A novel image fusion algorithm based on nonsubsampled shearlet transform

To overcome the shortcoming of traditional image fusion method based on multi-scale transform, a novel adaptive image fusion algorithm based on nonsubsampled shearlet transform (NSST) is proposed. Firstly, the NSST is utilized to decompose the source images on various scales and in different directions, and the low frequency sub-band and bandpass sub-band coefficients are obtained. Secondly, for the low frequency sub-band coefficients, the singular value decomposition method in the gradient domain is used to estimate the local structure information of image, and an adaptive ‘weighted averaging’ fusion rule based on the sigmoid function and the extracted features is presented. To improve the quality of fused image, a novel sum-modified-Laplacian (NSML), which can extract more useful information from source images, is employed as the measurement to select bandpass sub-band coefficients. Finally, the fused image is obtained by performing the inverse NSST on the combined coefficients. The proposed fusion method is verified on several sets of multi-source images, and the experimental results show that the proposed approach can significantly outperform the conventional image fusion methods in terms of both objective evaluation criteria and visual quality.     

An improved fusion algorithm for infrared and visible images based on multi-scale transform

In this paper, an improved fusion algorithm for infrared and visible images based on multi-scale transform is proposed. First of all, Morphology-Hat transform is used for an infrared image and a visible image separately. Then two images were decomposed into high-frequency and low-frequency images by contourlet transform (CT). The fusion strategy of high-frequency images is based on mean gradient and the fusion strategy of low-frequency images is based on Principal Component Analysis (PCA). Finally, the final fused image is obtained by using the inverse contourlet transform (ICT). The experiments and results demonstrate that the proposed method can significantly improve image fusion performance, accomplish notable target information and high contrast and preserve rich details information at the same time.     

基于区域分割和Counterlet变换的图像融合算法

提出了一种基于区域分割和Contourlet变换的图像融合算法。首先,对各源图像做区域分割,并利用区域能量比和区域清晰比的概念来度量和提取区域信息;然后,对各源图像进行多尺度非子采样Contourlet分解,分解后的高频部分采用绝对值取大算子进行融合,低频部分则采用基于区域的融合规则和算子进行融合;最后进行重构得到融合图像。对红外与可见光图像进行了融合实验,并与基于像素的àtrous小波变换和Contourlet变换的融合效果进行了比较。结果表明,采用本文算法的融合图像既保留了可见光图像的光谱信息,又继承了红外图像的目标信息,其熵值高于基于像素的融合方法约10%,交叉熵仅为基于像素的融合方法的1%左右。