An improved fusion algorithm for infrared and visible images based on multi-scale transform

In this paper, an improved fusion algorithm for infrared and visible images based on multi-scale transform is proposed. First of all, Morphology-Hat transform is used for an infrared image and a visible image separately. Then two images were decomposed into high-frequency and low-frequency images by contourlet transform (CT). The fusion strategy of high-frequency images is based on mean gradient and the fusion strategy of low-frequency images is based on Principal Component Analysis (PCA). Finally, the final fused image is obtained by using the inverse contourlet transform (ICT). The experiments and results demonstrate that the proposed method can significantly improve image fusion performance, accomplish notable target information and high contrast and preserve rich details information at the same time.     

Image fusion based on expectation maximization algorithm and steerable pyramid

In this paper, a novel image fusion method based on the expectation maximization (EM) algorithm and steerable pyramid is proposed. The registered images are first decomposed by using steerable pyramid.The EM algorithm is used to fuse the image components in the low frequency band. The selection method involving the informative importance measure is applied to those in the high frequency band. The final fused image is then computed by taking the inverse transform on the composite coefficient representations.Experimental results show that the proposed method outperforms conventional image fusion methods.     

A Pan-sharpening method appropriate to vegetation applications

An improved Pan-sharpening algorithm appropriate to vegetation applications is proposed to fuse a set of IKONOS panchromatic （PAN） and multispectral image （MSI） data. The normalized difference vegetation index （NDVI） is introduced to evaluate the quality of fusion products. Compared with other methods such as principal component analysis （PCA）, wavelet transform （WT）, and curvelet transform （CT）, this algorithm has a better trade-off between keeping the spatial and spectral information. The NDVI performances indicate that the fusion product of this method is more suitable for vegetation applications than the other methods.     

Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain

Multimodal medical image fusion aims to fuse images with complementary multisource information. In this paper, we propose a novel multimodal medical image fusion method using pulse coupled neural network (PCNN) and a weighted sum of eight-neighborhood-based modified Laplacian (WSEML) integrating guided image filtering (GIF) in non-subsampled contourlet transform (NSCT) domain. Firstly, the source images are decomposed by NSCT, several low- and high-frequency sub-bands are generated. Secondly, the PCNN-based fusion rule is used to process the low-frequency components, and the GIF-WSEML fusion model is used to process the high-frequency components. Finally, the fused image is obtained by integrating the fused low- and high-frequency sub-bands. The experimental results demonstrate that the proposed method can achieve better performance in terms of multimodal medical image fusion. The proposed algorithm also has obvious advantages in objective evaluation indexes VIFF, Q_W, API, SD, EN and time consumption.     

An infrared and visible image fusion method based upon multi-scale and top-hat transforms

The high-frequency components in the traditional multi-scale transform method are approximately sparse, which can represent different information of the details. But in the low-frequency component, the coefficients around the zero value are very few, so we cannot sparsely represent low-frequency image information. The low-frequency component contains the main energy of the image and depicts the profile of the image. Direct fusion of the low-frequency component will not be conducive to obtain highly accurate fusion result. Therefore, this paper presents an infrared and visible image fusion method combining the multi-scale and top-hat transforms. On one hand, the new top-hat-transform can effectively extract the salient features of the low-frequency component. On the other hand, the multi-scale transform can extract highfrequency detailed information in multiple scales and from diverse directions. The combination of the two methods is conducive to the acquisition of more characteristics and more accurate fusion results. Among them, for the low-frequency component, a new type of top-hat transform is used to extract low-frequency features, and then different fusion rules are applied to fuse the low-frequency features and low-frequency background; for high-frequency components, the product of characteristics method is used to integrate the detailed information in high-frequency. Experimental results show that the proposed algorithm can obtain more detailed information and clearer infrared target fusion results than the traditional multiscale transform methods. Compared with the state-of-the-art fusion methods based on sparse representation, the proposed algorithm is simple and efficacious, and the time consumption is significantly reduced.     

基于Shearlet变换的自适应图像融合算法

针对多聚焦图像与多光谱和全色图像的成像特点,结合Shearlet变换具有较好的稀疏表示图像特征的性质,提出了一种新的图像融合规则.并基于此融合规则,提出了基于Shearlet变换的自适应图像融合算法.在多聚焦图像的融合算法中,分别对聚焦不同的图像进行Shearlet变换,并基于本文提出的融合规则,对分解后的高低频系数进行融合处理. 通过与多种算法的比较实验证明了本文提出的算法融合的图像具有更高的清晰度和更加丰富的细节信息.在多光谱和全色图像的融合处理中,提出了一种基于Shearlet变换与HSV变换相结合的图像融合方法.该算法首先对多光谱图像作HSV变换,将得到的V分量与全色图像进行Shearlet分解与融合,在融合过程中对分解系数选用特定的融合准则进行融合,最后将融合生成新的分量与H、S分量进行HSV逆变换产生新的RGB融合图像. 该算法在空间分辨率和光谱特性两方面达到了良好的平衡,融合后的图像在减少光谱失真的同时,有效增强了空间分辨率. 仿真实验证明,本文算法融合的图像与传统的多光谱和全色图像融合算法相比,具有更佳的融合性能和视觉效果.     

一种改进的弱光谱畸变PCA融合方法

针对用PCA融合方法进行高光谱遥感影像和高分影像融合会出现一定程度的光谱失真问题,提出了一种改进的弱光谱畸变PCA融合方法。采用NCUT(normalized cut)影像分割算法,将复杂的高光谱遥感影像对象化, 增加融合样本的线性可分性, 从而削弱传统PCA融合产生的光谱畸变;运用图论和聚类理论生成表达像素间相似度的权重矩阵和若干掩膜,并用这些掩膜切割高光谱影像与高分影像,再分别融合其对应匹配的子区域对象,最后将所有子区域融合结果拼接成一幅影像。使用Hyperion高光谱数据和Rapid Eye高分影像进行实验,结果表明：该方法在保证融合结果空间分辨率提升和纹理信息不变的前提下,光谱保真能力优于传统的PCA融合方法。     

抗混叠轮廓波域采用压缩感知的云图融合方法

提出一种采用压缩感知的云图融合方法.该方法针对传统轮廓波存在频谱混叠的缺点,结合抗混叠塔式滤波器组和方向滤波器组,构造出一种抗混叠的轮廓波变换,并将其引入压缩感知中的稀疏表示环节,将云图分解成稠密和稀疏两部分|对稠密成份采用传统方法进行融合,而对稀疏成份,则在压缩感知框架下,通过少数线性测量的融合,并采用二步迭代收缩的图像重构算法,在迭代时利用前面两个估计值更新当前值,得到融合结果.实验表明,该方法的融合结果无论在视觉质量及定量指标上都明显优于传统方法,有利于揭示全面的天气信息.     

融合Retinex和离散小波奇异值分解的远距离目标图像清晰化

针对远距离成像系统获取的低照度降质图像增强问题,提出了一种融合Retinex和离散小波奇异值分解的图像清晰化算法。该方法首先利用自适应全尺度Retinex（adaptive full-scale retinex, AFSR）“粗”提取照度分量和反射分量,然后通过离散小波变换将所提取的图像反射分量分解为4个频率子带并估计出低频子带图像的奇异值矩阵,最后应用逆小波变换“精”重建图像。实验结果表明:所提方法处理后的低照度降质图像视觉增强效果较好,在图像对比度、信息熵、平均梯度和边缘密度等客观评价指标方面优于其他经典算法。     

高分辨率遥感影像融合处理技术的对比分析研究

随着遥感技术的发展,获取遥感数据的手段越来越丰富。由各种不同的传感器获取的影像数据与日俱增,在同一地区形成了多时相、多分辨率的影像序列。如何综合各种类型的遥感影像信息,提高遥感数据的利用效益已成为遥感应用的瓶颈问题。多源遥感数据融合技术是解决这一问题的有效手段。高空间分辨率影像数据的多样性和复杂性对遥感信息融合处理技术提出了新的更高的要求。以IKONOS卫星数据为例对其进行了空间分辨率的影像融合。研究中引入了多种融合方法,如IHS变换、主成分分析、小波变换以及基于区域特征的自适应小波包算法。从光谱质量和空间信息的角度出发对融合方法进行了比较研究,分析出了比较适合于IKONOS卫星的高分辨率影像融合的处理方法。     

结合深度学习的非下采样剪切波遥感图像融合

遥感图像融合是指将不同传感器得到的具有不同观测特性的图像信息有选择、有策略地结合起来,以得到具有更优观测特性的新图像的方法。提出一种深度学习结合非下采样剪切波变换(NSST)的遥感图像融合算法,利用改进的超分辨率重建网络对多光谱图像(MS)进行空间分辨率增强,全色图像(PAN)参考重建后的多光谱图像的每个分量进行直方图匹配。将对应通道的图像进行NSST变换,分别得到低频子带和若干高频子带。低频子带通过使用基于梯度域的自适应加权平均规则来获得低频融合系数,高频子带采用局部空间频率最大值规则来获得高频融合系数,最后经逆NSST变换重构获得融合图像。对不同数据集中的City和Inland多光谱图像采用双三次插值方法进行上采样,作者提出算法的通用图像质量指数(UIQI)分别为0.988 6和0.932 1,光谱角映射(SAM)分别为1.872 1和2.143 2。实验结果表明,图像结构更加清晰,保存的光谱信息更加完整,融合图像质量优于对比算法,融合图像更利于人类视觉观察。     

可调节自适应遥感影像融合方法研究

大部分常用的遥感影像融合方法都存在一个缺陷:只能产生一个特定的融合结果,用户无法控制最终的结果应该保留多少光谱信息或细节信息。提出了一种基于小波变换的可调节自适应遥感影像融合方法,该方法首先分别将待融合影像进行小波分解,然后,通过引入2个可调节参量,在小波域内融合,最后通过小波逆变换得到融合结果。使用法国地球资源探测卫星(SPOT)图像和陆地资源卫星专题绘图仪(landsat TM)图像,将该方法与传统的小波变换融合法、强度色散饱和变换融合法和主成分变换法进行对比试验,结果表明,该方法可以在细节保留和光谱保持两方面达到不同程度的平衡,在合理的参量组合下,融合图像的目视效果和统计指标优于传统融合方法。     

Novel image fusion method based on discrete fractional random transform

We introduce a new spectrum transform into the image fusion field and propose a novel fusion method based on discrete fractional random transform （DFRNT）. In DFRNT domain, high amplitude spectrum （HAS） and low amplitude spectrum （LAS） components carry different information of original images. For different fusion goals, different fusion rules can be adopted in HAS and LAS components, respectively. The proposed method is applied to fuse real multi-spectral （MS） and panchromatic （Pan） images. The fused image is observed to preserve both spectral information of MS and spatial information of Pan. Spectrum distribution of DFRNT is random and uniform, which guarantees that good information is reserved.     

基于变换域PCNN的近红外与彩色可见光融合

针对近红外与彩色可见光图像融合后对比度低、细节丢失和颜色失真等问题,提出一种基于多尺度变换和自适应脉冲耦合神经网络(PCNN-pulse coupled neural network,PCNN)的红外与彩色可见光图像融合的新算法。首先将彩色可见光图像转换到HSI（hue saturation intensity)空间,HSI色彩空间包含亮度、色度和饱和度三个分量,并且这三个分量互不相关,因此利用这个特点可对三个分量分别进行处理。将其亮度分量与近红外图像分别进行多尺度变换,变换方法选择Tetrolet变换。变换后分别得到低频和高频分量,针对图像低频分量,提出一种期望最大的低频分量融合规则;针对图像高频分量,采用高斯差分算子调节PCNN模型的阈值,提出一种自适应的PCNN模型作为融合规则。处理后的高低频分量经过Tetrolet逆变换得到的融合图像作为新的亮度图像。然后将新的亮度图像和原始的色度和饱和度分量反向映射到RGB空间,得到融合后的彩色图像。为了解决融合带来的图像平滑化和原始图像光照不均的问题,引入颜色与锐度校正机制(colour and sharpness correction, CSC)来提高融合图像的质量。为了验证方法的有效性,选取了5组分辨率为1 024×680近红外与彩色可见光图像进行试验,并与当前高效的四种融合方法以及未进行颜色校正的本方法进行了对比。实验结果表明,同其他图像融合算法进行对比分析,该方法在有无CSC颜色的情况下均能保留最多的细节和纹理,可见度均大大提高,同时本方法的结果在光照条件较弱的情况下具有更多的细节和纹理,均具有更好的对比度和良好的色彩再现性。在信息保留度、颜色恢复、图像对比度和结构相似性等客观指标上均具有较大优势。     

Multiscale top-hat selection transform based infrared and visual image fusion with emphasis on extracting regions of interest

To effectively combine regions of interest in original infrared and visual images, an adaptively weighted infrared and visual image fusion algorithm is developed based on the multiscale top-hat selection transform. First, the multiscale top-hat selection transform using multiscale structuring elements with increasing sizes is discussed. Second, the image regions of the original infrared and visual images at each scale are extracted by using the multiscale top-hat selection transform. Third, the final fusion regions are constructed from the extracted multiscale image regions. Finally, the final fusion regions are combined into a base image calculated from the original images to form the final fusion result. The combination of the final fusion regions uses the adaptive weight strategy, and the weights are adaptively obtained based on the importance of the extracted features. In the paper, we compare seven image fusion methods: wavelet pyramid algorithm (WP), shift invariant discrete wavelet transform algorithm (SIDWT), Laplacian pyramid algorithm (LP), morphological pyramid algorithm (MP), multiscale morphology based algorithm (MSM), center-surround top-hat transform based algorithm (CSTHT), and the proposed multiscale top-hat selection transform based algorithm. These seven methods are compared over five different publicly available image sets using three metrics of spatial frequency, mean gradient, and Q. The results show that the proposed algorithm is effective and may be useful for the applications related to the infrared and visual image fusion.     

基于区域分割和Counterlet变换的图像融合算法

提出了一种基于区域分割和Contourlet变换的图像融合算法。首先,对各源图像做区域分割,并利用区域能量比和区域清晰比的概念来度量和提取区域信息;然后,对各源图像进行多尺度非子采样Contourlet分解,分解后的高频部分采用绝对值取大算子进行融合,低频部分则采用基于区域的融合规则和算子进行融合;最后进行重构得到融合图像。对红外与可见光图像进行了融合实验,并与基于像素的àtrous小波变换和Contourlet变换的融合效果进行了比较。结果表明,采用本文算法的融合图像既保留了可见光图像的光谱信息,又继承了红外图像的目标信息,其熵值高于基于像素的融合方法约10%,交叉熵仅为基于像素的融合方法的1%左右。     

一种基于提升小波的图像融合技术研究

针对红外与可见光图像进行提升小波变换后低频图像的特点,提出了一种低频分量的融合算法,高频分量采取邻域方差取大为准则进行融合,然后进行提升小波逆变换得到融合图像。通过与传统小波融合方法进行比较,并引入信息熵、清晰度、Xydeas-Petrovic客观性能指标对融合后的图像进行分析。实验结果表明不论从视觉效果还是从客观性能指标上,该算法都优于传统的融合方法。     

A categorization method of infrared polarization and intensity image fusion algorithm based on the transfer ability of difference features

The fusion of infrared polarization and intensity image can significantly improve the detection performance of target, and the fused image is more suitable for human visual perception and further image-processing tasks. In this paper, a new categorization method of infrared polarization and intensity image fusion algorithm based on the transfer ability of difference feature is proposed. Firstly, the difference feature between two kinds of image and the characteristics of different fusion algorithms are analyzed and summarized. Second, an evaluation vector of fusion algorithm for difference feature transform ability is constructed. Thirdly, the transfer ability of fusion algorithm for difference feature is estimated by the evaluation vector, and the degree of transfer ability of fusion algorithm for difference feature is analyzed. Finally the fusion algorithms are classified by the degree of transfer ability of fusion algorithm for difference feature. The results shows that the proposed fusion algorithm categorization method helps select fusion algorithms in actual scene.     

基于非采样提升小波-Contourlet变换的图像融合算法

为克服非采样Contourlet变换中金字塔分解的不足,首先在提升小波变换的基础上,通过取消其奇偶分裂环节得到具有平移不变性的非采样提升小波变换,然后用此变换来取代非采样Contourlet变换中的金字塔分解,得到新的非采样提升小波-Contourlet变换。将此变换与一定的融合规则相结合,提出了一种基于非采样提升小波-Contourlet变换的图像融合算法。实验表明,该算法相对于非采样Contourlet变换能从源图像中提取更多有用信息注入到融合图像中,可得到更高性能的融合图像。