Fusion of remote sensing images based on pyramid decomposition with Baldwinian Clonal Selection Optimization

In this paper, we put forward a novel fusion method for remote sensing images based on the contrast pyramid (CP) using the Baldwinian Clonal Selection Algorithm (BCSA), referred to as CPBCSA. Compared with classical methods based on the transform domain, the method proposed in this paper adopts an improved heuristic evolutionary algorithm, wherein the clonal selection algorithm includes Baldwinian learning. In the process of image fusion, BCSA automatically adjusts the fusion coefficients of different sub-bands decomposed by CP according to the value of the fitness function. BCSA also adaptively controls the optimal search direction of the coefficients and accelerates the convergence rate of the algorithm. Finally, the fusion images are obtained via weighted integration of the optimal fusion coefficients and CP reconstruction. Our experiments show that the proposed method outperforms existing methods in terms of both visual effect and objective evaluation criteria, and the fused images are more suitable for human visual or machine perception.     

A novel image fusion algorithm based on nonsubsampled shearlet transform

To overcome the shortcoming of traditional image fusion method based on multi-scale transform, a novel adaptive image fusion algorithm based on nonsubsampled shearlet transform (NSST) is proposed. Firstly, the NSST is utilized to decompose the source images on various scales and in different directions, and the low frequency sub-band and bandpass sub-band coefficients are obtained. Secondly, for the low frequency sub-band coefficients, the singular value decomposition method in the gradient domain is used to estimate the local structure information of image, and an adaptive ‘weighted averaging’ fusion rule based on the sigmoid function and the extracted features is presented. To improve the quality of fused image, a novel sum-modified-Laplacian (NSML), which can extract more useful information from source images, is employed as the measurement to select bandpass sub-band coefficients. Finally, the fused image is obtained by performing the inverse NSST on the combined coefficients. The proposed fusion method is verified on several sets of multi-source images, and the experimental results show that the proposed approach can significantly outperform the conventional image fusion methods in terms of both objective evaluation criteria and visual quality.     

基于区域检测与非下采样轮廓波变换的红外与彩色可见光图像融合

针对灰度图像融合的分辨率低及现有的彩色图像融合方法融合的图像色彩不自然、不符合人的视觉感受的特点,在此提出一种基于Snake模型的区域检测和非下采样轮廓波变换(NSCT)的红外与彩色可见光图像融合的方法。首先对彩色可见光图像进行亮度、色度和饱和度(IHS)颜色空间变换提取亮度分量,并用Snake模型对红外图像的目标区域进行检测;然后对亮度分量和目标替换的红外图像应用NSCT分解,对所得到的高频系数采用像素点"绝对值和取大"、低频系数采用基于"亮度重映射技术"的加权融合规则进行融合;通过对融合系数进行NSCT逆变换获得融合图像的亮度分量,最后运用颜色空间逆变换得到融合图像。实验结果表明,所提出的融合方法既能保持可见光图像的高分辨率和自然色彩,又能准确保留红外图像中检测出的目标信息,获得视觉效果较好、综合指标较优的融合图像。     

基于区域检测与非下采样轮廓波变换的红外与彩色可见光图像融合

针对灰度图像融合的分辨率低及现有的彩色图像融合方法融合的图像色彩不自然、不符合人的视觉感受的特点,在此提出一种基于Snake模型的区域检测和非下采样轮廓波变换（NSCT）的红外与彩色可见光图像融合的方法。首先对彩色可见光图像进行亮度、色度和饱和度（IHS）颜色空间变换提取亮度分量,并用Snake模型对红外图像的目标区域进行检测;然后对亮度分量和目标替换的红外图像应用NSCT分解,对所得到的高频系数采用像素点绝对值和取大、低频系数采用基于亮度重映射技术的加权融合规则进行融合;通过对融合系数进行NSCT逆变换获得融合图像的亮度分量,最后运用颜色空间逆变换得到融合图像。实验结果表明,所提出的融合方法既能保持可见光图像的高分辨率和自然色彩,又能准确保留红外图像中检测出的目标信息,获得视觉效果较好、综合指标较优的融合图像。     

改进的曲波变换图像融合方法

考虑将曲波变换引入图像融合能够更好地提取原始图像,对一种新的图像融合方法—曲波变换图像融合法进行了研究。将图像序列进行曲波变换后,通过对所有图像的高频进行逆变换及域值处理来获得区域图。根据区域图中高频区域的边界点在每张图层上的活跃度不同求得区域边界的图层分布,利用插值获得高频区域的区域分布图。通过高频区域的膨胀求得整幅图的区域分布图,然后在曲波变换的变换域,利用区域分布图对多尺度的高频系数采用高斯加权求和;对低频系数采用取平均值的规则完成图像的融合。进行了图像融合实验,实验结果表明,与传统的小波变换及基于像素的曲波变换相比,提出的方法获得的融合图像边缘更清晰,更接近参考图像。     

非下采样变换的红外与可见光图像融合

基于非下采样Contourlet变换（NSCT）,提出了一种红外和可见光图像融合算法。针对低频子带系数和各带通方向子带系数分别提出了基于图像物理特征的系数加权选择方式与基于区域能量匹配的系数选择方式,即低频基于区域梯度信息、高频基于区域特征因子的加权与选择结合的图像融合算法。实验结果表明：非下采样Contourlet变换具有较快的运算速度,且经非下采样变换后能量更加集中,可提供更多的图像信息。相对于基于像素的图像融合算法,本文的图像融合算法具有更高的融合性能,是一种更适合图像融合的多尺度几何分析（MGA）工具。     

Infrared and visible image fusion method based on saliency detection in sparse domain

Infrared and visible image fusion is a key problem in the field of multi-sensor image fusion. To better preserve the significant information of the infrared and visible images in the final fused image, the saliency maps of the source images is introduced into the fusion procedure. Firstly, under the framework of the joint sparse representation (JSR) model, the global and local saliency maps of the source images are obtained based on sparse coefficients. Then, a saliency detection model is proposed, which combines the global and local saliency maps to generate an integrated saliency map. Finally, a weighted fusion algorithm based on the integrated saliency map is developed to achieve the fusion progress. The experimental results show that our method is superior to the state-of-the-art methods in terms of several universal quality evaluation indexes, as well as in the visual quality.     

Multifocus image fusion based on features contrast of multiscale products in nonsubsampled contourlet transform domain

In this paper, an efficient multifocus image fusion approach is proposed based on local features contrast of multiscale products in nonsubsampled contourlet transform (NSCT) domain. In order to improve the robustness of the fusion algorithm to the noise and select the coefficients of the fused image properly, the multiscale products, which can distinguish edge structures from noise more effectively in NSCT domain, is developed and introduced into image fusion field. The selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail. To improve the quality of the fused image, novel different local features contrast measurements, which are proved to be more suitable for human vision system and can extract more useful detail information from source images and inject them into the fused image, are developed and used to select coefficients from the clear parts of subimages to compose coefficients of fused images. Experimental results demonstrate the proposed method performs very well in fusion both noisy and noise-free multifocus images, and outperform conventional methods in terms of both visual quality and objective evaluation criteria.     

Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain

Multifocus image fusion aims at overcoming imaging cameras's finite depth of field by combining information from multiple images with the same scene. For the fusion problem of the multifocus image of the same scene, a novel algorithm is proposed based on multiscale products of the lifting stationary wavelet transform (LSWT) and the improved pulse coupled neural network (PCNN), where the linking strength of each neuron can be chosen adaptively. In order to select the coefficients of the fused image properly with the source multifocus images in a noisy environment, the selection principles of the low frequency subband coefficients and bandpass subband coefficients are discussed, respectively. For choosing the low frequency subband coefficients, a new sum modified-Laplacian (NSML) of the low frequency subband, which can effectively represent the salient features and sharp boundaries of the image in the LSWT domain, is an input to motivate the PCNN neurons; when choosing the high frequency subband coefficients, a novel local neighborhood sum of Laplacian of multiscale products is developed and taken as one type of feature of high frequency to motivate the PCNN neurons. The coefficients in the LSWT domain with large firing times are selected as coefficients of the fused image. Experimental results demonstrate that the proposed fusion approach outperforms the traditional discrete wavelet transform (DWT)-based, LSWT-based and LSWT-PCNN-based image fusion methods even though the source image is in a noisy environment in terms of both visual quality and objective evaluation.     

一种基于小波变换的红外偏振融合算法

针对红外偏振图像可以较好地抑制背景噪声,对目标边缘信息比较敏感的特点,提出一种基于小波变换的红外偏振融合算法,它主要用于红外辐射强度图像和偏振度图像融合,增加图像的信息量。首先采用小波变换对参与融合的每幅图像分别进行各尺度分解,得到各尺度小波系数,然后针对不同尺度小波系数,采用邻域平均梯度为判据进行融合,得到融合后的各尺度小波系数,最后通过小波逆变换进行图像重构,得到融合图像。融合前后的图像对比表明融合图像在保留辐射强度图像的清晰度的同时,突出了目标的边缘、轮廓信息。相对于辐射强度图像,融合图像的梯度均值提高了112%,相对于偏振度图像,融合图像的标准差提高了151%,信息熵提高了38%。     

Technique for gray-scale visual light and infrared image fusion based on non-subsampled shearlet transform

A novel image fusion technique based on NSST (non-subsampled shearlet transform) is presented, aiming at resolving the fusion problem of spatially gray-scale visual light and infrared images. NSST, as a new member of MGA (multi-scale geometric analysis) tools, possesses not only flexible direction features and optimal shift-invariance, but much better fusion performance and lower computational costs compared with several current popular MGA tools such as NSCT (non-subsampled contourlet transform). We specifically propose new rules for the fusion of low and high frequency sub-band coefficients of source images in the second step of the NSST-based image fusion algorithm. First, the source images are decomposed into different scales and directions using NSST. Then, the model of region average energy (RAE) is proposed and adopted to fuse the low frequency sub-band coefficients of the gray-scale visual light and infrared images. Third, the model of local directional contrast (LDC) is given and utilized to fuse the corresponding high frequency sub-band coefficients. Finally, the final fused image is obtained by using inverse NSST to all fused sub-images. In order to verify the effectiveness of the proposed technique, several current popular ones are compared over three different publicly available image sets using four evaluation metrics, and the experimental results demonstrate that the proposed technique performs better in both subjective and objective qualities.     

基于数学形态学的数字全息再现像融合方法

针对数字全息中不同再现距离获得的携带不同聚焦信息的再现像, 提出了一种基于数学形态学的多聚焦再现像融合方法, 以有效扩展成像景深。首先通过小波-Controulet变换获得源图像的高频和低频分量;然后, 针对数字全息中含散斑噪声的特点, 对高频分量采用基于数学形态学区域能量的方法进行融合, 对低频分量采用加权对比度法进行融合;最后, 将融合系数反变换得到融合图像。通过对算法的有效性分析和实验验证, 将本文提出的方法与不加入数学形态学的融合方法进行了对比研究。结果表明, 基于数学形态学的融合方法能充分抑制散斑噪声的影响, 保留更多细节信息, 有效扩展了成像景深范围达11.5 cm。其中, 对于表面粗糙且信息量较少的骰子, 基于数学形态学方法的空间梯度算子提高了11.8%, 熵值提高了2.7%;对于表面光滑且信息量较多的硬币, 其空间梯度算子提高了13.6%, 熵值提高了2.8%。     

Multi-focus image fusion algorithm based on compound PCNN in Surfacelet domain

In order to effectively retain details and suppress noise, a multi-focus image fusion method based on Surfacelet transform and compound PCNN is proposed. Surfacelet transform is a powerful multi-resolution analysis tool which is able to decompose the original image into a number of different frequency band sub-images, compound PCNN model is a combined model of PCNN and dual-channel PCNN which is to select the fusion coefficients from the decomposed coefficients, the Local sum-modified-Laplacian (LSML) is selected as external stimulus of compound PCNN, fusion coefficients are decided by compound PCNN. The experimental results show that the new method has a good performance, fusion image has more texture details and it is more similar to the original images, the objective evaluation indexes show that this method is superior to the traditional image fusion methods.     

Fusion method of infrared and visible images based on neighborhood characteristic and regionalization in NSCT domain

On fusing infrared and visible image, the traditional fusion method cannot get the better image quality. Based on neighborhood characteristic and regionalization in NSCT (Nonsubsampled Contourlet Transform) domain, the fusion algorithm was proposed. Firstly, NSCT was adopted to decompose infrared and visible images at different scales and directions for the low and high frequency coefficients, the low frequency coefficients which were fused with improving regional weighted fusion method based on neighborhood energy, and the high-frequency coefficients were fused with multi-judgment rule based on neighborhood characteristic regional process. Finally, the coefficients were reconstructed to obtain the fused image. The experimental results show that, compared with the other three related methods, the proposed method can get the biggest value of IE (information entropy), MI(VI,F) (mutual information from visible image), MI(VI,F) (mutual information from infrared image), MI (sum of mutual information), and Q^AB/F (edge retention). The proposed method can leave enough information in the original images and its details, and the fused images have better visual effects.     

Multi-focus image fusion based on window empirical mode decomposition

In order to improve multi-focus image fusion quality, a novel fusion algorithm based on window empirical mode decomposition (WEMD) is proposed. This WEMD is an improved form of bidimensional empirical mode decomposition (BEMD), due to its decomposition process using the adding window principle, effectively resolving the signal concealment problem. We used WEMD for multi-focus image fusion, and formulated different fusion rules for bidimensional intrinsic mode function (BIMF) components and the residue component. For fusion of the BIMF components, the concept of the Sum-modified-Laplacian was used and a scheme based on the visual feature contrast adopted; when choosing the residue coefficients, a pixel value based on the local visibility was selected. We carried out four groups of multi-focus image fusion experiments and compared objective evaluation criteria with other three fusion methods. The experimental results show that the proposed fusion approach is effective and performs better at fusing multi-focus images than some traditional methods.     

基于分块DCT变换编码的小波域多幅图像融合算法

提出了一种利用DCT变换和小波变换的特征层图像融合算法.其基本思想是先对多幅源图像进行分块DCT变换,选取较大方差对应的变换系数,将图像压缩为原图像大小的1/4,保留系数的对应坐标作为提取信息时的密钥;其次将经处理后的DCT系数直接作为小波变换的分解系数,经小波逆变换后得到融合信息.实验结果表明,该算法实现了多幅不同大小图像的融合,同时单一密钥只能提取单一图像. 关键词： 图像融合 小波变换 离散余弦变换 编码     

有限离散剪切波域的红外可见光图像融合

针对目前图像融合过程中的不足之处,结合有限离散剪切波具有高的方向敏感性和抛物尺度化特性,提出了一种有限离散剪切波变换下的图像融合算法。首先对严格配准的多传感器图像进行有限离散剪切波变换,得到低频子带系数和不同尺度不同方向的高频子带系数;然后对低频子带系数采用全局特征值和像素点之间的差异性与区域空间频率匹配度相结合的融合算法,高频方向子带系数采用方向权重对比度与相对区域平均梯度和相对区域方差相结合的方案;最后通过有限离散剪切波逆变换得到融合图像。实验结果表明,与其他的融合算法相比较,本文算法不但有良好的主观视觉效果,而且3幅图像的客观评价指标分别平均提高了0.9%、3.8%、3.1%,2.6%、3.8%、2.9%和1.5%、125%、59%,充分说明了本文融合算法的优越性。     

一种基于图像融合和卷积神经网络的相位恢复方法

相位恢复法利用光波传输中某一(或某些)截面上的光强分布来传感系统波前,其结构简单,不易受震动及环境干扰,被广泛应用于光学遥感和像差检测等领域.传统相位恢复法采用迭代计算,很难满足实时性要求,且在一定程度上依赖于迭代转换或迭代优化初值.为克服上述问题,本文提出了一种基于卷积神经网络的相位恢复方法,该方法采用基于小波变换的图像融合技术对焦面和离焦面图像进行融合处理,可在不损失图像信息的同时简化卷积神经网络的输入.网络模型训练完成后可依据输入的融合图像直接输出表征波前相位的4-9阶Zernike系数,且波前传感精度均方根(root-mean-square,RMS)可达0.015λ,λ=632.8 nm.研究了噪声、离焦量误差和图像采样分辨率等因素对波前传感精度的影响,验证了该方法对噪声具有一定鲁棒性,相对离焦量误差在7.5%内时,波前传感精度RMS仍可达0.05λ,且随着图像采样分辨率的提升,波前传感精度有所改善,但训练时间成本随之增加.此外,分析了实际应用中,当系统像差阶数与网络训练阶数略有差异时,本方法所能实现的传感精度,并给出了解决方案.     

A medical image fusion method based on energy classification of BEMD components

A medical image fusion method based on bi-dimensional empirical mode decomposition (BEMD) and dual-channel PCNN is proposed in this paper. The multi-modality medical images are decomposed into intrinsic mode function (IMF) components and a residue component. IMF components are divided into high-frequency and low-frequency components based on the component energy. Fusion coefficients are achieved by the following fusion rule: high frequency components and the residue component are superimposed to get more textures; low frequency components contain more details of the source image which are input into dual-channel PCNN to select fusion coefficients, the fused medical image is achieved by inverse transformation of BEMD. BEMD is a self-adaptive tool for analyzing nonlinear and non-stationary data; it doesn’t need to predefine filter or basis function. Dual-channel PCNN reduces the computational complexity and has a good ability in selecting fusion coefficients. A combined application of BEMD and dual-channel PCNN can extract the details of the image information more effectively. The experimental result shows the proposed algorithm gets better fusion result and has more advantages comparing with traditional fusion algorithms.     

基于平移不变剪切波变换域图像融合算法

针对传统基于多尺度变换的图像融合方法存在的缺点,提出了一种基于平移不变剪切波变换域的自适应图像融合新方法.首先,使用平移不变剪切波变换对源图像进行分解,得到低频子带及方向带通子带系数.然后,对于低频子带系数采用梯度域奇异值分解方法估计图像的局部结构信息,提出了基于提取的特征与S函数的可变加权融合策略;对于各方向带通子带系数,提出了一种基于改进的拉普拉斯能量和匹配的"加权平均"和选择相结合的系数选择策略.最后,对得到的融合系数进行逆变换得到融合图像.通过实验可以发现相比于传统的图像融合方法,本文方法得到了更高的客观指标,融合图像视觉效果更好.