A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain

This paper presents a multi-focus image fusion algorithm based on dual-channel PCNN in NSCT domain. The fusion algorithm based on multi-scale transform is likely to produce the pseudo-Gibbs effects and it is not effective to fuse the dim or partial bright images. To solve these problems, this algorithm will get a number of different frequency sub-image of the two images by using the NSCT transform, the selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail, and the images are fused based on the improved dual-channel PCNN in order to determine the band-pass sub-band coefficient, at last fused image is obtained by using the inverse NSCT transform. Fusion rules based on dual-channel PCNN are used to solve the complexity of the PCNN parameter settings and long computing time problems. The experimental results show that the algorithm has overcome the defects of the traditional multi-focus image fusion algorithm and improved the fusion effect.     

Multi-focus image fusion based on window empirical mode decomposition

In order to improve multi-focus image fusion quality, a novel fusion algorithm based on window empirical mode decomposition (WEMD) is proposed. This WEMD is an improved form of bidimensional empirical mode decomposition (BEMD), due to its decomposition process using the adding window principle, effectively resolving the signal concealment problem. We used WEMD for multi-focus image fusion, and formulated different fusion rules for bidimensional intrinsic mode function (BIMF) components and the residue component. For fusion of the BIMF components, the concept of the Sum-modified-Laplacian was used and a scheme based on the visual feature contrast adopted; when choosing the residue coefficients, a pixel value based on the local visibility was selected. We carried out four groups of multi-focus image fusion experiments and compared objective evaluation criteria with other three fusion methods. The experimental results show that the proposed fusion approach is effective and performs better at fusing multi-focus images than some traditional methods.     

Image fusion algorithm based on redundant-lifting NSWMDA and adaptive PCNN

Pyramid decomposition in the NSCT transformation is a band-pass filtering process in the frequency domain where different scales of images are orthogonal. However, from the perspective of the image content, correlation is likely to exist between the fused images, and this kind of decomposition makes images of different scales contain redundant information, as a result of which the fused image may not capture the subtle information from the original images. In order to overcome the above-mentioned problem, an effective image fusion method based on redundant-lifting non-separable wavelet multi-directional analysis (NSWMDA) and adaptive pulse coupled neural network (PCNN) has been proposed. The original images are firstly decomposed by using the NSWMDA into several sub-bands in order to retain texture detail and contrast information of the images, and then adaptive PCNN algorithm is applied on the high-frequency directional sub-bands to extract the high-frequency information. The low-frequency sub-bands are evaluated by weighted average based on Gaussian kernel with a chosen maximum fusion rule. Results from experiments show that the proposed method can make the fused image maintains more texture details and contrast information.     

基于改进的空域相关的多聚焦图像融合

提出了一种简单有效的像素级多聚焦图像融合方法。针对正交小波变换缺乏平移不变性而产生视觉失真的缺陷,采用Atrous算法将原图像分解在不同频率域上。Atrous算法先将滤波器h0(n),h1(n)各点间插入适当的零值后再与低频信号做卷积,故又称为"多孔算法"。将具有抑制噪声性能的空阈相关法作为高频子图像的融合规则,选取相关性强边缘特征显著的点作为最终融合子图像的像素点。实验表明,由此融合的图像能完好的保留边缘纹理信息。融合后的图像在客观评价和主管视觉效果上均有提高。     

Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain

Multifocus image fusion aims at overcoming imaging cameras's finite depth of field by combining information from multiple images with the same scene. For the fusion problem of the multifocus image of the same scene, a novel algorithm is proposed based on multiscale products of the lifting stationary wavelet transform (LSWT) and the improved pulse coupled neural network (PCNN), where the linking strength of each neuron can be chosen adaptively. In order to select the coefficients of the fused image properly with the source multifocus images in a noisy environment, the selection principles of the low frequency subband coefficients and bandpass subband coefficients are discussed, respectively. For choosing the low frequency subband coefficients, a new sum modified-Laplacian (NSML) of the low frequency subband, which can effectively represent the salient features and sharp boundaries of the image in the LSWT domain, is an input to motivate the PCNN neurons; when choosing the high frequency subband coefficients, a novel local neighborhood sum of Laplacian of multiscale products is developed and taken as one type of feature of high frequency to motivate the PCNN neurons. The coefficients in the LSWT domain with large firing times are selected as coefficients of the fused image. Experimental results demonstrate that the proposed fusion approach outperforms the traditional discrete wavelet transform (DWT)-based, LSWT-based and LSWT-PCNN-based image fusion methods even though the source image is in a noisy environment in terms of both visual quality and objective evaluation.     

基于人工鱼群优化分块的多聚焦图像融合

在多聚焦图像的融合过程中,对源图像采用固定大小的分块会导致融合后的图像存在块效应、边缘模糊甚至聚焦错误。为了克服此问题,提出了一种新的基于人工鱼群优化分块的多聚焦图像融合方法。首先,将源图像分解成互不重叠的方块,利用聚焦准则选取清晰度高的方块,将已选择的方块合并重构成初始融合图像。然后,利用改进的人工鱼群优化算法,根据一定的适应度值,寻找最优大小的分块方式,获得更优的融合图像。该方法与基于空域、频域及其他优化算法的融合方法进行了多个实验比较,结果表明,该方法获得的融合图像具有较好的客观质量和主观视觉感觉。     

基于人工鱼群优化分块的多聚焦图像融合

在多聚焦图像的融合过程中,对源图像采用固定大小的分块会导致融合后的图像存在块效应、边缘模糊甚至聚焦错误。为了克服此问题,提出了一种新的基于人工鱼群优化分块的多聚焦图像融合方法。首先,将源图像分解成互不重叠的方块,利用聚焦准则选取清晰度高的方块,将已选择的方块合并重构成初始融合图像。然后,利用改进的人工鱼群优化算法,根据一定的适应度值,寻找最优大小的分块方式,获得更优的融合图像。 该方法与基于空域、频域及其他优化算法的融合方法进行了多个实验比较,结果表明,该方法获得的融合图像具有较好的客观质量和主观视觉感觉。     

基于分块DCT变换编码的小波域多幅图像融合算法

提出了一种利用DCT变换和小波变换的特征层图像融合算法.其基本思想是先对多幅源图像进行分块DCT变换,选取较大方差对应的变换系数,将图像压缩为原图像大小的1/4,保留系数的对应坐标作为提取信息时的密钥;其次将经处理后的DCT系数直接作为小波变换的分解系数,经小波逆变换后得到融合信息.实验结果表明,该算法实现了多幅不同大小图像的融合,同时单一密钥只能提取单一图像. 关键词： 图像融合 小波变换 离散余弦变换 编码     

Technique for image fusion based on NSST domain INMF

A novel technique for image fusion based on non-subsampled shearlet transform (NSST) domain improved non-negative matrix factorization (INMF) is proposed. Firstly, NSST, which owns much lower computational complexity compared with other conventional typical multi-resolution tools, is adopted to perform the multi-scale and multi-directional decompositions of source images. Secondly, the traditional basic NMF model is updated to be an improved NMF (INMF). INMF is utilized to capture the marked characteristics in a series of sub-band components from the pure mathematical point of view and without destroying the two-dimensional structural information in the image. Thirdly, with INMF and the model of local directional contrast (LDC), the fused sub-images can be achieved. Finally, the final fused image can be obtained by using the inverse NSST. Experimental results demonstrate that the presented technique outperforms other typical NMF-based ones in both visual effect and objective evaluation criteria.     

一种基于小波变换的红外偏振融合算法

针对红外偏振图像可以较好地抑制背景噪声,对目标边缘信息比较敏感的特点,提出一种基于小波变换的红外偏振融合算法,它主要用于红外辐射强度图像和偏振度图像融合,增加图像的信息量。首先采用小波变换对参与融合的每幅图像分别进行各尺度分解,得到各尺度小波系数,然后针对不同尺度小波系数,采用邻域平均梯度为判据进行融合,得到融合后的各尺度小波系数,最后通过小波逆变换进行图像重构,得到融合图像。融合前后的图像对比表明融合图像在保留辐射强度图像的清晰度的同时,突出了目标的边缘、轮廓信息。相对于辐射强度图像,融合图像的梯度均值提高了112%,相对于偏振度图像,融合图像的标准差提高了151%,信息熵提高了38%。     

基于特征提取和脉冲耦合神经网络的图像融合算法

为了提高目标检测的准确度和精确度,提出了一种新的基于特征提取和脉冲耦合神经网络(Pulse-coupled neural network,PCNN)模型的融合算法。该算法的原理是:首先对原图像进行特征提取,然后分别建立基于处理后的图像及原图像的PCNN。融合的作用是通过PCNN的链接输入得以体现的。融合图像综合了各个侧重于原图像不同特征的滤波器的选择性。仿真结果证明,所提出的算法在增加图像目标的可识别程度方面效果明显。     

Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain

This paper presents a new multi-source image fusion scheme based on lifting stationary wavelet transform (LSWT) and a novel dual-channel pulse-coupled neural network (PCNN). By using LSWT, we can calculate a flexible multiscale and shift-invariant representation of registered images. After decomposing the original images using LSWT, a new dual-channel pulse coupled neural network, which can overcome some shortcomings of original PCNN for image fusion and putout the fusion image directly, is proposed and used for the fusion of sub-band coefficients of LSWT. In this fusion scheme, a new sum-modified-laplacian(NSML) of the low frequency sub-band image, which represent the edge-feature of the low frequency sub-band image in SLWT domain, is presented and input to motivate the dual-channel PCNN. For the fusion of high frequency sub-band coefficients, a novel local neighborhood modified-laplacian (LNML) measurement is developed and used as external stimulus to motivate the dual-channel PCNN. This fusion scheme is verified on several sets of multi-source images, and the experiments show that the algorithms proposed in the paper can significantly improve image fusion performance, compared with the fusion algorithms such as traditional wavelet, LSWT, and LSWT-PCNN in terms of objective criteria and visual appearance.     

Infrared and visible image fusion method based on saliency detection in sparse domain

Infrared and visible image fusion is a key problem in the field of multi-sensor image fusion. To better preserve the significant information of the infrared and visible images in the final fused image, the saliency maps of the source images is introduced into the fusion procedure. Firstly, under the framework of the joint sparse representation (JSR) model, the global and local saliency maps of the source images are obtained based on sparse coefficients. Then, a saliency detection model is proposed, which combines the global and local saliency maps to generate an integrated saliency map. Finally, a weighted fusion algorithm based on the integrated saliency map is developed to achieve the fusion progress. The experimental results show that our method is superior to the state-of-the-art methods in terms of several universal quality evaluation indexes, as well as in the visual quality.     

A medical image fusion method based on energy classification of BEMD components

A medical image fusion method based on bi-dimensional empirical mode decomposition (BEMD) and dual-channel PCNN is proposed in this paper. The multi-modality medical images are decomposed into intrinsic mode function (IMF) components and a residue component. IMF components are divided into high-frequency and low-frequency components based on the component energy. Fusion coefficients are achieved by the following fusion rule: high frequency components and the residue component are superimposed to get more textures; low frequency components contain more details of the source image which are input into dual-channel PCNN to select fusion coefficients, the fused medical image is achieved by inverse transformation of BEMD. BEMD is a self-adaptive tool for analyzing nonlinear and non-stationary data; it doesn’t need to predefine filter or basis function. Dual-channel PCNN reduces the computational complexity and has a good ability in selecting fusion coefficients. A combined application of BEMD and dual-channel PCNN can extract the details of the image information more effectively. The experimental result shows the proposed algorithm gets better fusion result and has more advantages comparing with traditional fusion algorithms.     

一种基于小波变换的多尺度多算子图像融合方法

图像融合技术以其综合多传感器信息的优越性日益受到诸多领域的重视。为了使其应用在医学、遥感、计算机视觉、气象预报、军事目标识别等方面更迅速、深入地开展,有效、实用的融合算法是至关重要的。本文在小波变换金字塔结构的基础上,提出了一种多尺度多算子融合方法,对热红外图像和可见光图像的融合进行了研究。结果融合效果很好,目标和背景区别显著,而且边缘不突兀。由于这种方法对小波分解的层数要求不高,因此计算量不大,便于并行处理及硬件实时化实现,具有广阔的应用前景。     

基于遗传算法参数优化的PCNN红外图像分割

构造一种基于遗传算法参数优化的脉冲耦合神经网络(PCNN)红外图像分割算法。该算法首先利用PCNN的全局耦合性和脉冲同步性对输入图像进行点火处理,根据PCNN的输出结果计算熵作为遗传算法的适应度函数,并利用熵的变化量作为遗传算法的收敛依据,对PCNN模型中影响图像分割的参数进行组合优化,结合PCNN生物视觉特性和遗传算法解空间随机搜索能力来寻找关键参数的最优值。将遗传算法和PCNN进行结合可充分发挥二者优势,将本文方法与最大类间方差法（OTSU）、最大熵直方图分割算法和PCNN分割方法进行对比,通过交叉熵、区域对比度等客观指标对分割后的图像进行定量分析,结果表明无论从主观视觉还是客观指标,本文方法分割效果优于其他对比方法。     

Multi-focus image fusion based on robust principal component analysis and pulse-coupled neural network

Multi-focus image fusion combines multiple source images with different focus points into one image, so that the resulting image appears all in-focus. In order to improve the accuracy of focused region detection and fusion quality, a novel multi-focus image fusion scheme based on robust principal component analysis (RPCA) and pulse-coupled neural network (PCNN) is proposed. In this method, registered source images are decomposed into principal component matrices and sparse matrices with RPCA decomposition. The local sparse features computed from the sparse matrix construct a composite feature space to represent the important information from the source images, which become inputs to PCNN to motivate the PCNN neurons. The focused regions of the source images are detected by the firing maps of PCNN and are integrated to construct the final, fused image. Experimental results demonstrate that the superiority of the proposed scheme over existing methods and highlight the expediency and suitability of the proposed method.     

Multi-focus image fusion using a bilateral gradient-based sharpness criterion

The aim of multi-focus image fusion is to combine multiple images with different focuses for enhancing the perception of a scene. The challenge is to how evaluate the local content (sharp) information of the input images. To tackle the above challenge, a new bilateral sharpness criterion is proposed to exploit both the strength and the phase coherence that are evaluated using the gradient information of the images. Then the proposed bilateral sharpness criterion is further exploited to perform weighted aggregation of multi-focus images. Extensive experimental results are provided to demonstrate that the proposed bilateral sharpness criterion outperforms conventional seven sharpness criterions.     

一种基于小波系数综合能量特征的多算子图像融合算法

提出了一种新的多算子小波分解图像融合算法,算法对输入图像进行多尺度小波分解,综合考虑同层各子带及相邻层子带小波系数图像特征描述的相关一致性,基于局部空间复合能量和局部相对能量差特征测度,采用多算子自适应融合规则构造融合图像,得到含有丰富细节特征的融合图像。