Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain

Multifocus image fusion aims at overcoming imaging cameras's finite depth of field by combining information from multiple images with the same scene. For the fusion problem of the multifocus image of the same scene, a novel algorithm is proposed based on multiscale products of the lifting stationary wavelet transform (LSWT) and the improved pulse coupled neural network (PCNN), where the linking strength of each neuron can be chosen adaptively. In order to select the coefficients of the fused image properly with the source multifocus images in a noisy environment, the selection principles of the low frequency subband coefficients and bandpass subband coefficients are discussed, respectively. For choosing the low frequency subband coefficients, a new sum modified-Laplacian (NSML) of the low frequency subband, which can effectively represent the salient features and sharp boundaries of the image in the LSWT domain, is an input to motivate the PCNN neurons; when choosing the high frequency subband coefficients, a novel local neighborhood sum of Laplacian of multiscale products is developed and taken as one type of feature of high frequency to motivate the PCNN neurons. The coefficients in the LSWT domain with large firing times are selected as coefficients of the fused image. Experimental results demonstrate that the proposed fusion approach outperforms the traditional discrete wavelet transform (DWT)-based, LSWT-based and LSWT-PCNN-based image fusion methods even though the source image is in a noisy environment in terms of both visual quality and objective evaluation.     

一种基于方向窗特性的Contourlet域的多聚焦图像融合算法

针对同一场景多聚焦图像的融合问题,提出了一种基于方向区域特性的Contourlet域多聚焦图像融合算法.该算法对图像进行Contourlet变换,分解为不同尺度、不同方向的高低频子带|低频和高频子带分别采用方向区域的方差匹配度和能量作为融合规则|最后通过反变换得到融合图像.结果表明,所提出的方向区域方法能够更好地体现二维图像中的曲线或直线状边缘特征,是一种有效可行的图像融合算法.     

一种基于非下采样Contourlet变换多聚焦图像融合算法

针对现有小波类图像融合算法的不足,提出了一种基于非下采样Contourlet变换多聚焦图像融合算法,并在Contourlet域中引入了局部区域可见度以及局部方向能量的概念.针对低频子带系数和各带通方向子带系数分别提出了基于局部区域可见度以及基于局部方向能量的系数选择方案.通过对多聚焦图像融合的仿真实验,表明该算法相对于传统的基于离散小波变换和离散小波框架变换融合算法能够有效减少有用信息的丢失以及虚假信息的引入,同时能够从源图像中提取更多的有用信息并注入到融合图像中, 得到更好视觉效果和更优量化指标的融合图像.     

A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain

This paper presents a multi-focus image fusion algorithm based on dual-channel PCNN in NSCT domain. The fusion algorithm based on multi-scale transform is likely to produce the pseudo-Gibbs effects and it is not effective to fuse the dim or partial bright images. To solve these problems, this algorithm will get a number of different frequency sub-image of the two images by using the NSCT transform, the selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail, and the images are fused based on the improved dual-channel PCNN in order to determine the band-pass sub-band coefficient, at last fused image is obtained by using the inverse NSCT transform. Fusion rules based on dual-channel PCNN are used to solve the complexity of the PCNN parameter settings and long computing time problems. The experimental results show that the algorithm has overcome the defects of the traditional multi-focus image fusion algorithm and improved the fusion effect.     

基于可见光的多波段偏振图像融合新算法

采用了一种新的基于小波变换的偏振图像融合算法.首先,将两个波段中的每一波段三幅偏振图像利用小波变换分解成低频和高频部分,低频的小波系数平均值作为融合后的低频系数,高频细节系数根据不同区域特征选择方法以及对应输入图像小波系数的窗口区域方差来确定融合后高频小波系数,得到一个波段一幅图像.接着,将得到的图像再进行小波分解,采用低频图像的小波系数最小值作为融合后的低频系数,高频图像根据纹理一致性测度的纹理检测确定融合规则,用来调整高频小波系数,将来自不同图像的特征与细节融合在一起,并对融合图像质量进行了对比评价.实验结果表明,融合后的偏振图像不仅反映了场景的偏振信息,而且还包含了丰富的光谱信息,目标与背景的衬比度也得到了增强,为进一步的目标检测和识别提供了便利.     

基于非采样Contourlet变换的遥感图像融合算法

为了使融合后的多光谱图像在尽可能保持原始多光谱图像光谱特性的同时,显著提高空间分辨力,提出了一种基于非采样Contourlet变换(NSCT)的遥感图像融合算法。算法首先对全色波段图像进行非采样Contourlet变换,得到全色波段图像的低频子带系数和各带通方向子带系数;然后针对多光谱图像的每一个波段,将其进行双线性插值后作为融合后多光谱图像的低频子带系数,对全色波段图像的各带通方向子带系数采用基于成像系统物理特性的注入模型(调整系数)进行局部调整后,作为融合后多光谱图像的各带通方向子带系数,从而得到融合后多光谱图像的非采样Contourlet变换系数;最后再经非采样Contourlet逆变换得到该波段具有高空间分辨力的多光谱图像。采用IKONOS卫星遥感图像进行了仿真实验,实验结果表明,该算法在光谱保留和空间质量提高方面优于其它传统的遥感图像融合算法。     

A novel image fusion algorithm based on nonsubsampled shearlet transform

To overcome the shortcoming of traditional image fusion method based on multi-scale transform, a novel adaptive image fusion algorithm based on nonsubsampled shearlet transform (NSST) is proposed. Firstly, the NSST is utilized to decompose the source images on various scales and in different directions, and the low frequency sub-band and bandpass sub-band coefficients are obtained. Secondly, for the low frequency sub-band coefficients, the singular value decomposition method in the gradient domain is used to estimate the local structure information of image, and an adaptive ‘weighted averaging’ fusion rule based on the sigmoid function and the extracted features is presented. To improve the quality of fused image, a novel sum-modified-Laplacian (NSML), which can extract more useful information from source images, is employed as the measurement to select bandpass sub-band coefficients. Finally, the fused image is obtained by performing the inverse NSST on the combined coefficients. The proposed fusion method is verified on several sets of multi-source images, and the experimental results show that the proposed approach can significantly outperform the conventional image fusion methods in terms of both objective evaluation criteria and visual quality.     

一种基于NSCT变换的红外与可见光图像融合算法

针对红外与可见光图像融合,提出了一种基于NSCT变换的图像融合方法。对经NSCT变换的低频子带系数采用基于区域能量自适应加权的融合规则,对高频子带系数采用混合的融合方法,即对于低层,采用基于区域方差选大的融合方法,对于高层采用像素点的绝对值选大的融合方法。实验结果表明,该融合算法可以获得更多的细节信息,能获得较理想的融合图像。     

基于成像机理的小波包变换多聚焦图像融合

由于可见光成像系统的聚焦范围有限,因而在成像过程中,除聚焦良好的物体能生成清晰的图像外,该物体前后一定距离外的所有物体都将呈现不同程度的模糊.为了获得场景内所有物体均清晰的图像,在分析了多聚焦图像成像机理的基础上,提出了一种基于小波包变换的融合方法.它是将成像系统先聚焦在一部分对象上,得到其清晰的图像;然后再将其聚焦在另一部分对象上,得到另一清晰的图像;最后把这两幅实验图像加以融合,从而获得场景内所有物体均清晰的图像.实验结果表明,基于小波包变换的融合方法能够将信号的频带进行多层次划分,对高频成分也能进一步地分解,可有效综合多聚焦图像.     

基于小波变换的不同融合规则的图像融合研究

提出了利用小波变换按照不同融合规则及融合算子去构造融合图像对应的小波系数,得到一种新的基于多尺度分解的像素的图像融合方法.通过对融合图像统计参数对比表明,所提出的基于小波变换的像素局部能量作为准则的融合效果更好,既可避免传统融合规则存在的信息损失,又提高了融合图像的空间分辨率和清晰度,融合图像符合人的视觉特性,更有利于机器视觉.     

Multifocus image fusion and denoising scheme based on homogeneity similarity

A novel image fusion algorithm based on homogeneity similarity is proposed in this paper, aiming at solving the fusion problem of clean and noisy multifocus images. Firstly, the initial fused image is acquired with one multiresolution image fusion method. The pixels of the source images, which are similar to the corresponding initial fused image pixels, are considered to be located in the sharply focused regions. By this method, the initial focused regions are determined. In order to improve the fusion performance, morphological opening and closing are employed for post-processing. Secondly, the homogeneity similarity is introduced and used to fuse the clean and noisy multifocus images. Finally, the fused image is obtained by weighting the neighborhood pixels of the point of source images which are located at the focused region. Experimental results demonstrate that, for the clean multifocus image fusion, the proposed method performs better than some popular image fusion methods in both subjective and objective qualities. Furthermore, it can simultaneously resolve the image restoration and fusion problem when the source multifocus images are corrupted by the Gaussian white noise, and can also provide better performance than the conventional methods.     

Fusion method of infrared and visible images based on neighborhood characteristic and regionalization in NSCT domain

On fusing infrared and visible image, the traditional fusion method cannot get the better image quality. Based on neighborhood characteristic and regionalization in NSCT (Nonsubsampled Contourlet Transform) domain, the fusion algorithm was proposed. Firstly, NSCT was adopted to decompose infrared and visible images at different scales and directions for the low and high frequency coefficients, the low frequency coefficients which were fused with improving regional weighted fusion method based on neighborhood energy, and the high-frequency coefficients were fused with multi-judgment rule based on neighborhood characteristic regional process. Finally, the coefficients were reconstructed to obtain the fused image. The experimental results show that, compared with the other three related methods, the proposed method can get the biggest value of IE (information entropy), MI(VI,F) (mutual information from visible image), MI(VI,F) (mutual information from infrared image), MI (sum of mutual information), and Q^AB/F (edge retention). The proposed method can leave enough information in the original images and its details, and the fused images have better visual effects.     

基于数学形态学的数字全息再现像融合方法

针对数字全息中不同再现距离获得的携带不同聚焦信息的再现像, 提出了一种基于数学形态学的多聚焦再现像融合方法, 以有效扩展成像景深。首先通过小波-Controulet变换获得源图像的高频和低频分量;然后, 针对数字全息中含散斑噪声的特点, 对高频分量采用基于数学形态学区域能量的方法进行融合, 对低频分量采用加权对比度法进行融合;最后, 将融合系数反变换得到融合图像。通过对算法的有效性分析和实验验证, 将本文提出的方法与不加入数学形态学的融合方法进行了对比研究。结果表明, 基于数学形态学的融合方法能充分抑制散斑噪声的影响, 保留更多细节信息, 有效扩展了成像景深范围达11.5 cm。其中, 对于表面粗糙且信息量较少的骰子, 基于数学形态学方法的空间梯度算子提高了11.8%, 熵值提高了2.7%;对于表面光滑且信息量较多的硬币, 其空间梯度算子提高了13.6%, 熵值提高了2.8%。     

Image fusion algorithm based on redundant-lifting NSWMDA and adaptive PCNN

Pyramid decomposition in the NSCT transformation is a band-pass filtering process in the frequency domain where different scales of images are orthogonal. However, from the perspective of the image content, correlation is likely to exist between the fused images, and this kind of decomposition makes images of different scales contain redundant information, as a result of which the fused image may not capture the subtle information from the original images. In order to overcome the above-mentioned problem, an effective image fusion method based on redundant-lifting non-separable wavelet multi-directional analysis (NSWMDA) and adaptive pulse coupled neural network (PCNN) has been proposed. The original images are firstly decomposed by using the NSWMDA into several sub-bands in order to retain texture detail and contrast information of the images, and then adaptive PCNN algorithm is applied on the high-frequency directional sub-bands to extract the high-frequency information. The low-frequency sub-bands are evaluated by weighted average based on Gaussian kernel with a chosen maximum fusion rule. Results from experiments show that the proposed method can make the fused image maintains more texture details and contrast information.     

非下采样变换的红外与可见光图像融合

基于非下采样Contourlet变换（NSCT）,提出了一种红外和可见光图像融合算法。针对低频子带系数和各带通方向子带系数分别提出了基于图像物理特征的系数加权选择方式与基于区域能量匹配的系数选择方式,即低频基于区域梯度信息、高频基于区域特征因子的加权与选择结合的图像融合算法。实验结果表明：非下采样Contourlet变换具有较快的运算速度,且经非下采样变换后能量更加集中,可提供更多的图像信息。相对于基于像素的图像融合算法,本文的图像融合算法具有更高的融合性能,是一种更适合图像融合的多尺度几何分析（MGA）工具。     

Region-based fusion of infrared and visible images using nonsubsampled contourlet transform

With the nonsubsampled contourlet transform (NSCT), a novel region-segmentation-based fusion algorithm for infrared (IR) and visible images is presented.The IR image is segmented according to the physical features of the target.The source images are decomposed by the NSCT, and then, different fusion rules for the target regions and the background regions are employed to merge the NSCT coefficients respectively.Finally, the fused image is obtained by applying the inverse NSCT.Experimental results show that the proposed algorithm outperforms the pixel-based methods, including the traditional wavelet-based method and NSCT-based method.     

Technique for gray-scale visual light and infrared image fusion based on non-subsampled shearlet transform

A novel image fusion technique based on NSST (non-subsampled shearlet transform) is presented, aiming at resolving the fusion problem of spatially gray-scale visual light and infrared images. NSST, as a new member of MGA (multi-scale geometric analysis) tools, possesses not only flexible direction features and optimal shift-invariance, but much better fusion performance and lower computational costs compared with several current popular MGA tools such as NSCT (non-subsampled contourlet transform). We specifically propose new rules for the fusion of low and high frequency sub-band coefficients of source images in the second step of the NSST-based image fusion algorithm. First, the source images are decomposed into different scales and directions using NSST. Then, the model of region average energy (RAE) is proposed and adopted to fuse the low frequency sub-band coefficients of the gray-scale visual light and infrared images. Third, the model of local directional contrast (LDC) is given and utilized to fuse the corresponding high frequency sub-band coefficients. Finally, the final fused image is obtained by using inverse NSST to all fused sub-images. In order to verify the effectiveness of the proposed technique, several current popular ones are compared over three different publicly available image sets using four evaluation metrics, and the experimental results demonstrate that the proposed technique performs better in both subjective and objective qualities.     

Multifocus image fusion scheme using focused region detection and multiresolution

To solve the fusion problem of the multifocus images of the same scene, a novel algorithm based on focused region detection and multiresolution is proposed. In order to integrate the advantages of spatial domain-based fusion methods and transformed domain-based fusion methods, we use a technique of focused region detection and a new fusion method of multiscale transform (MST) to guide pixel combination. Firstly, the initial fused image is acquired with a novel multiresolution image fusion method. The pixels of the original images, which are similar to the corresponding initial fused image pixels, are considered to be located in the sharply focused regions. By this method, the initial focused regions can be determined, and the techniques of morphological opening and closing are employed for post-processing. Then the pixels within the focused regions in each source image are selected as the pixels of the fused image; meanwhile, the initial fused image pixels which are located at the focused border regions are retained as the pixels of the final fused image. The fused image is then obtained. The experimental results show that the proposed fusion approach is effective and performs better in fusing multi-focus images than some current methods.     

基于伪维格纳分布的图像融合

提出了一种基于伪维格纳分布(PWVD)的融合方法.利用一维N像素的滑动窗口在各个方向上对各待融合图像进行伪维格纳变换,选择均方根最大的方向为各待融合网像的PWVD分解方向,分解形成待融合图像不同频段的能量谱图,然后,针对各待融合不同频段的能量谱图,融合原则足高频段取区域能量最大,低频段取能量方差最大,形成具有不同频段的融合能量谱网,最后,对能量谱网进行PWVD逆变换,形成融合图像.对红外与可见光图像、多聚焦图像、电子计算机X射线断层扫描(CT)图像与磁共振(MR)图像和红外与合成孔径雷达(SAR)图像进行了融合实验,并对融合图像和待融合图像进行了信息熵对比.实验结果表明,采用本文算法的融合图像保留了待融合图像的绝大部分信息.     

Intensity image denoising for laser active imaging system using nonsubsampled contourlet transform and SURE approach

This paper presents an algorithm based on nonsubsampled contourlet transform (NSCT) and Stein's unbiased risk estimate with a linear expansion of thresholds (SURE-LET) approach for intensity image denoising. First, we analyzed the multiplicative noise model of intensity image and make the non-logarithmic transform on the noisy signal. Then, as a multiscale geometric representation tool with multi-directivity and shift-invariance, NSCT was performed to capture the geometric information of images. Finally, SURE-LET strategy was modified to minimize the estimation of the mean square error between the clean image and the denoised one in the NSCT domain. Experiments on real intensity images show that the algorithm has excellent denoising performance in terms of the peak signal-to-noise ratio (PSNR), the computation time and the visual quality.