A medical image fusion method based on energy classification of BEMD components

A medical image fusion method based on bi-dimensional empirical mode decomposition (BEMD) and dual-channel PCNN is proposed in this paper. The multi-modality medical images are decomposed into intrinsic mode function (IMF) components and a residue component. IMF components are divided into high-frequency and low-frequency components based on the component energy. Fusion coefficients are achieved by the following fusion rule: high frequency components and the residue component are superimposed to get more textures; low frequency components contain more details of the source image which are input into dual-channel PCNN to select fusion coefficients, the fused medical image is achieved by inverse transformation of BEMD. BEMD is a self-adaptive tool for analyzing nonlinear and non-stationary data; it doesn’t need to predefine filter or basis function. Dual-channel PCNN reduces the computational complexity and has a good ability in selecting fusion coefficients. A combined application of BEMD and dual-channel PCNN can extract the details of the image information more effectively. The experimental result shows the proposed algorithm gets better fusion result and has more advantages comparing with traditional fusion algorithms.     

Image fusion scheme using a novel dual-channel PCNN in lifting stationary wavelet domain

This paper presents a new multi-source image fusion scheme based on lifting stationary wavelet transform (LSWT) and a novel dual-channel pulse-coupled neural network (PCNN). By using LSWT, we can calculate a flexible multiscale and shift-invariant representation of registered images. After decomposing the original images using LSWT, a new dual-channel pulse coupled neural network, which can overcome some shortcomings of original PCNN for image fusion and putout the fusion image directly, is proposed and used for the fusion of sub-band coefficients of LSWT. In this fusion scheme, a new sum-modified-laplacian(NSML) of the low frequency sub-band image, which represent the edge-feature of the low frequency sub-band image in SLWT domain, is presented and input to motivate the dual-channel PCNN. For the fusion of high frequency sub-band coefficients, a novel local neighborhood modified-laplacian (LNML) measurement is developed and used as external stimulus to motivate the dual-channel PCNN. This fusion scheme is verified on several sets of multi-source images, and the experiments show that the algorithms proposed in the paper can significantly improve image fusion performance, compared with the fusion algorithms such as traditional wavelet, LSWT, and LSWT-PCNN in terms of objective criteria and visual appearance.     

A multi-focus image fusion algorithm based on an improved dual-channel PCNN in NSCT domain

This paper presents a multi-focus image fusion algorithm based on dual-channel PCNN in NSCT domain. The fusion algorithm based on multi-scale transform is likely to produce the pseudo-Gibbs effects and it is not effective to fuse the dim or partial bright images. To solve these problems, this algorithm will get a number of different frequency sub-image of the two images by using the NSCT transform, the selection principles of different subband coefficients obtained by the NSCT decomposition are discussed in detail, and the images are fused based on the improved dual-channel PCNN in order to determine the band-pass sub-band coefficient, at last fused image is obtained by using the inverse NSCT transform. Fusion rules based on dual-channel PCNN are used to solve the complexity of the PCNN parameter settings and long computing time problems. The experimental results show that the algorithm has overcome the defects of the traditional multi-focus image fusion algorithm and improved the fusion effect.     

Image fusion algorithm based on redundant-lifting NSWMDA and adaptive PCNN

Pyramid decomposition in the NSCT transformation is a band-pass filtering process in the frequency domain where different scales of images are orthogonal. However, from the perspective of the image content, correlation is likely to exist between the fused images, and this kind of decomposition makes images of different scales contain redundant information, as a result of which the fused image may not capture the subtle information from the original images. In order to overcome the above-mentioned problem, an effective image fusion method based on redundant-lifting non-separable wavelet multi-directional analysis (NSWMDA) and adaptive pulse coupled neural network (PCNN) has been proposed. The original images are firstly decomposed by using the NSWMDA into several sub-bands in order to retain texture detail and contrast information of the images, and then adaptive PCNN algorithm is applied on the high-frequency directional sub-bands to extract the high-frequency information. The low-frequency sub-bands are evaluated by weighted average based on Gaussian kernel with a chosen maximum fusion rule. Results from experiments show that the proposed method can make the fused image maintains more texture details and contrast information.     

基于变换域PCNN的近红外与彩色可见光融合

针对近红外与彩色可见光图像融合后对比度低、细节丢失和颜色失真等问题,提出一种基于多尺度变换和自适应脉冲耦合神经网络(PCNN-pulse coupled neural network,PCNN)的红外与彩色可见光图像融合的新算法。首先将彩色可见光图像转换到HSI（hue saturation intensity)空间,HSI色彩空间包含亮度、色度和饱和度三个分量,并且这三个分量互不相关,因此利用这个特点可对三个分量分别进行处理。将其亮度分量与近红外图像分别进行多尺度变换,变换方法选择Tetrolet变换。变换后分别得到低频和高频分量,针对图像低频分量,提出一种期望最大的低频分量融合规则;针对图像高频分量,采用高斯差分算子调节PCNN模型的阈值,提出一种自适应的PCNN模型作为融合规则。处理后的高低频分量经过Tetrolet逆变换得到的融合图像作为新的亮度图像。然后将新的亮度图像和原始的色度和饱和度分量反向映射到RGB空间,得到融合后的彩色图像。为了解决融合带来的图像平滑化和原始图像光照不均的问题,引入颜色与锐度校正机制(colour and sharpness correction, CSC)来提高融合图像的质量。为了验证方法的有效性,选取了5组分辨率为1 024×680近红外与彩色可见光图像进行试验,并与当前高效的四种融合方法以及未进行颜色校正的本方法进行了对比。实验结果表明,同其他图像融合算法进行对比分析,该方法在有无CSC颜色的情况下均能保留最多的细节和纹理,可见度均大大提高,同时本方法的结果在光照条件较弱的情况下具有更多的细节和纹理,均具有更好的对比度和良好的色彩再现性。在信息保留度、颜色恢复、图像对比度和结构相似性等客观指标上均具有较大优势。     

Novel fusion method for visible light and infrared images based on NSST–SF–PCNN

The purpose of image fusion is to combine the source images of the same scene into a single composite image with more useful information and much better visual effects, which is undoubtedly suitable for further image processing tasks. This paper presented a novel fusion method for visible light and infrared images based on non-subsampled shearlet transform (NSST)–spatial frequency (SF)–pulse coupled neural network (PCNN). As a recently developed multi-resolution geometric analysis tool, NSST not only has remarked superiorities over other past conventional tools in terms of information capturing and computational costs saving, but also overcomes the lack of shift-invariance in shearlet transform (ST), so NSST applies to conducting the decompositions and reconstructions. Besides, traditional PCNN model is also upgraded to be an improved one called IPCNN in this paper to fuse the low-frequency and high-frequency subband coefficients. In the IPCNN structure, on the one hand, the value of the linking strength β is determined by the SF which represents the gradient features of the subband image; on the other hand, the time matrix is utilized to adaptively decide the iteration number of the IPCNN model, which is helpful to increase the function efficiency and save computational resources. Experimental results indicate that the proposed method performs well and has obvious superiorities over other current typical ones in both subjective visual performance and objective criteria.     

Multifocus image fusion scheme based on features of multiscale products and PCNN in lifting stationary wavelet domain

Multifocus image fusion aims at overcoming imaging cameras's finite depth of field by combining information from multiple images with the same scene. For the fusion problem of the multifocus image of the same scene, a novel algorithm is proposed based on multiscale products of the lifting stationary wavelet transform (LSWT) and the improved pulse coupled neural network (PCNN), where the linking strength of each neuron can be chosen adaptively. In order to select the coefficients of the fused image properly with the source multifocus images in a noisy environment, the selection principles of the low frequency subband coefficients and bandpass subband coefficients are discussed, respectively. For choosing the low frequency subband coefficients, a new sum modified-Laplacian (NSML) of the low frequency subband, which can effectively represent the salient features and sharp boundaries of the image in the LSWT domain, is an input to motivate the PCNN neurons; when choosing the high frequency subband coefficients, a novel local neighborhood sum of Laplacian of multiscale products is developed and taken as one type of feature of high frequency to motivate the PCNN neurons. The coefficients in the LSWT domain with large firing times are selected as coefficients of the fused image. Experimental results demonstrate that the proposed fusion approach outperforms the traditional discrete wavelet transform (DWT)-based, LSWT-based and LSWT-PCNN-based image fusion methods even though the source image is in a noisy environment in terms of both visual quality and objective evaluation.     

基于Contourlet的遥感图像放大与增强

提出一种遥感图像放大和增强的新方法.应用拉普拉斯塔形变换（LP）构建原图像的细节图像,采取双三次插值的方法分别放大原图像和细节图像,并将两个放大后的图像相加后线性处理.经过二级Contourlet分解变换,构造非线性增强函数增强Contourlet系数.最后用原图像取代Contourlet分解变换后的低频子带后重构图像,完成图像的放大和增强.结果表明,此方法能丰富放大后图像的细节,增强效果良好,有效提高放大后遥感图像的空间分辨率.     

改进的曲波变换图像融合方法

考虑将曲波变换引入图像融合能够更好地提取原始图像,对一种新的图像融合方法—曲波变换图像融合法进行了研究。将图像序列进行曲波变换后,通过对所有图像的高频进行逆变换及域值处理来获得区域图。根据区域图中高频区域的边界点在每张图层上的活跃度不同求得区域边界的图层分布,利用插值获得高频区域的区域分布图。通过高频区域的膨胀求得整幅图的区域分布图,然后在曲波变换的变换域,利用区域分布图对多尺度的高频系数采用高斯加权求和;对低频系数采用取平均值的规则完成图像的融合。进行了图像融合实验,实验结果表明,与传统的小波变换及基于像素的曲波变换相比,提出的方法获得的融合图像边缘更清晰,更接近参考图像。     

基于二代curvelet变换的图像融合研究

曲波(Curvelet)作为一种新的多尺度分析方法比小波更加适合分析二维图像中的曲线或直线状边缘特征,而且具有更高的逼近精度和更好的稀疏表达能力.将curvelet变换引入图像融合,能够更好地提取原始图像的特征,为融合图像提供更多的信息.第二代curvelet理论的提出也使得其理论更易理解和实现.因此,提出了一种基于第二代curvelet变换的图像融合方法,首先将图像进行curvelet变换,然后在相应尺度上利用融合规则将curvelet系数融合,最后进行重构得到融合结果.对多聚焦图像进行了实验,采用均方误差、偏差指数和相关系数对融合结果进行了客观评价,并与基于小波变换的融合进行了比较,实验结果表明该方法除分解2层时与小波性能相当,取其他分解层数时均获得更好的融合效果.     

基于可见光的多波段偏振图像融合新算法

采用了一种新的基于小波变换的偏振图像融合算法.首先,将两个波段中的每一波段三幅偏振图像利用小波变换分解成低频和高频部分,低频的小波系数平均值作为融合后的低频系数,高频细节系数根据不同区域特征选择方法以及对应输入图像小波系数的窗口区域方差来确定融合后高频小波系数,得到一个波段一幅图像.接着,将得到的图像再进行小波分解,采用低频图像的小波系数最小值作为融合后的低频系数,高频图像根据纹理一致性测度的纹理检测确定融合规则,用来调整高频小波系数,将来自不同图像的特征与细节融合在一起,并对融合图像质量进行了对比评价.实验结果表明,融合后的偏振图像不仅反映了场景的偏振信息,而且还包含了丰富的光谱信息,目标与背景的衬比度也得到了增强,为进一步的目标检测和识别提供了便利.     

基于互信息改进型脉冲耦合神经网络多值图像分割

为了自动地进行图像的多值分割,从原始图像与分割图像之间的相互关系出发,以最大互信息为优化分割目标,以互信息熵差作为一种新的分类类数判据,在对传统脉冲耦合神经网络模型改进的基础上,提出了一种基于最大互信息改进型脉冲耦合神经网络图像多值分割算法.理论分析和实验结果表明,该方法能够自动确定最佳分割迭代次数及最佳分割灰度类数,对分割图像具有良好的特征划分能力,且在分割类数较少的情况下,能较好地保持图像细节、纹理及边缘等信息,对不同图像分割准确度高,具有较强的适用性.     

An infrared and visible image fusion method based upon multi-scale and top-hat transforms

The high-frequency components in the traditional multi-scale transform method are approximately sparse, which can represent different information of the details. But in the low-frequency component, the coefficients around the zero value are very few, so we cannot sparsely represent low-frequency image information. The low-frequency component contains the main energy of the image and depicts the profile of the image. Direct fusion of the low-frequency component will not be conducive to obtain highly accurate fusion result. Therefore, this paper presents an infrared and visible image fusion method combining the multi-scale and top-hat transforms. On one hand, the new top-hat-transform can effectively extract the salient features of the low-frequency component. On the other hand, the multi-scale transform can extract highfrequency detailed information in multiple scales and from diverse directions. The combination of the two methods is conducive to the acquisition of more characteristics and more accurate fusion results. Among them, for the low-frequency component, a new type of top-hat transform is used to extract low-frequency features, and then different fusion rules are applied to fuse the low-frequency features and low-frequency background; for high-frequency components, the product of characteristics method is used to integrate the detailed information in high-frequency. Experimental results show that the proposed algorithm can obtain more detailed information and clearer infrared target fusion results than the traditional multiscale transform methods. Compared with the state-of-the-art fusion methods based on sparse representation, the proposed algorithm is simple and efficacious, and the time consumption is significantly reduced.     

基于特征提取和脉冲耦合神经网络的图像融合算法

为了提高目标检测的准确度和精确度,提出了一种新的基于特征提取和脉冲耦合神经网络(Pulse-coupled neural network,PCNN)模型的融合算法。该算法的原理是:首先对原图像进行特征提取,然后分别建立基于处理后的图像及原图像的PCNN。融合的作用是通过PCNN的链接输入得以体现的。融合图像综合了各个侧重于原图像不同特征的滤波器的选择性。仿真结果证明,所提出的算法在增加图像目标的可识别程度方面效果明显。     

基于Shearlet变换的自适应图像融合算法

针对多聚焦图像与多光谱和全色图像的成像特点,结合Shearlet变换具有较好的稀疏表示图像特征的性质,提出了一种新的图像融合规则.并基于此融合规则,提出了基于Shearlet变换的自适应图像融合算法.在多聚焦图像的融合算法中,分别对聚焦不同的图像进行Shearlet变换,并基于本文提出的融合规则,对分解后的高低频系数进行融合处理. 通过与多种算法的比较实验证明了本文提出的算法融合的图像具有更高的清晰度和更加丰富的细节信息.在多光谱和全色图像的融合处理中,提出了一种基于Shearlet变换与HSV变换相结合的图像融合方法.该算法首先对多光谱图像作HSV变换,将得到的V分量与全色图像进行Shearlet分解与融合,在融合过程中对分解系数选用特定的融合准则进行融合,最后将融合生成新的分量与H、S分量进行HSV逆变换产生新的RGB融合图像. 该算法在空间分辨率和光谱特性两方面达到了良好的平衡,融合后的图像在减少光谱失真的同时,有效增强了空间分辨率. 仿真实验证明,本文算法融合的图像与传统的多光谱和全色图像融合算法相比,具有更佳的融合性能和视觉效果.     

基于深度玻尔兹曼模型的红外与可见光图像融合

为了克服红外与可见光图像融合时噪声干扰及易产生伪影导致目标轮廓不鲜明、对比度低的缺点,提出一种基于深度模型分割的图像融合方法.首先,采用深度玻尔兹曼机学习红外与可见光的目标和背景轮廓先验,构建轮廓的深度分割模型,通过Split Bregman迭代算法获取最优能量分割后的红外与可见光图像轮廓;然后再使用非下采样轮廓波变换对源图像进行分解,并针对所分割的背景轮廓采用结构相似度的规则进行系数组合;最后进行非下采样轮廓波反变换重构出融合图像.数值试验证明,该算法可以有效获取目标和背景轮廓均清晰的融合图像,融合结果不但具有较高的对比度,还能抑制噪声影响,具有有效性.     

Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain

Multimodal medical image fusion aims to fuse images with complementary multisource information. In this paper, we propose a novel multimodal medical image fusion method using pulse coupled neural network (PCNN) and a weighted sum of eight-neighborhood-based modified Laplacian (WSEML) integrating guided image filtering (GIF) in non-subsampled contourlet transform (NSCT) domain. Firstly, the source images are decomposed by NSCT, several low- and high-frequency sub-bands are generated. Secondly, the PCNN-based fusion rule is used to process the low-frequency components, and the GIF-WSEML fusion model is used to process the high-frequency components. Finally, the fused image is obtained by integrating the fused low- and high-frequency sub-bands. The experimental results demonstrate that the proposed method can achieve better performance in terms of multimodal medical image fusion. The proposed algorithm also has obvious advantages in objective evaluation indexes VIFF, Q_W, API, SD, EN and time consumption.     

基于分块DCT变换编码的小波域多幅图像融合算法

提出了一种利用DCT变换和小波变换的特征层图像融合算法.其基本思想是先对多幅源图像进行分块DCT变换,选取较大方差对应的变换系数,将图像压缩为原图像大小的1/4,保留系数的对应坐标作为提取信息时的密钥;其次将经处理后的DCT系数直接作为小波变换的分解系数,经小波逆变换后得到融合信息.实验结果表明,该算法实现了多幅不同大小图像的融合,同时单一密钥只能提取单一图像. 关键词： 图像融合 小波变换 离散余弦变换 编码     

A novel image fusion algorithm based on nonsubsampled shearlet transform

To overcome the shortcoming of traditional image fusion method based on multi-scale transform, a novel adaptive image fusion algorithm based on nonsubsampled shearlet transform (NSST) is proposed. Firstly, the NSST is utilized to decompose the source images on various scales and in different directions, and the low frequency sub-band and bandpass sub-band coefficients are obtained. Secondly, for the low frequency sub-band coefficients, the singular value decomposition method in the gradient domain is used to estimate the local structure information of image, and an adaptive ‘weighted averaging’ fusion rule based on the sigmoid function and the extracted features is presented. To improve the quality of fused image, a novel sum-modified-Laplacian (NSML), which can extract more useful information from source images, is employed as the measurement to select bandpass sub-band coefficients. Finally, the fused image is obtained by performing the inverse NSST on the combined coefficients. The proposed fusion method is verified on several sets of multi-source images, and the experimental results show that the proposed approach can significantly outperform the conventional image fusion methods in terms of both objective evaluation criteria and visual quality.     

基于Contourlet域隐马尔可夫树模型的图像融合算法

本文提出一种基于Contourlet域隐马尔可夫树(HMT)模型的图像融合算法。由于Contourlet变换能克服小波变换在处理高维信号时的不足,它比小波变换具有更好的方向性、较高的逼近精度和更好的稀疏表达性能。而HMT模型能有效捕获尺度间、尺度内的contourlet系数特性。因此将Contourlet域HMT模型应用于图像融合领域,能充分挖掘数据之间的相关性,更好的提取图像边缘特征,为融合提取更多的特征信息。实验结果表明本文的算法获得的融合图像视觉效果良好,是一种有效且可行的融合算法。