基于Contourlet域隐马尔可夫树模型的图像融合算法

针对多尺度几何变换统计信号处理这一领域的优势,提出一种基于Contourlet域隐马尔可夫树模型的图像融合算法.由于Contourlet变换能克服小波变换在处理高维信号时的不足,它比小波变换具有更好的方向性、较高的逼近精度和更好的稀疏表达性能.而隐马尔可夫树模型能有效捕获尺度间、尺度内的Contourlet系数特性.因此将Contourlet域隐马尔可夫树模型应用于图像融合领域,能充分挖掘数据之间的相关性,更好的提取图像边缘特征,为融合提取更多的特征信息.实验结果表明基于Contourlet域隐马尔可夫树图像融合算法获得的融合图像视觉效果良好,是一种有效且可行的融合算法.     

一种基于方向窗特性的Contourlet域的多聚焦图像融合算法

针对同一场景多聚焦图像的融合问题,提出了一种基于方向区域特性的Contourlet域多聚焦图像融合算法.该算法对图像进行Contourlet变换,分解为不同尺度、不同方向的高低频子带;低频和高频子带分别采用方向区域的方差匹配度和能量作为融合规则;最后通过反变换得到融合图像.结果表明,所提出的方向区域方法能够更好地体现二维图像中的曲线或直线状边缘特征,是一种有效可行的图像融合算法.     

基于区域分维和非采样Contourlet变换的图像融合算法

针对源图像有用信息的提取,提出了基于区域分维和非下采样Contourlet变换相结合的红外与可见光图像融合算法.将图像的区域属性、区域大小、边缘强度以及纹理显著程度等特点用图像不同尺度上的区域分维进行描述,对于非下采样Contourlet变换低频系数,根据源图像不同尺度上的区域分维进行基于系数选择的融合.针对带通子带系数设计了系数局部匹配度算子,依据匹配度不同采用加权和系数选取相结合的融合规则.与其他常规融合方法进行比较,该算法可有效实现红外与可见光图像的融合.     

基于区域分维和非采样Contourlet变换的图像融合算法

针对源图像有用信息的提取,提出了基于区域分维和非下采样Contourlet变换相结合的红外与可见光图像融合算法.将图像的区域属性、区域大小、边缘强度以及纹理显著程度等特点用图像不同尺度上的区域分维进行描述,对于非下采样Contourlet变换低频系数,根据源图像不同尺度上的区域分维进行基于系数选择的融合.针对带通子带系数设计了系数局部匹配度算子,依据匹配度不同采用加权和系数选取相结合的融合规则.与其他常规融合方法进行比较,该算法可有效实现红外与可见光图像的融合.     

一种基于方向窗特性的Contourlet域的多聚焦图像融合算法

针对同一场景多聚焦图像的融合问题,提出了一种基于方向区域特性的Contourlet域多聚焦图像融合算法.该算法对图像进行Contourlet变换,分解为不同尺度、不同方向的高低频子带|低频和高频子带分别采用方向区域的方差匹配度和能量作为融合规则|最后通过反变换得到融合图像.结果表明,所提出的方向区域方法能够更好地体现二维图像中的曲线或直线状边缘特征,是一种有效可行的图像融合算法.     

一种基于非下采样Contourlet变换多聚焦图像融合算法

针对现有小波类图像融合算法的不足,提出了一种基于非下采样Contourlet变换多聚焦图像融合算法,并在Contourlet域中引入了局部区域可见度以及局部方向能量的概念.针对低频子带系数和各带通方向子带系数分别提出了基于局部区域可见度以及基于局部方向能量的系数选择方案.通过对多聚焦图像融合的仿真实验,表明该算法相对于传统的基于离散小波变换和离散小波框架变换融合算法能够有效减少有用信息的丢失以及虚假信息的引入,同时能够从源图像中提取更多的有用信息并注入到融合图像中, 得到更好视觉效果和更优量化指标的融合图像.     

基于Contourlet域隐马尔可夫树模型的图像融合算法

本文提出一种基于Contourlet域隐马尔可夫树(HMT)模型的图像融合算法。由于Contourlet变换能克服小波变换在处理高维信号时的不足,它比小波变换具有更好的方向性、较高的逼近精度和更好的稀疏表达性能。而HMT模型能有效捕获尺度间、尺度内的contourlet系数特性。因此将Contourlet域HMT模型应用于图像融合领域,能充分挖掘数据之间的相关性,更好的提取图像边缘特征,为融合提取更多的特征信息。实验结果表明本文的算法获得的融合图像视觉效果良好,是一种有效且可行的融合算法。     

基于非采样提升小波-Contourlet变换的图像融合算法

为克服非采样Contourlet变换中金字塔分解的不足,首先在提升小波变换的基础上,通过取消其奇偶分裂环节得到具有平移不变性的非采样提升小波变换,然后用此变换来取代非采样Contourlet变换中的金字塔分解,得到新的非采样提升小波-Contourlet变换。将此变换与一定的融合规则相结合,提出了一种基于非采样提升小波-Contourlet变换的图像融合算法。实验表明,该算法相对于非采样Contourlet变换能从源图像中提取更多有用信息注入到融合图像中,可得到更高性能的融合图像。     

基于区域分割和Counterlet变换的图像融合算法

提出了一种基于区域分割和Contourlet变换的图像融合算法。首先,对各源图像做区域分割,并利用区域能量比和区域清晰比的概念来度量和提取区域信息;然后,对各源图像进行多尺度非子采样Contourlet分解,分解后的高频部分采用绝对值取大算子进行融合,低频部分则采用基于区域的融合规则和算子进行融合;最后进行重构得到融合图像。对红外与可见光图像进行了融合实验,并与基于像素的àtrous小波变换和Contourlet变换的融合效果进行了比较。结果表明,采用本文算法的融合图像既保留了可见光图像的光谱信息,又继承了红外图像的目标信息,其熵值高于基于像素的融合方法约10%,交叉熵仅为基于像素的融合方法的1%左右。     

一种基于区域的NSCT域多光谱与高分辨率图像融合算法

提出了一种基于多阈值分割和无下采样Contourlet变换(Nonsubsampled Contourlet Transform,NSCT)的多光谱与高分辨率图像融合算法.对多光谱图像进行多阈值分割,并利用提出的区域均值比指标将多光谱图像划分为需要进行空间细节增强及需要保持光谱特征的区域;然后利用NSCT对高分辨率图像和多光谱图像的强度分量进行多尺度、多方向分解.分解后的低频部分采用基于窗口邻域的融合规则和算子进行融合,高频部分按区域均值比指标进行区域融合;最后进行重构得到融合后的多光谱图像的强度分量,经IHS逆变换后得到高分辨率的多光谱图像.实验结果表明,该算法可获得较理想的融合图像,融合效果优于IHS变换法、基于像素的à trous小波变换法以及基于像素的NSCT法.     

Image fusion through local feature extraction by using multi-scale top-hat by reconstruction operators

The purpose of image fusion is to combine useful image features of different original images into the final fusion image, which will produce one useful result image for different applications. One of the main difficulties of image fusion is extracting useful image features of different original images. In some cases, useful image features are local image features of the whole image. To efficiently extract local image features and produce an efficient fusion result, an image fusion algorithm based on the extracted local image features by using multi-scale top-hat by reconstruction operators is proposed in this paper. Firstly, multi-scale local feature extraction using multi-scale top-hat by reconstruction operators is discussed. Then, based on the extracted multi-scale local features of different original images, the useful image features for image fusion are constructed. Finally, the constructed useful image features for image fusion are combined into the final fusion image. Experimental results on different types of images show that, the proposed algorithm performs well for image fusion.     

Pulse Coupled Neural Network-Based Multimodal Medical Image Fusion via Guided Filtering and WSEML in NSCT Domain

Multimodal medical image fusion aims to fuse images with complementary multisource information. In this paper, we propose a novel multimodal medical image fusion method using pulse coupled neural network (PCNN) and a weighted sum of eight-neighborhood-based modified Laplacian (WSEML) integrating guided image filtering (GIF) in non-subsampled contourlet transform (NSCT) domain. Firstly, the source images are decomposed by NSCT, several low- and high-frequency sub-bands are generated. Secondly, the PCNN-based fusion rule is used to process the low-frequency components, and the GIF-WSEML fusion model is used to process the high-frequency components. Finally, the fused image is obtained by integrating the fused low- and high-frequency sub-bands. The experimental results demonstrate that the proposed method can achieve better performance in terms of multimodal medical image fusion. The proposed algorithm also has obvious advantages in objective evaluation indexes VIFF, Q_W, API, SD, EN and time consumption.     

基于结构相似度的图像融合质量评价

在分析现有图像融合质量评价方法特点的基础上，提出了新型的、基于结构相似度的图像融合质量评价方法.针对不同情况，分别采用平均结构相似度、加权平均结构相似度、结构信息与交互信息量之乘积作为图像融合质量客观评价标准.该方法充分考虑了图像的结构信息和人类视觉系统的特性，可以为不同场合下选择不同的算法提供依据.对不同融合算法的质量评价结果表明,该方法是一种有效的图像融合质量评价方法.     

基于形态学4子带分解金字塔的图像融合

提出了一种基于数学形态学滤波的多分辨力图像融合。这种融合方法使用了形态学开闭运算构造了低通与高通滤波器,将原始图像分解为4子带图像金字塔和4子带方向衬比度图像金字塔。然后利用方向衬比度和区域标准差进行图像融合得到融合的4子带图像金字塔,最后应用子带图像重构得到融合图像。融合实验表明,该方法优于传统的形态学金字塔图像融合,衬比度金字塔图像融合和小波分解图像融合。     

Multiscale top-hat selection transform based infrared and visual image fusion with emphasis on extracting regions of interest

To effectively combine regions of interest in original infrared and visual images, an adaptively weighted infrared and visual image fusion algorithm is developed based on the multiscale top-hat selection transform. First, the multiscale top-hat selection transform using multiscale structuring elements with increasing sizes is discussed. Second, the image regions of the original infrared and visual images at each scale are extracted by using the multiscale top-hat selection transform. Third, the final fusion regions are constructed from the extracted multiscale image regions. Finally, the final fusion regions are combined into a base image calculated from the original images to form the final fusion result. The combination of the final fusion regions uses the adaptive weight strategy, and the weights are adaptively obtained based on the importance of the extracted features. In the paper, we compare seven image fusion methods: wavelet pyramid algorithm (WP), shift invariant discrete wavelet transform algorithm (SIDWT), Laplacian pyramid algorithm (LP), morphological pyramid algorithm (MP), multiscale morphology based algorithm (MSM), center-surround top-hat transform based algorithm (CSTHT), and the proposed multiscale top-hat selection transform based algorithm. These seven methods are compared over five different publicly available image sets using three metrics of spatial frequency, mean gradient, and Q. The results show that the proposed algorithm is effective and may be useful for the applications related to the infrared and visual image fusion.     

Multifocus image fusion scheme using focused region detection and multiresolution

To solve the fusion problem of the multifocus images of the same scene, a novel algorithm based on focused region detection and multiresolution is proposed. In order to integrate the advantages of spatial domain-based fusion methods and transformed domain-based fusion methods, we use a technique of focused region detection and a new fusion method of multiscale transform (MST) to guide pixel combination. Firstly, the initial fused image is acquired with a novel multiresolution image fusion method. The pixels of the original images, which are similar to the corresponding initial fused image pixels, are considered to be located in the sharply focused regions. By this method, the initial focused regions can be determined, and the techniques of morphological opening and closing are employed for post-processing. Then the pixels within the focused regions in each source image are selected as the pixels of the fused image; meanwhile, the initial fused image pixels which are located at the focused border regions are retained as the pixels of the final fused image. The fused image is then obtained. The experimental results show that the proposed fusion approach is effective and performs better in fusing multi-focus images than some current methods.     

A novel image fusion algorithm based on nonsubsampled shearlet transform

To overcome the shortcoming of traditional image fusion method based on multi-scale transform, a novel adaptive image fusion algorithm based on nonsubsampled shearlet transform (NSST) is proposed. Firstly, the NSST is utilized to decompose the source images on various scales and in different directions, and the low frequency sub-band and bandpass sub-band coefficients are obtained. Secondly, for the low frequency sub-band coefficients, the singular value decomposition method in the gradient domain is used to estimate the local structure information of image, and an adaptive ‘weighted averaging’ fusion rule based on the sigmoid function and the extracted features is presented. To improve the quality of fused image, a novel sum-modified-Laplacian (NSML), which can extract more useful information from source images, is employed as the measurement to select bandpass sub-band coefficients. Finally, the fused image is obtained by performing the inverse NSST on the combined coefficients. The proposed fusion method is verified on several sets of multi-source images, and the experimental results show that the proposed approach can significantly outperform the conventional image fusion methods in terms of both objective evaluation criteria and visual quality.     

A medical image fusion method based on energy classification of BEMD components

A medical image fusion method based on bi-dimensional empirical mode decomposition (BEMD) and dual-channel PCNN is proposed in this paper. The multi-modality medical images are decomposed into intrinsic mode function (IMF) components and a residue component. IMF components are divided into high-frequency and low-frequency components based on the component energy. Fusion coefficients are achieved by the following fusion rule: high frequency components and the residue component are superimposed to get more textures; low frequency components contain more details of the source image which are input into dual-channel PCNN to select fusion coefficients, the fused medical image is achieved by inverse transformation of BEMD. BEMD is a self-adaptive tool for analyzing nonlinear and non-stationary data; it doesn’t need to predefine filter or basis function. Dual-channel PCNN reduces the computational complexity and has a good ability in selecting fusion coefficients. A combined application of BEMD and dual-channel PCNN can extract the details of the image information more effectively. The experimental result shows the proposed algorithm gets better fusion result and has more advantages comparing with traditional fusion algorithms.     

近自然彩色图像融合算法及其实时处理系统的发展

在军事和生产领域,特别是在极其恶劣的可视条件下,图像融合技术越来越强调融合效果显示的"近自然"感觉,以及人类视觉感知的要求。从彩色图像融合算法的发展概况出发,着重介绍了两种具有代表性的基于视觉特性的近自然彩色图像融合方法,并特别阐述了课题组近期开展的相关算法研究成果。总结了国内外实时彩色图像融合系统的发展现状,概括了课题组已具备的硬件实验基础,综合分析了实时彩色图像融合技术的若干关键技术,如多源图像特征分析、实时图像配准、融合图像后处理等。针对实时图像融合技术的应用状况,提出图像融合系统未来的发展趋势。