A false color image fusion method based on multi-resolution color transfer in normalization YCBCR space

In this paper, a false color image fusion method for merging visible and infrared images is proposed. Firstly, the source images and reference image are decomposed respectively by Laplacian pyramid transform. Then the grayscale fused image and the difference images between the normalized source images are assigned to construct YC_BC_R components. In the color transfer step, all the three channels of the color space in each decomposition level are processed with the statistic color mapping according to the color characteristics of the corresponding sub-images of the reference image. Color transfer is designed based on the multi-resolution scheme in order to significantly improve the detailed information of the final image, and to reduce excessive saturation phenomenon to have a comparatively natural color appearance compared with the classical global-coloring algorithm. Moreover, the differencing operation between the normalized source images not only provides inter-sensor contrast to make popping the potential targets but also weakens the influence of the ambient illumination variety to a certain degree. Finally, the fused results and several metrics for evaluation of fused images subjectively and objectively illustrate that the proposed color image fusion algorithm can yield a more complete mental representation of the perceived scene, resulting in better situational awareness.     

Multi-focus image fusion algorithm based on compound PCNN in Surfacelet domain

In order to effectively retain details and suppress noise, a multi-focus image fusion method based on Surfacelet transform and compound PCNN is proposed. Surfacelet transform is a powerful multi-resolution analysis tool which is able to decompose the original image into a number of different frequency band sub-images, compound PCNN model is a combined model of PCNN and dual-channel PCNN which is to select the fusion coefficients from the decomposed coefficients, the Local sum-modified-Laplacian (LSML) is selected as external stimulus of compound PCNN, fusion coefficients are decided by compound PCNN. The experimental results show that the new method has a good performance, fusion image has more texture details and it is more similar to the original images, the objective evaluation indexes show that this method is superior to the traditional image fusion methods.     

Enhanced compression of integral images by combined use of residual images and MPEG-4 algorithm in three-dimensional integral imaging

In this paper, we proposed a novel approach to enhance the compression rate of integral images by combined use of the residual images generated from the sub-images and the MPEG-4 algorithm. In the proposed method, elemental images picked up from a three-dimensional object are transformed into sub-images, and these sub-images are sequentially rearranged with a spiral scanning topology and the first sub-image is assigned as the reference image. Then, by sequentially computing the differences between the reference image and other consecutive sub-images, a sequence of residual images is generated. Here, the residual images together with the reference image are modeled as the consecutive video frames just like a conventional moving picture. Finally, these residual images are compressed with the MPEG-4 algorithm. Experimental results show that compression efficiency of the proposed method has been improved up to 61.56% as compared to those of the JPEG-based compression scheme and up to 151.54% as compared to those of the conventional method averagely.     

一种基于小波系数综合能量特征的多算子图像融合算法

提出了一种新的多算子小波分解图像融合算法,算法对输入图像进行多尺度小波分解,综合考虑同层各子带及相邻层子带小波系数图像特征描述的相关一致性,基于局部空间复合能量和局部相对能量差特征测度,采用多算子自适应融合规则构造融合图像,得到含有丰富细节特征的融合图像。     

一种基于纹理特征的红外成像目标跟踪方法

提出了一种基于LBP（Local Binary Pattern)纹理特征的红外成像目标跟踪方法,将LBP纹理特征集成到了核跟踪方法中.根据目标各区域对背景的区分能力不同,提出了目标各区域置信度的评价方法,用基于区域置信度及空间距离核加权的LBP特征概率密度函数,构造了目标及候选目标的特征模型.通过相似性度量,利用均值漂移方法实现了基于纹理特征的红外成像目标跟踪.实验结果验证了该算法在红外成像目标跟踪中较基于灰度的均值漂移跟踪算法更为鲁棒.     

基于小波变换与小域特征模糊融合的人脸识别

小波变换是一种很好的图像压缩方法,利用小波变换对人脸图像进行三次小波分解,并将低频分量分割成为7个子图像。鉴于人脸上的各小域子图像信息的相互独立性。先利用小域子图像实现软分类,然后使用传统奇异值分解(SVD)法提取出各小域子图像的奇异值(SV),构造出小域奇异值特征向量,给出待识别图像对训练样本图像的隶属度,并采用模糊融合的方法对小域特征进行数据融合,获得识别结果。实验结果表明,该方法实现起来简单、识别速度快,具有很高的识别率。     

基于小波变换和数据融合技术的弱小目标检测

 鉴于弱小目标检测所固有的难点及常用的单一分辨率下的检测方法还不能准确稳定地检测出目标，提出了一种弱小目标检测新方法。考虑到实际应用中的复杂背景和大量干扰噪声，运用数据融合技术，先对图像进行小波多分辨率分解，然后将不同分辨率下的子图进行最优加权平均融合来检测弱小目标。用实地拍摄的空中弱小目标红外和可见光图像分别进行实验验证，实验图像取256×256像素点阵大小，其中目标占10×10像素左右。结果表明该方法能够准确稳定地检测弱小目标，为后续的跟踪作了很好的铺垫。     

Facial expression recognition algorithm using LGC based on horizontal and diagonal prior principle

The traditional Local Binary Pattern (LBP) algorithm can analyze the center pixel and neighboring pixels of the gray relationship, using in facial expression recognition, but you cannot consider the eyes, mouth, forehead and other areas in the expression feature different trends in the gradient direction. Firstly, we propose the Local Gradient Coding (LGC) algorithm, though the binary encoding to the horizontal, vertical and diagonal gradients respectively, to produce the fusion characteristic, then this can fully describe the facial muscles texture, wrinkles and other local deformation of contains the expression information. On the other hand, in order to reduce the computational complexity, and to remove the redundant, while not lose the main information contained in the face texture expression. This paper proposes and optimizes a new LGC operator based on horizontal and diagonal gradient prior principle (LGC-HD). The experimental results from JAFFE database show that, LGC-HD algorithm is more quickly and effectively to extract facial expression feature than LGC algorithm. Comparing to the traditional LBP algorithm, LBP uniform pattern and Gabor filtering, this LGC-HD algorithm has a significant advantage in the recognition accuracy and run time.     

Efficient compression of motion-compensated sub-images with Karhunen-Loeve transform in three-dimensional integral imaging

An approach to highly enhance the compression efficiency of the integral images by applying the Karhunen-Loeve transform (KLT) algorithm to the motion-compensated sub-images is proposed. The sub-images transformed from the elemental images picked-up from the three-dimensional (3D) object might represent the different perspectives of the object. Thus, the similarity among the sub-images gets better than that among the elemental images, so that an improvement of compression efficiency of the sub-images could be obtained. However, motion vectors occurred among the sub-images might result in an additional increase of image data to be compressed. Accordingly, in this paper, motion vectors have been estimated and compensated in all sub-image in advance. Then the KLT algorithm was applied to these motion-compensated sub-images for compression. It is shown from some experimental results that compression efficiency of the proposed method has been improved up to 24.44%, 40.62%, respectively, on the average compared to that of the conventional KLT compression method and that of the JPEG.     

Technique for image fusion based on NSST domain INMF

A novel technique for image fusion based on non-subsampled shearlet transform (NSST) domain improved non-negative matrix factorization (INMF) is proposed. Firstly, NSST, which owns much lower computational complexity compared with other conventional typical multi-resolution tools, is adopted to perform the multi-scale and multi-directional decompositions of source images. Secondly, the traditional basic NMF model is updated to be an improved NMF (INMF). INMF is utilized to capture the marked characteristics in a series of sub-band components from the pure mathematical point of view and without destroying the two-dimensional structural information in the image. Thirdly, with INMF and the model of local directional contrast (LDC), the fused sub-images can be achieved. Finally, the final fused image can be obtained by using the inverse NSST. Experimental results demonstrate that the presented technique outperforms other typical NMF-based ones in both visual effect and objective evaluation criteria.     

极值温差红外图像的自适应双局部增强算法

针对目前红外焦平面成像系统在观察目标、特别是极值温差目标时,各温度段灰度描述不均匀和细节不够的问题,提出了一种自适应红外图像双局部增强算法。详细介绍了通过空间分布和灰度统计特性两个方向实现对极值温差图像自适应增强的方法,该方法首先从红外图像的空间分布特性出发,将图像切割成多个局部图像,然后再从直方图灰度分布出发,将局部图像的直方图进行聚类分段,并对分段直方图均衡增强,最后对生成的每个局部图像增强结果进行线性插值拼接完成增强算法。通过在红外焦平面系统中实验证明了极值温差自适应的红外图像双局部增强算法的可行性,并获得了很好的效果,成像质量有明显提高。     

Image-fusion-based multi-resolution active contour model

This paper proposes an active contour model (snake) based on image fusion, which is used in object detection and object tracking. Firstly, a multi-resolution image fusion with wavelet transform is applied to obtain the multi-resolution fused images. Secondly, in the low-frequency sub-image, a snake is applied with the Sobel operator to detect the object's contour; and in other high-frequency sub-images, a wavelet-based snake is applied. The two convergent snakes are fused in a multi-resolution scheme to obtain a fused snake in the fused image in an original resolution. Experiment results indicate this fused snake's detection or tracking accuracy is improved greatly.     

基于小波变换的视差图像全局几何配准新算法

为了解决视差图像的快速、鲁棒配准问题,提出了一种基于小波近似图像和垂直细节图像由粗到精的加权全局配准策略.首先利用小波变换的多分辨率特性,对图像进行小波变换生成一个基于灰度的金字塔,从金字塔顶层到底层对每一层的近似分量进行由粗到精的配准.为了进一步提高配准可靠性,在金字塔次底层分别对近似图像和垂直细节图像进行加权相关配准,得到稳定的最优配准.     

基于偏最小二乘算法的人脸图像超分辨率技术

提出了基于偏最小二乘法回归的超分辨率复原算法.介绍了偏最小二乘法回归算法的原理,研究和分析了基于偏最小二乘法回归的超分辨率复原算法.将高低分辨率图像块的高频信息和中频信息作为其特征,并采用分块重叠的方法解决了复原时存在的方块效应.通过对亚洲人脸和欧美人脸的实验结果表明,提出的方法无论是对亚洲人脸还是欧美人脸都能取得较好的复原效果,并且在放大倍数较大的情况下,复原的效果仍然显著.     

基于形态学4子带分解金字塔的图像融合

提出了一种基于数学形态学滤波的多分辨力图像融合。这种融合方法使用了形态学开闭运算构造了低通与高通滤波器,将原始图像分解为4子带图像金字塔和4子带方向衬比度图像金字塔。然后利用方向衬比度和区域标准差进行图像融合得到融合的4子带图像金字塔,最后应用子带图像重构得到融合图像。融合实验表明,该方法优于传统的形态学金字塔图像融合,衬比度金字塔图像融合和小波分解图像融合。     

Multiscale top-hat selection transform based infrared and visual image fusion with emphasis on extracting regions of interest

To effectively combine regions of interest in original infrared and visual images, an adaptively weighted infrared and visual image fusion algorithm is developed based on the multiscale top-hat selection transform. First, the multiscale top-hat selection transform using multiscale structuring elements with increasing sizes is discussed. Second, the image regions of the original infrared and visual images at each scale are extracted by using the multiscale top-hat selection transform. Third, the final fusion regions are constructed from the extracted multiscale image regions. Finally, the final fusion regions are combined into a base image calculated from the original images to form the final fusion result. The combination of the final fusion regions uses the adaptive weight strategy, and the weights are adaptively obtained based on the importance of the extracted features. In the paper, we compare seven image fusion methods: wavelet pyramid algorithm (WP), shift invariant discrete wavelet transform algorithm (SIDWT), Laplacian pyramid algorithm (LP), morphological pyramid algorithm (MP), multiscale morphology based algorithm (MSM), center-surround top-hat transform based algorithm (CSTHT), and the proposed multiscale top-hat selection transform based algorithm. These seven methods are compared over five different publicly available image sets using three metrics of spatial frequency, mean gradient, and Q. The results show that the proposed algorithm is effective and may be useful for the applications related to the infrared and visual image fusion.     

一种基于强边缘块的时域多分辨率图像分割算法

针对序列图像的变化检测,提出了一种基于强边缘块的时域多分辨率图像分割算法.首先在具有明显边缘特征的图像序列中,提取图像强边缘块的直方图,然后,利用时域多分辨算法,比较不同帧之间的图像差异.这种方法不但能够检测出图像的变化,而且能够确定图像变化的类型.在阈值的选取过程中,采用了自适应阈值方法,实验证明这种方法取得了较好的效果.     

人脸图像光照预处理的一种新方法

人脸识别是图像分析和理解领域中最成功的应用之一,近年来得到了迅速的发展,但是阻碍人脸识别技术应用到实际中的瓶颈之一——光照问题,一直没能得到很好的解决。局部二值模式是最近发展起来的一种理论简单但功能强大的纹理分析算法,在计算机视觉等领域表现出良好的性能。将该纹理提取算法应用到图像预处理中并并利用大规模中国人脸图像数据库CAS-PEAL-R1来检验这种方法的有效性。实验结果表明:加入LBP纹理后,该方法能较好解决光照变化问题,提高识别性能。     

一种电磁干扰源成像多分辨率分区算法

在利用抛物反射面对电磁干扰源成像过程中,由于系统衍射受限导致干扰源成像模糊,分辨率低,难以分辨,由于不同频率不同区域干扰源所成图像分辨率不同,具有分区域多分辨率的特征,采用已有超分辨算法难以提高分辨率。利用Mean Shift算法,在原有算法基础上改进使其能够适应多分辨率的电磁干扰源成像,在图像分割的基础上对多分辨率图像进行分块抽离,并采用基于L_R迭代的盲反卷积算法分别对各区域进行分辨率的提高,仿真结果表明算法能够适应对干扰源的多分辨率电磁成像并提高分辨率。