基于多尺度区域对比的显著目标识别

为了对图像中的显著目标进行更精确的识别,提出一种新的基于多尺度区域对比的视觉显著性计算模型。首先基于多尺度思想将图像分别分割为不同数目的超像素,对超像素内的像素颜色值取平均以生成抽象化图像;然后根据显著特征的稀少性及显著特征的聚集性,计算单一尺度下超像素颜色特征的显著性值;最后通过取各尺度超像素显著度的平均值来融合多尺度显著图,得到最终的视觉显著图。实验表明,以MSRA图库中的1 000张随机自然图片为例,该模型较现有较好的区域对比模型,显著目标识别的精确率提高了14.8%,F-Measure值提高了9.2%。与现有的算法相比,该模型提高了算法对显著目标大小的适应性,减少了背景对显著目标识别的干扰,具有更好的一致性,能更好地识别显著目标。     

基于生物视觉特征和视觉心理学的视频显著性检测算法

提出了一种空域和时域相结合的视频显著性检测算法.对单帧图像,受视觉皮层层次化感知特性和Gestalt视觉心理学的启发,提出了一种层次化的静态显著图检测方法.在底层,通过符合生物视觉特性的特征图像（双对立颜色特征及亮度特征图像）的非线性简化模型来合成特征图像,形成多个候选显著区域;在中层,根据矩阵的最小Frobenius-范数（F-范数）性质选取竞争力最强的候选显著区域作为局部显著区域;在高层,利用Gestalt视觉心理学的核心理论,对在中层得到的局部显著区域进行整合,得到具有整体感知的空域显著图.对序列帧图像,基于运动目标在位置、运动幅度和运动方向一致性的假设,对Lucas-Kanade算法检测出的光流点进行二分类,排除噪声点的干扰,并利用光流点的运动幅度来衡量运动目标运动显著性.最后,基于人类视觉对动态信息与静态信息敏感度的差异提出了一种空域和时域显著图融合的通用模型.实验结果表明,该方法能够抑制视频背景中的噪声并且解决了运动目标稀疏等问题,能够较好地从复杂场景中检测出视频中的显著区域.     

Saliency detection based on biological plausibility of hypercomplex Fourier spectrum contrast

This Letter proposes a novel saliency detection method based on biological plausibility of a hypercomplex Fourier spectrum contrast algorithm. The proposed algorithm takes into consideration not only simulation of simple cortical cells in the receptive field of humans but also the texture-color feature global spectrum contrast of an image. First, we utilize log-Gabor filters to mimic simple cortical cells in the receptive field of humans. Two complex numbers of texture colors are acquired through feature maps in hue, saturation, and value color space by log-Gabor. Second, we build the hypercomplex number using these representations of feature maps. Finally, the salient object is detected by spectrum contrast in the hypercomplex Fourier domain. Experimental results show that the proposed algorithm outperforms the state-of-the-art methods.     

Infrared image enhancement through saliency feature analysis based on multi-scale decomposition

To improve contrast between dim target region and background in infrared (IR) long-range surveillance, this paper proposes a fast image enhancement approach using saliency feature extraction based on multi-scale decomposition. Firstly, a smooth based multi-scale decomposition is designed and applied to original infrared image, generating sub-images with various frequency components at different decomposition levels. The dim target regions of sub-images are extracted by a local frequency-tuned based saliency feature detection method, secondly. With saliency maps created by saliency extraction using multi-scale local windows with different sizes, the sub-images are enhanced at different decomposition scales. Finally, the enhanced result is reconstructed by synthesizing the all sub-images with adjustable synthetic weights. Since salient areas are analyzed based on fast multi-scale image decomposition, IR image can be s enhanced with good contrast successfully and rapidly. Compared with other algorithms, the experimental results prove that the proposed method is robust and efficient for IR image enhancement.     

Local graph regularized coding for salient object detection

Subspace segmentation based salient object detection has received increasing interests in recent years. To preserve the locality and similarity of regions, a grouping effect of representation is introduced to segment the salient object and background in subspace. Then a new saliency map is calculated by incorporating this local graph regularizer into coding, which explicitly explores the data self-representation model and thus locate more accurate salient regions. Moreover, a heuristic object-based dictionary from background superpixels is obtained in border set removing the image regions within the potential object regions. Experimental results on four large benchmark databases demonstrate that the proposed method performs favorably against eight recent state-of-the-art methods in terms of three evaluation criterions, with a reduction of MAE by 19.8% than GR and 29.3% than CB in the two SED datasets, respectively. Meanwhile, our method also runs faster than the comparative detection approaches.     

基于背景原型对比度的显著性物体检测

针对传统显著性模型在自然图像的显著性物体检测中存在的缺陷,提出了一种利用背景原型(background prototypes)进行对比的视觉关注模型,以实现显著性物体的检测与提取;传统显著性模型主要通过计算区域中心与四周区域差异性实现显著性检测,而自然场景中显著性区域和背景区域往往都存在较大差异,导致在复杂图像中难以获得理想检测效果;基于背景原型对比度的显著性物体检测方法在图像分割生成的超像素图基础上,选择距离图像中心较远的图像区域作为背景原型区域,通过计算图像中任意区域与这些背景原型区域的颜色对比度准确检测和提取图像中的显著性物体;实验结果表明,基于背景原型对比度的显著性模型可以更好地滤除杂乱背景,产生更稳定、准确的显著图,在准确率、召回率和F-measure等关键性能和直观视觉效果上均优于目前最先进的显著性模型,计算复杂度低,利于应用推广。     

基于纹理显著性的微光图像目标检测

微光图像对比度较低,目标显著性不明显,目标自动探测难度大.针对此问题,本文提出一种噪声鲁棒性较好的图像局部纹理粗糙度算法,并给出一种适用于微光图像显著分析的纹理显著性算法.首先,提出一种新的局部纹理粗糙度算法,该算法利用最佳尺寸计算局部纹理粗糙度,对纹理图像进行加噪实验,与基于局部分形维的粗糙度方法相比,本文局部纹理粗糙度算法表现出较好的噪声鲁棒性;其次,在提取图像粗糙度特征图的基础上,给出一种针对纹理的显著性度量算法;最后,将纹理显著性算法应用于微光图像目标检测,实验结果证明了该算法的有效性.     

基于稀疏先验的空间目标图像盲反演方法

针对图像盲反演算法未考虑空间目标图像自身特性,致使对空间目标图像细节信息恢复不理想、重构图像中易产生边界伪像等不足之处,提出了一种基于稀疏表示的联合稀疏先验约束盲反演算法.首先,结合空间目标图像梯度的稀疏特性,采用图像梯度的L 0范数提取有利于模糊核估计的图像显著边缘信息;其次,采用L p范数和L 0范数对图像的梯度分布和空间域进行稀疏约束,以保证反演图像的像素点间具有显著的对比度,同时保证图像中包含边缘和纹理等细节信息;最后,采用拉普拉斯分布先验对模糊核进行约束,以保证模糊核的稀疏特性.采取交替迭代策略对所提出的模型进行优化求解,从而得到模糊核和空间目标图像的估计值.实验结果表明,相比于几种具有代表性的盲反演算法,提出的方法能估计出更准确的模糊核,对图像边缘和纹理等细节信息具有更好的恢复能力,在主观评价和客观评价方面均取得了较好的反演性能.     

Visual enhancement based on salient region detection and layered difference representation

We propose a novel image enhancement method based on salient region detection and a layered difference representation of 2D histograms. We first obtain the visual salient region corresponding to maximal human attention using saliency filters. Then, we obtain a difference vector for the visual salient region by solving a constrained optimization problem of the layered difference representation at a specified layer. Finally, the new difference vector and the difference vector of the original image are aggregated to enhance the salient region and protect other regions from overstretching or brightness shift. Experimental results including comparisons with other methods show that our proposed algorithm produces more suitable enhanced images compared with the results of existing algorithms.     

Infrared moving object detection based on local saliency and sparse representation

The key issue of infrared object detection is to locate moving object in image sequence. In order to improve detection precision, an infrared object detection method based on local saliency and sparse representation is proposed in this paper. Motion information, such as velocity, acceleration components are added into the eigenvectors to build local saliency model. And the approximate position of the infrared target is located based on the local saliency. To accurately extract the infrared object, sparse representation is used to capture complete edge of the object. Experiments show that the proposed method can accurately detect infrared moving objects, and has good robustness to external disturbances and dynamic background.     

Fast image enhancement using multi-scale saliency extraction in infrared imagery

We propose a multi-scale saliency extraction based fast infrared image enhancement approach. A local frequency-tuned based saliency extraction technique is designed for highlighting the salient regions, firstly. Then, multi-scale saliency extraction is demonstrated, introducing multi-scale local windows with different sizes to extract regions of interest at different scales. Finally, the original image is enhanced with combining multi-scale salient image regions into one image. The experimental results prove the proposed approach is robust and efficient for infrared image enhancement.     

A biologically inspired spatiotemporal saliency attention model based on entropy value

A biologically inspired spatiotemporal saliency attention model based on entropy value is proposed in this paper. This model includes a dynamic attention phase and a static attention phase. In the dynamic attention phase, low-level visual features are extracted from current and some previous frames. Every feature map is resized into some different sizes. The feature maps in same size and same feature for all the frames are used to calculate the entropy value map. All the entropy maps are normalized and are fused into a dynamic saliency map. In the static attention phase, same features are extracted and form multi-scale feature maps by center-surround differences in current frame, and then those feature maps are transformed into conspicuity maps, which are linearly combined into a static saliency map. Our model decides salient regions based on a spatiotemporal saliency map which is generated by integration of the dynamic and the static saliency map. Experimental results indicate that: when there is noise among the frames or there is change of illumination among the frames, our model is excellent to Shi's model and Marat's model; when the moving objects do not belong to the static salient regions, our model is better than Ban's model.     

视觉注意机制在图像增强中的应用研究

将视觉注意机制引入到直方图构造中,并在此基础上提出了一种新的基于灰度级信息量直方图的图像增强算法.该算法利用Itti视觉注意计算模型对图像的显著性进行分析,获得全局显著图;然后,将全局显著图划分为若干等大的子区域,求取各子区域的平均显著值,并做归一化处理,得到子区域的加权统计系数;再将各子区域的灰度级加权统计值相加,得到灰度级信息量直方图;最后,依据直方图均衡化的映射函数,调整灰度级的动态范围.实验结果表明,该算法明显优于经典的GHE算法和AHE算法,具有满意的视觉效果.     

A robust infrared dim target detection method based on template filtering and saliency extraction

Dim target detection in infrared image with complex background and low signal-clutter ratio (SCR) is a significant and difficult task in the infrared target tracking system. A robust infrared dim target detection method based on template filtering and saliency extraction is proposed in this paper. The weighted gray map is obtained from the infrared image to highlight the target which is brighter than its neighbors and has weak correlation with its background. The target saliency map is then calculated by phase spectrum of Fourier Transform, so that the dim target detection could be converted to salient region extraction. The potential targets are finally extracted by combining the two maps. Moreover, position discrimination between targets in the two maps is used to exclude the false alarms and extract the targets. Experimental results on measured images indicate that our method is feasible, adaptable and robust in different backgrounds. The ROC (Receiver Operating Characteristic) curves obtained from the simulated images demonstrate the proposed method outperforms some existing typical methods in both detection rate and false alarm rate, for target detection with low SCR.     

Saliency detection based on diffusion maps

Visual saliency has recently attracted lots of research interest in the computer vision community. In this paper, we propose a novel computational model for bottom-up saliency detection based on manifold learning. A typical graph-based manifold learning algorithm, namely the diffusion maps, is adopted for establishing our saliency model. In the proposed method, firstly, a graph is constructed using low-level image features. Then, the diffusion maps algorithm is performed to learn the diffusion distances at different time, which are utilized to derive the saliency measure. Compared to existing saliency models, our method has the advantage of being able to capture the intrinsic nonlinear structures in the original feature space. Experimental results on publicly available data demonstrate that our method outperforms the state-of-the-art saliency models, both qualitatively and quantitatively.     

Moving target detection approach based on spatio-temporal salient perception

The differences in texture and motion between man-made object and natural scene are the key features for human biological visual system to detect moving object in scenery. The paper proposed a moving target detection approach based on spatio-temporal perception, which is a crucial function of the visual attention mechanism. The spatial feature including edge, orientation, texture and contrast of the image are extracted, and then the corresponding spatial salient map are constructed by fusing the features through difference of Gaussian (DOG) function, which can suppress the common and enhance the difference of local region. Then, the global motion, local motion and relative motion between continuous images are extracted by means of pyramid multi-resolution, and the moving salient map is constructed after the motion difference between moving target and background is confirmed. Finally, the spatio-temporal salient map is constructed by fusing the spatial salient map and the moving salient map through competition strategy, and the moving target could be detected by searching the maximum in the spatio-temporal salient map. Some experiments are included and the results show that the method can accurately detect the moving target in complex background.     

Salient region detection using background priors

In this paper, we introduce a novel salient region detection algorithm by using background priors. Because of the fact that superpixel is perceptually more meaningful than pixel, and which can reduce the complexity of image processing, we use the superpixel algorithm to reprocess original images. In addition, we hold the point that the colors in the image boundary could mainly represent all background colors, hence we compute the color contrast between the intern colors and the boundary colors. Since the nearer the patches are close to center, the more they affect other patches, we propose a new distribution-based model. Finally, experimental results demonstrate that the proposed method outperforms the state-of-the-art approaches.     

Two-scale image fusion of visible and infrared images using saliency detection

Military, navigation and concealed weapon detection need different imaging modalities such as visible and infrared to monitor a targeted scene. These modalities provide complementary information. For better situation awareness, complementary information of these images has to be integrated into a single image. Image fusion is the process of integrating complementary source information into a composite image. In this paper, we propose a new image fusion method based on saliency detection and two-scale image decomposition. This method is beneficial because the visual saliency extraction process introduced in this paper can highlight the saliency information of source images very well. A new weight map construction process based on visual saliency is proposed. This process is able to integrate the visually significant information of source images into the fused image. In contrast to most of the multi-scale image fusion techniques, proposed technique uses only two-scale image decomposition. So it is fast and efficient. Our method is tested on several image pairs and is evaluated qualitatively by visual inspection and quantitatively using objective fusion metrics. Outcomes of the proposed method are compared with the state-of-art multi-scale fusion techniques. Results reveal that the proposed method performance is comparable or superior to the existing methods.     

Contour level object detection with top-down information

This paper presents a contour level object detection approach. In contrast to conventional bounding box results, we give out the salient closed contour of the object, which provides a possibility of semantic analysis for the object. We get the salient closed contour with Ratio Contour algorithm. The top-down information needed by salient closed contour extraction is based on the well-known Bag-of-Features methodology. Our top-down information based contour extraction and completion is much more efficient and robust than many related approaches lack of the top-down information. We also propose a novel post-processing framework for object detection. With low threshold and a refined binary classifier, we can get stable high performance. We evaluate our approaches on UIUC cars dataset. We show that our approaches apparently improve the performance of object detections under clutter.     

局部对比度结合区域显著性红外弱小目标检测

为了解决局部对比度方法的计算效率低,以及在某些红外场景中易出现虚警的问题,将其与图像区域显著性相结合,提出一种改进的局部对比度算法——区域局部对比度算法,仅在图像的显著性区域中进行局部对比度计算,而非遍历整幅图像。首先进行基于图像信息熵和局部相似性的红外图像区域显著性度量,经二值化得到单帧图像显著性区域;接下来在该区域中进行局部对比度数值计算,得到区域局部对比度图像,最后经过自适应阈值分割,得到弱小目标检测结果。实验结果表明,区域局部对比度算法可以极大提高红外弱小目标的信噪比,检测结果准确,虚警率低,与原始的局部对比度算法相比,检测效率有明显提升,可以更好地保持弱小目标的形状。