基于生物视觉特征和视觉心理学的视频显著性检测算法

提出了一种空域和时域相结合的视频显著性检测算法.对单帧图像,受视觉皮层层次化感知特性和Gestalt视觉心理学的启发,提出了一种层次化的静态显著图检测方法.在底层,通过符合生物视觉特性的特征图像（双对立颜色特征及亮度特征图像）的非线性简化模型来合成特征图像,形成多个候选显著区域;在中层,根据矩阵的最小Frobenius-范数（F-范数）性质选取竞争力最强的候选显著区域作为局部显著区域;在高层,利用Gestalt视觉心理学的核心理论,对在中层得到的局部显著区域进行整合,得到具有整体感知的空域显著图.对序列帧图像,基于运动目标在位置、运动幅度和运动方向一致性的假设,对Lucas-Kanade算法检测出的光流点进行二分类,排除噪声点的干扰,并利用光流点的运动幅度来衡量运动目标运动显著性.最后,基于人类视觉对动态信息与静态信息敏感度的差异提出了一种空域和时域显著图融合的通用模型.实验结果表明,该方法能够抑制视频背景中的噪声并且解决了运动目标稀疏等问题,能够较好地从复杂场景中检测出视频中的显著区域.     

Infrared and visible image fusion method based on saliency detection in sparse domain

Infrared and visible image fusion is a key problem in the field of multi-sensor image fusion. To better preserve the significant information of the infrared and visible images in the final fused image, the saliency maps of the source images is introduced into the fusion procedure. Firstly, under the framework of the joint sparse representation (JSR) model, the global and local saliency maps of the source images are obtained based on sparse coefficients. Then, a saliency detection model is proposed, which combines the global and local saliency maps to generate an integrated saliency map. Finally, a weighted fusion algorithm based on the integrated saliency map is developed to achieve the fusion progress. The experimental results show that our method is superior to the state-of-the-art methods in terms of several universal quality evaluation indexes, as well as in the visual quality.     

Spatio-temporal segmentation of moving objects using edge features in infrared videos

In this paper, a novel method is proposed for spatio-temporal segmentation of moving objects using edge features in infrared videos. We define motion saliency of edge (MSoE) to generate the MSoE-map. The seeds of moving objects are extracted from the MSoE-map by using Otsu's method and subsequently compensated by historical data. An improved layer-based region growing method is applied to the seeds to achieve spatial segmentation of moving objects. The region growing method has an adjustable growing threshold. So, one of the focuses of our work is how to determine the best growing threshold. A Markov Random Field (MRF) based criterion with maximum a posterior (MAP) estimation principle is proposed for performance evaluation of moving object segmentation without ground truth (GT) in infrared videos. This criterion can be considered as an object function of threshold determination during global searching. The global optimum is accomplished by using simulated annealing (SA) algorithm to obtain the best growing threshold. The final segmentation mask of moving objects is grown from the seeds with the best growing threshold. Experimental results are provided to illustrate that the proposed method has better performance for moving object segmentation with fewer effects of object-background misclassification in infrared videos.     

Infrared small target tracking based on sample constrained particle filtering and sparse representation

Infrared search and track technology for small target plays an important role in infrared warning and guidance. In view of the tacking randomness and uncertainty caused by background clutter and noise interference, a robust tracking method for infrared small target based on sample constrained particle filtering and sparse representation is proposed in this paper. Firstly, to distinguish the normal region and interference region in target sub-blocks, we introduce a binary support vector, and combine it with the target sparse representation model, after which a particle filtering observation model based on sparse reconstruction error differences between sample targets is developed. Secondly, we utilize saliency extraction to obtain the high frequency area in infrared image, and make it as a priori knowledge of the transition probability model to limit the particle filtering sampling process. Lastly, the tracking result is brought about via target state estimation and the Bayesian posteriori probability calculation. Theoretical analyses and experimental results show that our method can enhance the state estimation ability of stochastic particles, improve the sparse representation adaptabilities for infrared small targets, and optimize the tracking accuracy for infrared small moving targets.     

Drogue detection for vision-based autonomous aerial refueling via low rank and sparse decomposition with multiple features

The technology of vision-based probe-and-drogue autonomous aerial refueling is an amazing task in modern aviation for both manned and unmanned aircraft. A key issue is to determine the relative orientation and position of the drogue and the probe accurately for relative navigation system during the approach phase, which requires locating the drogue precisely. Drogue detection is a challenging task due to disorderly motion of drogue caused by both the tanker wake vortex and atmospheric turbulence. In this paper, the problem of drogue detection is considered as a problem of moving object detection. A drogue detection algorithm based on low rank and sparse decomposition with local multiple features is proposed. The global and local information of drogue is introduced into the detection model in a unified way. The experimental results on real autonomous aerial refueling videos show that the proposed drogue detection algorithm is effective.     

局部对比度结合区域显著性红外弱小目标检测

为了解决局部对比度方法的计算效率低,以及在某些红外场景中易出现虚警的问题,将其与图像区域显著性相结合,提出一种改进的局部对比度算法——区域局部对比度算法,仅在图像的显著性区域中进行局部对比度计算,而非遍历整幅图像。首先进行基于图像信息熵和局部相似性的红外图像区域显著性度量,经二值化得到单帧图像显著性区域;接下来在该区域中进行局部对比度数值计算,得到区域局部对比度图像,最后经过自适应阈值分割,得到弱小目标检测结果。实验结果表明,区域局部对比度算法可以极大提高红外弱小目标的信噪比,检测结果准确,虚警率低,与原始的局部对比度算法相比,检测效率有明显提升,可以更好地保持弱小目标的形状。     

Infrared image enhancement through saliency feature analysis based on multi-scale decomposition

To improve contrast between dim target region and background in infrared (IR) long-range surveillance, this paper proposes a fast image enhancement approach using saliency feature extraction based on multi-scale decomposition. Firstly, a smooth based multi-scale decomposition is designed and applied to original infrared image, generating sub-images with various frequency components at different decomposition levels. The dim target regions of sub-images are extracted by a local frequency-tuned based saliency feature detection method, secondly. With saliency maps created by saliency extraction using multi-scale local windows with different sizes, the sub-images are enhanced at different decomposition scales. Finally, the enhanced result is reconstructed by synthesizing the all sub-images with adjustable synthetic weights. Since salient areas are analyzed based on fast multi-scale image decomposition, IR image can be s enhanced with good contrast successfully and rapidly. Compared with other algorithms, the experimental results prove that the proposed method is robust and efficient for IR image enhancement.     

基于多特征的快速红外弱小目标检测算法

为了从全向红外搜索和跟踪系统采集的海量大视场高分辨率红外图像中快速准确地检测出红外弱小目标,本文提出了一种基于由粗到细的分阶段检测策略和时空域特征融合的红外弱小目标检测算法.首先,通过引入基于频域的快速显著性检测算法预先检测出目标可能存在的候选区域;其次,对候选区域进行角点检测以判定是否存在候选目标;最后,通过结合帧间时空域特征对候选目标进行进一步判定,以提取真实目标、删除虚假目标.多种实际场景的实验结果表明,该目标检测算法不仅运算量小而且探测概率高、虚警率低,是一种工程实用性能很好的红外弱小目标检测算法.     

A method for moving objects segmentation based on human vision perception in infrared video

In this paper, a new region growing method to achieve the accurate and complete segmentation of the moving objects is introduced. Firstly, the ideal seeds of every moving object are extracted based on “hole” effect of temporal difference. Secondly, on the basis of the consideration that human vision system is most sensitive to the local contrast between targets and surrounding, we proposed a metric for “good” infrared target segmentation based on human vision perception. And according to this metric, a search method based on fine and rough adjustment is applied to determine the best growing threshold for moving objects. The segmented mask of every moving object is grown from the relevant seeds with the best growing threshold. At last, the segmented masks of all moving objects are merged into a complete segmented mask. Experimental results show that the proposed method is superior and effective on segmentation of infrared moving object.     

复杂环境下运动目标偏振成像检测方法研究

针对低对比度、低信噪比等复杂环境下运动目标检测失检率较高的问题,提出了基于稳定性主成分寻踪的运动目标偏振成像检测方法。首先将预处理后的连续帧偏振图像组合成一个矩阵,依据帧间图像信息相关性,建立了稳定性主成分寻踪数学模型,将该矩阵分解成低秩、稀疏,噪声三部分,其中稀疏矩阵包含了帧间目标信息;再以低秩矩阵核范数与稀疏矩阵1范数的和为目标函数,利用增广拉格朗日乘子法求得目标函数值最小时的稀疏矩阵;最后采用马尔科夫随机场滤除稀疏矩阵中的噪声。实验结果表明,该方法对复杂环境有很好的适应能力,且检测准确率优于其他算法。     

基于局部峰值的红外弱小目标快速检测

针对红外图像的小目标检测问题,提出了一种基于局部尖峰特性的检测方法.首先分析红外小目标的局部灰度特性,提出了一种红外目标的峰值特性判据;然后依据目标的峰值特性判据和时域特性,设计了一种目标检测的快速算法,算法先基于子块预选出局部极大值点,把后续运算限于各极大值点处以减少运算量,再根据极大点值在各方向上的灰度下降判断其尖峰特性;最后利用帧间的连续性滤去噪音引起的伪目标.实验表明本文的算法具有很快的处理速度,且能有效滤去图像中的随机噪音.     

A robust infrared dim target detection method based on template filtering and saliency extraction

Dim target detection in infrared image with complex background and low signal-clutter ratio (SCR) is a significant and difficult task in the infrared target tracking system. A robust infrared dim target detection method based on template filtering and saliency extraction is proposed in this paper. The weighted gray map is obtained from the infrared image to highlight the target which is brighter than its neighbors and has weak correlation with its background. The target saliency map is then calculated by phase spectrum of Fourier Transform, so that the dim target detection could be converted to salient region extraction. The potential targets are finally extracted by combining the two maps. Moreover, position discrimination between targets in the two maps is used to exclude the false alarms and extract the targets. Experimental results on measured images indicate that our method is feasible, adaptable and robust in different backgrounds. The ROC (Receiver Operating Characteristic) curves obtained from the simulated images demonstrate the proposed method outperforms some existing typical methods in both detection rate and false alarm rate, for target detection with low SCR.     

Small object detection in forward-looking infrared images with sea clutter using context-driven Bayesian saliency model

There are two common challenges for small object detection in forward-looking infrared (FLIR) images with sea clutter, namely, detection ambiguity and scale variance. This paper presents a context-driven Bayesian saliency model to deal with these two issues. By inspecting the camera geometry of the FLIR imaging under the background of sea and sky, we observed that there exists dependency relationship between the locations and scales at which objects may occur, and the context which is defined to be the location of horizon line. Based on this observation, we propose to incorporate contextual information into the basic bottom-up saliency computation, and a unified Bayesian model is developed to achieve this goal. The proposed model is generic and can be potentially applied to other circumstances where context is available for facilitating object detection. Experimental results have demonstrated the effectiveness of our method.     

Moving target detection approach based on spatio-temporal salient perception

The differences in texture and motion between man-made object and natural scene are the key features for human biological visual system to detect moving object in scenery. The paper proposed a moving target detection approach based on spatio-temporal perception, which is a crucial function of the visual attention mechanism. The spatial feature including edge, orientation, texture and contrast of the image are extracted, and then the corresponding spatial salient map are constructed by fusing the features through difference of Gaussian (DOG) function, which can suppress the common and enhance the difference of local region. Then, the global motion, local motion and relative motion between continuous images are extracted by means of pyramid multi-resolution, and the moving salient map is constructed after the motion difference between moving target and background is confirmed. Finally, the spatio-temporal salient map is constructed by fusing the spatial salient map and the moving salient map through competition strategy, and the moving target could be detected by searching the maximum in the spatio-temporal salient map. Some experiments are included and the results show that the method can accurately detect the moving target in complex background.     

基于多尺度区域对比的显著目标识别

为了对图像中的显著目标进行更精确的识别,提出一种新的基于多尺度区域对比的视觉显著性计算模型。首先基于多尺度思想将图像分别分割为不同数目的超像素,对超像素内的像素颜色值取平均以生成抽象化图像;然后根据显著特征的稀少性及显著特征的聚集性,计算单一尺度下超像素颜色特征的显著性值;最后通过取各尺度超像素显著度的平均值来融合多尺度显著图,得到最终的视觉显著图。实验表明,以MSRA图库中的1 000张随机自然图片为例,该模型较现有较好的区域对比模型,显著目标识别的精确率提高了14.8%,F-Measure值提高了9.2%。与现有的算法相比,该模型提高了算法对显著目标大小的适应性,减少了背景对显著目标识别的干扰,具有更好的一致性,能更好地识别显著目标。     

Fast image enhancement using multi-scale saliency extraction in infrared imagery

We propose a multi-scale saliency extraction based fast infrared image enhancement approach. A local frequency-tuned based saliency extraction technique is designed for highlighting the salient regions, firstly. Then, multi-scale saliency extraction is demonstrated, introducing multi-scale local windows with different sizes to extract regions of interest at different scales. Finally, the original image is enhanced with combining multi-scale salient image regions into one image. The experimental results prove the proposed approach is robust and efficient for infrared image enhancement.     

Two-scale image fusion of visible and infrared images using saliency detection

Military, navigation and concealed weapon detection need different imaging modalities such as visible and infrared to monitor a targeted scene. These modalities provide complementary information. For better situation awareness, complementary information of these images has to be integrated into a single image. Image fusion is the process of integrating complementary source information into a composite image. In this paper, we propose a new image fusion method based on saliency detection and two-scale image decomposition. This method is beneficial because the visual saliency extraction process introduced in this paper can highlight the saliency information of source images very well. A new weight map construction process based on visual saliency is proposed. This process is able to integrate the visually significant information of source images into the fused image. In contrast to most of the multi-scale image fusion techniques, proposed technique uses only two-scale image decomposition. So it is fast and efficient. Our method is tested on several image pairs and is evaluated qualitatively by visual inspection and quantitatively using objective fusion metrics. Outcomes of the proposed method are compared with the state-of-art multi-scale fusion techniques. Results reveal that the proposed method performance is comparable or superior to the existing methods.     

Local graph regularized coding for salient object detection

Subspace segmentation based salient object detection has received increasing interests in recent years. To preserve the locality and similarity of regions, a grouping effect of representation is introduced to segment the salient object and background in subspace. Then a new saliency map is calculated by incorporating this local graph regularizer into coding, which explicitly explores the data self-representation model and thus locate more accurate salient regions. Moreover, a heuristic object-based dictionary from background superpixels is obtained in border set removing the image regions within the potential object regions. Experimental results on four large benchmark databases demonstrate that the proposed method performs favorably against eight recent state-of-the-art methods in terms of three evaluation criterions, with a reduction of MAE by 19.8% than GR and 29.3% than CB in the two SED datasets, respectively. Meanwhile, our method also runs faster than the comparative detection approaches.     

基于双层局部对比度的红外弱小目标检测方法

针对传统基于人类视觉系统的检测方法在复杂背景下容易造成检测虚警的问题,提出一种基于双层局部对比度的红外弱小目标检测方法.首先,通过双层对角灰度差对比度分析机制,充分利用小目标局部对比度的先验信息,提高目标对比度的同时抑制背景杂波及噪声;之后,利用自适应阈值分割法获取待检测的真实目标.实验结果表明,与主流基于人类视觉系统的检测方法相比,所提方法的背景抑制因子平均提高9.3倍以上,信杂比率增益平均提高7.8倍以上,在不同的复杂场景下均具有更好的检测性能.     

Human detection based on motion object extraction and head–shoulder feature

Aimed at the shortcomings of the traditional video monitoring system, human detection method in intelligent video monitoring system was researched. This paper proposed a human detection method based on motion object extraction and head–shoulder feature to complete human detection and statistics in video image sequences. Firstly, background subtraction based on adaptive threshold was used to extract foreground moving object information, then image erosion and image dilation were used to bypass the object shade and remove false object in order to optimize the results of motion object extraction. And finally, for realizing human moving object detection, we proposed the object discrimination algorithm based on human head–shoulder feature to complete human detection and statistics. Experimental results show that the method can successfully realize human detection and statistics. The method is highly accurate and has good real-time and extensive applications. The identification rate is 86% through human video sequences to test. This method can detect human automatically and provide the theoretical and technological base for object detection in the intelligent surveillance system.