基于生物视觉特征和视觉心理学的视频显著性检测算法

提出了一种空域和时域相结合的视频显著性检测算法.对单帧图像,受视觉皮层层次化感知特性和Gestalt视觉心理学的启发,提出了一种层次化的静态显著图检测方法.在底层,通过符合生物视觉特性的特征图像（双对立颜色特征及亮度特征图像）的非线性简化模型来合成特征图像,形成多个候选显著区域;在中层,根据矩阵的最小Frobenius-范数（F-范数）性质选取竞争力最强的候选显著区域作为局部显著区域;在高层,利用Gestalt视觉心理学的核心理论,对在中层得到的局部显著区域进行整合,得到具有整体感知的空域显著图.对序列帧图像,基于运动目标在位置、运动幅度和运动方向一致性的假设,对Lucas-Kanade算法检测出的光流点进行二分类,排除噪声点的干扰,并利用光流点的运动幅度来衡量运动目标运动显著性.最后,基于人类视觉对动态信息与静态信息敏感度的差异提出了一种空域和时域显著图融合的通用模型.实验结果表明,该方法能够抑制视频背景中的噪声并且解决了运动目标稀疏等问题,能够较好地从复杂场景中检测出视频中的显著区域.     

图像序列的显著性目标区域检测方法

针对传统视觉显著性模型在自顶向下的任务指导和动态信息处理方面的不足,设计并实现了融入运动特征的视觉显著性模型。利用该模型提取了图像的静态特征和动态特征,静态特征的提取在图像的亮度、颜色和方向通道进行,运动特征的提取采用基于多尺度差分的特征提取方法实现,然后各通道分别通过滤波、差分得到显著图,在生成全局显著图时,提出多通道参数估计方法,计算图像感兴趣区域与眼动感兴趣区域的相似度,从而可在图像上准确定位目标位置。针对20组视频图像序列(每组50帧)进行了实验,结果表明:本文算法提取注意焦点即目标区域的平均相似度为0.87,使用本文算法能够根据不同任务情境,选择各特征通道的权重参数,从而可有效提高目标搜索的效率。     

A biologically inspired spatiotemporal saliency attention model based on entropy value

A biologically inspired spatiotemporal saliency attention model based on entropy value is proposed in this paper. This model includes a dynamic attention phase and a static attention phase. In the dynamic attention phase, low-level visual features are extracted from current and some previous frames. Every feature map is resized into some different sizes. The feature maps in same size and same feature for all the frames are used to calculate the entropy value map. All the entropy maps are normalized and are fused into a dynamic saliency map. In the static attention phase, same features are extracted and form multi-scale feature maps by center-surround differences in current frame, and then those feature maps are transformed into conspicuity maps, which are linearly combined into a static saliency map. Our model decides salient regions based on a spatiotemporal saliency map which is generated by integration of the dynamic and the static saliency map. Experimental results indicate that: when there is noise among the frames or there is change of illumination among the frames, our model is excellent to Shi's model and Marat's model; when the moving objects do not belong to the static salient regions, our model is better than Ban's model.     

Background updating and shadow detection based on spatial, color, and texture information of detected objects

Background model updating is a vital process for any background subtraction technique. This paper presents an updating mechanism that can be applied efficiently to any background subtraction technique. This updating mechanism exploits the color and spatial features to characterize each detected object. Spatial and color features are used to classify each detected object as a moving background object, a ghost, or a real moving object. The starting position of each detected object is the cue for updating background images. In addition, this paper presents a hybrid scheme to detect and remove cast shadows based on texture and color features. The robustness of the proposed method and its effectiveness in overcoming challenging problems such as gradual and sudden illumination changes, ghost appearance, non-stationary background objects, the stability of moving objects most of the time, and cast shadows are verified quantitatively and qualitatively.     

结合人眼视觉关注特性的视频质量评价

考虑到人眼视觉关注特性在视频质量评价(VQA)中所具有的重要作用,提出了一种结合人眼视觉关注特性的视频质量评价方法。首先利用三维Sobel算子以及恰可察觉失真模型得到全局显著图,对全局显著图的每个显著像素点构建结构张量来求取一帧的全局质量;然后利用视频运动信息以及人眼中心关注特性求得局部显著图来进行感知加权,得到一帧的局部质量;最后均衡局部与全局质量得到视频中一帧的质量,并采用机器学习的方法获得时域加权模型,对视频帧进行加权,从而得到客观视频质量评价值。在LIVE视频数据库上进行性能测试,得到PLCC(Pearson Linear Correlation Coefficient)为0.827,SROCC(Spearman Rank Order Correlation Coefficient)为0.802,与已有相关算法相比,所提出的VQA方法的评价结果更接近人眼的主观感知。     

Analog vision chip for motion detection of an approaching object against a moving background based on the insect visual system

A network for motion detection of an approaching object without influence of the moving background was proposed based on the insect visual system. The two-dimensional array of the analog complementary metal oxide semiconductor (CMOS) circuits for extracting the edge signals of the approaching object without outputting those of the moving background was inserted at the first stage of the network. At the next stage, analog CMOS circuits for detection of approaching velocity and direction, which accept the extracted edge signals, were inserted based on the locust vision system. A chip of the proposed network was fabricated with the 1.2 mm CMOS process. It was clarified from the measured results and the simulation results with the simulation program with integrated circuit emphasis (SPICE) that the two-dimensional circuits of the first stage can only generate the signals of target edges. The measured results showed that the chip can detect the approaching velocity and direction of the target in the image which contains the moving background.     

基于星图识别的空间目标检测算法研究

从恒星背景中检测出空间目标是空间目标天基光学测量相机所要解决的关键技术难题之一。提出了一种基于星图识别的空间目标检测算法,利用背景星图的平移、旋转、比例伸缩不变性,应用星图识别原理,根据识别恒星在不同帧图像中的坐标变化估计背景运动参数,进行探测图像序列的配准,然后在配准后的图像序列中检测出空间目标。通过仿真验证,该方法对于运动恒星背景中运动小目标的检测具有比较好的效果。     

基于多尺度区域对比的显著目标识别

为了对图像中的显著目标进行更精确的识别,提出一种新的基于多尺度区域对比的视觉显著性计算模型。首先基于多尺度思想将图像分别分割为不同数目的超像素,对超像素内的像素颜色值取平均以生成抽象化图像;然后根据显著特征的稀少性及显著特征的聚集性,计算单一尺度下超像素颜色特征的显著性值;最后通过取各尺度超像素显著度的平均值来融合多尺度显著图,得到最终的视觉显著图。实验表明,以MSRA图库中的1 000张随机自然图片为例,该模型较现有较好的区域对比模型,显著目标识别的精确率提高了14.8%,F-Measure值提高了9.2%。与现有的算法相比,该模型提高了算法对显著目标大小的适应性,减少了背景对显著目标识别的干扰,具有更好的一致性,能更好地识别显著目标。     

基于空时联合稀疏重构的红外小弱运动目标检测方法

提出了一种基于空时联合稀疏重构的红外小弱运动目标检测算法。通过学习序列图像内容而构建的空时联合字典能同时刻画目标或背景的形态特征和运动信息;利用多元高斯运动模式从空时联合字典中提取出目标空时字典和背景空时字典,目标空时过完备字典描述移动的目标,背景空时过完备字典表征背景噪声。将连续多帧图像在空时联合字典上进行稀疏分解,然后分别利用目标空时字典和背景空时字典中的最大稀疏系数及其空时原子重构信号,获取重构残余能量差异来区分目标和背景。试验结果表明,由同源的空时字典重构的残余能量小,而由异构的空时字典恢复的残余能量大,该方法不仅能提高序列信号表示的稀疏度,还能有效提高小运动目标的探测能力。     

基于多特征差异检测与联合控制映射的红外图像选择加密算法

为了实现对红外图像的选择性加密,提出了基于多特征差异检测与联合控制映射的红外图像选择算法。引入分段正弦变换,将输出图像分割为3个不同的区域,对每个区域完成不同的拉伸变换,完成初始红外图像的增强,凸显真实红外目标;再利用增强图像中目标与背景的灰度差异,从而设计目标决策因子,并分割Top-Hat变换的结构元素,构建红外背景抑制机制,过滤杂波与噪声;利用灰度水平、对比度与相似度,建立多特征差异检测模型,提取包含真实目标与可疑目标的感兴趣区域;以Logistic映射为控制条件,综合Tent映射与Chebyshev映射,设计联合控制混沌映射,利用其输出的混合随机序列对感兴趣区域进行置乱;引入引力模型,对混淆的感兴趣区域内的像素进行扩散,完成红外目标选择加密。实验结果显示:与已有的图像局部加密机制相比,该文算法输出密文信息熵值达到了7.982 6,能够更好地用于红外图像局部选择性加密。     

基于灰度信息的动场景视频序列中运动对象的提取

提出了一种基于视频序列灰度信息的运动对象提取方法。该方法采用改进的Sobel算子提取边缘图像,依据边缘信息将视频图像分割为不同的灰度连续区域。在各灰度连续区域中,选取特征点进行匹配获得特征点对。根据特征点对合并灰度连续区域,获得全局运动参数。采用具有自适应帧间隔的帧差交集法,获得图像中运动对象区域。结合灰度信息和运动信息,分割出运动对象。实验结果表明,该算法可以有效地将运动对象从视频序列中提取出来。     

The moving target detection algorithm based on the improved visual background extraction

This paper presents a moving target detection algorithm based on the improved visual background extraction. Traditional VIBE (Visual Background Extractor) algorithm is one of the powerful background subtraction algorithm. It can quickly, accurately and integrally detect moving target. However, sometimes it will falsely determine background as foreground and impact detection results. In this paper, we improve the traditional VIBE algorithm by joining TOM (Time of map) mechanism in the process of detection, so it can not only use the pixel’s spatial domain information, but also make full use of the pixel’s time domain information. Experiments detailed in this paper show the algorithm presented in this paper has better detection effect than the traditional VIBE algorithm.     

多尺度无监督彩色图像分割

非采样Contourlet变换是一种新的多尺度多分辨率分析工具.本文提出了一种基于非采样Contourlet变换的彩色图像无监督分割算法.首先利用非采样Contourlet变换的平移不变性在其变换域应用梯度向量法提取图像多尺度边缘|然后在Contourlet变换域的低频子带和高频子带中分别提取局部低频能量纹理特征与高频多尺度Zernike矩纹理特征,并将二种纹理特征融合.最后在边缘图像中映射种子像素点,利用纹理和颜色特征欧氏距离,对彩色图像采用区域生长和区域合并的方法进行分割.实验结果证明:该算法将图像空间域的颜色特征与非采样Contourlet变换域的多尺度边缘和纹理特征恰当结合在一起实现彩色图像无监督自动分割,与传统算法相比有更高的准确性和鲁棒性.     

Spatio-temporal segmentation of moving objects using edge features in infrared videos

In this paper, a novel method is proposed for spatio-temporal segmentation of moving objects using edge features in infrared videos. We define motion saliency of edge (MSoE) to generate the MSoE-map. The seeds of moving objects are extracted from the MSoE-map by using Otsu's method and subsequently compensated by historical data. An improved layer-based region growing method is applied to the seeds to achieve spatial segmentation of moving objects. The region growing method has an adjustable growing threshold. So, one of the focuses of our work is how to determine the best growing threshold. A Markov Random Field (MRF) based criterion with maximum a posterior (MAP) estimation principle is proposed for performance evaluation of moving object segmentation without ground truth (GT) in infrared videos. This criterion can be considered as an object function of threshold determination during global searching. The global optimum is accomplished by using simulated annealing (SA) algorithm to obtain the best growing threshold. The final segmentation mask of moving objects is grown from the seeds with the best growing threshold. Experimental results are provided to illustrate that the proposed method has better performance for moving object segmentation with fewer effects of object-background misclassification in infrared videos.     

基于纹理显著性的微光图像目标检测

微光图像对比度较低,目标显著性不明显,目标自动探测难度大.针对此问题,本文提出一种噪声鲁棒性较好的图像局部纹理粗糙度算法,并给出一种适用于微光图像显著分析的纹理显著性算法.首先,提出一种新的局部纹理粗糙度算法,该算法利用最佳尺寸计算局部纹理粗糙度,对纹理图像进行加噪实验,与基于局部分形维的粗糙度方法相比,本文局部纹理粗糙度算法表现出较好的噪声鲁棒性;其次,在提取图像粗糙度特征图的基础上,给出一种针对纹理的显著性度量算法;最后,将纹理显著性算法应用于微光图像目标检测,实验结果证明了该算法的有效性.     

Dim moving target tracking algorithm based on particle discriminative sparse representation

The small dim moving target usually submerged in strong noise, and its motion observability is debased by numerous false alarms for low signal-to-noise ratio (SNR). A target tracking algorithm based on particle filter and discriminative sparse representation is proposed in this paper to cope with the uncertainty of dim moving target tracking. The weight of every particle is the crucial factor to ensuring the accuracy of dim target tracking for particle filter (PF) that can achieve excellent performance even under the situation of non-linear and non-Gaussian motion. In discriminative over-complete dictionary constructed according to image sequence, the target dictionary describes target signal and the background dictionary embeds background clutter. The difference between target particle and background particle is enhanced to a great extent, and the weight of every particle is then measured by means of the residual after reconstruction using the prescribed number of target atoms and their corresponding coefficients. The movement state of dim moving target is then estimated and finally tracked by these weighted particles. Meanwhile, the subspace of over-complete dictionary is updated online by the stochastic estimation algorithm. Some experiments are induced and the experimental results show the proposed algorithm could improve the performance of moving target tracking by enhancing the consistency between the posteriori probability distribution and the moving target state.     

基于自适应非参数统计模型的彩色目标跟踪算法研究

针对复杂环境条件下的视觉跟踪问题,提出一种基于自适应非参数统计模型的彩色目标跟踪算法。利用目标和背景之间的强度差别,基于自适应核密度估计模型对运动目标进行了非参数统计建模。为了实现具有较大范围运动目标的跟踪,在充分考虑目标和背景之间的相关性前提下,采用目标特征统计的背景加权直方图对搜索区域进行了扩大。为了提高对环境变化的适应能力,根据目标和环境的变化自适应更新目标特征分布模型。通过对实际图像序列的实验,结果表明该算法能够有效跟踪运动目标,并且平均迭代次数比传统方法减少了37.28%。     

Measurements-based Moving Target Detection in Quantum Video

A method to detect a moving target in multi-channel quantum video is proposed based on multiple measurements on the video strip. The proposed method is capable of detecting the location of the moving target in each frame of the quantum video thereby ensuring that the motion trail of the object is easily and efficiently retrieved. Three experiments, i.e. moving target detection (MTD) of a pixel, MTD of an object in complex shape, and MTD of a pixel whose color is conterminous with that of its background, are implemented to demonstrate the feasibility of the proposal. This study presents a modest attempt to focus on the moving target detection and its applications in quantum video.     

基于兴趣区域掩码卷积神经网络的红外-可见光图像融合与目标识别算法研究

建立权重独立的双通道残差卷积神经网络,对可见光与红外频段下的目标图像进行特征提取,生成多尺度复合频段特征图组.基于像点间的欧式距离计算双频段特征图显著性,根据目标在不同成像频段下的特征贡献值进行自适应融合.通过热源能量池化核与视觉注意力机制,分别生成目标在双频段下的兴趣区域逻辑掩码并叠加在融合图像上,凸显目标特征并抑制...