网格运动分析与形态学滤波相结合的视频对象分割

提出了一种基于二维网格运动分析与改进形态学滤波空域自动分割策略相结合的视频对象时空分割算法。该算法首先利用高阶统计方法对视频图像的二维网格表示进行运动分析，快速得到前景对象区域，通过后处理有效获得前景对象运动检测掩膜。然后，用一种结合交变序列重建滤波算法和自适应阈值判别算法的改进分水岭分割策略有效获得前景对象的精确边缘。最后，用区域基时空融合算法将时域分割结果和空域分割结果结合起来提取出边缘精细的视频对象。实验结果表明，本算法综合了多种算法的优点，主客观分割效果理想。     

2-D mesh-based video object segmentation and tracking with occlusion resolution

This paper integrates fully automatic video object segmentation and tracking including detection and assignment of uncovered regions in a 2-D mesh-based framework. Particular contributions of this work are (i) a novel video object segmentation method that is posed as a constrained maximum contrast path search problem along the edges of a 2-D triangular mesh, and (ii) a 2-D mesh-based uncovered region detection method along the object boundary as well as within the object. At the first frame, an optimal number of feature points are selected as nodes of a 2-D content-based mesh. These points are classified as moving (foreground) and stationary nodes based on multi-frame node motion analysis, yielding a coarse estimate of the foreground object boundary. Color differences across triangles near the coarse boundary are employed for a maximum contrast path search along the edges of the 2-D mesh to refine the boundary of the video object. Next, we propagate the refined boundary to the subsequent frame by using motion vectors of the node points to form the coarse boundary at the next frame. We detect occluded regions by using motion-compensated frame differences and range filtered edge maps. The boundaries of detected uncovered regions are then refined by using the search procedure. These regions are either appended to the foreground object or tracked as new objects. The segmentation procedure is re-initialized when unreliable motion vectors exceed a certain number. The proposed scheme is demonstrated on several video sequences.     

一种应用形态学滤波的视频对象时空分割算法

从视频图像中提取视频对象是基于内容的视频编码中的一项关键技术。本文提出了一种基于帧间运动信息和形态学滤波的视频对象时空分割算法。该算法首先利用分块高阶统计算法和基于最大类间方差的阈值算法得到目标的运动区域检测模板。然后,用基于交变序列重建滤波的分水岭算法得到前景对象的精确边缘。最后,用区域基时空融合方法将运动检测和形态学分割结果结合起来提取出视频对象。实验结果表明,本文算法能避免区域合并有效提取出具有精确边缘的视频对象,主客观分割效果理想。     

Video object tracking and segmentation with box annotation

This paper presents a two-stage approach, track and then segment, to perform semi-supervised video object segmentation (VOS) with only bounding box annotations. The proposed reverse optimization for VOS (ROVOS) which leverages a fully convolutional Siamese network performs tracking and segmentation in the tracker. The segmentation cues are able to reversely optimize the location of the tracker and the object segmentation masks are produced by the two-branch system online. The experimental results on DAVIS 2016 and DAVIS 2017 demonstrate significant improvements of the proposed algorithm over the state-of-the-art methods.     

Video object segmentation via random walks on two-frame graphs comprising superpixels

We propose a novel video object segmentation method employing random walkers to travel on graphs constructed on two consecutive frames. First, we estimate the initial foreground and background distributions by minimising an energy function that incorporates the stationary distributions of the random walks. The random walkers frequently travel between similar nodes of the graph constructed on two adjacent frames, which enables the incorporation of the inter-frame information into the energy function effectively and elegantly. Then, we refine the initial results by simulating the movements of multiple random walkers. We process the sequence in a recursive manner, which naturally propagates the previous segmentation labels to the subsequent frames. Additionally, we develop a strategy for adjusting the superpixel number using region similarity and the average Frobenius norm of optical flow gradient. This strategy can improve performance significantly. Furthermore, we discuss the feature selection problem in the method to select a more effective feature representation. Extensive and comparable experiments on Segtrack and Segtrack v2 demonstrate that the proposed algorithm yields higher performance than several recent state-of-the-art approaches.     

Video object segmentation in rainy situations based on difference scheme with object structure and color analysis

A scheme based on a difference scheme using object structures and color analysis is proposed for video object segmentation in rainy situations. Since shadows and color reflections on the wet ground pose problems for conventional video object segmentation, the proposed method combines the background construction-based video object segmentation and the foreground extraction-based video object segmentation where pixels in both the foreground and background from a video sequence are separated using histogram-based change detection from which the background can be constructed and detection of the initial moving object masks based on a frame difference mask and a background subtraction mask can be further used to obtain coarse object regions. Shadow regions and color-reflection regions on the wet ground are removed from the initial moving object masks via a diamond window mask and color analysis of the moving object. Finally, the boundary of the moving object is refined using connected component labeling and morphological operations. Experimental results show that the proposed method performs well for video object segmentation in rainy situations.     

基于运动补偿的Snake视频对象跟踪算法

当对象移动幅度大时，Snake视频对象跟踪算法中的曲线迭代过程易陷入局部最小，为此，提出一种运动补偿预处理的解决方法。此方法预先估计对象的运动信息，然后对Snake曲线的初始轮廓位置进行运动补偿，最后进行Snake跟踪。实验表明，这种方法不仅跟踪效果好，而且能有效地减少Snake曲线演化的迭代次数。     

宽带非高斯信号的二维波达方向估计方法

该文提出了一种解决宽带非高斯信号二维波达方向估计的方法。该方法利用相干信号子空间方法把宽带的阵列频域数据四阶累积量聚焦到同一个参考频段下,然后利用基于信号空时特征结构的时空DOA 矩阵方法来进行二维DOA估计。理论上证明该方法在高斯噪声环境下对宽带非高斯信号都具有很好的估计性能,通过计算机仿真也验证了该方法的有效性。     

Layered moving-object segmentation for stereoscopic video using motion and depth information

A novel layered stereoscopic moving-object segmentation method is proposed in this paper by exploiting both motion information and depth information to extract moving objects for each depth layer with high accuracy on their shape boundary. By taking a higher-order statistics on two frame-difference fields across three adjacent frames, the computed motion information are used to conduct change detection and generate one motion mask that consists of all the moving objects from all the depth layers involved at each view. It would be highly desirable, and challenging, to further differentiate them according to their residing depth layer to achieve layered segmentation. For that, multiple depth-layer masks are generated using our proposed disparity estimation method, one for each depth layer. By intersecting the motion mask and one depth-layer mask at any given layer-of-interest, the moving objects associated with the corresponding layer are then extracted. All the above-mentioned processes are repeatedly performed along the video sequence with a sliding window of three frames at a time. For demonstration, only the foreground and the background layers are considered in this paper, while the proposed method is generic and can be straightforwardly extended to more layers, once the corresponding depth-layer masks are made available. Experimental results have shown that the proposed layered moving-object segmentation method is able to segment the foreground and background moving objects separately, with high accuracy on their shape boundary. In addition, the required computational load is considered fairly inexpensive, since our design methodology is to generate masks and perform intersections for extracting the moving objects for each depth layer.     

运动目标的自动分割与跟踪

该文提出了一种对视频序列中的运动目标进行自动分割的算法。该算法分析图像在L U V空间中的局部变化,同时使用运动信息来把目标从背景中分离出来。首先根据图像的局部变化,使用基于图论的方法把图像分割成不同的区域。然后,通过度量合成的全局运动与估计的局部运动之间的偏差来检测出运动的区域,运动的区域通过基于区域的仿射运动模型来跟踪到下一帧。为了提高提取的目标的时空连续性,使用Hausdorff跟踪器对目标的二值模型进行跟踪。对一些典型的MPEG-4测试序列所进行的评估显示了该算法的优良性能。     

Video object transmission by means of virtual reality based object extraction

This paper presents a new technique to extract objects from a real complex background so that a video sequence can be decomposed into a set of objects as required for object oriented video compression techniques. The proposed method is based on a background subtraction technique. However, instead of using a fixed background, the system relies on predicting one from a previously constructed virtual model of the environment. Thus, camera movements are allowed. These movements are estimated by means of a tracker device. We also present the virtual model construction technique for indoor environments. The method has been successfully tested for several different video sequences including capture errors, partially mapped virtual environments and camera positioning errors. Further work will focus on extending the virtual models not only to environment, but also to objects, and integrating the method in a MPEG4 standard compression system.     

基于时空信息的自动视频对象分割算法

提出一种在通用视频序列中从背景里分离出运动对象的方法.首先,使用全局运动估计和补偿、场景变化检测技术进行预处理.然后,使用四阶统计显著性检测方法从帧差图像中分离出前景和背景,并使用连通成分标记算法和一连串形态学开启、闭合操作得到修正后的二值模板图.接着,使用对称差分技术消除覆盖\显露的背景以及部分噪声.最后,使用模板匹配和更新,不仅能够得到快速变化的对象,而且能够得到视频对象暂时停止运动的部分.     

Unsupervised image segmentation based on analysis of binary partition tree for salient object extraction

This paper proposes an unsupervised image segmentation approach aimed at salient object extraction. Starting from an over-segmentation result of a color image, region merging is performed using a novel dissimilarity measure considering the impact of color difference, area factor and adjacency degree, and a binary partition tree (BPT) is generated to record the whole merging sequence. Then based on a systematic analysis of the evaluated BPT, an appropriate subset of nodes is selected from the BPT to represent a meaningful segmentation result with a small number of segmented regions. Experimental results demonstrate that the proposed approach can obtain a better segmentation performance from the perspective of salient object extraction.     

On-line video object segmentation using illumination-invariant color-texture feature extraction and marker prediction

A novel on-line video object segmentation scheme based on illumination-invariant color-texture feature extraction and marker prediction is proposed in this paper. First, the location of the object of interest is initialized based on user-specified markers. Superpixels are generated in the next available frame of the input video to extract the illumination-invariant color-texture features of the object of interest. The proposed object marker prediction scheme consists of estimating the user-specified markers and locating the object of interest in the next available frame via superpixel motion prediction using illumination-invariant optical flow, marker superpixel candidate generation using short-term superpixel affinity, and maximum likelihood computation using long-term superpixel affinity. The experimental results obtained when the proposed method is applied to several challenging video clips demonstrate that the proposed approach is competitive with several other state-of-the-art methods, especially when the illumination and object motion change dramatically.     

基于变化检测和帧差累积的视频对象分割方法

针对目前许多视频对象分割方法中分割边界不精 确、遮挡和不规则运动问题解决效果 不好等问题,提出一种新的视频 对象分割算法。利用人眼的视觉特点,即对运动(时间梯度)和边缘(空间梯度)都特别敏 感,把帧间运动变化检测(时域 定区间帧差累积)和图像的边缘检测结合起来,首先利用t显著 性检验检测对称帧的帧间变化,再对检测出的初始运动变化 区域进行时域定区间帧差累积计算,并进一步整合形成记忆掩膜(MT);然后应用改进的Kirs ch边 缘检测算子较为精确地检测当 前帧中所有的边缘信息,减少MT膜中的残留噪声,并通过时空滤波获得语义视频对 象平面;最终选择性的应用填充及 形态学处理操作,实现视频对象的分割。实验结果验证了本文算法的有效性和准确性。     

基于时空运动信息的药液异物自适应分割算法

为了能够从药液视频序列图像中准确地提取出运动异物对象,提出一种基于帧差图时空运动信息的药液异物模糊自适应阈值分割算法。首先通过4帧序列图像的隔帧差分得到2幅差分图并分别划分为5×5的图像块;然后计算对应图像分块的4阶矩以实现异物的运动信息提取;最后采用自适应阈值依据帧差图对应图像块的4阶矩之差实现运动异物的分割,并经过形态学处理去除掉噪声和空洞。为使阈值能够跟随图像块灰度变化,阈值的调整采用模糊推理依据对应块灰度均值差和方差变化自适应实现。实验及实际测试结果表明,本文所提算法较好地满足了低对比度和局部光照变化的药液异物实时检测要求,是一种实用有效的图像分割方法。     

基于遗传算法的二维最小交叉熵的动态图像分割

为解决动态图像的分割问题,本文提出了一种遗传算法的二维最小交叉熵的分割算法。首先给出二维交叉熵的定义,然后运用遗传算法,以二维交叉熵为评价函数,搜索能使二维交叉熵最小的参数向量,并以该参数向量为分割阈值对飞机图像进行图像分割处理。实验结果表明,二维飞机交叉熵图像分割精度比一维飞机熵图像分割精度高,且比传统的二维熵分割速度快。     

基于改进麻雀算法的最大2维熵分割方法

为了提高最大2维熵分割的性能,提出了基于改进麻雀算法的最大2维熵分割方法,可减小运算量并且缩短计算时间.首先,融合反向学习策略和自适应t分布变异,引入精英粒子,以扩大算法搜索范围,增加算法后期局部搜索能力;其次,使用萤火虫机制,对最优解进行扰动变异,进一步增加种群多样性;最后,采用提出的改进麻雀算法寻找图像最大2维熵,...     

三维动态偏移场模型及其在视频跟踪技术中的应用

基于二维动态偏移场模型,该文提出了动态偏移场模型的三维描述形式,实现了对目标沿景深方向运动状态的描述,并为失真图像序列的动态偏移提供了由平面偏移估计到空间运动状态估计的渐进描述。在视频跟踪系统中,较之其他视频跟踪技术,基于三维偏移场模型理论,该文实现了跟踪视频序列的稳定化和对被跟踪目标运动状态的估计。     

用均匀中心对称阵二维西ESPRIT方法实现闭环形式二维角估计

本文提出了适用于一类均匀中心对称阵的二维西ESPRIT方法,它是一种闭环形式的高分辨算法,对信号源方位角和仰角估计实现自动配对.在算法最后阶段构造一个矩阵,其第I个特征值的实部和虚部分别与第I个信号源相对X轴和Y轴的方向余波一一对应.该算法除了初始变换和最后矩阵特征分解外,整个过程都采用高效的实值计算.并推广应用于DFT波束空间,可在较小的空间维数上处理,从而减小计算复杂性.最后对算法做了一阶近似渐进性能分析.仿真结果说明了算法是有效的.