Infrared point target detection with improved template matching

Detecting point targets in infrared images is a difficult task. Template matching is simple and easy to implement for completing this task. However, it has some shortcomings. We propose an improved template matching method for detecting targets. Different from the classic template matching, the projection coefficients obtained from principal component analysis are used as templates and the nonlinear correlation is proposed to measure the similarity, the matching degree. The correlation in original space can not capture the higher-order statistical property of images. So its detection performance is not satisfying. We introduce the nonlinear correlation, which computes the correlation coefficients in a higher-dimensional feature space or even in an infinite-dimensional feature space, to capture the higher-order statistics. The detection performance is improved greatly. Results of experiments show that the improved method is competent to detect infrared point targets.     

一种基于Kalman滤波的环形模板匹配相关跟踪算法(英文)

为了解决在目标跟踪系统中,传统相关算法在目标发生目标局部遮挡或旋转等姿态变化较大的情况时容易跟踪丢失的问题,提出一种改进的基于卡尔曼预测器的环形模板匹配相关跟踪的算法.利用卡尔曼预测器来预测下一帧目标可能出现的区域,然后在较小的预测区域中进行环形相关匹配运算,找到最佳相关匹配点,使跟踪更具主动性。环形匹配还可以克服由于姿态变化而引起的横向匹配点丢失,从而可以跟踪各种姿态运动的机动目标.实验中,利用改进算法对出现局部遮挡情况的姿态变化大的运动目标进行跟踪,传统算法处理此类情况容易跑飞,而本文算法不受这两种跟踪局限性的干扰,始终稳定跟踪机动目标且耗时大幅减少.     

A robust infrared dim target detection method based on template filtering and saliency extraction

Dim target detection in infrared image with complex background and low signal-clutter ratio (SCR) is a significant and difficult task in the infrared target tracking system. A robust infrared dim target detection method based on template filtering and saliency extraction is proposed in this paper. The weighted gray map is obtained from the infrared image to highlight the target which is brighter than its neighbors and has weak correlation with its background. The target saliency map is then calculated by phase spectrum of Fourier Transform, so that the dim target detection could be converted to salient region extraction. The potential targets are finally extracted by combining the two maps. Moreover, position discrimination between targets in the two maps is used to exclude the false alarms and extract the targets. Experimental results on measured images indicate that our method is feasible, adaptable and robust in different backgrounds. The ROC (Receiver Operating Characteristic) curves obtained from the simulated images demonstrate the proposed method outperforms some existing typical methods in both detection rate and false alarm rate, for target detection with low SCR.     

一种新的红外成像末制导目标跟踪方法

为了稳定跟踪导弹末制导阶段的红外目标,提出了一种基于尺度不变特征变换的红外目标跟踪算法.尺度不变性特征变换所提取的图像纹理特征具有尺度和旋转不变性,跟踪算法分别提取目标模板和待跟踪图像的尺度不变特征变换特征.根据最小欧氏距离准则提取目标模板与待跟踪图像间相匹配的尺度不变特征变换特征点对,利用该特征点对拟合反映两图像间映射关系的仿射模型,并据此估计目标中心位置及调整目标模板尺寸.仿真结果表明,跟踪算法能够较好地实现在导弹末制导阶段对红外地面杂波背景下目标的稳定跟踪,其跟踪准确度和稳定度优于传统方法.
关键词:末制导跟踪|尺度不变性特征变换|特征匹配|仿射模型     

相邻帧间匹配的迎头点目标跟踪算法

针对海空复杂背景下迎头点目标检测与跟踪难题,提出了一种基于相邻帧间匹配的边检测边跟踪算法.算法对相邻红外图像序列帧间点与点的邻域匹配,标记匹配结果兴趣区域像素点,统计标记次数,与输入单帧图像同步显示迎头目标检测结果.算法主要特点在于无需提前假定疑似目标点位置,单个匹配过程与当前相邻两帧外的其它序列帧无关,整个匹配过程不随目标数目多少或运动状态变化而改变.根据仿真和实拍照片实验,证实了理论上区别于传统算法的上述优点,在军事应用中具有较高的参考价值.     

Modified particle filter-based infrared pedestrian tracking

Tracking infrared pedestrian targets is a crucial part in video surveillance. Many factors make this problem decidedly non-linear and non-Gaussian, and the appropriate solution at present is based on the particle filter technique which is powerful and simple to implement. But in many cases, the traditional particle filter tracking algorithm fails to track the targets robustly and accurately. To solve these problems, a modified particle filter algorithm that combines intensity and edge cues is proposed. The algorithm firstly extracts the intensity cue and edge cue of the target based on the visual models which are originally learnt from the first frame and will be updated during the tracking process according to an automatic model updating strategy. Secondly, these two cues are combined into the particle filter framework by an adaptive integration scheme. Furthermore, its performance is evaluated with real-world infrared pedestrian sequences and extensive experimental results show that the presented method can track the infrared pedestrian more effectively and reliably than the traditional particle filter algorithm.     

基于局部轮廓特征的无人机头部检测跟踪算法

针对无人机的结构特点,提出了一种基于目标轮廓提取、轮廓自动分段、头部定位以及头部模板匹配四个模块的目标头部检测跟踪算法.首先对第一帧图像提取目标轮廓,并通过计算轮廓点的变化率,对轮廓进行自动分段,得到目标的4个局部轮廓点列,进而根据头部轮廓点列的特点,完成头部轮廓筛选,然后利用基于目标中轴的二次曲线拟合,实现头部顶点的...     

一种基于算法融合的红外目标跟踪方法

视频目标跟踪的难点在于快速、准确地在帧与帧之间匹配目标.由于红外图像目标与背景的反差低,图像的边缘模糊并且灰度级动态范围小,使红外目标跟踪难度比可见光更大.本文提出一种针对红外日标跟踪的融合算法,该方法融合直方图和不变矩的特点.首先利用目标的直方图计算简单快速的特点,由均值平移算法快速找到局部最优解,但由于该局部最优解仪为直方图匹配的最优解,缺少目标形状特征,与实际目标位置存在一定的偏差;其次,利用边缘小变矩作为修正特征修正误差,避免跟踪误差逐渐累计而最终导致跟踪失败,以提高跟踪的稳定性和精度.实验结果表明,该算法能够消除跟踪过程中的漂移现象,提高跟踪精度.     

相位一致性图像及其在目标跟踪中的应用(英文)

针对传统实时相关跟踪方法对照度变化敏感的问题,提出了一种基于相位一致性图像的相关跟踪方法.利用相位一致性函数值在[0,1]区间内且无量纲、对图像的亮度和对比度具有不变性等特点,首先对原始图像进行相位一致性检测,得到相位一致性图像,再利用MAD(Minimum Absolute Difference)等相关跟踪算法在相位一致性图像中对目标进行跟踪运算.对可见光和红外图像的实验表明,在图像的亮度和对比度发生剧烈变化的情况下,算法仍能保持对目标的稳定跟踪.该方法可用于解决传统实时相关跟踪方法普遍存在的因照度变化导致跟踪点漂移甚至跟踪失败的问题.     

Infrared/laser multi-sensor fusion and tracking based on the multi-scale model

The state estimation problem of targets detected by infrared/laser composite detection system with different sampling rates was studied in this paper. An effective state estimation algorithm based on data fusion is presented. Because sampling rate of infrared detection system is much higher than that of the laser detection system, the theory of multi-scale analysis is used to establish multi-scale model in this algorithm. At the fine scale, angle information provided by infrared detection system is used to estimate the target state through the unscented Kalman filter. It makes full use of the high frequency characteristic of infrared detection system to improve target state estimation accuracy. At the coarse scale, due to the sampling ratio of infrared and laser detection systems is an integer multiple, the angle information can be fused directly with the distance information of laser detection system to determine the target location. The fused information is served as observation, while the converted measurement Kalman filter (CMKF) is used to estimate the target state, which greatly reduces the complexity of filtering process and gets the optimal fusion estimation. The simulation results of tracking a target in 3-D space by infrared and laser detection systems demonstrate that the proposed algorithm in this paper is efficient and can obtain better performance than traditional algorithm.     

基于音视频信息融合的目标检测与跟踪算法

针对单一视觉跟踪算法易受遮挡影响的缺陷,提出一种基于音视频信息融合的目标检测与跟踪算法。整个算法框架包括视频检测与跟踪、声源定位、音视频信息融合跟踪3个模块。视频检测与跟踪模块采用YOLOv5m算法作为视觉检测的框架,使用无迹卡尔曼滤波和匈牙利算法实现多目标的跟踪与匹配;声源定位模块采用十字型麦克风阵列获取音频信息,结合各麦克风接收信号的时延计算声源方位;音视频信息融合跟踪模块构建音视频似然函数和音视频重要性采样函数,采用重要性粒子滤波作为音视频融合跟踪的算法,实现对目标的跟踪。在室内复杂环境下对算法性能进行测试,结果表明该算法跟踪准确率达到90.68%,相较于单一模态算法具有更好的性能。     

伪Zernike矩在低信噪比红外目标检测中的应用

由于探测器本身固有的特性以及军事上的极限使用要求,红外图像普遍存在目标-背景间对比度较差、目标边缘模糊和噪声较大等特点,采用常规模板匹配、Hu矩方法难以取得理想的检测效果。针对低信噪比红外目标图像,分析了伪Zernike矩的基本原理、不变性和计算方法,提出了低信噪比红外目标检测的伪Zernike矩方法,并比较了模板匹配、Hu矩、伪Zernike矩方法的目标检测效果。理论分析和实验验证了该方法的有效性。     

基于改进二阶段检测网络的长时跟踪重检测方法

为构建适用于长时跟踪的重检测模块,受改进二阶段检测网络的GlobalTrack方法的启发,提出了一种高效的对特定模板目标进行端到端重检测的深度网络：首先,为了在大尺度图像上更高效地融合模板特征,通过构造交叉信息增强模块改进深度互相关方法,利用交叉通道注意力信息编码搜索特征和模板特征;此外,采用动态实例交互模块替代传统二阶段网络的RPN(region proposal network)和RCNN(region-based convolutional neural networks)结构,根据模板信息指导检测网络的分类和回归阶段,构建了端到端的稀疏重检测结构。在LaSOT和OxUva长时跟踪数据集上进行对比实验,本文方法相较于原始方法性能提升3%,实时帧率提升173%。实验结果表明,改进后的方法可以在全图范围内更准确、快速地重新检测模板目标。     

基于改进模板匹配及图像差分法的PCB板缺陷多级检测方法

针对目前应用于PCB缺陷检测系统的模板匹配方法及缺陷检测方法存在准确性不足的问题,提出一种基于改进模板匹配及图像差分法的PCB缺陷多级检测方法。提出基于多方向Sobel算子的改进模板匹配方法实现待测图像与模板图像的匹配,针对PCB板漏件缺陷,提出基于图像差分法的多级二值化检测法实现PCB图像的缺陷检测。结合实验平台测试发现,该方法能够准确地提取出缺陷区域。与现有方法相比,该方法的误检率仅5%,具有更好的稳定性以及更高的准确性。     

MR fingerprinting reconstruction with Kalman filter

Magnetic resonance fingerprinting (MR fingerprinting or MRF) is a newly introduced quantitative magnetic resonance imaging technique, which enables simultaneous multi-parameter mapping in a single acquisition with improved time efficiency. The current MRF reconstruction method is based on dictionary matching, which may be limited by the discrete and finite nature of the dictionary and the computational cost associated with dictionary construction, storage and matching.In this paper, we describe a reconstruction method based on Kalman filter for MRF, which avoids the use of dictionary to obtain continuous MR parameter measurements. With this Kalman filter framework, the Bloch equation of inversion-recovery balanced steady state free-precession (IR-bSSFP) MRF sequence was derived to predict signal evolution, and acquired signal was entered to update the prediction. The algorithm can gradually estimate the accurate MR parameters during the recursive calculation. Single pixel and numeric brain phantom simulation were implemented with Kalman filter and the results were compared with those from dictionary matching reconstruction algorithm to demonstrate the feasibility and assess the performance of Kalman filter algorithm.The results demonstrated that Kalman filter algorithm is applicable for MRF reconstruction, eliminating the need for a pre-define dictionary and obtaining continuous MR parameter in contrast to the dictionary matching algorithm.     

基于图像分离块操作的快速模板匹配跟踪算法

传统的模板匹配跟踪算法存在运算量大和实时性差的缺陷,限制了它的应用范围。针对这一问题,在已有的基于位置预测相关跟踪算法的基础上,提出了利用图像分离块操作对相关跟踪算法进行改进,进一步减少相关跟踪算法的计算量,以满足系统的实时性要求。对改进算法进行了模拟仿真实验验证。仿真结果表明：该改进算法不仅在很大程度上减少了计算量,提高了跟踪系统的实时性,而且能够有效地减少随机噪声的影响,使得跟踪更加快速准确。     

Tensor Fukunaga-Koontz transform for small target detection in infrared images

Infrared small targets detection plays a crucial role in warning and tracking systems. Some novel methods based on pattern recognition technology catch much attention from researchers. However, those classic methods must reshape images into vectors with the high dimensionality. Moreover, vectorizing breaks the natural structure and correlations in the image data. Image representation based on tensor treats images as matrices and can hold the natural structure and correlation information. So tensor algorithms have better classification performance than vector algorithms. Fukunaga-Koontz transform is one of classification algorithms and it is a vector version method with the disadvantage of all vector algorithms. In this paper, we first extended the Fukunaga-Koontz transform into its tensor version, tensor Fukunaga-Koontz transform. Then we designed a method based on tensor Fukunaga-Koontz transform for detecting targets and used it to detect small targets in infrared images. The experimental results, comparison through signal-to-clutter, signal-to-clutter gain and background suppression factor, have validated the advantage of the target detection based on the tensor Fukunaga-Koontz transform over that based on the Fukunaga-Koontz transform.     

A novel low-cost and small-size human tracking system with pyroelectric infrared sensor mesh network

This paper presents a low-cost and small-size human tracking system based on pyroelectric infrared (PIR) sensor mesh network. A wireless pyroelectric sensor network is developed using PIRs and PIR cone optics. The layout of PIRs and sensor nodes are well investigated and the real detection range of PIR is analyzed. A simple and effective PIR signal processing method is designed to get the event signal, and an innovative location method based on detecting angle bisectors of PIRs and data fusion is proposed. An improved Kalman filter and a particle filter are used for human tracking respectively. Simulation and Experimental results have shown that the human tracking system can effectively recognize, locate and track a human target with promising accuracy.     

基于组合线阵的近程运动小目标被动定位跟踪

针对水下运动小目标被动探测与定位问题,提出了分段组合子阵联合处理探测方法,各探测子阵采用相互垂直结构布局,克服了单阵方位模糊及无法定位等问题。研究了分段组合子阵的宽带最小方差无畸变失真响应近场聚焦目标定位方法,实现了近程蛙人等水下小目标被动高精度定位。在此基础上,采用卡尔曼滤波算法对目标运动轨迹进行预测估计,将目标定位信息与跟踪轨迹信息进行匹配,实现高背景噪音下的运动小目标的跟踪处理。理论分析及仿真结果表明,分段子阵联合处理能有效对水下运动小目标进行定位和跟踪,海试试验进一步验证了该方法的有效性。     

Joint detection and tracking of size-varying infrared targets based on block-wise sparse decomposition

The high variability of target size makes small target detection in Infrared Search and Track (IRST) a challenging task. A joint detection and tracking method based on block-wise sparse decomposition is proposed to address this problem. For detection, the infrared image is divided into overlapped blocks, and each block is weighted on the local image complexity and target existence probabilities. Target-background decomposition is solved by block-wise inexact augmented Lagrange multipliers. For tracking, label multi-Bernoulli (LMB) tracker tracks multiple targets taking the result of single-frame detection as input, and provides corresponding target existence probabilities for detection. Unlike fixed-size methods, the proposed method can accommodate size-varying targets, due to no special assumption for the size and shape of small targets. Because of exact decomposition, classical target measurements are extended and additional direction information is provided to improve tracking performance. The experimental results show that the proposed method can effectively suppress background clutters, detect and track size-varying targets in infrared images.