Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition

Image fusion for visible and infrared images is a significant task in image analysis. The target regions in infrared image and abundant detail information in visible image should be both extracted into the fused result. Thus, one should preserve or even enhance the details from original images in fusion process. In this paper, an algorithm using pixel value based saliency detection and detail preserving based image decomposition is proposed. Firstly, the multi-scale decomposition is constructed using weighted least squares filter for original infrared and visible images. Secondly, the pixel value based saliency map is designed and utilized for image fusion in different decomposition level. Finally, the fusion result is reconstructed by synthesizing different scales with synthetic weights. Since the information of original signals can be well preserved and enhanced with saliency extraction and multi scale decomposition process, the fusion algorithm performs robustly and excellently. The proposed approach is compared with other state-of the-art methods on several image sets to verify the effectiveness and robustness.     

多尺度形态算子融合图像滤波技术及滤波质量评价

针对舰载红外警戒系统的红外和电视图像,提出了一种新的海空背景下受强杂波、噪声污染的图像目标滤波算法和滤波效果的定量评价算子。算法采用多尺度的形态算子对输入的图像并行滤波,大尺度形态算子抑制图像噪声,小尺度形态算子提取目标边缘细节信息。处理后的图像进行基于树状小波帧变换的图像信息融合,融合图像可完备提取不同尺度滤波后的图像信息。针对目标检测跟踪的图像滤波算法的评价,提出了目标与背景的交叉分辨力评价算子及评价准则。仿真实验表明。该滤波算法要优于中值滤波、自适应滤波、小波变换滤波算法,滤波质量的定量评价算法是合理的、有效的。算法适用于舰载红外警戒系统。     

基于时频差的正交容积卡尔曼滤波跟踪算法

针对基于时频差测量的无源跟踪中面临的非线性估计问题, 提出一种正交容积卡尔曼滤波跟踪算法. 该算法在容积卡尔曼滤波算法的基础上, 通过引入特定正交矩阵改进容积采样方法, 在高维状态估计下减小因采样产生的误差, 在没有增加计算量的前提下, 有效提高收敛速度及跟踪精度. 仿真结果表明, 在基于到达时差和到达频差的联合无源跟踪问题中, 与扩展卡尔曼滤波及容积卡尔曼滤波算法相比, 本文所提算法在跟踪性能上有明显提升.     

基于运动方向估计的管道滤波算法

管道滤波算法提出了从时域角度解决弱小目标检测问题的思路,对于红外强起伏天空背景中弱点目标的检测问题,管道内强噪音的干扰以及低信噪比的条件会导致检测概率降低的情况出现.本文提出了一种运动方向估计的管道滤波算法,分析了红外弱点目标的运动特性,依据弱点目标在相邻帧间位置具有连贯性的特征,建立了弱点目标的运动方向估计模型.在模型中利用弱点目标逐帧检测的先验位置信息,估计弱点目标的运动方向和轨迹,根据估计结果去除管道内噪音对弱点目标的干扰.仿真结果表明,该方法能够很好地抑制管道内噪音的影响,提高弱点目标的检测概率,增强弱点目标抗管道内噪音干扰的能力.     

实时运动结构重建在自主导航系统中的应用

实时运动结构重建是自主车辆、机器人导航、空间探测器自主降落、智能监控等领域中的重要研究课题。目前实时运动结构重建主要存在着特征匹配困难、鲁棒性差、系统无法自动获取初始参数和需要大量人工干预等诸多问题。利用高速CMOS摄像机与惯性传感数据融合提高了运动结构重建算法的精度及其鲁棒性。该算法在扩展卡尔曼滤波框架下是通过融合惯性与视觉传感器的数据来进行运动估计的。对场景中的每一个待估计结构的特征点建立对应的卡尔曼滤波器,以估计其空间三维结构信息。运动估计模块与结构估计模块交替运行,减小了系统运算的复杂度,提高了实时性能。通过对真实场景图像序列的实验验证结果表明,惯性传感器的额外信息能够有效地提高运动结构估计的精度,能够增强算法的鲁棒性。     

基于Huber的高阶容积卡尔曼跟踪算法

为改善高阶容积卡尔曼滤波算法的滤波精度和鲁棒性, 提出了一种新的基于Huber的高阶容积卡尔曼滤波算法. 在采用统计线性回归模型近似非线性量测模型的基础上, 利用Huber M 估计算法实现状态的量测更新. 进一步结合高阶球面-径向容积准则的状态预测模块构成基于 Huber的高阶容积卡尔曼跟踪算法. 重点分析了Huber代价函数的调节因子对算法跟踪性能的影响. 通过对纯方位目标跟踪和再入飞行器跟踪两个实例验证了所提算法的跟踪性能优于传统高阶容积卡尔曼滤波算法.     

An improved fusion algorithm for infrared and visible images based on multi-scale transform

In this paper, an improved fusion algorithm for infrared and visible images based on multi-scale transform is proposed. First of all, Morphology-Hat transform is used for an infrared image and a visible image separately. Then two images were decomposed into high-frequency and low-frequency images by contourlet transform (CT). The fusion strategy of high-frequency images is based on mean gradient and the fusion strategy of low-frequency images is based on Principal Component Analysis (PCA). Finally, the final fused image is obtained by using the inverse contourlet transform (ICT). The experiments and results demonstrate that the proposed method can significantly improve image fusion performance, accomplish notable target information and high contrast and preserve rich details information at the same time.     

基于音视频信息融合的目标检测与跟踪算法

针对单一视觉跟踪算法易受遮挡影响的缺陷,提出一种基于音视频信息融合的目标检测与跟踪算法。整个算法框架包括视频检测与跟踪、声源定位、音视频信息融合跟踪3个模块。视频检测与跟踪模块采用YOLOv5m算法作为视觉检测的框架,使用无迹卡尔曼滤波和匈牙利算法实现多目标的跟踪与匹配;声源定位模块采用十字型麦克风阵列获取音频信息,结合各麦克风接收信号的时延计算声源方位;音视频信息融合跟踪模块构建音视频似然函数和音视频重要性采样函数,采用重要性粒子滤波作为音视频融合跟踪的算法,实现对目标的跟踪。在室内复杂环境下对算法性能进行测试,结果表明该算法跟踪准确率达到90.68%,相较于单一模态算法具有更好的性能。     

基于DSP的电动汽车锂电池荷电状态估算的研究与实现

锂电池荷电状态(SOC)的准确估算是电动汽车能源管理的关键技术。为了提高锂电池SOC的估算精度,将无迹卡尔曼滤波(UKF)应用于锂电池SOC估算,以减小拓展卡尔曼滤波(EKF)简单线性化带来的误差。搭建电池检测系统的硬件平台,以TMS320F28335型数字信号处理器(DSP)为主控芯片(MCU),实现电压、电流、温度的检测及UKF算法,并设计了相关的电池测试实验。实验结果表明,UKF可以实时估算锂电池SOC,估算误差在4%以内,高于传统的拓展卡尔曼滤波(EKF)。     

A novel low-cost and small-size human tracking system with pyroelectric infrared sensor mesh network

This paper presents a low-cost and small-size human tracking system based on pyroelectric infrared (PIR) sensor mesh network. A wireless pyroelectric sensor network is developed using PIRs and PIR cone optics. The layout of PIRs and sensor nodes are well investigated and the real detection range of PIR is analyzed. A simple and effective PIR signal processing method is designed to get the event signal, and an innovative location method based on detecting angle bisectors of PIRs and data fusion is proposed. An improved Kalman filter and a particle filter are used for human tracking respectively. Simulation and Experimental results have shown that the human tracking system can effectively recognize, locate and track a human target with promising accuracy.     

利用地球红外辐射的旋转飞行体姿态估计方法

针对导航控制系统对姿态测试技术多元化、新型化和低成本的要求, 提出了一种基于地球红外辐射的旋转飞行体姿态估计方法. 首先, 根据地球红外辐射的产生机理, 结合红外辐射在大气中的传播规律, 建立了地球红外辐射模型. 然后, 分析了旋转飞行体的运动特征, 构建了红外传感器的测量模型. 为了探索红外传感器的输出信号与旋转飞行体的姿态信息之间的内在联系, 研究了不同姿态角和视场角下的传感器输出信号特征. 最后, 为了提高旋转飞行体的姿态测试精度, 设计了基于三轴红外传感器的扩展卡尔曼滤波算法来估计姿态角和横滚角速度. 结果表明: 利用地球红外辐射场进行姿态测试的方法有效可行, 俯仰角估计误差在±0.1°, 横滚角估计误差在±0.05°, 横滚角速度估计误差在±1 rad/s. 该姿态测量方法简单有效, 能够满足旋转飞行体的姿态测量要求.     

激光数据链路与IRST信息融合方法研究

针对协同空战中激光数据链路系统传输的友机雷达探测信息与本机红外搜索跟踪系统（IRST）探测信息的不同特性,提出一种基于最优数据压缩的异步信息融合方法来提高探测系统性能。分析了包括时间配准、空间对准、数据融合、目标跟踪的信息融合过程,并通过仿真,对融合前、后所得的观测曲线与目标真实轨迹的比较及其误差曲线进行对比分析,融合后的方位角和俯仰角的误差已经维持在2mrad以内,结果表明该方法可以有效提高数据的精度。     

基于等效模型和多时间尺度扩展卡尔曼滤波的锂离子电池SOC预测

荷电状态(SOC)和最大可用电量估计是锂离子电池寿命预测中的两个最重要部分;然而与快速时变的SOC比较,最大可用电量的参数变化缓慢;文章提出了一个基于等效模型和多时间尺度的扩展卡尔曼滤波(EKF)预测算法对SOC和最大可用容量分别在不同时间尺度上进行估计,在宏观尺度上利用了SOC估计值作为观测量,更新最大可用电量;针对NCA/C卫星锂离子电池实验数据的仿真结果表明,提出的多时间尺度EKF预测算法与EKF联合估计算法相比,SOC和最大可用电量估计准确度更高,同时提高了计算效率。     

卡尔曼滤波在激光跟踪测量系统中的应用

激光跟踪测量系统对于测量运动目标空间位置是行之有效的,但在测量过程中,各种干扰噪声的影响会降低测量精度。采用卡尔曼滤波来减小噪声的影响以提高测量精度。介绍了激光跟踪测量系统,建立了状态方程和测量方程,给出了卡尔曼滤波算法,仿真结果表明,运用卡尔曼滤波大大提高了测量系统的精度。     

Fusion of 3D laser scanner and depth images for obstacle recognition in mobile applications

The problem of obstacle detection and recognition or, generally, scene mapping is one of the most investigated problems in computer vision, especially in mobile applications. In this paper a fused optical system using depth information with color images gathered from the Microsoft Kinect sensor and 3D laser range scanner data is proposed for obstacle detection and ground estimation in real-time mobile systems. The algorithm consists of feature extraction in the laser range images, processing of the depth information from the Kinect sensor, fusion of the sensor information, and classification of the data into two separate categories: road and obstacle. Exemplary results are presented and it is shown that fusion of information gathered from different sources increases the effectiveness of the obstacle detection in different scenarios, and it can be used successfully for road surface mapping.     

The infrared and visible image fusion algorithm based on target separation and sparse representation

Although the fused image of the infrared and visible image takes advantage of their complementary, the artifact of infrared targets and vague edges seriously interfere the fusion effect. To solve these problems, a fusion method based on infrared target extraction and sparse representation is proposed. Firstly, the infrared target is detected and separated from the background rely on the regional statistical properties. Secondly, DENCLUE (the kernel density estimation clustering method) is used to classify the source images into the target region and the background region, and the infrared target region is accurately located in the infrared image. Then the background regions of the source images are trained by Kernel Singular Value Decomposition (KSVD) dictionary to get their sparse representation, the details information is retained and the background noise is suppressed. Finally, fusion rules are built to select the fusion coefficients of two regions and coefficients are reconstructed to get the fused image. The fused image based on the proposed method not only contains a clear outline of the infrared target, but also has rich detail information.     

一种新的卫星钟差Kalman滤波噪声协方差估计方法

采用Kalman滤波方法进行钟差参数计算和预报时, 需确定Kalman滤波噪声协方差矩阵. 针对这一问题, 提出了一种新的卫星钟差Kalman滤波噪声协方差估计方法, 通过建立新息的相关函数序列与未知的噪声参数间的线性函数模型, 采用最小二乘法进行噪声参数估计. 采用精密钟差数据进行钟差参数估计和预报分析, 结果表明, 该方法具有较好的收敛性, 并与顾及随机噪声模型的开窗分类因子自适应抗差估计方法进行对比分析, 验证了新方法的正确性和有效性.     

Unscented Kalman filter and its nonlinear application for tracking a moving target

The extended Kalman filter (EKF) is probably the most widely used estimation algorithm for nonlinear systems. However, more than 40 years of experience in the estimation community has shown that is difficult to implement, difficult to tune, and only reliable for systems that are almost linear on the time scale of the updates. To overcome these limitations, this paper proposes the unscented Kalman filter (UKF). And the algorithms of the FEKF, SEKF and UKF are given. Furthermore, the state models and measurement models of a target are set up. For comparison purpose, the three algorithms is simulated for the target tracking, and the algorithm performance is analyzed and compared by the simulation results of FEKF, SEKF and UKF. Numerical results demonstrate that FEKF and UKF give almost identical results while the estimates of SEKF are clearly worse. The UKF is easier to implement, avoiding Jacobian and Hessian matrices computation.     

基于改进YOLOv3网络的无人车夜间环境感知

环境感知是无人车夜间行驶中的一项关键任务，提出一种改进的YOLOv3网络，以实现夜间对无人车获取的红外图像中行人、车辆的检测，将判断周边车辆的行驶方向问题转化为预测车辆位置的角度大小问题，并与深度估计信息进行融合对周边车辆行驶的距离和速度作出判断，从而实现夜间无人车对周边车辆行驶意图的感知。该网络具有端到端的优点，能实现整张图像作为网络的输入，直接在输出层回归检测目标的边界框位置、所属的类别和车辆的角度预测结果，并和深度估计信息融合得到周边车辆的距离和速度信息。实验结果表明，使用改进的YOLOv3网络对夜间无人车获取的红外图像进行目标检测的时间为0.04 s/帧，角度和速度预测效果较好，准确性和实时性达到了实际应用要求。     

Detection of infrared small target based on fusion of multi-filters北大核心CSCD

Aiming at solving accuracy problem of infrared small target detection in sky and ocean background scenarios of infrared image sequences, a novel infrared small target detection based on multi-filters algorithm fusion method is presented in this paper. Firstly infrared small target and imaging, time and space characteristics of the corresponding background noise are analyzed. Tophat algorithm with improved Robinson guard filter are then integrated to highlight target and suppress clutter background by using infrared small target imaging features. Adaptive threshold segmentation is used to extract candidate targets, while Unger smoothing filter and multi-objects association filter are used to eliminate random noise and false targets in the candidate targets. Multiple experiments of infrared small target image sequences are implemented, and experimental results show that proposed method can detect infrared small targets at 99% detection rate with high reliability and good real-time performance. © 2017, Editorial Board, Journal of Applied Optics. All right reserved.