一种具有自适应非均匀校正功能的非制冷焦平面探测器组件

基于场景的非均匀校正算法(scene based nonuniformity correction,SBNUC)是非均匀校正技术今后的重点发展方向,介绍了近年来基于恒定统计约束的SBNUC、神经网络的SBNUC和运动估计的SBNUC算法的研究进展。研究了SBNUC算法在实际焦平面探测器组件上的实现方法,该方法仅依赖拍摄序列的信息对焦平面探测器的增益和偏置参数进行组间更新或帧间更新,可有效补偿温漂。研制了一种具有自适应非均匀校正功能的非制冷焦平面探测器组件,红外视频经该组件处理后,图像质量有所提高。该组件可明显提高热成像系统的成像性能,并能动态地保证热成像系统随场景变化的稳定性。     

热释电IRFPA非均匀性校正实验系统研究

采用虚拟仪器技术,设计了基于LabVIEW软件平台的热释电IRFPA（红外焦平面阵列）非均匀性校正系统。该系统可通过控制面板选择校正算法,选取3种不同的标准像元的标准校正曲线。可以对IRFPA待校正的像元输出进行采集,对非均匀性参数进行测试,还可以进行非均匀性校正。系统通过三维波形以及图像的显示来观察校正前后对比,并能计算出校正前后的NU（非均匀性）值大小。对像元数为120160的热释电IRFPA输出的视频信号进行了非均匀性校正实验,对非均匀性校正算法进行了统计对比,对仿真结果及数据进行了分析总结。经过校正实验验证了系统的可行性,结果证明基于平均值法的两点定标算法对热释电IRFPA非均匀性校正后的NU值是最小的。通过统计数据得出校正后的NU可平均下降30%。     

Guided filter and adaptive learning rate based non-uniformity correction algorithm for infrared focal plane array

Imaging non-uniformity of infrared focal plane array (IRFPA) behaves as fixed-pattern noise superimposed on the image, which affects the imaging quality of infrared system seriously. In scene-based non-uniformity correction methods, the drawbacks of ghosting artifacts and image blurring affect the sensitivity of the IRFPA imaging system seriously and decrease the image quality visibly. This paper proposes an improved neural network non-uniformity correction method with adaptive learning rate. On the one hand, using guided filter, the proposed algorithm decreases the effect of ghosting artifacts. On the other hand, due to the inappropriate learning rate is the main reason of image blurring, the proposed algorithm utilizes an adaptive learning rate with a temporal domain factor to eliminate the effect of image blurring. In short, the proposed algorithm combines the merits of the guided filter and the adaptive learning rate. Several real and simulated infrared image sequences are utilized to verify the performance of the proposed algorithm. The experiment results indicate that the proposed algorithm can not only reduce the non-uniformity with less ghosting artifacts but also overcome the problems of image blurring in static areas.     

基于场景的红外焦平面阵列非均匀性校正算法综述

红外焦平面阵列的非均匀性噪声是制约红外成像质量的主要因素。基于场景的非均匀校正算法通常利用图像序列并依赖帧间运动对焦平面阵列的非均匀性进行校正。介绍和分析了全局非均匀性校正,Kalman滤波器法,自适应滤波法,轨迹跟踪法,基于场景运动分析的校正算法,基于小波变换实现低通滤波的校正算法,高通滤波与神经网络相结合的算法,基于小波去噪、序列图像配准和正交最小二乘拟合的校正算法,改进的神经网络算法以及代数算法等,对算法进行了比较。     

Non-uniformity correction algorithm for IRFPA based on motion controllable micro-scanning and perimeter diaphragm strips

Non-uniformity correction is the key issue for the image quality improvement of infrared focal panel array (IRFPA) imaging. A non-uniformity correction (NUC) algorithm for IRFPA based on motion controllable micro-scanning platform and perimeter diaphragm strips is presented. We initially execute one-point calibration to the perimeter detectors, then based on controllable motion of adjacent frames, a special algebraic algorithm is proposed to transport the calibration of the perimeter detectors to those interior un-corrected ones. In this way, the bias parameter of the whole field of view (FOV) is calculated. The algorithm can be easily combined with sub-pixel imaging, thereby improving the quality of thermal imaging system (image spatial resolution and uniformity). All calculations are algebraic, with a low computation load. The algorithm can realize adaptive one point calibration without covering the central FOV rapidly. Experiments on simulated infrared data demonstrate that this algorithm requires only dozens of frames to obtain high quality corrections.     

基于BP神经网络的红外焦平面非均匀性校正技术

在传统BP神经网络非均匀性校正理论的基础上,结合红外焦平面阵列读出通道的时变特性,提出一种新的输出期望估计方法.该方法利用当前像素邻域和读出通道估计输出期望值.实验表明,算法能有效抑制焦平面固定图案噪音,提高场景目标的分辨能力,达到较好的视觉效果.     

基于维纳滤波的红外焦平面阵列非均匀性校正算法

充分利用红外图像的空间相关性和时间相关性,提出了一种基于维纳（Wiener）滤波的红外焦平面阵列（IRFPA）非均匀性校正算法,实现对辐射信号的无偏估计,滤波器的参量通过时域一、二阶统计结合空域平均获得,同现有的典型校正算法相比,本文算法具有收敛速度快、校正准确度高的特点,理论分析以及针对实际红外图像的实验结果表明提出的算法更具优越性.     

基于三次样条插值的IRFPA非均匀性校正算法*

针对红外成像制导跟踪系统工程应用的实际要求,对红外焦平面阵列工作在大动态范围条件下的非均匀性校正算法进行了深入研究,依据函数插值原理,导出了三次样条插值非均匀性校正算法.用模拟的非均匀性图像和实际的红外图像对算法进行了校验.结果表明该算法具有动态范围大、校正准确度高的优点,可对红外焦平面阵列实现非均匀性和非线性双重校正效果.     

基于干扰对消的红外焦平面非均匀性校正算法

红外焦平面器件的非均匀性产生机理复杂,难以准确拟合探测元响应曲线。提出了一种基于相关干扰抵消的非均匀性校正算法,以预先采集到的一帧黑体面源图像做为自适应干扰对消器的参考输入图像,自适应滤波器由参考输入图像迭代计算出待校正红外图像的空间噪声的最佳估计,实现从空间噪声中提取真实图像信号。自适应滤波算法采用变步长最小均方误差算法,减少了算法的运算量,提高了算法的收敛速度。理论分析以及针对实际红外图像的仿真结果表明,提出的算法校正效果好,收敛速度快,更易于工程实现。     

基于特征分解的红外焦平面非均匀性校正算法

针对目前红外焦平面自适应场景校正算法工程应用的局限,提出了一种基于红外焦平面非均匀性特征分解的场景校正算法。分析了红外焦平面非性匀性构成因素,把其中的高频部分分解成盲点、斑块、行列非均匀性等,把缓慢变化的低频部分分解成梯度渐变非均匀性;分别对各类非均匀性采用不同的校正算法;合并校正结果,得到校正后的图像。实验结果表明,该算法校正精度高、收敛速度快、抑止目标退化能力强,适合工程应用。     

适应积分时间调整的红外图像非均匀性校正方法

针对应用常规红外图像非均匀性校正方法在变积分时间时,图像灰度值会发生改变的现象,提出了一种适应积分时间调整的红外图像非均匀性校正方法.该方法将不同积分时间、不同温度的黑体定标数据和对应的理论红外辐射量整合为一个整体数据库,借助神经网络损失函数和误差反向传递机制,对模型中的校正系数进行学习.训练得到的校正网络能在红外相机积分时间实时调整过程中,保证图像均匀地稳定输出,对后端红外图像处理有着重要意义,并验证训练该网络不需要大量定标数据.而针对红外探测器响应漂移的现象,则提出了在线修正校正系数的方法以有效应对.     

基于三次样条插值的IRFPA非均匀性校正算法

针对红外成像制导跟踪系统工程应用的实际要求,对红外焦平面阵列工作在大动态范围条件下的非均匀性校正算法进行了深入研究,依据函数插值原理,导出了三次样条插值非均匀性校正算法.用模拟的非均匀性图像和实际的红外图像对算法进行了校验.结果表明该算法具有动态范围大、校正准确度高的优点,可对红外焦平面阵列实现非均匀性和非线性双重校正效果.     

基于变积分时间的红外焦平面非均匀性校正算法研究

针对两点温度定标算法在应用过程中曝露的问题,提出了基于变积分时间的红外焦平面非均匀性校正算法.该算法先对图像进行非线性压缩,转换为线性图像,再利用红外焦平面阵列探测元的响应特性与积分时间之间的关系,采用改变积分时间的方法拟合红外焦平面探测器的平均响应特性曲线,进行两点校正,然后对结果进行取指数操作,即得到原图非均匀校正后的图像.分别利用两点温度定标法和变积分法对航拍红外图像进行校正效果验证,同时进行了不同校正算法的非均匀性适应性评价实验.实验结果表明新算法计算量小,校正准确度高,反应速度快,并在一定程度上解决了大动态范围下响应非线性对校正性能的影响,具有很好的工程应用价值.     

一种新的红外焦平面阵列非均匀性代数校正算法

 针对传统红外图像非均匀性代数校正算法收敛速度慢、运动估计精度不高的缺点,提出一种多尺度光流帧间运动估计的非均匀代数校正算法。通过时域低通滤波,采用多尺度光流估计下一帧图像,将所得图像对进行代数校正。该方法性能在自主研发的热像仪中得到验证,和传统的红外图像非均匀性代数校正算法相比,算法收敛速度从60帧提高到25帧,提高一倍左右,运动估计精度从校正后图像方差76.539减少到32.482。     

Scene based nonuniformity correction based on block ergodicity for infrared focal plane arrays

This paper puts forward a new scene based nonuniformity correction algorithm for IRFPA. This method adopts phase-correlation method for motion estimation and takes the sum of mean-square errors of the pixel brightness between several adjacent frames as the cost function when the brightness constancy assumption between two adjacent frames is satisfied. Nonuniformity correction parameters could be estimated by minimizing such cost function. In order to reduce calculation quantity, we can divide these images into several subblocks, and solve for the optimum solution of the cost function respectively in each subblock. From the analysis, it is shown that the optimum solution is of global uniqueness when all the elements in subblocks could satisfy the ergodicity condition. Then the estimated value of nonuniformity correction parameters could be deduced by minimizing the cost functions. The nonuniformity correction experiments for both infrared image sequence with simulated nonuniformity and infrared imagery with real nonuniformity show that the proposed algorithm could achieve a great correction effect by only analyzing a small number of frames.     

一种适用于红外搜索跟踪系统的实时非均匀性校正算法

针对目前红外搜索系统实用性较强的两点非均匀性校正存在难以实时跟踪图像非均匀的不足点,提出一种新的基于两点非均匀性校正和基于场景的实时联合校正算法。该算法利用两点校正提供基础校正系数,并充分利用红外搜索系统大数据量的特点,对实时数据量进行统计、分析,进而找出系统非均匀性随时间的漂移量,解决只采用两点校正算法带来的红外图像退化的问题。多次试验证明,采用联合非均匀校正算法的相对非均匀度由两点校正的5%降到了2%左右,并具有时间稳定性,获得了较好的校正效果。     

基于自适应扩散模型的单帧红外条纹非均匀性校正算法

针对红外焦平面成像系统存在列向条纹非均匀性的现象,采用了一种基于自适应PM扩散模型的非均匀校正新算法。首先,综合利用图像梯度信息和局部灰度统计信息,自适应计算PM模型的扩散阈值;然后将每列像素的PM模型估计值作为该列像素的期望值;最后采用最陡下降法迭代计算得到每列像元的校正参数,并对结果进行循环校正以提高校正效果。实验结果表明:该算法可以保护图像边缘信息,与同类算法相比,能够更有效地抑制条纹非均匀性,并且能够防止图像产生鬼影。     

基于FPGA的红外图像处理与实时显示系统研究

介绍了基于FPGA的红外图像处理与实时显示系统的工作原理。针对传统的红外焦平面阵列(IRFPA)非均匀性校正算法的不足，提出了对采用神经元法和两点线性法校正其非均匀性算法的改进，重点介绍了两点线性法的软硬件实现方式，该算法在Spartan系列FPGA上实现并获得成功。     

An evaluation method based on absolute difference to validate the performance of SBNUC algorithms

Scene-based non-uniformity correction (SBNUC) algorithms are an important part of infrared image processing; however, SBNUC algorithms usually cause two defects: (1) ghosting artifacts and (2) over-correction. In this paper, we use the absolute difference based on guided image filter (AD-GF) method to validate the performance of SBNUC algorithms. We obtain a self-separation source using the improved guided image filter to process the input image, and use the self-separation source to obtain the space-high-frequency parts of the input image and the corrected image. Finally, we use the absolute difference between the two space-high-frequency parts as the evaluation result. Based on experimental results, the AD-GF method has better robustness and can validate the performance of SBNUC algorithms even if ghosting artifacts or over-correction occur. Also the AD-GF method can measure how SBNUC algorithms perform in the time domain, it’s an effective evaluation method for SBNUC algorithm.     

A pipelined architecture for real time correction of non-uniformity in infrared focal plane arrays imaging system using multiprocessors

This paper proposes a kind of pipelined electric circuit architecture implemented in FPGA, a very large scale integrated circuit (VLSI), which efficiently deals with the real time non-uniformity correction (NUC) algorithm for infrared focal plane arrays (IRFPA). Dual Nios II soft-core processors and a DSP with a 64+ core together constitute this image system. Each processor undertakes own systematic task, coordinating its work with each other’s. The system on programmable chip (SOPC) in FPGA works steadily under the global clock frequency of 96Mhz. Adequate time allowance makes FPGA perform NUC image pre-processing algorithm with ease, which has offered favorable guarantee for the work of post image processing in DSP. And at the meantime, this paper presents a hardware (HW) and software (SW) co-design in FPGA. Thus, this systematic architecture yields an image processing system with multiprocessor, and a smart solution to the satisfaction with the performance of the system.