Registration method for infrared images under conditions of fixed-pattern noise

This paper proposes a new registration method for infrared images under conditions of fixed-pattern noise (FPN). Conventional registration techniques are susceptible to FPN and it is therefore very desirable to have a registration algorithm that is tolerant to FPN. For this purpose, we utilize the difference of the cross-power spectrum of two discrete shifted images to suppress the noise power spectrum while the shifts information is well preserved. In particular, we show that the phase of the cross-power spectrum difference is a periodic two-dimensional binary stripe signal with the exact shifts determined to subpixel accuracy by the number of periods of the phase difference along each frequency axis. Robust estimates of shifts can be obtained by transforming its discontinuities to Hough domain. Experimental results show that the proposed method exhibits robust and accurate registration performance even for the noisy images that could not be handled by conventional registration algorithms. We have also incorporated this technique to a registration-based nonuniformity correction (NUC) framework, indicating that our registration technique is able to estimate motion parameters reliably, leading to satisfactory NUC result.     

Improvement in adaptive nonuniformity correction method with nonlinear model for infrared focal plane arrays

The scene adaptive nonuniformity correction (NUC) technique is commonly used to decrease the fixed pattern noise (FPN) in infrared focal plane arrays (IRFPA). However, the correction precision of existing scene adaptive NUC methods is reduced by the nonlinear response of IRFPA detectors seriously. In this paper, an improved scene adaptive NUC method that employs “S”-curve model to approximate the detector response is presented. The performance of the proposed method is tested with real infrared video sequence, and the experimental results validate that our method can promote the correction precision considerably.     

一种具有自适应非均匀校正功能的非制冷焦平面探测器组件

基于场景的非均匀校正算法(scene based nonuniformity correction,SBNUC)是非均匀校正技术今后的重点发展方向,介绍了近年来基于恒定统计约束的SBNUC、神经网络的SBNUC和运动估计的SBNUC算法的研究进展。研究了SBNUC算法在实际焦平面探测器组件上的实现方法,该方法仅依赖拍摄序列的信息对焦平面探测器的增益和偏置参数进行组间更新或帧间更新,可有效补偿温漂。研制了一种具有自适应非均匀校正功能的非制冷焦平面探测器组件,红外视频经该组件处理后,图像质量有所提高。该组件可明显提高热成像系统的成像性能,并能动态地保证热成像系统随场景变化的稳定性。     

Ghosting reduction in scene-based nonuniformity correction of infrared image sequences

Scene-based adaptive nonuniformity correction （NUC） is currently being applied to achieve higher performance in infrared imaging systems. However, almost all scene-based NUC algorithms cause the production of ghosting artifacts over output images. Based on constant-statistics theory, we propose a novel threshold self-adaptive ghosting reduction algorithm to improve the space low-pass and temporal high-pass （SLP- THP） NUC technique. The correction parameters of the previous frame are regarded as thresholds to compute new correction parameters. Experimental results show that the proposed algorithm can obtain a satisfactory performance in reducing unwanted ghosting artifacts.     

An enhanced non-uniformity correction algorithm for IRFPA based on neural network

Influenced by detector materials’ non-uniformity, growth and etching techniques, etc., every detector’s responsivity of infrared focal plane arrays (IRFPA) is different, which results in non-uniformity of IRFPA. And non-uniformity of IRFPA generates fixed pattern noises (FPN) that are superposed on infrared image. And it may degrade the infrared image quality, which greatly limits the application of IRFPA. Non-uniformity correction (NUC) is an important technique for IRFPA. The traditional non-uniformity correction algorithm based on neural network and its modified algorithms are analyzed in this paper. And a new improved non-uniformity correction algorithm based on neural network is proposed in this paper. In this algorithm, the desired image is estimated by using three successive images in an infrared sequence. And blurring effect caused by motion is avoided by applying implicit motion detection and edge detection. So the estimation image is closer to real image than the estimation image estimated by other algorithms, which results in fast convergence speed of correction parameters. A comparison is made to these algorithms in this paper. And experimental results show that the algorithm proposed in this paper can correct the non-uniformity of IRFPA effectively and it prevails over other algorithms based on neural network.     

基于自适应滤波的红外焦平面阵列非均匀性校正算法

 红外探测器响应漂移特性会降低红外焦平面阵列（IRFPA）非均匀性校正的精度。针对该问题提出了一种基于场景的IRFPA非均匀性校正算法。该算法利用所获得的序列成像场景信息,采用一种基于快速自适应滤波器的最优化递归估计方法来获得非均匀性校正参数,并利用当前的成像信息来更新校正参数,以此降低探测器响应漂移特性对非均匀性校正的影响。算法仿真实验显示,对非线性参数为26.12%的同一图像,使用该算法、两点校正算法和卡尔曼滤波校正算法校正1 h后,可分别将非线性参数降至1.856%,3.122%和1.893%,说明该算法可获得稳定而较好的非均匀性校正效果。     

Nonuniformity correction algorithm with nonlinear model for infrared focal plane arrays

For the detector in infrared focal plane arrays (IRFPA) with a large dynamic range of response, a nonlinear model of response curve of the detector in IRFPA is introduced in this paper. With the model, the Kalman-filter nonuniformity correction (NUC) algorithm with linear model, developed by Torres and Hayat, is extended. In the extended algorithm, the raw image is translated into a linearized one firstly by directly employing a logarithm-based transformation. Then the linearized image is corrected by the Kalman-filter NUC algorithm with linear model, and the corrected linearized image is obtained. Finally the uniformity image of the original one is achieved by fulfilling an exponent transformation to the corrected linearized image. The presented algorithm not only inherits the advantage of the original algorithm that resolves the problem of the temporal drift in the gain and the bias in each detector by updating NUC parameters with information of the current scene, but also reduce the influence of the detector nonlinear response to the NUC performance, so it is suitable for IRFPA under large response-range. The NUC ability of the presented algorithm is demonstrated by experiments with real infrared image sequences.     

A new adaptive nonuniformity correction algorithm for infrared line scanner based on neural networks

The striping pattern nonuniformity of the infrared line scanner (IRLS) severely limits the system performance. An adaptive nonuniformity correction (NUC) algorithm for IRLS using neural network is proposed.It uses a one-dimensional median filter to generate ideal output of network and can complete NUC by a single frame with a high correction level. Applications to both simulated and real infrared images show that the algorithm can obtain a satisfactory result with low complexity, no need of scene diversity or global motion between consecutive frames. It has the potential to realize real-time hardware-based applications.     

Nonuniformity correction algorithm based on adaptive filter for infrared focal plane arrays

Response nonuniformity is a key problem that influences the imaging performance of infrared focal plane arrays (IRFPA) imaging system. A parallel processing algorithm to adaptively estimate the nonuniformity correction (NUC) parameters for IRFPA is presented. In this algorithm, a bank of the adaptive filter is applied to adaptively estimate the NUC parameters for every detector in IRFPA. The infrared image sequences are input into the bank of adaptive filter. After certain times recursion calculations are executed frame-by-frame, then the optimal coefficients of the gain and the offset of detector in IRFPA are achieved. Then the NUC is fulfilled ultimately. The algorithm reduces the influence that the response drift with time imposed on NUC effectively, and achieves good NUC effect. It was validated by real experimental imaging procedures.     

Single image non-uniformity correction using compressive sensing

A non-uniformity correction (NUC) method for an infrared focal plane array imaging system was proposed. The algorithm, based on compressive sensing (CS) of single image, overcame the disadvantages of “ghost artifacts” and bulk calculating costs in traditional NUC algorithms. A point-sampling matrix was designed to validate the measurements of CS on the time domain. The measurements were corrected using the midway infrared equalization algorithm, and the missing pixels were solved with the regularized orthogonal matching pursuit algorithm. Experimental results showed that the proposed method can reconstruct the entire image with only 25% pixels. A small difference was found between the correction results using 100% pixels and the reconstruction results using 40% pixels. Evaluation of the proposed method on the basis of the root-mean-square error, peak signal-to-noise ratio, and roughness index (ρ) proved the method to be robust and highly applicable.     

基于场景的红外焦平面阵列非均匀性校正算法综述

红外焦平面阵列的非均匀性噪声是制约红外成像质量的主要因素。基于场景的非均匀校正算法通常利用图像序列并依赖帧间运动对焦平面阵列的非均匀性进行校正。介绍和分析了全局非均匀性校正,Kalman滤波器法,自适应滤波法,轨迹跟踪法,基于场景运动分析的校正算法,基于小波变换实现低通滤波的校正算法,高通滤波与神经网络相结合的算法,基于小波去噪、序列图像配准和正交最小二乘拟合的校正算法,改进的神经网络算法以及代数算法等,对算法进行了比较。     

Minimum mean square error method for stripe nonuniformity correction

Stripe nonuniformity is very typical in line infrared focal plane (IRFPA) and uncooled starring IRFPA. We develop the minimum mean square error (MMSE) method for stripe nonuniformity correction (NUC). The goal of the MMSE method is to determine the optimal NUC parameters for making the corrected image the closest to the ideal image. Moreover, this method can be achieved in one frame, making it more competitive than other scene-based NUC algorithms. We also demonstrate the calibration results of our algorithm using real and virtual infrared image sequences. The experiments verify the positive effect of our algorithm.     

基于自适应扩散模型的单帧红外条纹非均匀性校正算法

针对红外焦平面成像系统存在列向条纹非均匀性的现象,采用了一种基于自适应PM扩散模型的非均匀校正新算法。首先,综合利用图像梯度信息和局部灰度统计信息,自适应计算PM模型的扩散阈值;然后将每列像素的PM模型估计值作为该列像素的期望值;最后采用最陡下降法迭代计算得到每列像元的校正参数,并对结果进行循环校正以提高校正效果。实验结果表明:该算法可以保护图像边缘信息,与同类算法相比,能够更有效地抑制条纹非均匀性,并且能够防止图像产生鬼影。     

Correction of aeroheating-induced intensity nonuniformity in infrared images

Aeroheating-induced intensity nonuniformity effects severely influence the effective performance of an infrared (IR) imaging system in high-speed flight. In this paper, we propose a new approach to the correction of intensity nonuniformity in IR images. The basic assumption is that the low-frequency intensity bias is additive and smoothly varying so that it can be modeled as a bivariate polynomial and estimated by using an isotropic total variation (TV) model. A half quadratic penalty method is applied to the isotropic form of TV discretization. And an alternating minimization algorithm is adopted for solving the optimization model. The experimental results of simulated and real aerothermal images show that the proposed correction method can effectively improve IR image quality.     

A pipelined architecture for real time correction of non-uniformity in infrared focal plane arrays imaging system using multiprocessors

This paper proposes a kind of pipelined electric circuit architecture implemented in FPGA, a very large scale integrated circuit (VLSI), which efficiently deals with the real time non-uniformity correction (NUC) algorithm for infrared focal plane arrays (IRFPA). Dual Nios II soft-core processors and a DSP with a 64+ core together constitute this image system. Each processor undertakes own systematic task, coordinating its work with each other’s. The system on programmable chip (SOPC) in FPGA works steadily under the global clock frequency of 96Mhz. Adequate time allowance makes FPGA perform NUC image pre-processing algorithm with ease, which has offered favorable guarantee for the work of post image processing in DSP. And at the meantime, this paper presents a hardware (HW) and software (SW) co-design in FPGA. Thus, this systematic architecture yields an image processing system with multiprocessor, and a smart solution to the satisfaction with the performance of the system.     

一种适用于红外搜索跟踪系统的实时非均匀性校正算法

针对目前红外搜索系统实用性较强的两点非均匀性校正存在难以实时跟踪图像非均匀的不足点,提出一种新的基于两点非均匀性校正和基于场景的实时联合校正算法。该算法利用两点校正提供基础校正系数,并充分利用红外搜索系统大数据量的特点,对实时数据量进行统计、分析,进而找出系统非均匀性随时间的漂移量,解决只采用两点校正算法带来的红外图像退化的问题。多次试验证明,采用联合非均匀校正算法的相对非均匀度由两点校正的5%降到了2%左右,并具有时间稳定性,获得了较好的校正效果。     

DMA在高速红外图像实时处理系统中的应用

针对某红外成像定位系统对红外序列图像处理和诸如图像去噪、非均匀性校正、图像自适应分割、图像测量、数模解算等算法的实时性能要求，提出采用DSP DMA（存储器直接访问）方式处理系统中的转移和大量交换高效方案。以AD21062和EP1C6组成的数字图像处理系统为例，介绍DMA操作在高速红外实时图像处理系统中的应用，并给出具体的设计。实验表明，该设计方案可以使DSP从大量的数据搬移操作中解脱出来，专门的图像处理算法操作能够有效地提高数字图像处理系统的实时性，解决了系统的瓶颈问题。     

Study on high-precision temperature measurement of infrared thermal imager

The objective of this paper is to improve the precision and reliability of algorithms for temperature measurement using an IRFPA. A high-precision infrared temperature measurement algorithm based on the nonlinear response of each pixel in the IRFPA is proposed. The results show that the error variance of the algorithm is about one-sixth of traditional algorithms under identical conditions.     

基于衬底温度和贝叶斯估计的红外非均匀性校正（英）

分析了红外焦平面阵列(IRFPA)基于定标的非均匀性校正法(NUC)和基于场景的NUC算法各自的优势和问题,在此基础上提出了联合非均匀性校正方法。根据上电时刻焦平面衬底的温度值,从FLASH中提取事先存储的对应温度区间的增益和偏置校正参数,初步消除探测器的非均匀性。通过分析初步校正后图像残余非均匀性噪声的特性,提出了一种自适应非均匀性校正算法NSCT,对经过NSCT分解后的子带图像,利用贝叶斯阈值逐点进行信号方差和噪声方差估计,计算出残余非均匀性噪声后并加以去除。实验结果表明,该算法能有效提高校正精度,并具有更强的环境适应性。     

A New Piecewise Approach for Nonuniformity Correction in IRFPA

Considering different detector in IRFPA has different nonlinear response characteristic, a novel piecewise linear connection scheme for nonuniformity correction in IRFPA is proposed in this paper. Comparing to the widely used piecewise linear correction, the proposed scheme tries to find the n-segment piecewise straight-line which strives for going near (not always through) all available calibration points, rather than just passes through some n + 1 calibration points. Since each detector's output is corrected to the expected correction value as near as possible, the new scheme can achieve better NUC performance within the whole calibration range than that of the old one. The comparison experiment with simulated data and real IRFPA infrared data shows that the performance of this approach is more perfect than that of the old piecewise linear algorithm.