基于无人机红外光谱技术的影像数据匹配方法研究

无人机加载红外光谱载荷对区域内影像进行获取现已成为遥感领域一种重要的技术手段,可通过对携带位置信息的影像进行分类提取,得到植被盖度、温度指数等一系列因子指标。利用FREE BIRD(自由鸟)小型低空无人机系统挂载Tetracam红外相机(310万像素)对新疆玛纳斯县一河道进行影像获取。无人机飞行面积约为20.5 km2,为了得到更加精确的植被、温度等因子,需要对无人机红外影像进行配准,通过优化SIFT匹配参数和RANSAC粗差剔除后,获取了可靠的匹配结果,即经过算法匹配后的影像与原影像进行了误差比对,能够满足后期的应用需要, 这也是本文的创新点之一。将影像进行配准后进行二维影像拼接,将多张红外影像按照航向重叠度不低于60%,旁向重叠度不低于50%的概率进行拼接,得到拼接后的红外影像图。另外比较了SIFT和SUFT两种算法,利用优化的SIFT算法及改进的FLIR传感器获取1 600张热红外影像,利用地面同步测量数据对拼接后的红外影像进行算法匹配,并利用ENVI(完整的遥感图像处理平台)软件进行温度及植被盖度的影像反演,得到了研究区域的单一影像及红外影像的温度反演图及植被反演图。通过对两种算法的对比得到更加优化的算法模型,并对该模型进行回归分析和精度检验,得到该模型的相关系数R2为0.767,匹配精度为81.51%,模型精度较高。本模型的建立对日后无人机红外影像的配准及提取反演奠定了理论和实践基础。     

基于热红外图像处理技术的农作物冠层识别方法研究

为解决农作物冠层热红外图像边缘灰度级分布不均且噪声较大,而传统图像分割方法难以实现其目标区域有效识别的难题,以苗期红小豆冠层热红外图像为研究对象,将模糊神经网络和仿射变换有机结合,提出了基于热红外图像处理技术的农作物冠层识别模型。首先利用五层线性归一化模糊神经网络的自适应特性,选取高斯隶属度函数,自动计算冠层可见光图像识别的推理规则,有效地分割了可见光图像中的冠层区域。通过分析3种分割指标和熵,定量评价可见光图像冠层分割质量。网络迭代38次时,误差精度为0.000 952,该算法平均有效识别率为96.13%,获取可见光冠层图像的像元信息熵值范围为2.454 4~5.198 7,与标准算法所得冠层图像的像元信息熵仅相差0.245 9。然后以取得可见光图像的冠层有效区域为参考图像,采用仿射变换算法,调整优选平移、旋转、缩放等图像变换因子,配准原始热红外图像,提出了基于仿射变换的冠层热红外图像识别方法。对于初始温度范围值在16.35~19.92 ℃的农作物热红外图像,计算选取旋转幅度为1.0和缩放因子为0.9时,作为异源图像的最优配准参数,获取目标图像的最大温差为3.17 ℃,相对于原图像的平均温度值由18.711 ℃下降至17.790 ℃,进而实现了基于热红外图像处理技术的农作物冠层识别。最后以熵的互信息作为监督指标,对农作物冠层热红外图像识别方法进行评价。提出的冠层热红外图像识别方法,所获取的目标图像与初始热红外图像的平均互信息为4.368 7,标准目标图像和初始热红外图像的平均互信息为3.981 8,二者仅相差0.486 9。同时,两种冠层热红外图像的平均温度差值为0.25 ℃,高效消除了原始热红外图像的背景噪声。结果表明本研究方法的有效性和实用性,能够为应用热红外图像反映农作物生理生态信息特征指标参数提供技术借鉴。     

Integrated Digital Image Correlation considering gray level and blur variations: Application to distortion measurements of IR camera

The acquisition of images with different modalities may involve different alterations with respect to an ideal model. Inhomogeneous brightness and contrast, blur due to non-ideal focusing, distortions are common. It is proposed herein to account for such effects for instance by registering a calibration target image with an actual optical image to measure lens distortions. An Integrated Digital Image Correlation (I-DIC) algorithm is proposed to account for the above artifacts and the algorithm is detailed. The resolution and uncertainty of the technique are first investigated on synthetic images, and then applied to the measurement of distortions for infrared (IR) images. The procedure is shown to reduce drastically the residual level assessing the validity of the image formation model, but more importantly allowing for a much improved registration of images.     

太赫兹激励的红外热波检测技术

本文的目的在于探索一种新的适用于红外热波检测技术的热激励方式——太赫兹(THz)热激励. 文中介绍了THz波周期性热激励的热传导理论模型; 尝试利用返波振荡器(返波管backward wave oscillator, BWO)太赫兹源对一块碳纤维基底吸波涂层板进行周期性THz热激励, 红外热像仪连续观测和记录试件表面温场变化, Canny边缘算法处理热图像显示缺陷; 检测结果与闪光灯脉冲激励的结果进行比较, 讨论了太赫兹波激励红外热波检测技术可能的优势. 实现了THz技术与红外热波无损检测技术的结合.     

Multispectral registration method based on stellar trajectory fitting

Image registration techniques for detecting moving targets in space require high temporal resolution and multispectral images to improve the target detection probability and reduce the false positive rate. At present, image registration accuracy is affected by the effective number of common multispectral registration control points as well as its stability. Image registration based on on-orbit stellar trajectory measurement can be used to perform on-orbit modifications of registration deviation caused by thermal distortions during launch. This study proposes a new image registration method based on the on-orbit detection of stars by using the stellar trajectory on a camera’s focal plane. A generated 12?×?12 data template and the Lagrange interpolation method are used in the registration model. Multispectral image registration based on stellar trajectory fitting can achieve high-precision image registration among different spectra.     

舰船小目标图像配准算法

当舰船目标距离红外/可见光复合导引头较远的时候,红外与可见光图像中的目标信息微弱,可供提取的特征较少且差异较大,传统的图像配准算法很难适用.针对该问题,本文提出一种基于传感器参量的图像配准算法,首先根据红外与可见光传感器的成像模型将图像配准分解简化为视场配准与平移配准两个相对分离的步骤;然后利用传感器参量进行图像的视场配准;最后基于海天线和水平高通能量分布确定匹配点完成平移配准.仿真实验结果表明,该算法具有较高的配准准确度,可以应用于实际远距离海上舰船的红外和可见光图像配准.     

Infrared imaging based hyperventilation monitoring through respiration rate estimation

A change in the skin temperature is used as an indicator of physical illness which can be detected through infrared thermography. Thermograms or thermal images can be used as an effective diagnostic tool for monitoring and diagnosis of various diseases. This paper describes an infrared thermography based approach for detecting hyperventilation caused due to stress and anxiety in human beings by computing their respiration rates. The work employs computer vision techniques for tracking the region of interest from thermal video to compute the breath rate. Experiments have been performed on 30 subjects. Corner feature extraction using Minimum Eigenvalue (Shi–Tomasi) algorithm and registration using Kanade Lucas–Tomasi algorithm has been used here. Thermal signature around the extracted region is detected and subsequently filtered through a band pass filter to compute the respiration profile of an individual. If the respiration profile shows unusual pattern and exceeds the threshold we conclude that the person is stressed and tending to hyperventilate. Results obtained are compared with standard contact based methods which have shown significant correlations. It is envisaged that the thermal image based approach not only will help in detecting hyperventilation but can assist in regular stress monitoring as it is non-invasive method.     

用于光学系统分析的质心配准法

将图像区域像素的统计特征引入活动轮廓模型,提出使分割轮廓所包括区域的质心对应角均方根误差极小的最优搜索方法——质心配准法。质心配准法有效地避免了散斑噪声等图像污染对图像区域分割精度的影响,实现了模糊图像精确的区域分割,求得图像最佳配准参数。对实际光学系统输出的多幅具有较大空时互补性的低分辨率图像进行了仿真实验,实验结果表明：该配准算法具有较高的精度,并在光学系统分析上得到了很好的应用。     

Thermal feature extraction of servers in a datacenter using thermal image registration

Thermal cameras provide fine-grained thermal information that enhances monitoring and enables automatic thermal management in large datacenters. Recent approaches employing mobile robots or thermal camera networks can already identify the physical locations of hot spots. Other distribution information used to optimize datacenter management can also be obtained automatically using pattern recognition technology. However, most of the features extracted from thermal images, such as shape and gradient, may be affected by changes in the position and direction of the thermal camera. This paper presents a method for extracting the thermal features of a hot spot or a server in a container datacenter. First, thermal and visual images are registered based on textural characteristics extracted from images acquired in datacenters. Then, the thermal distribution of each server is standardized. The features of a hot spot or server extracted from the standard distribution can reduce the impact of camera position and direction. The results of experiments show that image registration is efficient for aligning the corresponding visual and thermal images in the datacenter, and the standardization procedure reduces the impacts of camera position and direction on hot spot or server features.     

Affine and polynomial mutual information coregistration for artifact elimination in diffusion tensor imaging of newborns

We have investigated the use of two different image coregistration algorithms for identifying local regions of erroneously high fractional anisotropy (FA) as derived from diffusion tensor imaging (DTI) data sets in newborns. The first algorithm uses conventional affine registration of each of the diffusion-weighted images to the unweighted (b = 0) image for each slice, while the second algorithm uses second-order polynomial warping. Similarity between images was determined using the mutual information (MI) criterion, which is the preferred 'cost' criterion for coregistration of images with significantly different image intensity distributions. We have found that subtle differences exist in the FA values resulting from affine and second-order polynomial coregistration and demonstrate that nonlinear distortions introduce artifacts of spatial extent similar to real white matter structures in the newborn subcortex. We show that polynomial coregistration systematically reduces the presence of erroneous regions of high FA and that such artifacts can be identified by visual inspection of FA maps resulting from affine and polynomial coregistrations. Furthermore, we show that nonlinear distortions may be particularly pronounced when acquiring image slices of axial orientation at the height of the nasal cavity. Finally, we show that third-order polynomial MI coregistration (using the images resulting from second-order coregistration as input) has no observable effect on the resulting FA maps.     

An infrared image super-resolution reconstruction method based on compressive sensing

Limited by the properties of infrared detector and camera lens, infrared images are often detail missing and indistinct in vision. The spatial resolution needs to be improved to satisfy the requirements of practical application. Based on compressive sensing (CS) theory, this thesis presents a single image super-resolution reconstruction (SRR) method. With synthetically adopting image degradation model, difference operation-based sparse transformation method and orthogonal matching pursuit (OMP) algorithm, the image SRR problem is transformed into a sparse signal reconstruction issue in CS theory. In our work, the sparse transformation matrix is obtained through difference operation to image, and, the measurement matrix is achieved analytically from the imaging principle of infrared camera. Therefore, the time consumption can be decreased compared with the redundant dictionary obtained by sample training such as K-SVD. The experimental results show that our method can achieve favorable performance and good stability with low algorithm complexity.     

Infrared Thermography and Image Analysis of Dynamic Processes around the Facial Area

This paper describes the principles of visualization and analysis of thermal fields generated by different physiological processes around the facial area and in the environment. The dynamics of these fields was studied and their possible application for quantitative evaluation of psychophysical parameters is analyzed using infrared thermography with high spatial and temporal resolution. A software module has been developed and tested for combining infrared and visible camera images. A technique was proposed for complex recording and analysis of central and peripheral nervous activities using a thermal camera that captures three types of temperature fields that vary with time around the facial area: exhaled gas flows, cutaneous blood circulation, and sweat gland activity.     

基于B样条插值算法的亚像元技术的研究

亚像元动态成像技术是目前实现卫星相机小型化及提高相机空间分辨率的一种有效方法。在不改变TDICCD相机的焦距、成像距离,以及TDI CCD器件的像元尺寸的前提下,亚像元动态成像技术可以提高相机的空间分辨率。利用B样条插值算法,研究了TDI CCD相机的图像的亚像元动态插值问题,由两幅相机输出的原始图像经过算法得到比原图像分辨率高的图像,并对比了该算法与其它几种算法的效果,分析结果表明,该算法较其它算法得到的高分辨率图像的效果更佳。     

Display systems and registration methods for augmented reality applications

Introductions are given to various display systems and corresponding registration methods developed and realized at Beijing Institute of Technology for augmented reality applications. An interactive projection system is used in a theatrical performance, and the registration between the virtual scene (projected image) and the real objects (dancers) is realized through a video camera working in the near infrared waveband. An ultra-light wide-angle head-mounted display system is designed for an interactive exhibition item in a scientific museum, and a multi-user six-degree-of-freedom tracking system is developed for the indoor registration, which uses infrared markers projected on the ceiling and a camera fixed on top of each head-mounted display. A fixed-position viewing system is developed for the on-site digital reconstruction of a historical site, which provides visitors with the visualization of the original magnificent buildings on the natural field of the ruins. The azimuth and pitch of the viewing system are detected by two rotary encoders. A volumetric 3D display based on multi-angle projection is applied in a navigation system for endoscopic sinus surgery. A 3D digital scanner is employed to scan the skin on the patient's head for the alignment between the patient and the 3D model from his CT or MRI images. The registration of the surgical tool is also achieved by optical means through tracking cameras.     

Infrared image analysis and elaboration for archaeology: The case study of a medieval “<Emphasis Type="Italic">capsella</Emphasis>” from Cimitile,Italy

Infrared reflectography, i.e. the use of images taken with infrared light, is currently applied in the field of cultural heritage mainly for paintings analysis to reveal the presence of underdrawings or alterations. Its use in archaeology for deciphering faded signs (texts, images, tattoos, etc.) is a lot more limited and in most cases no or simple data analysis and elaboration is performed. Here we show that infrared reflectography taken by using a wide spectral response (wavelength range from 400 to 2200 nm) VIDICON image acquisition system together with adequate post-elaboration, taking advantage from advanced techniques for data analysis (wavelet decomposition) and image registration and fusion, is able to produce high-quality ‘C&IR’ images. Such images can be obtained in a relatively easy way using the same hardware configuration generally used for infrared reflectographic analysis of paintings. The application to a medieval capsella (a small wooden relics container) from Cimitile, Italy, has shown that these results are of great interest for archaeologists.     

一种基于改进频域图像配准技术的超分辨力图像处理方法

为提高光电成像系统的空间分辨力,提出了一种基于改进的频率域图像配准技术的超分辨力图像处理方法。首先利用改进的频域图像配准方法估算出低分辨力图像之间的微位移量,然后采用Papoulis-Gerchberg超分辨力处理方法完成图像复原。利用不同重构方法进行了仿真及实验研究,给出了评价参数。模拟和实际显微热图像的处理结果表明:该算法可使图像质量得到改善,分辨的细节更多,可有效地提高光电成像系统的空间分辨力;处理算法简单,计算量小,可实现快速处理。该算法还可应用于其他不可控光学微扫描成像系统中,具有广泛的应用前景。     

The registration of MR images using multiscale robust methods

Acquisition of MR images involves their registration against some prechosen reference image. Motion artifacts and misregistration can seriously flaw their interpretation and analysis. This article provides a global registration method that is robust in the presence of noise and local distortions between pairs of images. It uses a two-stage approach, comprising an optional Fourier phase-matching method to carry out preregistration, followed by an iterative procedure. The iterative stage uses a prescribed set of registration points, defined on the reference image, at which a robust nonlinear regression is computed from the squared residuals at these points. The method can readily accommodate general linear, or even nonlinear, registration transformations on the images. The algorithm was tested by recovering the registration transformation parameters when a 256 × 256 pixel T₂¹-weighted human brain image was scaled, rotated, and translated by prescribed amounts, and to which different amounts of Gaussian noise had been added. The results show subpixel accuracy of recovery when no noise is present, and graceful degradation of accuracy as noise is added. When 40% noise is added to images undergoing small shifts, the recovery errors are less than 3 pixels. The same tests applied to the Woods algorithm gave slightly inferior accuracy for these images, but failed to converge to the correct parameters in some cases of large-scale-shifted images with 10% added noise.     

远距离多源图像融合系统实时配准设计

为了实现全天候多波段远距离实时图像监控,设计了具有微光、红外和可见光融合的光学前端,对多源图像进行实时配准研究。在平行光轴的基础上,通过计算不同视场图像的成像视差,计算仿射变换需要的参数,采用双线性内插算法弥补红外在成像方面与可见光图像的差别,将红外图像的变换制作成查找表存储在图像处理器DM642中,系统通过硬件查找表可以快速实现不同图像的配准变换,实现同步视频的实时配准与融合。实验表明:该设计能够准确地实现多源图像的实时配准,系统经过图像配准、图像融合和伪彩变换处理后的时间约为24.3 ms,系统探测距离大于3 km。     

基于相位一致性和Hough变换的多源图像配准方法

由于红外图像与可见光图像对比度不同,常用基于梯度幅值的特征匹配方法难以正确配准。在分析红外图像与可见光图像成像机制的基础上,提出了一种结合相位一致性边缘检测与Hough变换的多源图像配准新方法。该算法首先采用高通滤波和平台直方图均衡方法对红外图像进行预处理以提高红外图像的对比度,再利用具有图像对比度不变性的相位一致性边缘检测法提取两幅图像的边缘,结合Hough变换选取图像空间中最长的线作为特征,采用改进相位相关法作为相似性度量,在对数极坐标域下计算出两幅图像的几何变形参数。仿真实验结果表明,该方法能够以较高查准率实现红外与可见光图像自动配准,并具有较强的鲁棒性。     

基于位相相关检测的图像配准算法

分析了传统的傅里叶-梅林变换和最近提出的虚拟极坐标傅里叶变换算法在户外图像注册中的局限性,提出了一种更加适合户外摄像机姿态注册的基于对数傅里叶变换的图像配准算法。该算法能够独立地计算沿两坐标轴方向的不同缩放因子和计算两图像间较大的旋转角度,扩展了基于傅里叶变换的图片配准算法的实际应用范围。在关键技术研究方面,提出了由升余弦函数构成的低通滤波器和一种快速收敛的角度搜索技术,使该算法达到了很高的效率和鲁棒性。