红外热成像系统、图像处理及测试技术培训班(第七届)

正2019中科院光学系列专项培训2019年10月27日-11月1日中科院上海光机所一、红外热成像技术前沿进展及案例分析国内外红外器件现状与技术新进展及应用;空间预警系统的进展;空间红外目标探测与跟踪(拦截系统);多波段光电图像融合技术;基于视觉模型的红外图像彩色融合技术:遥感图像亚像素与超分辨技     

海空背景下红外-紫外双色探测技术研究

舰船采用紫外-红外多传感器探测低空飞行的导弹、飞机等目标，对各个传感器采集的目标图像数据进行融合处理，可提高对目标的探测识别概率。本文分析了红外传感器器和紫外传感器的各自的优越性、海空背景下导弹羽烟的紫外辐射传输特性，得出采用红外-紫外图像融合技术能使红外、紫外传感器的优势得到互补，融合级别适合在特征级上进行，并对红外-紫外双色探测技术进行了展望。     

一种双通道夜视图像彩色融合系统

提出了一种双通道夜视图像的彩色融合系统。利用Matrox Meteor-Ⅱ多通道图像采集卡获取双通道微光与红外视频图像．通过仿MIT,BIT．TNO．线性组合和混合结构等图像融合结构实现微光／微光和微光／红外图像的彩色融合处理。系统彩色图像融合处理是在VC++6．0环境下运用采集卡图像函数库实现的。建立的实验平台为彩色夜视融合算法的评价和进一步的研究奠定了基础。     

基于亮度对比度传递的红外与可见光图像融合方法研究

基于亮度一对比度传递技术提出了一种红外和彩色可见光图像的融合方法,该算法通过对红外图像和可见光图像在HIS空间进行二次融合,保留了可见光图像的颜色特性,并获得一幅具有良好亮度和对比度效果的融合图像。实验结果表明该方法融合噪声小、细节缺失少、融合速度快。     

基于CbCr查找表的双波段图像彩色融合算法

低照度可见光与红外图像的自然感彩色融合能够显著提高人眼视觉在低照度环境下的情景感知和目标探测能力。基于样本的融合算法是一种快速有效、实时性强的自然感彩色融合算法。针对已有算法在查找表构建和灰度信息利用方面存在的问题,提出一种基于CbCr查找表的双波段图像彩色融合算法。算法采用反向传播神经网络对图像样本的二维亮度向量(Y1,Y2)和二维色度向量(Cb,Cr)进行非线性拟合,从而获得亮度与色度间的映射关系f(Y1,Y2)→(Cb,Cr),并由此构建CbCr查找表。融合时,由输入的双波段灰度图像的亮度Y1,Y2和CbCr查找表获得彩色融合图像的色度Cb,Cr;由亮度Y1,Y2经双层拉普拉斯金字塔融合获得彩色融合图像的亮度YF;为了减小因环境变化导致的色彩映射偏差,对亮度Y1,Y2进行灰度校正。实验结果表明,本文融合图像具有颜色自然、细节丰富、利于(热)目标检测的特点,在清晰度、彩色性、映射准确性方面已经达到甚至优于Toet算法的图像融合效果。     

红外与X光图像融合探测构件内部热源

红外与可见光图像融合只能反映构件表面信息和温度场分布,为了探测构件内部发热源,提出了红外与X光图像融合方法。首先将红外图像做灰度化处理。然后采用Laplace金字塔融合算法对红外与X光配准图像进行融合,利用YIQ空间变换将红外图像的温度颜色信息迁移至金字塔融合图像上。最后,对工作状态下的电路板和充电器采用信息熵、标准差、平均梯度进行了融合图像质量评价。实验结果表明金字塔融合图像在评价参数上与红外图像相比均有提高,且平均梯度提高了137.20%,从而图像清晰度得到较大改善。融合后的彩色图像既包含了构件的温度分布,同时也能反映构件内部结构。进而可根据融合图像的温度场判断和分析内部热辐射源。     

一种夜雾天况彩色视频构建方法

针对单一红外或可见光波段成像技术无法满足夜雾天况彩色成像要求的问题,结合红外和可见光成像各自的特点,提出一种固定区域下针对夜雾天况的彩色视频构建方法。该方法在能见度高的白天利用可见光传感器进行可见光背景图像的构建,在能见度低的夜雾天气利用红外传感器提取出红外运动目标,依据可见光背景图像与原始红外图像的配准参数进行2幅图像的同比例融合,完成彩色视频的重构。实验结果表明,该方法能够准确完成包含红外目标的彩色视频构建,充分体现出夜雾天况下运动目标及其所在场景的彩色特征信息,提升人眼对目标与场景的识别和感知。对于图像大小为720pixel×576pixel的视频序列,该算法的运行速度能够达到40frame/s,可满足彩色视频实时构建的需要。     

基于区域检测与非下采样轮廓波变换的红外与彩色可见光图像融合

针对灰度图像融合的分辨率低及现有的彩色图像融合方法融合的图像色彩不自然、不符合人的视觉感受的特点,在此提出一种基于Snake模型的区域检测和非下采样轮廓波变换(NSCT)的红外与彩色可见光图像融合的方法。首先对彩色可见光图像进行亮度、色度和饱和度(IHS)颜色空间变换提取亮度分量,并用Snake模型对红外图像的目标区域进行检测;然后对亮度分量和目标替换的红外图像应用NSCT分解,对所得到的高频系数采用像素点"绝对值和取大"、低频系数采用基于"亮度重映射技术"的加权融合规则进行融合;通过对融合系数进行NSCT逆变换获得融合图像的亮度分量,最后运用颜色空间逆变换得到融合图像。实验结果表明,所提出的融合方法既能保持可见光图像的高分辨率和自然色彩,又能准确保留红外图像中检测出的目标信息,获得视觉效果较好、综合指标较优的融合图像。     

双机IRST配准融合图像的弱小目标检测方法

针对单机红外搜索跟踪（IRST）系统探测距离和精度有限,得到的红外图像在杂乱背景和强噪声环境中弱小目标难以检测的问题,采用双机IRST对同时刻同目标区域探测后的图像进行配准融合,融合过程中采用高频基于区域、低频基于像素的多规则算法,提出一种基于小波变换与边缘信息表征的目标检测方法。仿真实验表明,多规则融合算法使图像质量评价指标提高了30%～50%,该目标检测方法可有效剔除虚假目标及滤除杂波干扰,从融合滤波前的7个减少到3个,虚警率降低,有助于弱小目标更为精确的检测识别。     

红外和彩色可见光图像亮度-对比度传递融合算法

以红外和彩色可见光图像为研究对象,提出了一种基于亮度-对比度传递（LCT）技术的彩色图像融合算法。首先借助灰度融合方法将红外图像与彩色可见光图像亮度分量融合,然后用LCT技术改善灰度融合结果的亮度和对比度,最后利用快速YCBCR变换融合策略在RGB空间内直接生成彩色融合图像。文中利用像素平均融合法和多分辨率融合法作为不同的灰度融合措施以分别满足高实时性和高融合质量的需求。实验结果表明,提出算法的融合结果不仅具有与输入彩色可见光图像相近的自然色彩,而且具备令人满意的亮度和对比度,即使采用运算简单的像素平均法进行灰度融合,同样可以获得良好的融合效果。     

Quality assessment for visible and infrared color fusion images of typical scenes

Two comprehensive evaluation metrics, image perceptual quality based on target detectability (PQTD) and perceptual quality based on scene understanding (PQSU), are proposed to measure image quality for visible and infrared color fusion images of typical scenes. A psychophysical experiment is performed to explore the relationship between conventional quality attributes and the proposed evaluation metrics. The prediction models for PQTD and PQSU are derived by multiple linear regression statistical analyses. Results show that the variation of PQTD can be predicted by sharpness and perceptual contrast between the target and background, and that color harmony and sharpness can predict PQSU. The proposed evaluation metrics and their prediction models provide a foundation for further developing objective quality evaluation of color fusion images.     

Objective evaluation of target detectability in night vision color fusion images

An evaluation for objectively assessing the target detectability in night vision color fusion images is proposed.On the assumption that target detectability could be modeled as the perceptual color variation between the target and its optimal sensitive background region,we propose an objective target detectability metric in CIELAB color space defined by four color information features:target luminance,region perceptual luminance variation in human vision system,region hue difference,and region chroma difference.Experimental results show that this proposed metric is perceptually meaningful because it corresponds well with subjective evaluation.     

Fast color contrast enhancement method for color night vision

The increasing availability and deployment of imaging sensors operating in multiple spectral bands has led to a large research effort in color image fusion, resulting in a plethora of pixel-level image fusion algorithms. In this study a simple and fast fusion approach for color night vision is presented. The contrast of infrared and visible images is adjusted by local histogram equalization. Then the two enhanced images are fused into the three components of a Lab image in terms of a simple linear fusion strategy. To obtain false color images possessing a natural day-time color appearance, this paper adopts an approach which transfers color from the reference to the fused images in a simplified Lab space. To enhance the contrast between the target and the background, a stretch factor is introduced into the transferring equation in the b channel. Experimental results based on three different data sets show that the hot targets are popped out with intense colors while the background details present natural color appearance. Target detection experiments also show that the presented method has a better performance than the former methods, owing to the target recognition area, detection rate, color distance and running time.     

Effective contrast enhancement method for color night vision

Image fusion refers to the techniques that integrate complementary information from multiple image sensors’ data in a way that makes the new images more suitable for human visual perception. The paper focuses on the low color contrast problem of linear fusion algorithms with color transfer method. Firstly, the contrast of infrared and visible images is enhanced using local histogram equalization and median filter. Then the two enhanced images are fused into the three components of a Lab image in terms of a simple linear fusion strategy. To enhance the color contrast between the target and the background, the scaling factor is introduced into the transferring equation in the b channel. Experimental results based on three different data sets show that the hot and cold targets are all popped out with intense colors while the background details present natural color appearance. Target detection experiments through target recognition area, detection rate, target-background discrimination also show that the presented method has a better performance than the former methods.     

复杂背景下红外图像弱小目标检测

红外弱小目标检测是安防监控、侦察探测、精确制导等领域的关键技术。为了提高复杂背景条件下红外弱小目标检测的准确性和实时性,提出了一种基于深度学习的红外弱小目标检测算法YOLO-FCSP。根据红外图像中弱小目标的特点,在YOLO检测框架的基础上,通过减少下采样次数,结合跨阶段局部模块、Focus结构和空间金字塔池化结构设计了特征提取网络。借鉴多路径聚合的思路优化特征融合网络,同时调整检测输出层数量,通过信息复用提高特征利用效率。实验结果表明,本文提出的算法在检测红外弱小目标时具有较高的准确率和检测速度,精度和召回率分别为91.9%和94.6%,平均准确率(AP)值达到92.6%,检测速度达到170 f/s,满足实际应用中实时检测的需求。     

Fusion of visible and infrared images using saliency analysis and detail preserving based image decomposition

Image fusion for visible and infrared images is a significant task in image analysis. The target regions in infrared image and abundant detail information in visible image should be both extracted into the fused result. Thus, one should preserve or even enhance the details from original images in fusion process. In this paper, an algorithm using pixel value based saliency detection and detail preserving based image decomposition is proposed. Firstly, the multi-scale decomposition is constructed using weighted least squares filter for original infrared and visible images. Secondly, the pixel value based saliency map is designed and utilized for image fusion in different decomposition level. Finally, the fusion result is reconstructed by synthesizing different scales with synthetic weights. Since the information of original signals can be well preserved and enhanced with saliency extraction and multi scale decomposition process, the fusion algorithm performs robustly and excellently. The proposed approach is compared with other state-of the-art methods on several image sets to verify the effectiveness and robustness.     

伪Zernike矩在低信噪比红外目标检测中的应用

由于探测器本身固有的特性以及军事上的极限使用要求,红外图像普遍存在目标-背景间对比度较差、目标边缘模糊和噪声较大等特点,采用常规模板匹配、Hu矩方法难以取得理想的检测效果。针对低信噪比红外目标图像,分析了伪Zernike矩的基本原理、不变性和计算方法,提出了低信噪比红外目标检测的伪Zernike矩方法,并比较了模板匹配、Hu矩、伪Zernike矩方法的目标检测效果。理论分析和实验验证了该方法的有效性。     

基于四波段图像融合的彩色夜视方法研究

为了在低照度条件下获取目标的彩色图像,提高夜间对目标的识别能力,提出了基于四波段图像融合的彩色夜视方法.采用F-P滤光片设计出了透射中心在三基色光中心波长及近红外波段的四波段滤光片,在各个透射区域的平均透射率均达90%以上;将四波段滤光片设计成圆形滤色轮结构,用分光计测得了各波段滤光片的光谱透射性;对加入滤光片后的系统信噪比进行了分析和计算,分析结果表明加入滤光片不会引入噪声,计算结果表明加入蓝色、绿色、红色和近红外波段滤光片的成像系统的信噪比分别是原来单色微光夜视系统信噪比的19.59%、38.45%、47.28%和46.70%.借助国产超二代像增强器在微光实验室进行了四波段图像采集及彩色图像融合实验,实验时光照度分别为1×10~(-3)lx和1×10~(-1)lx,对获取的图像质量进行了评价.结果表明:在照度为1×10~(-3)lx时,融合的彩色图像在均值、方差和熵这三项指标上均优于过滤后的蓝色和绿色的单色图像,且由于彩色图像中利用了近红外图像进行增强,使得彩色图像亮度更高,颜色分辨性更好;在照度为1×10~(-1)lx时,融合后的彩色图像的信息熵比红、绿、蓝三种基色图像的大,彩色图像携带的信息量更大.本文的研究对彩色夜视成像系统的设计和研发具有借鉴和指导意义.     

采用视觉细胞响应模型的小目标复杂背景抑制

为了提高地面和云层等红外复杂背景下弱小目标的检测性能,提出了一种基于视觉细胞响应模型的红外弱小目标背景抑制新方法.首先利用简单细胞的感受野计算模型将原始图像采用Gabor函数卷积获得相同大小的两幅图像|然后采用设计的复杂细胞响应的非线性汇聚策略函数对获得的两幅图像进行融合处理,从而将红外图像中弱小目标和背景杂波分离,达到抑制背景的目的|最后采用自适应阈值分割技术得到目标点,实现了对红外弱小目标的检测跟踪.实验结果显示,与去局部均值和最大中值滤波两种滤波方法相比较,该方法能有效地检测出信杂比较低的弱小目标信号.