An infrared image super-resolution reconstruction method based on compressive sensing

Limited by the properties of infrared detector and camera lens, infrared images are often detail missing and indistinct in vision. The spatial resolution needs to be improved to satisfy the requirements of practical application. Based on compressive sensing (CS) theory, this thesis presents a single image super-resolution reconstruction (SRR) method. With synthetically adopting image degradation model, difference operation-based sparse transformation method and orthogonal matching pursuit (OMP) algorithm, the image SRR problem is transformed into a sparse signal reconstruction issue in CS theory. In our work, the sparse transformation matrix is obtained through difference operation to image, and, the measurement matrix is achieved analytically from the imaging principle of infrared camera. Therefore, the time consumption can be decreased compared with the redundant dictionary obtained by sample training such as K-SVD. The experimental results show that our method can achieve favorable performance and good stability with low algorithm complexity.     

具有紧支撑正交非张量积小波的图像融合

提出了基于一种新的小波——具有紧支撑、正交性、伸缩矩阵为[^2 0 ^0 2]的非张量积小波的图像融合方法。首先根据非张量积小波理论,利用Daubechies构造的单变量滤波器构造出基于四通道的不可分的小波滤波器组,用此滤波器组对参加融合的图像进行分解,然后对低频部分采用取均值、高频部分采用系数绝对值取大的融合算法对分解子图进行融合,最后重构。并采用熵、交叉熵、互信息、均方根误差和峰值信噪比等指标对该方法进行了客观评价。对可见光图像与红外图像、远红外图像与近红外图像、遥感图像、多聚焦图像和其它多类图像的融合实验结果证明本方法有较好的融合效果,其融合性能与采用同样融合算法的张量积db2小波的融合方法的融合性能相当。     

An adaptive fusion approach for infrared and visible images based on NSCT and compressed sensing

A novel nonsubsampled contourlet transform (NSCT) based image fusion approach, implementing an adaptive-Gaussian (AG) fuzzy membership method, compressed sensing (CS) technique, total variation (TV) based gradient descent reconstruction algorithm, is proposed for the fusion computation of infrared and visible images.Compared with wavelet, contourlet, or any other multi-resolution analysis method, NSCT has many evident advantages, such as multi-scale, multi-direction, and translation invariance. As is known, a fuzzy set is characterized by its membership function (MF), while the commonly known Gaussian fuzzy membership degree can be introduced to establish an adaptive control of the fusion processing. The compressed sensing technique can sparsely sample the image information in a certain sampling rate, and the sparse signal can be recovered by solving a convex problem employing gradient descent based iterative algorithm(s).In the proposed fusion process, the pre-enhanced infrared image and the visible image are decomposed into low-frequency subbands and high-frequency subbands, respectively, via the NSCT method as a first step. The low-frequency coefficients are fused using the adaptive regional average energy rule; the highest-frequency coefficients are fused using the maximum absolute selection rule; the other high-frequency coefficients are sparsely sampled, fused using the adaptive-Gaussian regional standard deviation rule, and then recovered by employing the total variation based gradient descent recovery algorithm.Experimental results and human visual perception illustrate the effectiveness and advantages of the proposed fusion approach. The efficiency and robustness are also analyzed and discussed through different evaluation methods, such as the standard deviation, Shannon entropy, root-mean-square error, mutual information and edge-based similarity index.     

Fusion method for infrared and visible images by using non-negative sparse representation

In this paper, an interesting fusion method, named as NNSP, is developed for infrared and visible image fusion, where non-negative sparse representation is used to extract the features of source images. The characteristics of non-negative sparse representation coefficients are described according to their activity levels and sparseness levels. Multiple methods are developed to detect the salient features of the source images, which include the target and contour features in the infrared images and the texture features in the visible images. The regional consistency rule is proposed to obtain the fusion guide vector for determining the fused image automatically, where the features of the source images are seamlessly integrated into the fused image. Compared with the classical and state-of-the-art methods, our experimental results have indicated that our NNSP method has better fusion performance in both noiseless and noisy situations.     

基于DTCWT和稀疏表示的红外偏振与光强图像融合

针对红外偏振与光强图像彼此包含共同信息和特有信息的特点,提出了一种基于双树复小波变换和稀疏表示的图像融合方法.首先,利用双树复小波变换获取源图像的高频和低频成分,并用绝对值最大值法获得融合的高频成分;然后,用低频成分组成联合矩阵,并使用K-奇异值分解法训练该矩阵的冗余字典,根据该字典求出各个低频成分的稀疏系数,通过稀疏系数中非零值的位置信息判断共有信息和特有信息,并分别使用相应的规则进行融合;最后,将融合的高低频系数经过双树复小波反变换得到融合图像.实验结果表明,本文提出的融合算法不仅能较好地凸显源图像的共有信息,而且能很好地保留它们的特有信息,同时,融合图像具有较高的对比度和细节信息.     

The infrared and visible image fusion algorithm based on target separation and sparse representation

Although the fused image of the infrared and visible image takes advantage of their complementary, the artifact of infrared targets and vague edges seriously interfere the fusion effect. To solve these problems, a fusion method based on infrared target extraction and sparse representation is proposed. Firstly, the infrared target is detected and separated from the background rely on the regional statistical properties. Secondly, DENCLUE (the kernel density estimation clustering method) is used to classify the source images into the target region and the background region, and the infrared target region is accurately located in the infrared image. Then the background regions of the source images are trained by Kernel Singular Value Decomposition (KSVD) dictionary to get their sparse representation, the details information is retained and the background noise is suppressed. Finally, fusion rules are built to select the fusion coefficients of two regions and coefficients are reconstructed to get the fused image. The fused image based on the proposed method not only contains a clear outline of the infrared target, but also has rich detail information.     

Precomputed compressive sensing for light transport acquisition

In this article, we propose an efficient and accurate compressive-sensing-based method for estimating the light transport characteristics of real-world scenes. Although compressive sensing allows the efficient estimation of a high-dimensional signal with a sparse or near-to-sparse representation from a small number of samples, the computational cost of the compressive sensing in estimating the light transport characteristics is relatively high. Moreover, these methods require a relatively smaller number of images than other techniques although they still need 500–1000 images to estimate an accurate light transport matrix. Precomputed compressive sensing improves the performance of the compressive sensing by providing an appropriate initial state. This improvement is achieved in two steps: 1) pseudo-single-pixel projection by multiline projection and 2) regularized orthogonal matching pursuit (ROMP) with initial signal. With these two steps, we can estimate the light transport characteristics more accurately, much faster, and with a lesser number of images.     

基于小波概率估计的图像融合方法研究

在研究了已有的图像融合方法后,提出基于小波变换和最大似然概率估计(MLE)相综合的融合方法,利用概率估计融合模型,首先对不同的传感器图像进行小波分解,然后对相应的子带求解仿射变换参数,根据Bayes规则进行最大后验概率似然估计,得到估计子带系数,最后通过小波反变换得到融合图像.在仿射变换的假设条件下定义融合规则,更适合传感器图像具有局部相反对比度的情况,采用此方法对航空可见光图像和红外图像进行融合实验,其结果与采用其它方法进行了对比,表明该方法的有效性.     

基于区域检测与非下采样轮廓波变换的红外与彩色可见光图像融合

针对灰度图像融合的分辨率低及现有的彩色图像融合方法融合的图像色彩不自然、不符合人的视觉感受的特点,在此提出一种基于Snake模型的区域检测和非下采样轮廓波变换(NSCT)的红外与彩色可见光图像融合的方法。首先对彩色可见光图像进行亮度、色度和饱和度(IHS)颜色空间变换提取亮度分量,并用Snake模型对红外图像的目标区域进行检测;然后对亮度分量和目标替换的红外图像应用NSCT分解,对所得到的高频系数采用像素点"绝对值和取大"、低频系数采用基于"亮度重映射技术"的加权融合规则进行融合;通过对融合系数进行NSCT逆变换获得融合图像的亮度分量,最后运用颜色空间逆变换得到融合图像。实验结果表明,所提出的融合方法既能保持可见光图像的高分辨率和自然色彩,又能准确保留红外图像中检测出的目标信息,获得视觉效果较好、综合指标较优的融合图像。     

一种快速稀疏分解图像去噪新方法

提出了一种基于分层树型结构正交匹配追踪算法的快速图像去噪方法.通过选择高斯函数和墨西哥草帽小波母函数构建混合冗余字典,采用分层树状结构表示字典,结合构正交匹配追踪算法,实现图像稀疏表示,提高了图像表示的稀疏性,降低了算法的复杂度.依据噪音能量阈值,通过多次迭代达到图像去噪的目的.实验结果表明,在相同的噪音水平下,该迭代去噪算法取得了较高的较好的PSNR,获得更好的视觉效果.     

基于字典学习的稠密光场重建算法

相机阵列是获取空间中目标光场信息的重要手段,采用大规模密集相机阵列获取高角度分辨率光场的方法增加了采样难度和设备成本,同时产生的大量数据的同步和传输需求也限制了光场采样规模.为了实现稀疏光场采样的稠密重建,本文基于稀疏光场数据,分析同一场景多视角图像的空间、角度信息的关联性和冗余性,建立有效的光场字典学习和稀疏编码数学模型,并根据稀疏编码元素间的约束关系,建立虚拟角度图像稀疏编码恢复模型,提出变换域稀疏编码恢复方法,并结合多场景稠密重建实验,验证提出方法的有效性.实验结果表明,本文方法能够对场景中的遮挡、阴影以及复杂的光影变化信息进行高质量恢复,可以用于复杂场景的稀疏光场稠密重建.本研究实现了线性采集稀疏光场的稠密重建,未来将针对非线性采集稀疏光场的稠密重建进行研究,以推进光场成像在实际工程中的应用.     

一种快速稀疏分解图像去噪新方法*

提出了一种基于分层树型结构正交匹配追踪算法的快速图像去噪方法.通过选择高斯函数和墨西哥草帽小波母函数构建混合冗余字典,采用分层树状结构表示字典,结合构正交匹配追踪算法,实现图像稀疏表示,提高了图像表示的稀疏性,降低了算法的复杂度.依据噪音能量阈值,通过多次迭代达到图像去噪的目的.实验结果表明,在相同的噪音水平下,该迭代去噪算法取得了较高的较好的PSNR,获得更好的视觉效果.     

一种基于NSCT变换的红外与可见光图像融合算法

针对红外与可见光图像融合,提出了一种基于NSCT变换的图像融合方法。对经NSCT变换的低频子带系数采用基于区域能量自适应加权的融合规则,对高频子带系数采用混合的融合方法,即对于低层,采用基于区域方差选大的融合方法,对于高层采用像素点的绝对值选大的融合方法。实验结果表明,该融合算法可以获得更多的细节信息,能获得较理想的融合图像。     

基于邻域分割的空谱联合稀疏表示高光谱图像分类技术研究

传统的高光谱遥感影像分类算法侧重于光谱信息的应用。随着高光谱遥感影像的空间分辨率的增加,高光谱影像中相同类别的地物在空间分布上呈现聚类特性,将空间特性有效地应用于高光谱遥感影像分类算法对分类精度的提升非常关键。但是,高光谱影像的高分辨率提供空间聚类特性的同时,在不同地物边缘处表现出的差异性更加明显,若不对空间邻域像素进行甄选,直接将邻域光谱信息引入,设计空谱联合稀疏表示进行图像分割,则分类误差较大,收敛速度大大降低。将光谱角引入空谱联合稀疏表示图像分类理论中,提出了一种基于邻域分割的空谱联合稀疏表示分类算法。该算法利用光谱角计算相邻像素的空间相似度,剥离相似度较低的邻域像素,将相似度高的邻域像素定义为同类地物,引入空谱联合稀疏表示模型中,采用子联合空间追踪算子和联合正交匹配追踪算子对其优化求解,以最小重构误差为准则进行分类。选取AVIRIS及ROSIS典型光谱影像数据进行实验仿真,从中可以看出,随着光谱角分割阈值的提高,复杂的高光谱影像分类精度和平滑区域的高光谱影像分类精度均逐步提高,表明邻域分割在空谱联合稀疏表示分类中的必要性。     

高频信息矢量匹配实现异源图像配准

介绍了一种通过提取红外与可见图像高频信息形成矢量模型的方法,该模型可用于可见和红外两种不同波段相同场景图像的配准。分析了红外与可见图像的共同特性,即边缘高频特性,并在作为模板的图像中提取这类高频信息。利用人工干预的方法形成矢量模型,该矢量模型可通过实时姿态信息进行实时三维变换,并重新投影为二维图形,据此可在另一图像中进行特征搜索,达到两者匹配的目的。利用实际数据进行了实验分析,结果显示,利用本文算法提取的矢量模型,经变换后能可靠地实现异源目标自动识别;实验证明此方法有效可行,并可推广应用于各种异源图像间的自动目标识别和配准处理。     

Infrared and visible image fusion method based on saliency detection in sparse domain

Infrared and visible image fusion is a key problem in the field of multi-sensor image fusion. To better preserve the significant information of the infrared and visible images in the final fused image, the saliency maps of the source images is introduced into the fusion procedure. Firstly, under the framework of the joint sparse representation (JSR) model, the global and local saliency maps of the source images are obtained based on sparse coefficients. Then, a saliency detection model is proposed, which combines the global and local saliency maps to generate an integrated saliency map. Finally, a weighted fusion algorithm based on the integrated saliency map is developed to achieve the fusion progress. The experimental results show that our method is superior to the state-of-the-art methods in terms of several universal quality evaluation indexes, as well as in the visual quality.     

Structured sublinear compressive sensing via belief propagation

Compressive sensing (CS) is a sampling technique designed for reducing the complexity of sparse data acquisition. One of the major obstacles for practical deployment of CS techniques is the signal reconstruction time and the high storage cost of random sensing matrices. We propose a new structured compressive sensing scheme, based on codes of graphs, that allows for a joint design of structured sensing matrices and logarithmic-complexity reconstruction algorithms. The compressive sensing matrices can be shown to offer asymptotically optimal performance when used in combination with orthogonal matching pursuit (OMP) methods. For reduced-complexity greedy reconstruction schemes, we propose a new family of list-decoding belief propagation algorithms, as well as reinforced and multiple-basis belief propagation (BP) algorithms. Our simulation results indicate that reinforced BP CS schemes offer very good complexity–performance tradeoffs for very sparse signal vectors.     

Fusion of infrared-visible images using improved multi-scale top-hat transform and suitable fusion rules

Integration of infrared and visible images is an active and important topic in image understanding and interpretation. In this paper, a new fusion method is proposed based on the improved multi-scale center-surround top-hat transform, which can effectively extract the feature information and detail information of source images. Firstly, the multi-scale bright (dark) feature regions of infrared and visible images are respectively extracted at different scale levels by the improved multi-scale center-surround top-hat transform. Secondly, the feature regions at the same scale in both images are combined by multi-judgment contrast fusion rule, and the final feature images are obtained by simply adding all scales of feature images together. Then, a base image is calculated by performing Gaussian fuzzy logic combination rule on two smoothed source images. Finally, the fusion image is obtained by importing the extracted bright and dark feature images into the base image with a suitable strategy. Both objective assessment and subjective vision of the experimental results indicate that the proposed method is superior to current popular MST-based methods and morphology-based methods in the field of infrared-visible images fusion.     

基于深度玻尔兹曼模型的红外与可见光图像融合

为了克服红外与可见光图像融合时噪声干扰及易产生伪影导致目标轮廓不鲜明、对比度低的缺点,提出一种基于深度模型分割的图像融合方法.首先,采用深度玻尔兹曼机学习红外与可见光的目标和背景轮廓先验,构建轮廓的深度分割模型,通过Split Bregman迭代算法获取最优能量分割后的红外与可见光图像轮廓;然后再使用非下采样轮廓波变换对源图像进行分解,并针对所分割的背景轮廓采用结构相似度的规则进行系数组合;最后进行非下采样轮廓波反变换重构出融合图像.数值试验证明,该算法可以有效获取目标和背景轮廓均清晰的融合图像,融合结果不但具有较高的对比度,还能抑制噪声影响,具有有效性.     

基于多任务卷积神经网络的红外与可见光多分辨率图像融合

红外与可见光图像融合一直是图像领域研究的热点,融合技术能弥补单一传感器的不足,为图像理解与分析提供良好的成像基础。因生产工艺以及成本的限制,红外探测器的分辨率远低于可见光探测器,并在一定程度上因源图像分辨率的差异阻碍了实际应用。针对红外与可见光图像分辨率不一致的问题,提出了用于红外图像超分辨率重建与融合的多任务卷积网络框架,应用于多分辨率图像融合。在网络结构方面,首先设计了双通道网络分别提取红外与可见光特征,使算法不受源图像分辨率的限制;其次提出了特征上采样模块,先用双线性插值方法增加像素个数,再通过多层感知器精细化拟合像素平滑空间与高频空间的映射关系,无需重新训练模型即可实现任意尺度的红外图像上采样;接着将线性注意力引入网络,学习特征空间位置间的非线性关系,抑制无关信息并增强网络对全局信息的表达。在损失函数方面,提出了梯度损失,保留红外与可见光图像中绝对值较大的滤波器响应值,并计算该值与重建的融合图像响应值的Frobenius范数,无需理想的融合图像作为真值监督网络学习就能生成融合图像;此外,在梯度损失、像素损失的共同作用下对多任务模型进行优化,可以同时重建融合图像和高分辨率红外图像...