Fusion of visible and infrared images using global entropy and gradient constrained regularization

Infrared and visible image fusion has been an important and popular topic in imaging science. Dual-band image fusion aims to extract both target regions in infrared image and abundant detail information in visible image into fused result, preserving even enhancing the information that inherits from source images. In our study, we propose an optimization-based fusion method by combining global entropy and gradient constrained regularization. We design a cost function by taking the advantages of global maximum entropy as the first term, together with gradient constraint as the regularized term. In this cost function, global maximum entropy could make the fused result inherit as more information as possible from sources. And using gradient constraint, the fused result would have clear details and edges with noise suppression. The fusion is achieved based on the minimization of the cost function by adding weight value matrix. Experimental results indicate that the proposed method performs well and has obvious superiorities over other typical algorithms in both subjective visual performance and objective criteria.     

信息论在粉末衍射结构分析中的应用—最大熵方法

从粉末衍射数据直接测定晶体结构介材料和晶体学研究的热门课题之一。文章介绍了粉末衍射结构的最大熵法。最大熵法是基于信息论的最大熵原理和最大似然原理的一种方法。由于其独特的优点，最大熵法是最有前景的粉末衍射结构分析方法之一。     

A Novel Blind Signal Detector Based on the Entropy of the Power Spectrum Subband Energy Ratio

In this paper, we present a novel blind signal detector based on the entropy of the power spectrum subband energy ratio (PSER), the detection performance of which is significantly better than that of the classical energy detector. This detector is a full power spectrum detection method, and does not require the noise variance or prior information about the signal to be detected. According to the analysis of the statistical characteristics of the power spectrum subband energy ratio, this paper proposes concepts such as interval probability, interval entropy, sample entropy, joint interval entropy, PSER entropy, and sample entropy variance. Based on the multinomial distribution, in this paper the formulas for calculating the PSER entropy and the variance of sample entropy in the case of pure noise are derived. Based on the mixture multinomial distribution, the formulas for calculating the PSER entropy and the variance of sample entropy in the case of the signals mixed with noise are also derived. Under the constant false alarm strategy, the detector based on the entropy of the power spectrum subband energy ratio is derived. The experimental results for the primary signal detection are consistent with the theoretical calculation results, which proves that the detection method is correct.     

Detection of Coronary Artery Disease Using Multi-Domain Feature Fusion of Multi-Channel Heart Sound Signals

Heart sound signals reflect valuable information about heart condition. Previous studies have suggested that the information contained in single-channel heart sound signals can be used to detect coronary artery disease (CAD). But accuracy based on single-channel heart sound signal is not satisfactory. This paper proposed a method based on multi-domain feature fusion of multi-channel heart sound signals, in which entropy features and cross entropy features are also included. A total of 36 subjects enrolled in the data collection, including 21 CAD patients and 15 non-CAD subjects. For each subject, five-channel heart sound signals were recorded synchronously for 5 min. After data segmentation and quality evaluation, 553 samples were left in the CAD group and 438 samples in the non-CAD group. The time-domain, frequency-domain, entropy, and cross entropy features were extracted. After feature selection, the optimal feature set was fed into the support vector machine for classification. The results showed that from single-channel to multi-channel, the classification accuracy has increased from 78.75% to 86.70%. After adding entropy features and cross entropy features, the classification accuracy continued to increase to 90.92%. The study indicated that the method based on multi-domain feature fusion of multi-channel heart sound signals could provide more information for CAD detection, and entropy features and cross entropy features played an important role in it.     

Maximum entropy: a complement to Tikhonov regularization for determination of pair distance distributions by pulsed ESR

Tikhonov regularization (TIKR) has been demonstrated as a powerful and valuable method for the determination of distance distributions of spin-pairs in bi-labeled biomolecules directly from pulsed ESR signals. TIKR is a direct method, which requires no iteration, and, therefore, provides a rapid and unique solution. However, the distribution obtained tends to exhibit oscillatory excursions with negative portions in the presence of finite noise, especially in the peripheral regions of the distribution. The Shannon-Jaynes entropy of a probability distribution provides an intrinsic non-negativity constraint on the probability distribution and an unbiased way of obtaining information from incomplete data. We describe how the maximum entropy regularization method (MEM) may be applied to solve the ill-posed nature of the dipolar signal in pulsed ESR. We make use of it to suppress the negative excursions of the distance distribution and to increase the tolerance to noise in the dipolar signal. Model studies and experimental data are investigated, and they show that, with the initial or "seed" probability distribution that is required for MEM taken as the TIKR result, then MEM is able to provide a regularized solution, subject to the non-negativity constraint, and it is effective in dealing with noise that is problematic for TIKR. In addition we have incorporated into our MEM method the ability to extract the intermolecular dipolar component, which is embedded in the raw experimental data. We find that MEM minimization, which is implemented iteratively, is greatly accelerated using the TIKR result as the seed, and it converges more successfully. Thus we regard the MEM method as a complement to TIKR by securing a positive pair distance distribution and enhancing the accuracy of TIKR.     

基于最小一乘和混沌遗传算法检测红外小目标

提出了一种基于最小一乘估计和混沌遗传算法进行背景预测检测红外小目标的方法.在建立最小一乘准则背景预测模型的基础上,根据最小一乘估计的性质,利用混沌序列内在的伪随机性,将混沌引入到遗传算法得到混沌遗传优化算法,以此解决最小一乘估计中极值的选取问题.将原始图像与预测图像相减得到预测残差图像后,利用基于二维指数熵的图像阈值选取快速算法进行分割.给出了实验结果与分析,并与基于遗传算法的最小一乘预测、最小二乘背景预测的检测算法作了比较.实验结果表明,提出的算法具有更高的检测概率和更好的检测结果.     

最大熵图像复原及其新进展

最大熵方法(MEM)是一种重要的图像复原方法,可以取得比一般线性复原算法更好的处理效果。简单阐述了最大熵图像复原的数学模型,介绍了近年来提出的新算法:直接迭代法,多尺度最大熵算法及闭合形式的最大熵算法。对今后该领域的研究和发展进行了展望。     

Convergence of S3C empowered distributed cooperative optimization for multi-unmanned surface vehicles

With the progress and development of modern marine science and technology, Unmanned Surface Vehicles (USVs) have been applied in various maritime scenes, for instance, target information search of marine environment, port patrol, etc. However, communication is different at maritime from on land, facing bad weather and uncontrollable factors, which leads to errors in the fusion of target position and velocity information of USVs, and it is difficult to achieve optimal path planning of USVs cluster. In this paper, S3C (intelligent sensor, communication, computing and control) fusion network method for USVs is studied for the model of USVs cluster with uncertain model parameters and unknown marine environmental disturbances, so as to optimize the tracking trajectory of USVs cluster center with a reasonable and efficient scheme. Firstly, a cloud–edge–end communication network architecture is constructed to ensure that USVs cluster communicates within a safe distance. Secondly, the brain-inspired sensing module is established to combine the positions detected by the vision sensors, radar and other intelligent sensors carried by each USV with integrated algorithms to solve the problem of target detection and location in USVs cluster. Finally, a computing module based on distributed cooperative optimization algorithm, and a control module combining the Extended State Observer (ESO) and the Controller are constructed to settle USVs’ cluster’s control. The simulation results verify that S3C fusion framework for USVs proposed is reasonable and effective.     

适合于生物图像的图像融合算法研究

图像融合作为一种有效的信息融合的技术,已广泛用于军事、遥感、机器视觉和医学图像等领域。本文讨论了三种基于像素级的图像融合算法：Ｐ加权平均,Ｔｏｅｔ算法和基于小波变换的算法;采用四种评价融合效果的量化判据：标准偏差,平均误差,峰值信噪比（ｓ／Ｎ）ｐ和熵差,将三种图像融合算法用于生物图像中细胞荧光图像和透射图像的融合,量化评价结果和视觉判断均说明,对于以细胞荧光图像和透射图像研究对象,需突出荧光图像的     

A novel infrared small target detection method based on BEMD and local inverse entropy

Compared to other targets, it is more difficult to detect infrared small targets due to several aspects such as the low signal to noise ratio, low contrast, small size, the lack of shape and texture information of the targets, especially under complex background. In this paper, a novel infrared small target detection method based on peer group filter (PGF), bi-dimensional empirical mode decomposition (BEMD) and local inverse entropy (LIE) is proposed to overcome these difficulties. The PGF is implemented to remove the noise and improve the signal-to-noise ratio of the initial image. Our proposed BEMD algorithm is able to estimate the background effectively and get the target image by removing the background from the original image and segmenting the Intrinsic Mode Functions (IMFs) making use of the local inverse entropy. Experimental results demonstrate that the novel method can extract the small targets validly and accurately.     

Trade-offs between Error Exponents and Excess-Rate Exponents of Typical Slepian–Wolf Codes

Typical random codes (TRCs) in a communication scenario of source coding with side information in the decoder is the main subject of this work. We study the semi-deterministic code ensemble, which is a certain variant of the ordinary random binning code ensemble. In this code ensemble, the relatively small type classes of the source are deterministically partitioned into the available bins in a one-to-one manner. As a consequence, the error probability decreases dramatically. The random binning error exponent and the error exponent of the TRCs are derived and proved to be equal to one another in a few important special cases. We show that the performance under optimal decoding can be attained also by certain universal decoders, e.g., the stochastic likelihood decoder with an empirical entropy metric. Moreover, we discuss the trade-offs between the error exponent and the excess-rate exponent for the typical random semi-deterministic code and characterize its optimal rate function. We show that for any pair of correlated information sources, both error and excess-rate probabilities exponential vanish when the blocklength tends to infinity.     

The principle of the maximum entropy method

Abstract

The theoretical background of the maximum entropy method (MEM) when it is applied to restore the electron or nuclear densities from diffraction data is described. In MEM, the concept of “entropy” is introduced to deal with any incompleteness in an observation in a proper way. An incompleteness causes some ambiguities in the results to some extent. The essence of the method is to find a solution which necessarily agrees with the observation, leaving the measure of ambiguities (entropy) maximum. A few results for simple structures with typical types of chemical bonding are also presented.     

基于复杂度的自适应门限弱小目标检测方法

针对红外弱小目标检测问题,提出了一种基于图像复杂度的自适应门限目标检测方法.讨论了天空中四类不同区域的图像信息熵.图像信息熵虽然较好地表达了图像的平均信息量,但对图像的突变点不敏感.将它改进得到图像方差加权信息熵,其较好地反映了图像的复杂度特征.将图像方差加权信息熵作为图像复杂度的定量描述,用两种特定的分析模板对图像复杂度进行分析.在目标区域中,两种分析模板得到的复杂度差异较大,而非目标区域的两种复杂度则基本没有差异.算法获取两种分析模板下的复杂度图像,再对两种复杂度图像做差,得到复杂度差值图像.对差值图像建立指数模型得到自适应分割门限完成目标检测.实验结果表明,该方法对低信杂比的红外云层背景弱小目标图像具有良好的检测效果.     

一种基于单似然检验的高光谱图像小目标检测器

针对背景和目标的先验光谱特征未知的条件,给出一种基于单似然检验的高光谱图像小目标检测器。小目标相对于背景的低概率性使得高光谱图像数据对目标光谱信号的矩特征几乎不施加约束,可在最大熵条件下将广义似然比检验简化为对背景似然的单似然检验;利用全部数据样本建立无参估计模型以充分利用样本信息,从而得到基于单似然检验的高光谱图像小目标检测器。该检测器避免了统计模型误差和不明确物理含义特征对实际高光谱图像数据检测带来的影响。使用可见光/近红外波段机载I型实用型模块化成像光谱仪(OMIS-I)高光谱图像进行了实验,实验结果及相应理论分析表明该算法可有效检测高光谱图像中的空间低概率目标。     

最大熵法在风廓线雷达谱分析中的应用研究

为了解现代谱分析技术在风廓线雷达中应用的可行性,通过采用实测的和模拟的风廓线雷达回波信号,对比研究了FFT法与最大熵法的谱分析效果。结果表明:(1)当回波信号比较强时,两者都可以得到较好的谱分析效果;但是当回波信号较弱时,最大熵法分析效果优于FFT法,最大熵法对地杂波具有较好的抑制能力。(2)最大熵谱比较光滑,表明最大熵法对随机白噪声也有一定的抑制作用。(3)最大熵法的递推阶数对谱分析结果有一定影响,最终预测误差准则确定的递推阶数一般偏小,采用15阶的递推阶数进行最大熵法分析取得了较好结果。由于风廓线雷达回波通常都较弱,因此研究结果可望用于改善信号处理效果。     

A Novel Adaptive Feature Fusion Strategy for Image Retrieval

In the era of big data, it is challenging to efficiently retrieve the required images from the vast amount of data. Therefore, a content-based image retrieval system is an important research direction to address this problem. Furthermore, a multi-feature-based image retrieval system can compensate for the shortage of a single feature to a certain extent, which is essential for improving retrieval system performance. Feature selection and feature fusion strategies are critical in the study of multi-feature fusion image retrieval. This paper proposes a multi-feature fusion image retrieval strategy with adaptive features based on information entropy theory. Firstly, we extract the image features, construct the distance function to calculate the similarity using the information entropy proposed in this paper, and obtain the initial retrieval results. Then, we obtain the precision of single feature retrieval based on the correlation feedback as the retrieval trust and use the retrieval trust to select the effective features automatically. After that, we initialize the weights of selected features using the average weights, construct the probability transfer matrix, and use the PageRank algorithm to update the initialized feature weights to obtain the final weights. Finally, we calculate the comprehensive similarity based on the final weights and output the detection results. This has two advantages: (1) the proposed strategy uses multiple features for image retrieval, which has better performance and more substantial generalization than the retrieval strategy based on a single feature; (2) compared with the fixed-feature retrieval strategy, our method selects the best features for fusion in each query, which takes full advantages of each feature. The experimental results show that our proposed method outperforms other methods. In the datasets of Corel1k, UC Merced Land-Use, and RSSCN7, the top10 retrieval precision is 99.55%, 88.02%, and 88.28%, respectively. In the Holidays dataset, the mean average precision (mAP) was 92.46%.     

基于数据融合的风电机组噪声预测

根据风电机组噪声信号检测复杂的情况,研究风电机组非声学参数的信息熵特征,对机组噪声进行多源数据融合预测。分析基于信息熵的非声学参数的特征提取方法,并对传统的基于遗传算法的支持向量机回归(GA-SVR)的缺陷提出改进,结合实际应用的非声学参数的信息熵特点平衡遗传算法(GA)的终止条件。通过统计分析完成了输入变量的筛选,去除了对预测影响较大的共线性因素,并实现了输入降维提高预测精度和速率。最后应用数据的信息熵特征,训练改进的GA-SVR建立最终的多源数据特征级融合预测模型。通过对比表明基于多源数据融合的预测方法精度最高,预测结果的相对误差平均值为0.7757%,具有实际可行性。     

基于图像信息熵的ptychography轴向距离误差校正

在轴向距离参与运算的ptychography算法中,轴向距离误差会使重建图像变模糊并降低图像的分辨率.本文基于菲涅耳衍射理论建立了轴向距离误差模型,根据不同轴向距离误差对重构图像清晰度的影响,提出用图像信息熵确定图像最清晰时的轴向距离,并重建出清晰的ptychography图像.比较了图像能量变化、Tamura系数和图像信息熵这三种图像清晰度评价函数在轴向距离误差校正过程中的分布情况,发现它们均具有单峰性,且峰值确定的轴向距离相同.图像信息熵相比其他两种图像清晰度评价函数具有更高的灵敏性.仿真以及实验均证明了基于图像信息熵的ptychography轴向误差校正的可行性.     

基于多检测器最大熵融合的多通道光谱图像异常检测

提出了一种多检测器最大熵融合的多通道光谱图像异常检测算法.选择多个不同的异常检测器，并利用自适应窗宽非参核密度估计方法估计其各自的输出分布，保留了多通道光谱图像数据的“长尾”特性，且避免了先验模型假设带来的模型误差.将各原始检测器的输出投影到具有标准正态边缘分布的变换空间中，利用变换空间中模型化的最大熵融合规则实现多检测器的决策级最优概率融合.在原数据空间通过似然函数的检验完成多通道光谱图像的目标检测.利用机载EPS-A航拍多通道光谱图像进行了实验，实验结果表明了算法的有效性.     

Infrared small target detection based on modified local entropy and EMD

Image entropy and empirical mode decomposition （EMD） are effective methods for target detection. EMD algorithm is a powerful tool for adaptive multiscale analysis of nonstationary signals. A new technique based on EMD and modified local entropy is proposed in small target detection under sea-sky background. With the EMD algorithm, it is valid to estimate the background and get the target image by removing the background from the original image and segmenting the target based on the modified local entropy method. The data analysis and experiments show the validity of the proposed algorithm.