基于二通道不可分加性小波的多光谱图像融合

提出了伸缩矩阵为[1,1;1,-1]的不可分小波的一种构造方法,并把它应用于多光谱图像与高分辨力全色图像的融合中。提出了一种二通道对称的不可分小波滤波器组的构造方法,设计出多组具有紧支撑、对称性和正交性的不可分小波6×6滤波器组,利用此类滤波器组中的低通滤波器对图像进行加性分解与重构。采用三种模式NAWS、NAWRGB和NAWL对ETM 及其它类多光谱图像与高分辨力全色图像进行融合研究。实验结果表明,该方法对多光谱图像与高分辨力全色图像的融合有较好的融合效果,与传统的融合方法相比,该方法既能保持多光谱图像的光谱信息,又能保持高分辨力全色图像的高分辨力特性,克服了传统张量积小波融合方法不能得到高分辨力图像的不足,并能节约运算量。     

Acquiring multi-spectral images by digital still cameras based on XYZLMS interim connection space

A method based on the XYZLMS interim connection space is proposed to accurately acquire the multi-spectral images by digital still cameras. The XYZLMS values are firstly predicted from RGB values by polynomial model with local training samples and then spectral reflectance is constructed from XYZLMS values by pseudo-inverse method. An experiment is implemented for multi-spectral image acquisition based on a commercial digital still camera. The results indicate that multi-spectral images can be accurately acquired except the very dark colors.     

Spectral band invariant wavelet-modified MACH filter

Filters synthesized with images of a specific spectral band in general fail to recognize targets in a different spectral band. In this paper, we therefore demonstrate the use of the wavelet-modified maximum average correlation height (WaveMACH) filter for automatic target recognition applications in both the visible and infrared (IR) spectral bands. As any input target appears different when imaged through two different sensors, i.e., a CCD or an IR camera, a WaveMACH filter synthesized using a CCD image shows no correlation with the image of the same target from an IR camera and vice-versa. Hence, separate filters are required to match the input targets from the two sensors. To avoid the synthesis and storage of separate filters, the images from CCD and IR camera are fused using Daubechies wavelet and then the rotation-invariant WaveMACH filter generated with the fused image. In all, 18 WaveMACH filters (each of 20° range) are required for in-plane rotation invariance in both the spectral bands for the full range of 0–360°. Computer simulation and experimental results implemented in hybrid digital–optical correlator architecture are shown for the proposed idea. The same filters have also been used to identify multiple targets in a scene. Performance measures like peak-to-sidelobe ratio (PSR), peak correlation energy (PCE) and correlation peak intensity (CPI) have been calculated as metrics of goodness.     

Efficient multi-bands image compression method for remote cameras

In this Letter, we propose an efficient compression algorithm for multi-spectral images having a few bands. First,we propose a low-complexity removing spectral redundancy approach to improve compression performance.Then, a bit plane encoding approach is applied to each band to complete the compression. Finally, the experiments are performed on multi-spectral images. The experiment results show that the proposed compression algorithm has good compressive property. Compared with traditional approaches, the proposed method can decrease the average peak signal noise ratio by 0.36 d B at 0.5 bpp. The processing speed reaches23.81 MPixels/s at the working frequency of 88 MHz, which is higher than the traditional methods. The proposed method satisfies the project application.     

Enhancing the capabilities of binary phase only filter

In this paper, we demonstrate that the capabilities of a binary phase-only filter (BPOF) can be enhanced to identify targets irrespective of rotation, scale or the imaging spectral band by utilizing the concept of log-polar transform and image fusion. Till date, BPOFs have been considered to be the simplest of all filters and incapable of identifying distorted images or images of different spectral bands like the visible or infrared (IR) bands. The novelty of this work lies in the approach adopted to demonstrate that a BPOF is equally capable of distortion-invariance like any other distortion-invariant complex matched filter. This is done by suitably fusing the images of visible and IR bands and then taking the log-polar transformation of the fused image to synthesize the BPOF. A single BPOF is thus sufficient to identify (0-360)° in-plane rotated images, (50-190)% scaled images, combination of rotation and scale changes of the target, noisy image of both the visible and IR spectral bands. A further enhancement of the correlation peak intensity (CPI) is achieved by modifying this BPOF with Mexican-hat wavelet. The designed filter was implemented in the hybrid digital-optical correlation scheme. Correlation peak intensity and peak correlation energy (PCE) have been calculated as metrics of goodness of the proposed approach. Experimental results have been presented.     

基于冠层辐射传输模型的地表反射率光谱重建方法

针对基于多光谱数据有限光谱信息重建地表反射率光谱的病态求解难题,提出一种基于冠层辐射传输物理机理并充分考虑像元异质性的地表反射率光谱重建方法,该方法假设混合像元由植被和土壤两种地物类型组成,利用冠层辐射传输模型构造端元光谱查找表,进而通过组分比例因子估算实现基于多光谱图像的高光谱地表反射率模拟。以Landsat ETM+多光谱图像为例的地表反射率超光谱重建验证实验结果表明,模拟的反射率光谱能够较好的反映不同地物特征信息。进一步地,利用模拟的地表反射率拟合Landsat ETM+图像和MODIS图像,各波段模拟图像与实际观测图像之间具有较高的相关系数(Landsat: 0.90~0.99, MODIS: 0.74~0.85),进一步验证了该方法的可行性。     

基于LCVR调谐的全偏振多谱段成像系统

提出一种新型全偏振多谱段成像系统,将液晶相位可变延迟器LCVR应用于全偏振成像技术,在可见-近红外波段上可快速实现光的全偏振态的精确调制.系统由光学镜头、LCVR、偏振片、滤波片和CCD探测器组成.文章首先介绍了系统结构、工作原理和光学设计,并提出了适合本系统的偏振定标方法,建立了偏振定标系统,实现了利用较小面积的偏振...     

窄带快照式多光谱成像色彩还原方法

由于兼具光谱分辨和空间分辨能力, 快照式窄带多光谱成像在资源遥感、精准农业、医疗检测等领域将有广泛应用。由于该方法使用窄带成像来提高光谱分辨率及图像对比度,所获得的图像是灰度信息,失去了场景的色彩信息,不便专家对图像鉴别、评价与赏析。已有的色彩还原算法主要针对光谱波段带宽较宽或者多个波段叠加基本覆盖整个可见光谱范围等两种光谱成像仪,不适合窄带多光谱成像方法的色彩还原。该研究适合于快照式窄带多光谱成像的色彩还原方法,提出建立窄带多光谱彩色相机的概念。首先,提出两种窄带多光谱色彩还原方法：(1)基于CIE色度系统三刺激值色的,(2)基于贝尔阵列插值算法的;其次,分别应用两种算法还原快照式窄带多光谱相机所获得的植物、手臂及宫颈组织等三种代表性场景窄带多光谱灰度图像;之后,计算并比较表征两种算法所得的代表性场景彩色图像的均值、方差、熵及梯度等表征图像质量的参数数值,确定出适合快照式窄带多光谱成像的色彩还原方法;最后,对所确定的色彩还原算法进行色偏校正。实验结果表明,基于CIE三刺激值色彩还原方法比贝尔阵列插值法更适用于窄带多光谱成像颜色复原。配合使用CIE三刺激值色彩还原方法及灰度图象校正算法,从窄带光谱成像所获得的植物、手臂皮肤及宫颈组织的灰度图像所还原出的近彩色图像逼近物体真实色彩,满足人眼观察习惯。介绍了仅覆盖可见光光谱范围30%的窄带多光谱图像进行色彩还原的方法,该方法证明快照式窄带多光谱成像可以兼具光谱分辨能力,同时保持可供人主观辨识的色彩信息。所提出实现快照式窄带多光谱彩色成像的方法,有望设计不同于传统RGB相机的彩色相机实施方案。     

光谱去相关技术在高光谱图像小波压缩中的应用

随着数据量的不断增长,如何有效压缩高光谱图像成为影响其普及应用的一个关键问题。近年来,小波压缩技术已经被证明是高光谱图像压缩方法中很有发展前景的一个,但由于其对高光谱图像特性的利用较为有限而使其性能的进一步提升受到了限制。文章根据高光谱图像的光谱特征,提出了一种基于光谱去相关的高光谱图像小波压缩方法,设计了分块预测方法来同时去除光谱间相关性和空间相关性,并将其应用于小波压缩方法之中。首先,将高光谱图像分为几个具有高谱间相关性的图像块。然后推导出各块中波段的近似成比例的特性,并在各块分别进行基于这一特性和超光谱图像其他特性设计波段预测编码。最后,将预测用的参考波段和预测后获得的偏差数据,通过小波编码技术进行压缩。实验结果表明,所设计的方法与目前先进的超光谱压缩技术相比其性能有显著的提升。与AT-3DSPIHT算法比较,最高PSNR或SNR提升幅度均能达到4.2 dB左右。此外,此方法在低比特率下的优势也十分突出。     

A new multi-spectral feature level image fusion method for human interpretation

Various different methods to perform multi-spectral image fusion have been suggested, mostly on the pixel level. However, the jury is still out on the benefits of a fused image compared to its source images. We present here a new multi-spectral image fusion method, multi-spectral segmentation fusion (MSSF), which uses a feature level processing paradigm. To test our method, we compared human observer performance in a three-task experiment using MSSF against two established methods: averaging and principle components analysis (PCA), and against its two source bands, visible and infrared. The three tasks that we studied were: (1) simple target detection, (2) spatial orientation, and (3) camouflaged target detection. MSSF proved superior to the other fusion methods in all three tests; MSSF also outperformed the source images in the spatial orientation and camouflaged target detection tasks. Based on these findings, current speculation about the circumstances in which multi-spectral image fusion in general and specific fusion methods in particular would be superior to using the original image sources can be further addressed.     

基于光谱响应函数的遥感图像融合对比研究

遥感图像融合是一个十分重要的问题,目前已出现了很多融合方法.一些现有方法可以从高空间分辨率全色数据中提取细节特征,并注入到低空间分辨牢多光谱数据中,同时尽可能保持多光谱数据的光谱特性.现有方法一般都不能利用遥感成像系统的物理信息,因此可能导致融合结果发生严重的光谱扭曲.该文采用适当的遥感图像融合模型对图像融合问题进行分解,将融合问题归结为空间细节调制参数构建与空间细节信息提取两个子问题,在对传感器光谱响应函数(SRF)的分析基础上,构建合理的空间细节调制参数.依据对现有方法的分类,文章将三种基于SRF的空间细节调制参数构建方法,与高斯高通滤波提取的空间细节信息结合,产生三种基于SRF的遥感图像融合方法.这些方法在Ikonos数据上进行了试验和分析,并与GS和HPM方法进行对比.     

正交偏振多光谱成像术应用于活体微循环观察研究

构建一种小型、简洁的活体微循环多光谱成像系统,将正交偏振光谱成像术OPS Imaging及液晶可调谐滤光片LCTF应用于活体微循环多光谱成像。LCTF具有较高的成像质量、较低的功耗、且没有移动部件和图像移动,能够连续、随机地在可见-近红外波段上快速实现波长的任意调谐。利用该系统,对活体裸鼠的耳廓采用检偏角为90°(正交偏振方式)与0°两种方式进行了试验,获取了裸鼠耳廓微血管的多光谱图,得出采用正交偏振成像方式的图像的对比度及图像细节均优于检偏角为0°时的图像。试验验证了正交偏振多光谱成像技术能增强活体微循环观察效果。     

多波段红外图像的海面舰船目标检测

现有的基于单个红外宽波段的海面舰船目标探测系统在面对复杂海天背景、岛岸背景、恶劣天气、亮带干扰或诱饵弹干扰等情况时,系统的探测率、虚警率、探测距离等性能指标均会受到严重的影响;为此,开展了基于多波段红外图像的海面舰船目标检测方法的研究。通过中波红外多波段数据采集系统实际采集107组五个中波红外波段的图像;波段1-5分别为3.7～4.8,3.7～4.1,4.4～4.8,3.7～3.9和4.65～4.75 μm;对多波段图像进行手动标注构建样本数据集,其中,正样本舰船目标298个,负样本非舰船目标353个。对于多波段红外图像,首先进行PCA降维并采用选择性搜索算法生成初始目标候选区域;针对候选区域中存在大量明显的非舰船目标区域的问题,利用积分图像计算候选区域的局部对比度,依据红外舰船目标的几何和灰度特征从初始目标候选区域中筛选出舰船目标可能性大的区域作为舰船目标候选区域。然后对舰船目标候选区域进行拓展以融入局部上下文信息,对于候选区域对应的5波段红外图像,分别提取每个波段图像的稠密SIFT特征,并将128维SIFT特征向量降为64维,融入SIFT特征的空间和波段位置分布信息得到新的特征向量,基于高斯混合模型对候选区域的特征向量集合进行编码融合得到舰船目标候选区域的费舍尔向量表示,最后利用线性SVM分类器识别出舰船目标。对多波段图像进行舰船目标候选区域生成实验,所提出的基于红外舰船目标的几何和灰度特征的约束方法可以有效地克服选择性搜索算法的不足,从初始目标候选区域中快速定位出舰船目标候选区域,对25组多波段图像进行实验,舰船目标候选区域生成的整体耗时为0.353 s,定位舰船目标区域耗时0.005 s。对100个正负样本进行目标识别测试,所提出的目标识别算法融合了目标的多波段图像特征信息,通过引入费舍尔向量挖掘了多波段图像梯度统计特征的深层次信息,算法的识别率达到了0.97,显著高于单波段红外图像的目标识别率。对25组多波段图像进行舰船目标检测实验,所提出的舰船目标检测方法能够在海天背景、岛岸背景以及亮带干扰等不同场景下完成海面舰船目标的检测工作,舰船目标定位准确,舰船目标召回率达到了0.95,每组多波段图像的平均检测耗时为1.33 s。研究结果表明,充分考虑海面舰船目标在红外图像中与局部海洋背景的辐射差异以及有效地融合舰船目标在多个红外波段图像中的辐射特征,可以增强舰船目标的可分性,提高舰船目标的识别率以及检测率,为基于多波段红外图像的海面舰船目标检测提供了新的技术支持。     

基于非线性光谱混合模型的遥感影像提取城市不透水层

针对传统方法在提取城市不透水层中的许多局限性,采用两种非线性光谱混合分解模型,包括混合调谐匹配滤波和多层感知器神经网络,通过混合像元分解获取城市不透水层.混合调谐匹配滤波利用用户选择的端元,通过最大化端元响应并减少未知背景信息的影响,进行局部分解端元.多层感知器由多个感知器组成,能够很好的进行非线性学习.对Landsa...     

基于多通道窄带滤光片和彩色图像传感器的实时多光谱成像系统

针对复染情况的出现,采用多通道窄带滤光片与彩色图像传感器相结合的方式,设计了一种多光谱成像方法.使用多通道窄带滤光片对光源进行分光,采用多元线性回归方法建立多光谱剥离模型,并对彩色图像传感器输出的多个单色光混叠响应进行剥离,通过FPGA实现多光谱图像的实时剥离运算和输出.实验结果表明:多通道窄带滤光片的半高宽为12nm/15nm/20nm,其透射光是三个不同波段的窄带单色光;在检验水平为0.01情况下的模型具有较高的准确性;具有相同光谱特征的物质在同一波段的灰度图像上特征一致,同一物质在不同波段上的灰度图像特性差异较大.     

Design of optocoupler for synthesizing four color spectra

LEDs with the advantage of high luminous efficacy and long life time show the potential of replacing traditional luminaire. Most commercial white LED light sources use blue or ultraviolet chip coated with emitting phosphor, but the sensitivity and instability of such phosphors has become a big issue. The typical RGB-LED by using individual chips has the problem of spatial separation and insufficient spectral overlap which leads to low CRI. This study suggests a novel and high-efficiency design of fiber optical optocoupler to synthesize four colors emitted by separate LEDs to provide the ideal light sources by adjusting the individual LEDs separately. By choosing different colored light to be synthesized, this optocoupler can be used as light sources which can be highly controlled to offer the best lighting conditions. Compared with other widely used commercial LED sources, this new design of light sources can be used in special experiments which require multi-spectral light.     

四通道可见光光谱相机的设计

随着光谱技术的发展，多光谱相机在农业、医疗、机器视觉、遥感探测等领域都得到了广泛的应用。提出一款小型化四通道可见光波段的多光谱相机，尺寸为107 mm×110 mm×74 mm，质量1 043 g，适合搭载在小型化无人机上进行遥感探测。相机系统采用棱镜分光光路设计方案，避免光程差和光轴偏移；设计开发的四通道可见光多光谱相机，采用一个FPGA控制器同时驱动4个图像传感器，实现4个通道像素级同步采集，曝光完全一致。实验结果显示:在红、绿、蓝3个特定波段及全波段相机可实时输出图像，既可输出某个特定波段图像(60 fps)，也可同时输出4个波段图像(15 fps)，有利于多波段图像同步采集，以及多光谱图像融合的研究。     

多色焦平面和图像融合SoC实现技术的研究

大规模、智能化的多色焦平面阵列探测器和高性能、高集成度的SoC技术是未来发展的方向。对多色焦平面的概况、发展和关键技术进行了分析。为了能够更有效的利用信息,把由多色焦平面探测器输出的,并经天然配准的各波段图像进行了融合处理。详细介绍了现有的多种图像融合算法、模型、SoC和高速处理硬件平台的研究情况以及若干新进展。     

Performance analysis of multi-spectral and panchromatic image fusion techniques based on two wavelet discrete approaches

During the past few years, many fusion algorithms have been proposed to combine a high-resolution panchromatic image with a low-resolution multi-spectral image to generate a high-resolution multi-spectral image. Among them, the wavelet-based algorithm has gained its popularity due to its ability of multi-resolution decomposition. More specifically, the wavelet transform is first applied to images. The wavelet coefficients are then combined based on a certain rule to produce the fused image. In this paper, we evaluated the performances of both the wavelet transform discrete approaches and the coefficient combination methods when they are applied to fuse multi-spectral and panchromatic images. For the discrete approaches of the wavelet transform, Mallat and “à trous” algorithms are chosen. For the coefficient combination, the additive wavelet method, the additive wavelet intensity method and the additive wavelet principal component method are selected. To evaluate the spectral quality of the fused images, correlation coefficient and Q_avg index are used as a local and global measure, respectively. Meanwhile, average gradient and standard deviation are used to evaluate the spatial quality. Our experiments show that keeping the combination method the same, the “à trous” algorithm works better than the Mallat algorithm for the fusion purpose. In addition, if keeping the wavelet discrete algorithm the same, the combination methods mentioned above are found to have different advantages between the spatial resolution improvement and the spectral quality preservation.     

微型快照式窄带多光谱成像宫颈癌筛查方法

白光阴道镜图像对比度较低,不利于医生鉴别不同病变程度组织,也不利于自动化宫颈癌筛查。利用癌变组织富含血红蛋白成分及血红蛋白具有特征波段这一特性,与传统高光谱空间扫描成像及分时获取不同波段多光谱成像方法相反,利用快照式多光谱窄带成像来加速光谱图像获取过程,提升不同病变程度组织之间灰度对比度同时,降低后续图像分析处理算法难度,实现对宫颈组织病变类型高帧率自动化分类。首先,使用微型快照式窄带多光谱摄像方法,在血红蛋白的两个强吸收峰(415±10)和(525±10) nm、一个反射带(620±10) nm和一个背景波段(450±10) nm共四个波段对宫颈组织进行快照式零时差获取四幅窄带光谱图像。而后,对所获取的光谱图像进行简单代数加减,以生成突显病变组织的融合图像,提高不同病变程度组织之间的对比度。最后,使用欧式距离分类算法,对光谱融合图像中不同病变级别进行分类,建立计算机辅助宫颈癌筛查方法。创新点在于实现了高帧率计算机辅助光学病理诊断方法。分别采用临床常规白光阴道镜及微型快照式窄带多光谱摄像对宫颈癌手术切下的新鲜组织进行彩色图像及光谱融合图像的高帧率采集,并使用同一个欧式距离分类算法对两种图像进行自动分类,分类结果都以组织病理诊断作为标准来计算正确率。通过对比两种分类结果正确率来检验光谱融合图像相对于彩色图像是否提升对比度,及其是否可以实现与组织病理诊断(金标准)结果一致的诊断。欧式距离分类算法对光谱融合图像分类准确率接近100%,远高于对白光阴道镜图像约50%的准确率。多位临床医生对基于微型快照式多光谱摄像头光谱融合图像的计算机自动分类结果表示接受。微型快照式窄带多光谱成像方法能有效提升光谱融合图像获取帧率及不同病变程度组织之间灰度对比度,能有效快速地将宫颈组织划分为与组织病理诊断结果一致的病变类型。由于诊断客观、无创伤、结果立等可得,该方法将有助于实现落后地区宫颈癌筛查的普及以及图像导航下的宫颈癌精准治疗手术。