多源图像融合算法实时优化方法北大核心CSCD

针对红外与可见光图像融合的实时性要求,介绍了一种解决目前高清或超高清多源图像拉普拉斯金字塔图像融合算法的实时实现方法。基于视频数据流设计了拉普拉斯金字塔并行流水线处理结构,分析了各流水线之间的时延及优化思路。通过片上缓存的方式补偿时延时间差,实现了算法的流水等长,保证了处理数据的完整性。该方法可以在赛灵思7系列及以上的可编程门阵列(field programmable gate array,FPGA)芯片上实现双通道1080×1920@60 Hz视频图像的5层拉普拉斯金字塔融合。实验结果显示,该实时并行处理方法融合效果良好,一帧图像的融合仅需10.535 ms,处理时延小于1 ms。

Real-time implementation of multi-source image fusion algorithm

Aiming at the real-time requirements of image fusion in the infrared and visible light, a real-time implementation method to solve the current high-definition or ultrahigh-definition multi-source Laplacian pyramid image fusion was proposed. Based on the video data stream, a parallel processing pipeline architecture of Laplacian pyramid system was designed. The time delay and optimization ideas between the pipelines were analyzed. All the delay time differences were compensated through on-chip cache to achieve the equal length of pipeline and guarantee the integrity of data processing in the whole algorithm. This method could realize 5-level Laplacian pyramid fusion of dual-channel 1080×1920@60 Hz video images on XILINX 7 series field programmable gate array (FPGA) and above. The experimental results show that this real-time method has better fusion effect, with only 10.535 ms of one-frame image fusion and the processing delay is less than 1 ms.