基于像素流的视频彩色化

针对利用传统光流传递关键帧颜色信息的视频彩色化方法计算耗时问题,以及全局传递颜色的视频彩色化方法导致欠饱和度问题,提出基于像素流的视频彩色化方法.首先,将参考帧与目标帧转换到Lab颜色空间中,利用其亮度通道通过一个深度学习网络得到像素流,该像素流中的数值指示了目标帧的颜色在参考帧中的位置;然后,利用该像素流对参考帧颜色...

Video colourisation based on voxel flow

Video colourisation methods that transfer colour information in keyframes based on traditional optical flow are time-consuming, while those relying on global colour transfer are prone to desaturation. This paper proposes a new video colourisation method based on voxel flow. In the proposed method, the reference and target images are both converted to the lab colour space, before a double-channel voxel flow is obtained by feeding the luminance channels of the images into a neural network. The voxel flow values indicate the positional colour correspondence between the target frame and the reference frame. Then, the colour of the target frame is obtained by bilinear interpolation of the reference frame utilising the voxel flow. Finally, the colour and luminance channels are combined to synthesise the final colourised image. Experimental results show that the proposed video colourisation method maintains the saturation of the reference image, while also maintaining edge sharpness. Compared with rival video colourisation methods based on traditional optical flow, the proposed method yields a higher peak signal-to-noise ratio (PSNR) and offers a shorter runtime.