首页 | 本学科首页   官方微博 | 高级检索  
     检索      

结合可逆网络的超高分辨率图像的风格迁移
引用本文:林真,郑茜颖.结合可逆网络的超高分辨率图像的风格迁移[J].半导体光电,2023,44(5):756-760.
作者姓名:林真  郑茜颖
作者单位:福州大学 物理与信息工程学院, 福州 350108
基金项目:福建省科技重点产业引导项目(2020H0007).*通信作者:郑茜颖 E-mail:zhengqy@vip.sina.com
摘    要:针对处理超高分辨率图像时面临的内存成本和风格迁移过程中过度风格化,提出了一种结合可逆网络的超高分辨率图像的风格迁移方法。该算法采用可逆的Glow模块作为基本单元构建可逆神经网络模块,并将图像分为小块处理;在风格迁移模块中使用具有通道注意力机制的残差模块和缩略图实例化归一化模块(TIN),以保证各模块风格一致;提出基于全局-局部的损失计算方式,能够有效地处理局部的结构特征。实验结果表明,相较于当前通用的各种神经风格迁移网络,所提算法不仅能够避免图像在编码和解码过程中的信息丢失问题,而且能以更低的内存成本实现更优的风格迁移。

关 键 词:可逆网络  超高分辨率图像  风格迁移  通道注意力机制  Glow模块
收稿时间:2023/7/18 0:00:00

Super-Resolution Image Style Transfer Combined with Reversible Network
LIN Zhen,ZHENG Qianying.Super-Resolution Image Style Transfer Combined with Reversible Network[J].Semiconductor Optoelectronics,2023,44(5):756-760.
Authors:LIN Zhen  ZHENG Qianying
Institution:College of Physics & Information Engineering, Fuzhou University, Fuzhou 350108, CHN
Abstract:Aiming at the problem of memory consumption in ultra-high resolution image processing and the problem of over-stylization in the process of style transfer, a method of ultra-high resolution image style transfer combined with reversible network is proposed. The algorithm used the reversible Glow module as the basic unit to construct a reversible neural network module, and divided the image into small blocks for processing. In the style transfer module, a residual module with a channel attention mechanism and a thumbnail instantiation normalization module (TIN) were used to ensure that the styles of each module were consistent. A global-local loss calculation method was proposed, which could effectively deal with local structural features. Experimental results show that, compared with the current general-purpose neural style transfer network, this algorithm can not only avoid the information loss problem in the process of image encoding and decoding, but also achieve better style transfer performance at a lower memory cost.
Keywords:reversible network  ultra-high resolution image  style transfer  channel attention mechanism  Glow module
点击此处可从《半导体光电》浏览原始摘要信息
点击此处可从《半导体光电》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号