计算机工程与应用2024，Vol.60Issue(4)：258-269,12.DOI:10.3778/j.issn.1002-8331.2210-0079
多尺度语义信息无监督山水画风格迁移网络
Unsupervised Landscape Painting Style Transfer Network with Multiscale Semantic Information
摘要
Abstract
This paper proposes CCME-GAN(circulatory correction multiscale evaluation-generative adversarial net-works)based on the cycle consistency loss,aiming at the problems of texture clutter and poor quality of generated images when the generative adversarial network of image conversion class is dealing with the task of unsupervised style transfer.Firstly,in the design of the network architecture,a multiscale evaluation network architecture based on the three-layer semantic information of images is proposed to enhance the transfer effect from the source domain to the target domain.Secondly,in the improvement of the loss function,a multiscale adversarial loss and a cyclic correction loss are proposed to guide the optimization iteration direction of the model with a stricter target,and generate pictures with better visual quality.Finally,in order to prevent the problem of pattern collapse,this paper adds an attention mechanism in the encoding stage of style features to extract important feature information,and then introduces the ACON activation function in each stage of the network to strengthen the nonlinear expression ability of the network and avoid neuron necrosis.The experi-mental results show that the FID value of this paper method is reduced by 21.80%and 34.33%compared with CycleGAN and ACL-GAN on the landscape painting style migration dataset.In addition,in order to verify the generalization ability of the model,the generalization experiments are compared on two public datasets,Vangogh2Photo,and Monet2Photo and the FID values are decreased by 7.58%,18.14%and 4.65%,6.99%respectively.关键词
无监督风格迁移/生成对抗网络(GAN)/多尺度评估/CycleGANKey words
unsupervised style transfer/generative adversarial networks(GAN)/multiscale evaluation/cycleGAN分类
信息技术与安全科学引用本文复制引用
周粤川,张建勋,董文鑫,高林枫,倪锦园..多尺度语义信息无监督山水画风格迁移网络[J].计算机工程与应用,2024,60(4):258-269,12.基金项目
重庆市教委科技研究重点项目(KJZD-K201801901) （KJZD-K201801901）
重庆理工大学研究生创新基金(gzlcx20222060). （gzlcx20222060）
