|国家科技期刊平台
首页|期刊导航|丝绸|基于SE注意力CycleGAN的蓝印花布单纹样自动生成

基于SE注意力CycleGAN的蓝印花布单纹样自动生成OACSTPCD

Single pattern automatic generation of blue calico based on SE attention CycleGAN

中文摘要英文摘要

根据蓝印花布纹样的风格特征,文章提出一种端到端的蓝印花布纹样自动生成方法,实现简笔画图像向蓝印花布单纹样的自动迁移.针对蓝印花布的抽象风格和小数据集问题,重新构造CycleGAN 生成网络中的编码器和解码器,使用SE(squeeze and excitation)注意力模块和残差模块与原始的卷积模块串联,提高特征提取能力和网络学习能力.同时减少生成网络中转换器的残差块层数,降低过拟合.实验结果表明,基于SE注意力CycleGAN 网络方法自动生成的蓝印花布新纹样主观性上更贴合原始风格,与原图更加接近,有助于蓝印花布的数字化传承和创新.

Blue calico is a traditional craft printing and dyeing product in China with a long history.It is a simple and primitive blue and white fabric that reflects people's preferences and embodies their longing for a happy life and simple aesthetic taste.It is famous for its unique pattern design style and broken lines.However,the lack of an algorithm for the automatic generation of blue calico patterns has hindered the innovative research of patterns.For this reason,an end-to-end automatic generation method of the blue calico pattern was proposed to realize the automatic conversion from a simple stroke image to a single blue calico pattern. Our solution belongs to CycleGAN-based methods,which are.popular to stylize images in artistic forms such as painting.CycleGAN is a generative adversarial network based on dual learning,overcoming the the limitations of requiring corresponding datasets of other methods,but it is slightly insufficient for geometric shape changes.Given the abstract style and small dataset of blue calico,the coder and decoder in the CycleGAN generation network are reconstructed,and the SE(squeeze and exception)attention module and residual module are connected in series with the original convolution module to improve the ability of feature extraction and network learning.SE attention mechanism gives different weights to different positions of images from the perspective of the channel domain,with the network focusing on key information.At the same time,reducing the number of residual block layers of the converter in the generative network to reduce over-fitting is implemented.Besides,to carry out this experiment,we have made the dataset of a single pattern of blue calico and the dataset of simple strokes. Due to the lack of previous research on this issue and the lack of appropriate measurement indicators for such experiments,the study used the generated image for visual comparison.In the experiment,to prove the superiority of the proposed algorithm,we compared our algorithm with the original CycleGAN and other algorithms based on the dual idea,like DuaIGAN and DiscoGAN.The experimental results show that our proposed algorithm can effectively combine the content of simple strokes with the style of blue calico,while the original CycleGAN algorithm has insufficient geometric deformation ability,and the other two algorithms save too much original information,which does not conform to the concise characteristics of blue calico.At the same time,the study also compared the effect of using different attention mechanisms,and compared the ECA(efficient channel attention)mechanism with CBAM(convolutional block attention module)mechanism.Among various attention mechanisms,the SE attention mechanism still has the best effect.The image generated by using ECA attention lacks the content of the original image;the image style conversion generated by using ECA attention is not enough.Besides,compared with the other two methods,the image generated by using the SE attention mechanism has smoother color block edges and less noise.The reason for the gap caused by using different attention mechanisms may be that different attention mechanisms increase the learning ability of generators to different degrees,and some make it difficult for generators and discriminators to form effective competition.Through the above experiments,the blue calico automatically generated by the method based on the SE attention CycleGAN network is closer to the original style.Through this algorithm,the design process of the blue calico can be simplified,which is beneficial to the digital inheritance and innovation of the blue calico. As a national intangible cultural heritage,the blue calico is of important value and significance.In this paper,an end-to-end network SE-CycleGAN based on the SE attention mechanism is proposed.Compared with other networks,the content of the image is better integrated with the style of the blue calico.The proposed network does not need matching datasets,so it can be well migrated to the generation of other similar patterns.Nevertheless,due to the limitation of the dataset and resolution,the patterns generated at present are still relatively simple.The next research work will focus on studying the method of generating multi-class and complex blue calico.

冉二飞;贾小军;喻擎苍;谢昊;陈卫彪

嘉兴学院信息科学与工程学院,浙江嘉兴 314001浙江理工大学计算机科学与技术学院(人工智能学院),杭州 310018||嘉兴学院信息科学与工程学院,浙江嘉兴 314001浙江理工大学计算机科学与技术学院(人工智能学院),杭州 310018嘉兴学院信息科学与工程学院,浙江嘉兴 314001||浙江师范大学数学与计算机科学学院,浙江金华 321004

轻工业

蓝印花布SE注意力风格迁移CycleGAN单纹样半监督学习图像生成

blue calicoSE attentionstyle transferCycleGANsingle patternsemi-supervised learningimage generation

《丝绸》 2024 (001)

31-37 / 7

10.3969/j.issn.1001-7003.2024.01.004

评论