杭州师范大学学报（自然科学版）2026，Vol.25Issue(4)：376-384,9.DOI:10.19926/j.cnki.issn.1674-232X.2025.05.273
基于双分支融合网络的动作迁移设计
Motion transfer design based on dual-branch fusion network
摘要
Abstract
To address the challenge of balancing source image texture preservation and accurate transfer of driving image pose,this paper proposes a dual-branch fusion(DBF)unsupervised image generation framework to achieve high-quality image animation action transfer.The framework adopts a two-stream parallel architecture.In this architecture,the optical flow alignment branch uses warping techniques to maintain the local texture consistency of the source image,while the attention alignment branch enhances pose transfer accuracy and structural integrity through global context modeling.Meanwhile,a designed cross-fusion module dynamically integrates the outputs of the two branches based on an adaptive content-aware strategy,balancing appearance preservation and target motion matching.Experimental results on datasets such as Fashion Video,TaiChi,and UvA-Nemo show that the proposed method outperforms classic action transfer models such as FOMM and TPS on multiple quantitative evaluation metrics.Specifically,DBF achieves an L1 reconstruction error as low as 0.011 on the UvA-Nemo dataset.Furthermore,On the TaiChi dataset,which contains complex backgrounds and large-scale motions,both the average keypoint distance representing pose accuracy and the missing keypoint rate representing structural integrity are significantly improved.Quantitative and qualitative analysis results fully demonstrate that the DBF network can generate spatiotemporally coherent and visually realistic image sequences,exhibiting excellent performance in image structure reconstruction and texture restoration.关键词
动作迁移/人工智能/图像生成/光流/注意力/双分支网络Key words
motion transfer/artificial intelligence/image generation/optical flow/attention/dual-branch fusion network分类
信息技术与安全科学引用本文复制引用
金超群,齐俏..基于双分支融合网络的动作迁移设计[J].杭州师范大学学报（自然科学版）,2026,25(4):376-384,9.基金项目
浙江省自然科学基金项目(LQN25F010014) （LQN25F010014）
国家自然科学基金项目(62501222,62471170) （62501222,62471170）
浙江省重点研发计划项目(2021c03131) （2021c03131）
