计算机应用研究2026，Vol.43Issue(2)：342-352,11.DOI:10.19734/j.issn.1001-3695.2025.06.0214
基于统一对齐与多阶段融合机制的多模态情感分析模型
Multimodal sentiment analysis model based on unified alignment and multi-stage fusion
摘要
Abstract
To address the modality heterogeneity,time-varying contributions,and limited semantic abstraction in multimodal sentiment analysis,this paper proposed a three-stage closed-loop fusion model(MIFA).Specifically,it followed an align-ment-regulation-abstraction fusion path that comprised unified semantic alignment,dynamic fusion regulation,and hierarchical semantic abstraction.Firstly,this model used unified semantic alignment to express heterogeneous modalities in a shared space.Next,it used contextual gating and channel modulation to estimate modality/channel weights and refine representa-tions.Finally,it used a hierarchical residual abstraction to enhance discriminative features,forming an end-to-end closed loop.Experiments on CMU-MOSI and CMU-MOSEI show that MIFA achieves Acc2 of 86.43％/86.03％and F,of 86.42％/85.81％,Acc7 reaches 45.04％/50.41％,and MAE is 0.689/0.532,outperforming mainstream baselines.These results indicate that MIFA stabilizes cross-modal alignment and adaptively regulates information flow,improves sentiment classification and intensity regression,and offers practical potential for complex multimodal scenarios.关键词
多模态情感分析/跨模态特征融合/统一语义对齐/动态融合调控/分层残差机制/跨模态鲁棒性Key words
multimodal sentiment analysis/cross-modal feature fusion/unified semantic alignment/dynamic fusion regula-tion/hierarchical residual mechanism/cross-modal robustness分类
信息技术与安全科学引用本文复制引用
冯广,刘馨婷,林忆宝,赵志文,肖俊鸿,周科栋,黄俊辉..基于统一对齐与多阶段融合机制的多模态情感分析模型[J].计算机应用研究,2026,43(2):342-352,11.基金项目
国家自然科学基金重点资助项目(62237001) （62237001）
广东省哲学社会科学青年项目(GD23YJY08) （GD23YJY08）
