计算机工程与应用2026，Vol.62Issue(11)：140-150,11.DOI:10.3778/j.issn.1002-8331.2504-0159
跨模态特征一致性对齐下的多模态情感分析
Multimodal Sentiment Analysis Under Cross-Modal Feature Consistency Alignment
崔文成 1孙佳惠 1邵虹1
作者信息
- 1. 沈阳工业大学 信息科学与工程学院,沈阳 110870
- 折叠
摘要
Abstract
Current multimodal data-based sentiment analysis methods have made significant progress in feature modeling and modal interaction,but there are still problems such as insufficient feature extraction and insufficient inter-modal semantic alignment,which can easily lead to the increase of redundant information and limited cross-modal interaction.This paper proposes a multimodal sentiment analysis method based on cross-modal feature consistency alignment.Firstly,based on the characteristics of each modal data,a three-branch feature extraction sub-network is designed to model the deep-level representation of textual,visual and auditory modalities respectively.Secondly,in order to mitigate the impact of modal inconsistency on the fusion effect,a cross-modal feature consistency alignment module is constructed,and an interme-diate layer supervisory mechanism is introduced to improve the alignment quality.Finally,the cross-modal Transformer fusion module is proposed to realize deep-level semantic interaction and emotion fusion modeling among multimodalities.Seven classification experiments are carried out on CMU-MOSI and CMU-MOSEI datasets,and the accuracies are improved by 3.7 and 6.4 percentage points,respectively,which verifies the effectiveness and robustness of the proposed model in multi-modal emotion recognition tasks.关键词
多模态情感分析(MSA)/多模态特征嵌入/跨模态特征一致性对齐/模态融合/Transformer模型Key words
multimodal sentiment analysis(MSA)/multimodal feature embedding/cross-modal feature consistency align-ment/modal fusion/Transformer model分类
信息技术与安全科学引用本文复制引用
崔文成,孙佳惠,邵虹..跨模态特征一致性对齐下的多模态情感分析[J].计算机工程与应用,2026,62(11):140-150,11.
