计算机应用研究2024，Vol.41Issue(1)：39-44,6.DOI:10.19734/j.issn.1001-3695.2023.04.0213
基于非文本模态强化和门控融合方法的多模态情感分析
Multimodal sentiment analysis based on non-text modality reinforcement and gating fusion method
摘要
Abstract
To address the problems of information density gaps between modalities and the possibility of losing some sentiment information in the fusion process,this paper proposed a multimodal sentiment analysis model based on non-text modality rein-forcement and gating fusion method.The model reduced the gap with text modality by designing an audio-visual reinforcement module to achieve information enhancement of audio and visual modalities.Then,the cross-modal attention and gating fusion method allowed the model to fully learn the multimodal sentiment information and the original sentiment information to enhance the representation of the model.Experimental results on the aligned and unaligned CMU-MOSEI datasets show that the pro-posed model is effective and achieves better performances than some existing models.关键词
多模态情感分析/多模态融合/模态强化/门控机制Key words
multimodal sentiment analysis/multimodal fusion/modality reinforcement/gating mechanism分类
信息技术与安全科学引用本文复制引用
魏金龙,邵新慧..基于非文本模态强化和门控融合方法的多模态情感分析[J].计算机应用研究,2024,41(1):39-44,6.
