计算机工程与应用2025，Vol.61Issue(2)：179-190,12.DOI:10.3778/j.issn.1002-8331.2406-0108
基于多模态信息融合的中文隐式情感分析
Implicit Sentiment Analysis for Chinese Texts Based on Multimodal Information Fusion
摘要
Abstract
The lack of explicit sentiment words in implicit sentiment expressions poses certain challenges to implicit senti-ment analysis.In order to solve this problem,the paper can resort to external information,which is one of the methods for addressing implicit sentiment analysis.Different from the existing research that draws on single textual information,an implicit sentiment analysis method that incorporates multimodal information(including speech and video)is proposed.The method aids in understanding implicit sentiment by extracting acoustic features such as tone and intensity from speech and capturing visual features such as facial expressions from video.BiLSTM network is utilized to mine the con-textual information within each unimodal state.The text-related speech and visual features are captured separately by com-bining the multi-head mutual attention mechanism,and are iteratively optimized to reduce the low-order redundant infor-mation of non-textual modalities.In addition,the comprehensive performance of implicit sentiment analysis is enhanced by designing a text-centered cross-attention fusion module to strengthen the implicit text feature representation and deal with inter-modal heterogeneity.Experimental results on CMU-MOSI,CMU-MOSEI,and MUMETA datasets show that the proposed model outperforms other baseline models.This multimodal processing strategy for implicit sentiment analysis makes full use of speech and visual external knowledge to capture implicit sentiment expressions more comprehensively and accurately,effectively improving the accuracy of implicit sentiment analysis.关键词
隐式情感分析/深度神经网络/多模态/注意力机制/特征融合Key words
implicit sentiment analysis/deep neural networks/multimodal/attention mechanism/feature fusion分类
信息技术与安全科学引用本文复制引用
张换香,李梦云,张景..基于多模态信息融合的中文隐式情感分析[J].计算机工程与应用,2025,61(2):179-190,12.基金项目
内蒙古自然科学基金(2023MS06012) （2023MS06012）
自治区直属高校基本科研业务费项目(2024QNJS033,2024XKJX019). （2024QNJS033,2024XKJX019）
