山西大学学报（自然科学版）2026，Vol.49Issue(1)：15-28,14.DOI:10.13451/j.sxu.ns.2025090
基于方面词感知的多模态细粒度情感分析
Multimodal Fine-grained Sentiment Analysis Based on Aspect Perception
摘要
Abstract
The existing multimodal fine-grained sentiment analysis models have problems of insufficient extraction of textual and vi-sual features and neglect of guiding role of aspect during modality fusion.To address these issues,an aspect percept multimodal fine-grained sentiment analysis model was proposed.Firstly,a semantic alignment module was designed to capture aspect clues in imag-es,enhancing aspect awareness.Secondly,an aspect-oriented syntactic dependency graph and an emotion syntactic graph attention network were constructed to explore complex dependency relationships related to aspect in the text from multiple perspectives.Thirdly,a multi-feature encoding module was developed to extract rich visual feature clues.Finally,a dual cross-attention mecha-nism was introduced to obtain bidirectional interaction information between text and image modalities.The quality of aspect features was further improved using a gated semantic graph convolutional network and an aspect masking mechanism,while an attention mechanism was employed for aspect percept modality fusion.The experimental results demonstrated that,compared to baseline models,the proposed model achieved average accuracy improvements of 3.00 and 2.78 percentage points on the Twitter-2015 and Twitter-2017 public datasets,respectively,along with average Macro-F1 score increases of 3.50 and 2.53 percentage points.These findings confirmed the model's effectiveness in enhancing the performance of multimodal fine-grained sentiment analysis.关键词
句法依赖图/多特征编码/情感句法图注意力网络/门控语义图卷积网络Key words
syntactic dependency graph/multi-feature encoding/emotion syntax graph attention network/gated semantic graph con-volutional network分类
信息技术与安全科学引用本文复制引用
郝雅卉,谢珺,郝戍峰,孙颖,连浩毅,杨文秀..基于方面词感知的多模态细粒度情感分析[J].山西大学学报（自然科学版）,2026,49(1):15-28,14.基金项目
虚拟现实技术与系统全国重点实验室(北京航空航天大学)开放课题基金(VRLAB2022C11) （北京航空航天大学）
山西省重点研发计划项目(202102020101004) （202102020101004）
山西省回国留学人员科研教研资助项目(2024-61) （2024-61）
