智能系统学报2024，Vol.19Issue(2)：335-343,9.DOI:10.11992/tis.202303009
基于抽象关系场景图的图像情感识别
Image sentiment recognition based on the abstract relational scene graph network
摘要
Abstract
Image sentiment recognition is an abstract process of forecasting human emotions by analysis of various visu-al stimuli.Most of the earlier literature does not focus on the relationships among objects and the interactions between objects and scenes,and the complex and diverse relationships among objects are difficult to fully exploit,resulting in difficulty in correctly forecasting image sentiment.To deal with this problem,we develop an abstract relational scene graph network for image sentiment recognition.First,an object and attribute detector is generated to extract object fea-tures and their corresponding attribute features from images.Second,the affinities and abstract relationship features among objects are inferred through object features,and then the abstract relational scene graph is generated.Moreover,an abstract relational graph convolutional network is developed for reasoning the abstract relational scene graph.Last,a progressive attention mechanism is designed to fuse multiple object features to acquire the overall object feature of the image.Application on three public datasets,FI,EmotionRoI,and Twitter I,demonstrates that the classification accuracy of the proposed method is better than that of the existing methods.关键词
图像情感识别/抽象关系/场景图/图卷积网络/注意力机制/卷积神经网络/视觉情感分析/深度学习Key words
image sentiment recognition/abstract relationship/scene graph/graph convolutional network/attention mechanism/convolutional neural network/visual sentiment analysis/deep learning分类
计算机与自动化引用本文复制引用
康博,钱艺,文益民..基于抽象关系场景图的图像情感识别[J].智能系统学报,2024,19(2):335-343,9.基金项目
国家自然科学基金项目(62366011) （62366011）
广西重点研发计划项目(桂科AB21220023) （桂科AB21220023）
广西图像图形与智能处理重点实验室项目(GIIP 2306). （GIIP 2306）
