计算机工程2024，Vol.50Issue(1)：91-100,10.DOI:10.19678/j.issn.1000-3428.0066929
基于多模态融合的图神经网络推荐算法
Graph Neural Network Recommendation Algorithm Based on Multimodal Fusion
摘要
Abstract
Many existing Graph Neural Network(GNN)recommendation algorithms use the node number information of the user-item interaction graph for training and learn the high-order connectivity among user and item nodes to enrich their representations.However,user preferences for different modal information are ignored,modal information such as images and text of items are not utilized,and the fusion of different modal features is summed without distinguishing the user preferences for different modal information types.A multimodal fusion GNN recommendation model is proposed to address this problem.First,for a single modality,a unimodal graph network is constructed by combining the user-item interaction bipartite graph,and the user preference for this modal information is learned in the unimodal graph.Graph ATtention(GAT)network is used to aggregate the neighbor information and enrich the local node representation,and the Gated Recurrent Unit(GRU)is used to decide whether to aggregate the neighbor information to achieve the denoising effect.Finally,the user and item representations learned from each modal graph are fused by the attention mechanism to obtain the final representation and then sent to the prediction module.Experimental results on the MovieLens-20M and H&M datasets show that the multimodal information and attention fusion mechanism can effectively improve the recommendation accuracy,and the algorithm model has significant improvements in Precision@K,Recall@K,and NDCG@K compared with the baseline optimal algorithm for the three indicators.When an evaluation index K value of 10 is selected,Precision@10,Recall@10,and NDCG@10 increase by 4.67%,2.42%,2.03%,and 2.49%,5.24%,2.05%,respectively,for the two datasets.关键词
多模态推荐/多模态融合/注意力机制/图神经网络/推荐系统/门控图神经网络Key words
multimodal recommendation/multimodal fusion/attention mechanism/Graph Neural Network(GNN)/recommendation system/gated Graph Neural Network(GNN)分类
信息技术与安全科学引用本文复制引用
吴志强,解庆,李琳,刘永坚..基于多模态融合的图神经网络推荐算法[J].计算机工程,2024,50(1):91-100,10.基金项目
国家自然科学基金(62276196) （62276196）
重庆市自然科学基金(cstc2021jcyj-msxmX1013) （cstc2021jcyj-msxmX1013）
湖北省重点研发计划项目(2021BAA030). （2021BAA030）
