首页|期刊导航|运筹与管理|融合注意力机制的残差神经协同过滤推荐模型

融合注意力机制的残差神经协同过滤推荐模型OA北大核心CHSSCDCSSCICSTPCD

Residual Neural Collaborative Filtering Recommendation Model Based on Attention Mechanism

中文摘要英文摘要

基于深度学习的推荐模型由于能够较充分地发掘数据中蕴含的低阶与高阶特征,展现出良好的应用潜力.由于推荐领域的数据非常稀疏且各用户的数据差异很大,在使用深度学习模型捕捉数据的高阶特征时很容易出现梯度异常的问题.同时,在融合数据的高阶特征和低阶特征时,当前的研究鲜有考虑用户的个性化偏好.为了解决上述问题,本文将残差的概念引入基于深度学习的推荐算法中,提出了一种融合注意力机制的残差神经协同过滤模型.该模型首先利用多层神经网络来提取用户和项目间的高阶特征,然后借助残差结构来传递低阶特征,防止梯度消失问题.同时,本文模型借助注意力机制来融合高阶特征与低阶特征,为不同用户分配不同的特征权重,以便更充分地反映用户的个性化偏好,提升推荐质量.在三个真实数据集上的实验显示,本文模型在各个推荐指标上均优于当前主要的同类型方法,有效提高了推荐系统的性能,具有良好的应用潜力.

With the development of Internet technology,online users usually need to spend a lot of time and effort searching the content they are interested in from the huge amount of information,so the problem with information overload arises.As the most simple and efficient information filtering technique,recommender systems(RS)can fully analyze the previous preference behaviors of users and build recommendation models to predict user prefer-ences,and recommend items most likely to be of interest to active users,which greatly improves user satisfaction and effectively alleviates the information overload problem.Especially,recommendation models based on deep learning(DL)show good application potential owing to making full use of the low-order and high-order features contained in the data.However,DL-based recommendation models are prone to the problem with gradient disap-pearance when capturing the high-order features because of data sparseness and user differentiation.Meanwhile,to the best of our knowledge,few studies consider personalized user preferences when integrating the high-order and low-order features. To address the above issues,this paper introduces the concept of residual into a DL-based recommendation model and proposes a residual neural collaborative filtering model integrating attention mechanism.Firstly,our model adopts a multi-layer neural network to effectively extract the high-order features between users and items;and a dense residual connection is used to transfer the low-order features to the hidden layer at the back end of the network,which can avoid the information loss caused by the layer-by-layer transmission of information in the traditional multi-layer perceptron(MLP).Subsequently,in consideration of the personalized recommendation needs of different users,we use an attention mechanism to adaptively integrate the low-order and high-order features to generate a set of feature vectors that can better express the preferences of different users.Finally,the preference ratings for all items are evaluated according to the feature vectors,and selecting Top-K items is recom-mended to target users through a sorting method. To validate the effectiveness of the proposed model,three public datasets with different sparse levels are used for the experiments.And,four evaluation metrics,namely Precision,Recall,F1 value,and NDCG,are used to test the performance of our model.Firstly,we design ablation experiments to illustrate the advantages of the used residual channel and attention mechanism.The experimental results show that our model achieves the best results among them,which indicates that both the residual channel and attention mechanism can better capture the user interest points and improve the recommendation accuracy of the model.Then,we compare four representative methods,called MF,NCF,AFN,and Wide & Deep,to further verify the effectiveness of the proposed model.The results show that our model has the better performances compared with the comparison methods in terms of various evaluation metrics on all datasets.Compared with the closest competitor,Wide &Deep,the performance of our model will increase by at least 5%and 2.6%when the length of recommendation list is fixed to 10 in the metrics Fl value and NDCG,respectively.Thus,the proposed model effectively improves the quality of RSs and has good application value. The main limitation of our model in this paper is that it only utilizes implicit feedback information to predict user preferences,while ignoring the influence of explicit feedback information,e.g.,ratings,reviews,etc.,on the degree of user preferences,making this model unable to take into account the consistency and reliability of user purchase intentions and interest preferences.Therefore,future work can be done in two aspects.On the one hand,we can effectively integrate the two types of information to fully capture the common features of users'real prefer-ences to enhance the prediction ability and recommendation reliability of the proposed model.On the other hand,user's demands for diversity should be considered to balance the relationship between accuracy and diversity.

王永;李行健;邓江洲

重庆邮电大学经济管理学院,重庆 400065重庆邮电大学经济管理学院,重庆 400065重庆邮电大学经济管理学院,重庆 400065

计算机与自动化

推荐算法残差注意力机制协同过滤

recommended algorithmresidualattention mechanismcollaborative filtering

《运筹与管理》 2024 (10)

201-208,8

国家自然科学基金资助项目(62272077,72301050)教育部人文社科规划基金项目(20YJAZH102)重庆市自然科学基金面上项目(cstc2021jcyj-msxmX0557)

10.12005/orms.2024.0340

评论