计算机应用与软件2024，Vol.41Issue(7)：56-60,5.DOI:10.3969/j.issn.1000-386x.2024.07.009
基于注意力机制和知识蒸馏的电影评分预测
MOVIE RATING PREDICTION BASED ON ATTENTION MECHANISM AND KNOWLEDGE DISTILLATION
摘要
Abstract
In view of the high time complexity of high-order interaction and the large size of complex problem solved by neural network in the simple factorization machines(FM),a knowledge distillation attention deep network(K-ADN)model is proposed based on the movie score prediction as an example.Combined with the attention network to distinguish the importance of interactive features,the attention value was obtained.Deep neural networks(DNN)were used to deal with the combination of high-order features,and the neural network model was established as the teacher model.Starting from the knowledge distillation technology,the teacher model was used to ensure the accuracy,and the student model was used to simplify the model size,so as to obtain more effective scoring prediction results.The experimental results based on Douban movie show that the accuracy of the model is improved,and the parameters are reduced by 86％after knowledge distillation.关键词
电影评分/深度神经网络/注意力网络/评分预测/知识蒸馏Key words
Movie rating/Deep neural network/Attention network/Scoring prediction/Knowledge distillation分类
信息技术与安全科学引用本文复制引用
刘彤,于思洁,倪维健..基于注意力机制和知识蒸馏的电影评分预测[J].计算机应用与软件,2024,41(7):56-60,5.基金项目
国家自然科学基金项目(71704096,61602278) （71704096,61602278）
青岛社科规划项目(QDSKL2001117). （QDSKL2001117）
