首页|期刊导航|舰船电子工程|基于多模态知识图谱的服装推荐算法

基于多模态知识图谱的服装推荐算法OA

Multi-modal Clothing Recommendation Algorithm Based on Knowledge Graph

中文摘要英文摘要

现有的服装推荐算法存在模型可解释性不强,用户信息聚合不够全面的问题.论文引入了双聚合优化策略,对KGAT模型进行了改建,以此为基础设计了一种基于多模态知识图谱的服装推荐模型——MDPKT.该模型将文本信息(用户品牌信息、服装主体属性等)以及视觉信息(服装图片)数据来源,转换为作为知识协作知识图,将品牌信息、服装主体的协作知识图传入到改进后的KGAT模型中;将服装图片视觉协作知识图传入到Resnet50预训练模型训练,将两类模型提取到的特征值传入图神经网络进行表示学习.引入的双聚合优化策略,能够动态地选择用户层以及项目层的最佳聚合跳数,使得信息的流通更为完备;改进后的KGAT更好地挖掘用户与项目之间的潜在偏好关系,可以有效提升模型的精确度.该模型在IQON10数据集以及IQON3000数据集上进行了实验,结果表明,该模型与其他基准模型相比可以获得更好的性能,论文模型在IQON10数据集上的提升效果更为明显,与SOTA模型相比,MDPKT在AUC、Recall@20、NDCG@20各个指标上分别有5.99%、5.12%、5.01%的显著提升,在IQON3000上这些指标分别提升了4.71%,8.1%和4.21%.

The existing clothing recommendation algorithms have problems with weak interpretability of models and incom-plete aggregation of user information.This article presents a novel clothing recommendation model called the multi-modal dual poli-cy knowledge graph(MDPKT),which enhances interpretability and aggregates user information more effectively.The MDPKT mod-el integrates multi-modal data—textual information like brand and clothing attributes,and visual data from clothing images—into a unified knowledge graph.It employs an improved KGAT model and a ResNet50 pre-training model to process textual and visual da-ta,respectively.A key feature the paper introduced in is the dual aggregation optimization strategy,which optimally selects the num-ber of aggregation hops for both users and items,improving information flow and model accuracy.The model is experimented on the IQON10 dataset and the IQON3000 dataset.The results show that this model can achieve better performance compared with other benchmark models.The improvement effect of the model proposed in this paper on the IQON10 dataset is more obvious.Compared with the SOTA model,MDPKT has significant improvements of 5.99%,5.12%,and 5.01%in AUC,Recall@20,and NDCG@20 re-spectively.On the IQON3000 dataset,these indicators have increased by 4.71%,8.1%,and 4.21%respectively.

万晓慧;李维乾;贺妮;邓玉琼

西安工程大学计算机科学学院 西安 710600西安工程大学计算机科学学院 西安 710600西安工程大学计算机科学学院 西安 710600西安工程大学计算机科学学院 西安 710600

计算机与自动化

服装推荐算法多模态知识图谱双聚合策略

fashion recommendationmulti-modelknowledge graphdual aggregation policy

《舰船电子工程》 2025 (3)

126-132,7

教育部重点实验室开放基金项目(编号:NS202118901)资助.

10.3969/j.issn.1672-9730.2025.03.026

评论