计算机工程与应用2024，Vol.60Issue(13)：36-50,15.DOI:10.3778/j.issn.1002-8331.2309-0481
多模态知识图谱融合技术研究综述
Research and Comprehensive Review on Multi-Modal Knowledge Graph Fusion Techniques
摘要
Abstract
Multi-modal knowledge graphs(MMKG)integrate various modal information such as vision and text,presenting knowledge structures graphically.With the advancement of artificial intelligence,MMKG have played a significant role in recommendation systems,intelligent Q&A,and knowledge search among other fields.Compared to traditional knowledge graphs,MMKG can understand and present knowledge in multiple dimensions,possessing superior representation and application capabilities.To delve deep into the study of MMKG,this review first conducts a detailed analysis and elucida-tion of the value and categories of MMKG.Based on different construction methods,it compares and summarizes multi-modal knowledge extraction,representation learning,entity alignment,and other aspects,categorizes multi-modal knowl-edge integration methods.It analyzes the progress in the applications of MMKG,discusses the limitations of MMKG,and proposes future research directions in the field of MMKG.关键词
多模态知识图谱/语言模型/融合技术/预训练技术Key words
multi-modal knowledge graph/language model/fusion techniques/pretraining techniques分类
信息技术与安全科学引用本文复制引用
陈囿任,李勇,温明,孙驰..多模态知识图谱融合技术研究综述[J].计算机工程与应用,2024,60(13):36-50,15.基金项目
新疆自治区重点研发计划(2022B01007-1) （2022B01007-1）
国家自然科学基金(62241209) （62241209）
新疆自治区自然科学基金(2022D01A225). （2022D01A225）
