软件导刊2023,Vol.22Issue(12):63-70,8.DOI:10.11907/rjdk.222499
基于多模态信息相关度计算的计算机教育领域实体链接
Entity Linking in the Field of Computer Education Based on Multi-modal Information Relevance Calculation
摘要
Abstract
In the field of education,the knowledge system in the discipline is usually linked to construct the discipline knowledge graph.How-ever,because the knowledge system is not immutable,it is particularly important to update the discipline knowledge graph.As a basic technol-ogy of building and updating knowledge graph,entity link is very critical.Therefore,in order to update the multi-modal knowledge graph in computer field,the paper proposed a visual entity linkage method.Firstly,we used YOLOV5 to identify the visual entities in the image.By combining visual entities,the triples in image text description were extracted and filtered.Secondly,we proposed a visual entity link rule(VELR)for the computer field.In order to effectively complete the link,the image visual entity and the head and tail entity of the filtered trip-let were used successively to find the best link point.We set different link strategies for different link points.The rules made full use of image visual entities and filtered triples to expand the linked entities.Finally,the triplet classification experiment shows that the proposed method is correct to realize the triplet generated by the linkage of multi-modal knowledge graph in the field of computer science,which proves the validi-ty of the proposed method.关键词
计算机学科/多模态知识图谱/实体链接/视觉实体/文本描述Key words
computer science/multi-modal knowledge graph/entity linking/visual entity/text description分类
信息技术与安全科学引用本文复制引用
郭沛,王会勇,张晓明..基于多模态信息相关度计算的计算机教育领域实体链接[J].软件导刊,2023,22(12):63-70,8.基金项目
河北省自然科学基金项目(F2022208002) (F2022208002)
河北省高等学校科学技术研究重点项目(ZD2021048) (ZD2021048)