| 注册
首页|期刊导航|计算机应用研究|基于自适应融合技术的多模态实体对齐模型

基于自适应融合技术的多模态实体对齐模型

任楚岚 于振坤 关超 井立志

计算机应用研究2025,Vol.42Issue(1):100-105,6.
计算机应用研究2025,Vol.42Issue(1):100-105,6.DOI:10.19734/j.issn.1001-3695.2024.05.0187

基于自适应融合技术的多模态实体对齐模型

Multi-modal entity alignment model based on adaptive fusion technology

任楚岚 1于振坤 1关超 1井立志1

作者信息

  • 1. 沈阳化工大学计算机科学与技术学院,沈阳 110142||辽宁省化工过程工业智能化技术重点实验室,沈阳 110142
  • 折叠

摘要

Abstract

Multi-modal entity alignment aims to identify equivalent entities between different multi-modal knowledge graphs composed of structured triples and images associated with entities.The existing research on multi-modal entity alignment main-ly focuses on multi-modal fusion strategies,ignoring the problems of modal imbalance and difficulty in integrating different mo-dalities,and fails to fully utilize multi-modal information.To solve these problems,this paper proposed the MACEA model,this model used the multi-modal variational autoencoder method to actively complete the missing modal information,the dy-namic modal fusion method to integrate and complement the information of different modalities,and the inter-modal contrastive learning method to model the inter-modal relations.These methods effectively solve the problems of modal missing and the dif-ficulty in modal fusion.Compared with the baseline model,MACEA improves the hits@1 and MRR indicators by 5.72%and 6.78%,respectively.The experimental results show that the proposed method can effectively identify aligned entity pairs,with high accuracy and practicality.

关键词

实体对齐/知识图谱/多模态/动态融合/模态缺失

Key words

entity alignment/knowledge graph/multi-modal/dynamic fusion/modality missing

分类

信息技术与安全科学

引用本文复制引用

任楚岚,于振坤,关超,井立志..基于自适应融合技术的多模态实体对齐模型[J].计算机应用研究,2025,42(1):100-105,6.

基金项目

辽宁省教育厅科学研究资助项目(LJKZ0449,LJKZ0434) (LJKZ0449,LJKZ0434)

计算机应用研究

OA北大核心

1001-3695

访问量0
|
下载量0
段落导航相关论文