| 注册
首页|期刊导航|计算机与数字工程|基于多层Transformer的细粒度图像-文本检索算法

基于多层Transformer的细粒度图像-文本检索算法

龚安 李丙寒

计算机与数字工程2026,Vol.54Issue(3):601-606,6.
计算机与数字工程2026,Vol.54Issue(3):601-606,6.DOI:10.3969/j.issn.1672-9722.2026.03.003

基于多层Transformer的细粒度图像-文本检索算法

Fine-grained Image-text Retrieval Algorithm Based on Multi-layer Transformer

龚安 1李丙寒1

作者信息

  • 1. 中国石油大学(华东)计算机科学与技术学院 青岛 266580
  • 折叠

摘要

Abstract

Most traditional deep learning-based image-text retrieval algorithms use CNN and RNN networks to encode image and text data.Such methods cannot fully exploit the fine-grained interaction information across modalities.To address this problem,a Transformer-based image-text retrieval network is proposed.It models the fine-grained interactions within and between modalities through two multilayer Transformer modules respectively,while using a CCA-based feature fusion method to obtain a higher quality feature representation.Finally it maximizes the relevance of paired samples through a feature similarity matrix.Comparative experi-ments conducted on two benchmark datasets,Wikipedia and Pascal Sentence,validate the effectiveness of the paper's approach.

关键词

图像-文本检索/Transformer/细粒度交互/相似度矩阵

Key words

image-text retrieval/Transformer/fine-grained interaction/similarity matrix

分类

信息技术与安全科学

引用本文复制引用

龚安,李丙寒..基于多层Transformer的细粒度图像-文本检索算法[J].计算机与数字工程,2026,54(3):601-606,6.

基金项目

中央高校基本科研业务费专项资金(编号:20CX05019A) (编号:20CX05019A)

中石油重大科技项目(编号:ZD2019-183-004)资助. (编号:ZD2019-183-004)

计算机与数字工程

1672-9722

访问量0
|
下载量0
段落导航相关论文