| 注册
首页|期刊导航|北京航空航天大学学报|细粒度语义增强的民航图文跨模态检索方法

细粒度语义增强的民航图文跨模态检索方法

刘姝妍 何柳 曾江辉

北京航空航天大学学报2026,Vol.52Issue(9):3075-3088,14.
✕
北京航空航天大学学报2026,Vol.52Issue(9):3075-3088,14.DOI:10.13700/j.bh.1001-5965.2025.0549

细粒度语义增强的民航图文跨模态检索方法

Fine-grained semantic-enhanced cross-modal image-text retrieval method for civil aviation

刘姝妍 1何柳 2曾江辉1

作者信息

  • 1. 中国航空综合技术研究所 标准数据技术研究部,北京 100028||中国航空综合技术研究所 工业互联网应用创新中心,北京 100028
  • 2. 中国航空综合技术研究所 标准数据技术研究部,北京 100028||中国航空综合技术研究所 工业互联网应用创新中心,北京 100028||复旦大学 计算机科学技术学院,上海 200438
  • 折叠

摘要

Abstract

In the fields of low-altitude economy and civil aviation,security assurance tasks heavily rely on the efficient correlation of cross-modal information such as images and texts.However,while mainstream cross-modal retrieval models perform well on general datasets,they underperform in these areas,which require high levels of fine-grained semantic understanding.Based on existing civil aviation datasets,a cross-modal retrieval approach with fine-grained semantic augmentation is suggested as a solution to this problem,creating a whole pipeline that includes data processing,model development,and training.First,text descriptions are optimized and enhanced based on a large multimodal model to construct a cross-modal retrieval dataset containing rich semantic information.Second,a model is created using a popular cross-modal retrieval framework.To improve the model's ability to express fine-grained semantic features,techniques such class supervision,key semantic information masking,and a fine-grained feature extraction module are introduced.Experimental results on two datasets verify the effectiveness of the proposed method,providing a reference technical path for cross-modal retrieval in low-altitude economy scenarios.

关键词

低空经济/民用航空/跨模态检索/文本描述优化/细粒度语义增强

Key words

low-altitude economy/civil aviation/cross-modal retrieval/text description optimization/fine-grained semantic enhancement

分类

航空航天

引用本文复制引用

刘姝妍,何柳,曾江辉..细粒度语义增强的民航图文跨模态检索方法[J].北京航空航天大学学报,2026,52(9):3075-3088,14.

基金项目

工业和信息化部民机专项科研项目(MJZ2-3N21) Civil Aircraft Special Research Project of the Ministry of Industry and Information Technology(MJZ2-3N21) (MJZ2-3N21)

北京航空航天大学学报

1001-5965

访问量0
|
下载量0
段落导航相关论文