| 注册
首页|期刊导航|青岛大学学报(自然科学版)|基于细粒度文本特征融合的跨模态单目深度估计模型

基于细粒度文本特征融合的跨模态单目深度估计模型

谭莉 王文龙 周萌萌 刘小娇 杨杰

青岛大学学报(自然科学版)2026,Vol.39Issue(2):40-47,8.
✕
青岛大学学报(自然科学版)2026,Vol.39Issue(2):40-47,8.DOI:10.3969/j.issn.1006-1037.2026.02.06

基于细粒度文本特征融合的跨模态单目深度估计模型

Cross-modal Monocular Depth Estimation Model Based on Fine-grained Textual Feature Fusion

谭莉 1王文龙 1周萌萌 2刘小娇 3杨杰1

作者信息

  • 1. 青岛大学机电工程学院,青岛 266071
  • 2. 青岛联合创智科技有限公司,青岛 266100
  • 3. 海逸恒安项目管理有限公司青岛事业部,青岛 250011
  • 折叠

摘要

Abstract

In the field of monocular depth estimation for complex scenes,a key problem is the occurrence of depth discontinuities and blurred edges caused by irregular objects such as people or animals.To address this issue,a model named Multiple Fine-Grained Textual Features Fusion for Monocular Depth Estimation(MFGT-Depth)was designed.The Gaussian Mixture Model(GMM)was used to probabilistically model latent semantic hier-archy and complex relationships among descriptions.For efficient cross-modal alignment,the cross-modal module then adaptively fused the text features and the image features ex-tracted by the image encoder.Experiments show that MFGT-Depth achieves significant improvements in major metrics on training datasets,reducing RMSE by 4.8%on the KITTI dataset,and exhibits strong generalization with significantly improved accuracy and robustness for depth estimation in scenes with irregular objects relative to Depth Any-thing V2.

关键词

单目深度估计/文本特征融合/高斯混合模型/细粒度/跨模态/深度学习/计算机视觉

Key words

monocular depth estimation/textual feature fusion/Gaussian Mixture Model/fine-grained/cross-modal/deep learning/computer vision

分类

信息技术与安全科学

引用本文复制引用

谭莉,王文龙,周萌萌,刘小娇,杨杰..基于细粒度文本特征融合的跨模态单目深度估计模型[J].青岛大学学报(自然科学版),2026,39(2):40-47,8.

基金项目

山东省自然科学基金(批准号:ZR2021MF025)资助. (批准号:ZR2021MF025)

青岛大学学报(自然科学版)

1006-1037

访问量0
|
下载量0
段落导航相关论文