| 注册
首页|期刊导航|计算机技术与发展|SGFusion:稀疏感知门控的多模态三维目标检测

SGFusion:稀疏感知门控的多模态三维目标检测

陈昊东 沈世全 李颖涛 王青旺 陈峥 赵杰 秦宗权 王艳锋

计算机技术与发展2026,Vol.36Issue(9):64-70,78,8.
✕
计算机技术与发展2026,Vol.36Issue(9):64-70,78,8.DOI:10.20165/j.cnki.ISSN1673-629X.2026.0065

SGFusion:稀疏感知门控的多模态三维目标检测

SGFusion:3D Object Detection of Multi-modal with Sparsity-aware Gating

陈昊东 1沈世全 2李颖涛 3王青旺 1陈峥 3赵杰 4秦宗权 4王艳锋4

作者信息

  • 1. 昆明理工大学 信息工程与自动化学院,云南 昆明 650500
  • 2. 昆明理工大学 信息工程与自动化学院,云南 昆明 650500||昆明理工大学 交通工程学院,云南 昆明 650500||昆明理工大学 未来交通创新研究院,云南 昆明 650500
  • 3. 昆明理工大学 交通工程学院,云南 昆明 650500
  • 4. 昆明云内动力股份有限公司,云南 昆明 650000
  • 折叠

摘要

Abstract

In autonomous driving perception,3D object detection often suffers from limited sensing modalities,leading to insufficient spa-tial modeling capability and degraded robustness,especially at long ranges and under heavy occlusions.Conventional single-modal meth-ods based on LiDAR or cameras alone struggle to provide stable and accurate detection in such challenging conditions.To address these issues,we propose SGFusion,a structure-aware multi-modal 3D object detection framework operating in Bird's Eye View(BEV)space.SGFusion integrates complementary LiDAR and image features to improve both accuracy and robustness.Specifically,a depth supervision signal derived from LiDAR point clouds is first introduced to provide explicit geometric priors for image BEV features,thereby enhancing the spatial consistency of cross-modal representations.On this basis,a sparsity-aware gated dual-attention mechanism(Sparsity-aware Gated Dual Attention,SGDA)is proposed to explicitly align geometric and semantic information between modalities in BEV space,while an input-dependent gating branch imposes sparsity on the cross-modal attention responses and adaptively reweights them according to the scene context.This design effectively suppresses depth-estimation artifacts and misalignment noise,and enhances robustness in complex driving scenes.Experiments on the nuScenes benchmark demonstrate that SGFusion achieves a mean Average Precision(mAP)of 74.9%and a nuScenes Detection Score(NDS)of 75.5%on the test set,outperforming representative single-modal and multi-modal baselines.

关键词

鸟瞰图/三维目标检测/多模态融合/稀疏感知/门控注意力/自动驾驶

Key words

Bird's Eye View(BEV)/3D object detection/multi-modal fusion/sparse perception/gated attention/autonomous driving

分类

信息技术与安全科学

引用本文复制引用

陈昊东,沈世全,李颖涛,王青旺,陈峥,赵杰,秦宗权,王艳锋..SGFusion:稀疏感知门控的多模态三维目标检测[J].计算机技术与发展,2026,36(9):64-70,78,8.

基金项目

云南省科技重点研发计划(202503AA080020) (202503AA080020)

国家自然科学基金项目(52272395) (52272395)

云南省基础研究项目(202401AS070118) (202401AS070118)

计算机技术与发展

1673-629X

访问量0
|
下载量0
段落导航相关论文