四川大学学报(自然科学版)2024,Vol.61Issue(3):136-143,8.DOI:10.19907/j.0490-6756.2024.032005
基于多光谱交互注意力融合的多尺度无人机小目标检测
Multiscale UAV small target detection based on multispectral interactive attention fusion
摘要
Abstract
Aiming at the challenges in UAV detection,such as small target size,significant influence by back-ground environment,and difficulties in deep fusion of multispectral features,this paper proposes a multiscale multispectral interactive attention fusion target detection model for small UAV target identification.Firstly,the backbone network is designed as a dual-flow network to extract the infrared and visible features at differ-ent scales,with the addition of small target detection layer and BiFPN cascade operation to enhance the ex-traction capability of UAV small target features.Secondly,an innovative multispectral interactive attention fu-sion module is designed.Under the guidance of this fusion module,the network can fuse the infrared and vis-ible modalities'information at different scales,allowing for deep aggregation of their repective features,lever-aging the strengths of each modality,and guiding the UAV small target detection.The experimental results demonstrate that compared to state-of-the-art multispectral target detection models,the model proposed in this paper achieves superior performance on the two public multispectral target detection datasets,FLIR and LLVIP.Furthmore,on the constructed multispectral UAV dataset,the proposed model effectively improves UAV detection accuracy and robustness of UAV.关键词
无人机检测/小目标检测/多光谱交互注意力融合/多尺度Key words
UAV detection/Small target detection/Multispectral interactive attention fusion/Multiscale分类
信息技术与安全科学引用本文复制引用
吴长柯,陈虎,潘涛,黄菊,刘洪,张萍,吴志红,苏强..基于多光谱交互注意力融合的多尺度无人机小目标检测[J].四川大学学报(自然科学版),2024,61(3):136-143,8.基金项目
国家自然科学基金重点项目(U20A20161) (U20A20161)