中南民族大学学报（自然科学版）2026，Vol.45Issue(5)：674-682,9.DOI:10.20056/j.cnki.ZNMDZK.20260740
基于红外视频与音频联合的无人机目标检测
UAV target detection based on the integration of infrared video and audio
摘要
Abstract
To addressing the challenges of detecting small drones,such as weak targets,complex backgrounds,and potential confusion,a detection method based on multimodal information fusion is proposed.To enhance the accuracy and robustness of target detection,the proposed method employs infrared video and audio for initial target detection,subsequently obtaining the final detection result through decision-level fusion.For infrared video,the"tracking-then-detecting"approach is adopted,incorporating a dynamic saliency difference enhancement module.The module integrates gradient-grayscale features and motion information through a multimodal feature fusion mechanism,combined with a window scaling strategy guided by local entropy and time-domain motion verification,thereby enhancing the contrast between weak and small targets and the background.Additionally,a space-time trajectory coding and correlation module is introduced,utilizing an LSTM network for short-term trajectory feature extraction and trajectory-measurement matching degree calculation.The dynamic space-time fusion factor optimizes the data association process,addressing issues such as target occlusion and trajectory discontinuity.Regarding audio processing,the Mel spectrum is extracted and converted into logarithmic Mel spectral features,with a CNN model employed for acoustic feature recognition.Experimental results demonstrate that the proposed method outperforms existing methods in terms of accuracy(89.5%),recall(85.7%),and average precision(75.4%),providing an effective and feasible approach for drone target detection in complex environments.关键词
无人机目标检测/动态显著性增强/多模态融合/时空轨迹编码Key words
UAVs target detection/dynamic saliency enhancement/multimodal fusion/spatiotemporal trajectory encoding分类
信息技术与安全科学引用本文复制引用
常聚忠,姚其新,杨振东,黄瑶玲,胡生辉..基于红外视频与音频联合的无人机目标检测[J].中南民族大学学报（自然科学版）,2026,45(5):674-682,9.基金项目
国网湖北省电力有限公司科技资助项目(521521240005) （521521240005）
