现代电子技术2024,Vol.47Issue(23):49-54,6.DOI:10.16652/j.issn.1004-373x.2024.23.008
基于无人机视频流的实时拼接方法研究
Research on real-time stitching based on UAV video streaming
刘彬 1梁攀攀 1卢迪 2靳冉1
作者信息
- 1. 陆装驻洛阳地区航空军代室,河南 洛阳 471000
- 2. 陆装驻株洲地区航空军代室,湖南 株洲 412000
- 折叠
摘要
Abstract
The real-time stitching method of UAV video stream is studied in depth,and a UAV video stream real-time stitching method based on multi-threaded parallel processing is proposed,which aims to cope with the difficulties of real-time stitching of UAV video stream.This method decomposes the real-time video stitching into a multi-threaded working mode by using the characteristic of computer parallel computing fully.The multi-threaded working mode is mainly composed of image registration thread,nonlinear optimization thread,closed-loop detection thread and image stitching thread.The image registration thread realizes the adaptive extraction and registration of video key frame,including feature point detection,feature point matching and image rough registration.The nonlinear optimization thread completes the dynamic optimization of the stitching parameter model to minimize the registration error and correct the error generated by real-time registration timely.The closed-loop detection thread detects the closed image pairs existing in the current frame and the historical frame,and performs nonlinear global optimization on the closed image pairs to minimize the global registration error.The image stitching thread generates the stitched image dynamically according to the optimized registration parameters.The validity and practicability of the method are verified by four groups of experimental data.It can be seen that the proposed method can eliminate the cumulative error of multi-frame stitching effectively and realize the real-time stitching of UAV video stream.关键词
无人机视频/多线程/并行处理/图像配准/非线性优化/闭环检测/累积误差/实时拼接Key words
UAV video/multithreading/parallel processing/image registration/nonlinear optimization/closed-loop detection/accumulated error/real-time stitching分类
电子信息工程引用本文复制引用
刘彬,梁攀攀,卢迪,靳冉..基于无人机视频流的实时拼接方法研究[J].现代电子技术,2024,47(23):49-54,6.