计算机工程与应用2024，Vol.60Issue(19)：230-241,12.DOI:10.3778/j.issn.1002-8331.2307-0069
融合时空信息的Transformer单目标跟踪算法
Transformer Single Target Tracking Algorithm Integrating Spatio-Temporal Information
摘要
Abstract
At present,the mainstream single target tracking method based on twin network matches the target by calculating the similarity between the template and the search area,but lacks the use of the space-time state information of the target.Especially when there are multiple similar targets in the scene,twin network trackers often cannot accurately distinguish the targets,resulting in tracking errors.To solve these problems,a single target tracking algorithm(SIFTransT)based on spatio-temporal information fusion in Transformer is proposed.Firstly,the algorithm obtains preliminary tracking results through MixFormer(end-to-end tracking with iterative mixed attention)tracker.Secondly,a target state calculation module is designed to calculate and store the target state information,including target position,boundary frame,speed,accelera-tion,movement direction,etc.,in order to dig the target state information deeply.Finally,a spatial-temporal information fu-sion module based on Transformer is constructed,which uses the self-attention of encoder and cross-attention of decoder to deeply integrate the state information of the target in the latest period of time,so as to more accurately model the state of the target and improve the accuracy of target tracking.The experimental results on LaSOT data set show that compared with the benchmark algorithm MixFormer,SIFTransT algorithm has improved the AUC index by 2.8 percentage points,PNorm index by 2.6 percentage points and P index by 2.1 percentage points,and the average frame processing per second on the server equipped with RTX8000 graphics card has reached 28 frames.关键词
单目标跟踪/目标状态计算/注意力机制/时空信息融合Key words
single target tracking/target state calculation/attention mechanism/space-time information fusion分类
信息技术与安全科学引用本文复制引用
江进宝,宣士斌,付杰..融合时空信息的Transformer单目标跟踪算法[J].计算机工程与应用,2024,60(19):230-241,12.基金项目
国家自然科学基金(61866003) （61866003）
广西民族大学研究生教育创新计划(gxun-chxs2021063). （gxun-chxs2021063）
