南京邮电大学学报（自然科学版）2024，Vol.44Issue(3)：48-62,15.DOI:10.14132/j.cnki.1673-5439.2024.03.007
无人机场景下基于Transformer的轻量化行人重识别
Transformer based lightweight person re-identification in unmanned aerial vehicle images
摘要
Abstract
Person re-identification(ReID)in the unmanned aerial vehicle(UAV)surveillance scenario has multi-viewpoints and multi-scales,and traditional convolutional neural network(CNN)-based methods for ReID suffer from the distribution of receptive fields and downsampling operators.These methods are hard to extract global features of pedestrian images,resulting in low image resolution in the feature space.A lightweight transformer-based person Re-Id(LTReID)method is proposed to utilize the attention-based method to extract multiple diversified body parts,and adopt the circle loss and the margin sample mining loss to enhance the ability to extract the discriminative features and provide the fine-grained retrieval.Furthermore,the Transformer model is pruned by using the post-training lightweight mask search algorithm,which can facilitate the deployment of the model on the platform of UAVs.On this basis,a learned spatial information embedding method is proposed to obtain an optimized non-visual information during the training,which can extract invariant features in the multi-viewpoints scenario of UAVs and improve the robustness of ReID.Finally,in the real person ReID dataset in aerial imagery,the factors that affect the performance of the LTReID method are discussed,such as multi-scale transformer networks and pruning ratios,and compared with those of the state-of-the-art ReID methods.Experimental results demonstrate the effectiveness and superiority of the proposed LTReID.关键词
无人机场景/行人重识别/Transformer轻量化/空间信息嵌入Key words
unmanned aerial vehicle(UAV)/person re-identification(ReID)/lightweight transformer/spatial information embedding分类
信息技术与安全科学引用本文复制引用
胡海峰,倪宗煜,赵海涛,张红,沐勇,吴建盛..无人机场景下基于Transformer的轻量化行人重识别[J].南京邮电大学学报（自然科学版）,2024,44(3):48-62,15.基金项目
国家自然科学基金(62071242,61571233,61901229,61872198)资助项目 （62071242,61571233,61901229,61872198）
