通信学报2025，Vol.46Issue(1)：108-123,16.DOI:10.11959/j.issn.1000-436x.2025019
基于多粒度融合和跨尺度感知的跨模态行人重识别
Cross-modality person re-identification based on multi-granularity fusion and cross-scale perception
摘要
Abstract
A cross-modality person re-identification network based on multi-granularity fusion and cross-scale perception was proposed,which could effectively extract person image features and reduce the modality discrepancies between im-ages.Firstly,a multi-scale feature fusion attention mechanism was proposed,and a multi-granularity non-local fusion framework was designed to effectively integrate image features from different modalities and scales.Secondly,a cross-scale feature information perception strategy was proposed,which could effectively reduce the influence of irrelevant noise caused by the change of perspective and person background on person discrimination.Finally,in view of the lack of person image feature information,a parallel dilated convolution residual module was designed to obtain more abun-dant person feature information.The proposed method was compared with current state-of-the-art cross-modal person re-identification algorithms on two standard public datasets.Experimental results show that the Rank-1 and mAP of the pro-posed method reach 75.9%and 73.3%,respectively,in the all search mode of the SYSU-MM01 dataset,and 93.7%and 89.3%in the VIS to IR retrieval mode of the RegDB dataset,respectively,which is better than the compared methods,which fully confirms the effectiveness of the proposed method.关键词
行人重识别/跨模态/特征融合/跨尺度信息Key words
person re-identification/cross-modality/feature fusion/cross-scale information分类
计算机与自动化引用本文复制引用
程德强,姬广凯,张皓翔,江鹤,寇旗旗..基于多粒度融合和跨尺度感知的跨模态行人重识别[J].通信学报,2025,46(1):108-123,16.基金项目
国家自然科学基金资助项目(No.52204117,No.52304182) （No.52204117,No.52304182）
济宁市重点研发计划基金资助项目(No.2023KJHZ007)The National Natural Science Foundation of China(No.52204117,No.52304182),The Key Research and Devel-opment Program of Jining City(No.2023KJHZ007) （No.2023KJHZ007）
