安庆师范大学学报（自然科学版）2024，Vol.30Issue(2)：69-76,8.DOI:10.13757/j.cnki.cn34-1328/n.2024.02.012
图像检索中融合扩展码字软分配的图像描述符
Image Descriptor with Soft Assignment of Expanded Codewords for Image Retrieval
摘要
Abstract
The image retrieval accuracy of Vector of Locally Aggregated Descriptor (VLAD) can be improved by increas-ing the number of centroids in clusters. However, it brings the problems of higher vector dimension and more memory require-ments to store image descriptors. An IM-VLAD is proposed by combining the expanded codewords based soft assignment with a hierarchical codebook of 2-layers. During training the codebooks, K-means algorithm is used to train the 1st layer visu-al codebook. Then, the 2nd layer codebook is trained according to the features which belong to each centroid in 1st codebook. During computing an image descriptor, an expanded codebook based soft assignment method is designed to allocate each local feature of image to its neighbor codewords with corresponding wights, where new codewords in 2st codebook are generated to expand original codewords. Thus, the residual vector of each local feature is computed and aggregated. Consequently, IM-VLAD is the form of concatenation of all the sub-vectors which is computed by aggregating residual vector of each local fea-ture from 2nd layer to 1st layer. Image retrieval is performed on three public datasets. Under the scale of 1st codebook is set as 64, the experimental results demonstrate that improvement compared to VLAD is from 0.526 to 0.628 with mean average pre-cision on Holiday dataset, from 3.17 to 3.50 with Recall@4 on UKBench dataset and from 0.513 to 0.604 with mean average precision on Holidays_Flickr1M respectively. Additionally, IM-VLAD demonstrates superior image retrieval accuracy com-pared to other improved methods.关键词
图像检索/图像描述符/码字扩展/特征分配Key words
image retrieval/image descriptor/codeword expansion/feature assignment分类
信息技术与安全科学引用本文复制引用
陶勇,艾列富..图像检索中融合扩展码字软分配的图像描述符[J].安庆师范大学学报（自然科学版）,2024,30(2):69-76,8.基金项目
国家自然科学基金(61801006),安徽省自然科学基金(1608085MF144,1908085MF194)和安徽省高校自然科学研究重点项目(KJ2020A0498) （61801006）
