山西大学学报（自然科学版）2024，Vol.47Issue(1)：81-92,12.DOI:10.13451/j.sxu.ns.2023142
基于注意力机制的语义对比学习算法
Semantic Contrastive Learning Algorithm Based On Attention Mechanism
摘要
Abstract
Inappropriate data augmentation in contrastive learning may lead to distortion of semantic information,and there is a huge semantic gap in semantic information about the same image under different types of data augmentation.In addition,the Convolution-al Neural Network(CNN)has a strong preference for textures and cannot accurately learn the deep semantic feature representations required for downstream tasks.In response to the above issues,we propose a method—Semantic attention contrastive learning meth-od(SACL).SACL first utilizes convolutional neural networks to extract features,and then the attention module mines global fea-tures to obtain higher-level semantic features,achieving the supplementation of low-level features and semantic fusion of deep fea-tures.Secondly,the positive and negative sample pairs are constructed using completely different data augmentation methods,and the positive samples generated by weak enhancement(geometric augmentation)and the negative samples generated by strong en-hancement(texture augmentation)are compared to obtain the image input with more significant differences.Gridding augmented view increases the number of positive samples and accelerates network convergence speed.We verified the effectiveness of the pro-posed semantic contrastive learning algorithm on four datasets,and the results showed that the average accuracy of the ImageNet-100 dataset can reach 78.3%,which can effectively improve the classification accuracy of the model.关键词
对比学习/注意力机制/语义特征表示/数据增强/纹理/网格化Key words
contrastive learning/attention mechanism/semantic feature representation/data augmentation/texture/gridding分类
信息技术与安全科学引用本文复制引用
陈俊芬,吕巧莉,谢博鋆,孙劲松..基于注意力机制的语义对比学习算法[J].山西大学学报（自然科学版）,2024,47(1):81-92,12.基金项目
河北省引进留学人员资助项目(C20200302) （C20200302）
河北省教育教学改革研究与实践项目(2020GJJG007) （2020GJJG007）
