|国家科技期刊平台
首页|期刊导航|自动化学报|基于特征变换和度量网络的小样本学习算法

基于特征变换和度量网络的小样本学习算法OA北大核心CSTPCD

Feature Transformation and Metric Networks for Few-shot Learning

中文摘要英文摘要

在小样本分类任务中,每个类别可供训练的样本数量非常有限.因此在特征空间中同类样本分布稀疏,异类样本间边界模糊.提出一种新的基于特征变换和度量网络(Feature transformation and metric networks,FTMN)的小样本学习算法用于小样本分类任务.算法通过嵌入函数将样本映射到特征空间,并计算输入该样本与所属类别中心的特征残差.构造一个特征变换函数对该残差进行学习,使特征空间内的样本特征经过该函数后向同类样本中心靠拢.利用变换后的样本特征更新类别中心,使各类别中心间的距离增大.算法进一步构造了一种新的度量函数,对样本特征中每个局部特征点的度量距离进行联合表达,该函数能够同时对样本特征间的夹角和欧氏距离进行优化.算法在小样本分类任务常用数据集上的优秀表现证明了算法的有效性和泛化性.

For few-shot classification,training samples for each class are highly limited.Consequently,samples from the same class tend to distribute sparsely while boundaries between different classes are indistinct in the feature space.Therefore,a novel few-shot learning algorithm based on feature transformation and metric networks(FTMN)is proposed for few-shot learning.The algorithm maps samples to the feature space through an embedding function and calculates the residual between the input features and their class center.A feature transformation function is then constructed to learn from the residual,enabling input features to move closer to their class center after trans-formation.The transformed features are used to update the class centers,increasing the distance between centers of different classes.Furthermore,the algorithm introduces a novel metric function that jointly expresses the metric distances of each point within the features.The metric function simultaneously optimizes both cosine similarity and Euclidean distance.The performance of the algorithm on commonly used datasets for few-shot classification valid-ates its effectiveness and generalization ability.

王多瑞;杜杨;董兰芳;胡卫明;李兵

中国科学技术大学 合肥 230026||中国科学院自动化研究所模式识别国家重点实验室 北京 100190中国科学院自动化研究所模式识别国家重点实验室 北京 100190||阿里巴巴科技(北京)有限公司 北京 100016中国科学技术大学 合肥 230026中国科学院自动化研究所模式识别国家重点实验室 北京 100190

特征变换度量学习小样本学习残差学习

Feature transformationmetric learningfew-shot learningresidual learning

《自动化学报》 2024 (007)

1305-1314 / 10

国家重点研发计划(2018AAA0102802),国家自然科学基金(62036011,62192782,61721004),中国科学院前沿科学重点研究计划(QYZDJ-SSW-JSC040)资助Supported by National Key Research and Development Pro-gram of China(2018AAA0102802),National Natural Science Foundation of China(62036011,62192782,61721004),and Key Research Program of Frontier Sciences of Chinese Academy of Sciences(QYZDJ-SSW-JSC040)

10.16383/j.aas.c210903

评论