山西大学学报(自然科学版)2024,Vol.47Issue(1):69-80,12.DOI:10.13451/j.sxu.ns.2023139
基于变分自编码器与流形特征的聚类算法
Clustering Algorithm Based on Variational Autoencoder and Manifold Features
摘要
Abstract
Deep neural network has become a promising clustering method due to its excellent nonlinear mapping ability and flexibil-ity in different scenarios.In order to map the original high-dimensional data to a feature space in where the clustering is easy to be done,feature extraction or feature transformationare are done by many deep clustering methods,and then the extracted features are grouped into different clusters in the lower-dimensional space,which still are assumed in Euclidean space.In order to explore the im-pact of feature extraction and manifold space on clustering performance,in this paper,we propose a clustering algorithm based on variational autoencoder and manifold learning—MFVC(Clustering Algorithm Based on Variational Autoencoder and Manifold Fea-tures).In this method,the β-VAE(Learning Basic Visual Concepts with a Constrained Variational Framework)with residual connec-tion layer is used as a feature extractor to extract image features,and the non-parameter attention mechanism SimAM(A Simple,Pa-rameter-Free Attention Module for Convolutional Neural Networks)is added to improve the expressive ability of the convolutional network.For more favorable features,the Manifold UMAP(Uniform Manifold Approximation and Projection for Dimension Reduc-tion)method is used to improve the separability of the features,and then the K-Means method is used for clustering learning.Experi-mental results on six benchmark datasets show that this method can provide better performance.MFVC achieves with accuracy of 0.981 on the MNIST(Mixed NationalInstitute of Standards and Technology database)dataset,and 0.681 on the Fashion-MNIST da-taset.关键词
变分自编码器/残差连接/UMAP/K-Means/流形学习Key words
variational autoencoder/residual connection/UMAP/K-Means/manifold learning分类
信息技术与安全科学引用本文复制引用
陈俊芬,韩金池,谢博鋆,谢政豪..基于变分自编码器与流形特征的聚类算法[J].山西大学学报(自然科学版),2024,47(1):69-80,12.基金项目
河北省引进留学人员资助项目(C20200302) (C20200302)
河北省教育教学改革研究与实践项目(2020GJJG007) (2020GJJG007)