南京理工大学学报（自然科学版）2024，Vol.48Issue(4)：469-478,488,11.DOI:10.14177/j.cnki.32-1397n.2024.48.04.008
基于用户层次聚类的联邦学习优化方法
Federated learning optimization method based on user hierarchical clustering
摘要
Abstract
Federated learning can generalize all local user data to achieve the purpose of protecting user data privacy by training a global model by distributed machine learning.Due to differences in user behaviors and environments,data heterogeneity is caused,and the performance of user local models is often much higher than that of global models.In response to the above problems,this paper proposes a federated learning method based on user hierarchical clustering.This paper designs a federated learning convergence evaluation method to determine the degree of convergence of the global model;when the global model converges,clustering user operations can more accurately find users with a higher degree of similarity;through the cosine similarity level hierarchical clustering,the clustering method aggregates similar users through clustering operations,thereby reducing the impact of data heterogeneity.In addition,this paper also uses a larger depth model WideResNet to improve the accuracy of the user's local training.This paper uses the data sets EMNIST and CIFAR10 to adjust the angle between user data,and conducts cluster federated learning experiments for two types of users and three types of users respectively.The experimental results show that compared with the traditional federated learning algorithm FedAvg,the training accuracy of federated learning after clustering is improved by about 10%.关键词
联邦学习/数据异构/层次聚类/余弦相似性/WideResNetKey words
federated learning/heterogeneous data/hierarchical clustering/cosine similarity/WideResNet分类
信息技术与安全科学引用本文复制引用
谭玉玲,欧国成,曹灿明,柴争议..基于用户层次聚类的联邦学习优化方法[J].南京理工大学学报（自然科学版）,2024,48(4):469-478,488,11.基金项目
国家自然科学基金(61972456) （61972456）
广东省普通高校青年创新人才类项目(2019GKQNCX114) （2019GKQNCX114）
