通信学报2025，Vol.46Issue(1)：93-107,15.DOI:10.11959/j.issn.1000-436x.2025014
空天地一体化网络中基于联邦深度强化学习的边缘协作缓存策略
Federated deep reinforcement learning-based edge collaborative caching strategy in space-air-ground integrated network
摘要
Abstract
To address the problem of limited network coverage in remote areas,combining space-air-ground integrated network with mobile edge computing could provide low-latency and high-reliability transmissions for user requests in these areas,as well as timely caching services.Considering the dynamic change of the topology of the space-air-ground integrated network and the content popularity being constantly updated,a network architecture of space-air-ground inte-grated edge collaborative caching was proposed first.Then,the cache replacement problem for edge servers was mod-eled as a Markov decision process.Finally,a federated discrete soft actor-critic(FDSAC)algorithm was proposed,with the core idea of integrating a weighted attention mechanism into the federated learning framework and incorporating a bi-directional long short-term memory network into the DSAC model.With the reconfigured reward function as the optimi-zation objective,the optimal cache replacement policy was learned by maximizing the expectation of negative long-term rewards.Simulation results show that compared with other algorithm,the proposed algorithm can improve the cache hit rate of user requests by 18%and reduce the access latency of content by 25%while protecting user privacy.关键词
空天地一体化网络/移动边缘计算/缓存/离散柔性演员评论家/联邦学习Key words
space-air-ground integrated network/mobile edge computing/caching/discrete soft actor-critic/federated learning分类
电子信息工程引用本文复制引用
刘亮,荆腾祥,段洁,毛武平,燕洪成,马文杰..空天地一体化网络中基于联邦深度强化学习的边缘协作缓存策略[J].通信学报,2025,46(1):93-107,15.基金项目
国家自然科学基金资助项目(No.62171070,No.61701058) （No.62171070,No.61701058）
重庆市教委科学技术研究基金资助项目(No.KJQN202200615)The National Natural Science Foundation of China(No.62171070,No.61701058),The Science and Technology Research Program of Chongqing Municipal Education Commission(No.KJQN202200615) （No.KJQN202200615）
