首页|期刊导航|通信学报|基于多智能体强化学习的异构网络CRE偏置动态优化算法

基于多智能体强化学习的异构网络CRE偏置动态优化算法OACSCDCSTPCD

Multi-agent reinforcement learning based dynamic optimization algorithm of CRE offset for heterogeneous networks

中文摘要英文摘要

为应对无线网络用户激增导致的高吞吐量需求,针对宏微异构网络干扰场景,提出一种基于多智能体强化学习的小区范围扩展(CRE)偏置动态优化算法.基于协作多智能体强化学习的值分解网络框架,通过合理利用并在微微基站间交互系统内用户分布及其所受干扰水平,实现所有微微基站的个性化 CRE 偏置值在线本地化决策.仿真结果表明,与CRE=5 dB、分布式Q-Learning算法相比,所提算法在提高系统吞吐量、均衡各基站吞吐量及改善边缘用户吞吐量方面具有明显优势.

To cope with the high throughput demand caused by the proliferation of wireless network users,a multi-agent reinforcement learning based dynamic optimization algorithm of cell range expansion(CRE)offset was proposed for in-terference scenarios in macro-pico heterogeneous networks.Based on the value decomposition network framework of collaborative multi-agent reinforcement learning,a personalized online local decision of CRE offset for all pico-base sta-tions was achieved by reasonably utilizing and interacting the intra-system user distribution and their interference levels among pico-base stations.Simulation results show that the proposed algorithm has significant advantages in increasing system throughput,balancing the throughput of each base station and improving edge-user throughput,compared to CRE=5 dB and distributed Q-learning algorithms.

张铖;朱家烨;刘泽宁;黄永明

东南大学移动通信全国重点实验室,江苏 南京 211111||网络通信与安全紫金山实验室,江苏 南京 211111东南大学移动通信全国重点实验室,江苏 南京 211111网络通信与安全紫金山实验室,江苏 南京 211111东南大学移动通信全国重点实验室,江苏 南京 211111||网络通信与安全紫金山实验室,江苏 南京 211111

电子信息工程

异构网络小区范围扩展多智能体强化学习值分解网络算法

heterogeneous networkcell range expansionmulti-agent reinforcement learningvalue decomposition net-work algorithm

《通信学报》 2023 (12)

86-98,13

国家自然科学基金资助项目(No.62225107,No.62271140)江苏省前沿引领技术基础研究重大基金资助项目(No.BK20222001)江苏省创新创业人才计划基金资助项目(No.JSSCBS20211332)The National Natural Science Foundation of China(No.62225107,No.62271140),The Natural Science Founda-tion on Frontier Leading Technology Basic Research Project of Jiangsu(No.BK20222001),The Jiangsu Innovative and Entrepre-neurial Talent Program(No.JSSCBS20211332)

10.11959/j.issn.1000-436x.2023235

评论