自动化学报2026，Vol.52Issue(6)：1304-1318,15.DOI:10.16383/j.aas.c250633
具有指数图信息通信的大规模情境多智能体强化学习
Large-scale Episodic Multi-agent Reinforcement Learning With Exponential Graph Information Communication
摘要
Abstract
Multi-agent reinforcement learning(MARL)demonstrates excellent performance in cooperative tasks.However,in large-scale multi-agent systems(MAS)with complex interaction relationships,traditional MARL al-gorithms perform poorly due to the lack of efficient communication mechanisms.To enhance the performance of MARL in large-scale MAS,this paper proposes an episodic MARL algorithm with exponential graph information communication(EMAGIC).First,this paper designs a one-peer exponential graph-based communication topology,where each agent communicates with only one other agent at each time step and transmits messages to all agents through a cyclic communication link.Second,this paper constructs a graph information communication mechanism that uses a gated recurrent unit to encode messages across multiple time steps and optimizes the encoded features of the messages by maximizing the mutual information between messages of different agents at the same time step.Fi-nally,this paper builds an independent episodic memory(EM)module to establish the correspondence between av-erage returns and global states for constructing a memory bank,and constructs the loss function by using the error between the EM target and the mean of individual values.Experimental results in multiple large-scale multi-agent environments show that EMAGIC consistently outperforms advanced MARL baseline methods.关键词
多智能体系统/强化学习/多智能体通信/指数图Key words
multi-agent systems/reinforcement learning/multi-agent communication/exponential graph引用本文复制引用
李方昱,刘金溢,孙浩源,韩红桂..具有指数图信息通信的大规模情境多智能体强化学习[J].自动化学报,2026,52(6):1304-1318,15.基金项目
国家重点研发计划(2023YFB3307300),国家自然科学基金(62373014,92467205,62522302,62473011),北京市科技新星项目(20250484938),北京市自然科学基金-小米创新联合基金(L253010)资助 Supported by National Key Research and Development Pro-gram of China(2023YFB3307300),National Natural Science Foundation of China(62373014,92467205,62522302,62473011),Beijing Nova Program of Science and Technology(20250484938),and Beijing Natural Science Foundation-Xiaomi Innovation Joint Fund(L253010) （2023YFB3307300）
