高技术通讯2026,Vol.36Issue(7):742-750,9.DOI:10.3772/j.issn.1002-0470.2026.07.008
面向复杂环境的W-QMIX-ATT多智能体协同对战研究
Research on W-QMIX-ATT algorithm for multi agent collaborative warfare in complex environments
摘要
Abstract
Multi-agent reinforcement learning is currently widely used in complex collaborative combat tasks,but it still faces challenges such as low collaboration efficiency and poor environmental adaptability.The fundamental reason originates from the intrinsic constraints of the QMIX(monotonic value function factorisation)algorithm,which is in-competent at fitting non-monotonic value functions and modeling dynamic inter-agent interactions.To address these issues,this paper proposes the W-QMIX algorithm,which introduces a weighted mechanism to design a joint weighting function that assigns different weights to the Q-values of various joint actions,thereby breaking through the monotonicity constraint of QMIX.Then,a multi-head attention mechanism is incorporated to construct the QMIX-ATT algorithm,enhancing the ability to capture dynamic interactions between agents.Moreover,a realistic simulated combat environment is essential to ensure the accuracy of the experimental results.Therefore,this paper proposes the construction of a simulated combat environment that integrates multiple terrains and weather condi-tions,with customizable state spaces for each agent,and conducts experimental studies.The results show that the improved algorithm achieves a win rate of up to 93.0%.Compared with the original QMIX algorithm,the win rate of the proposed method is improved by 7.8%,10.8%,and 9.7%in three different environments,respectively,demonstrating its effectiveness in multi-agent collaborative tasks.关键词
QMIX/加权机制/多头注意力机制/协同对战Key words
QMIX algorithm/weighted mechanism/multi-head attention mechanism/collaborative combat引用本文复制引用
陈亮,赵振开,王珺琳..面向复杂环境的W-QMIX-ATT多智能体协同对战研究[J].高技术通讯,2026,36(7):742-750,9.基金项目
国家自然科学基金(61873051,617030847)和国家自然科学基金联合基金重点项目(U21A20117)资助. (61873051,617030847)