南京航空航天大学学报（英文版）2025，Vol.42Issue(z1)：91-101,11.DOI:10.16356/j.1005-1120.2025.S.008
基于改进多智能体强化学习的自主冲突解脱方法研究
Autonomous Conflict Resolution(AutoCR)Based on Improved Multi-agent Reinforcement Learning
摘要
Abstract
Conflict resolution(CR)is a fundamental component of air traffic management,where recent progress in artificial intelligence has led to the effective application of deep reinforcement learning(DRL)techniques to enhance CR strategies.However,existing DRL models applied to CR are often limited to simple scenarios.This approach frequently leads to the neglect of the high risks associated with multiple intersections in the high-density and multi-airport system terminal area(MAS-TMA),and suffers from poor interpretability.This paper addresses the aforementioned gap by introducing an improved multi-agent DRL model that adopted to autonomous CR(AutoCR)within MAS-TMA.Specifically,dynamic weather conditions are incorporated into the state space to enhance adaptability.In the action space,the flight intent is considered and transformed into optimal maneuvers according to overload,thus improving interpretability.On these bases,the deep Q-network(DQN)algorithm is further improved to address the AutoCR problem in MAS-TMA.Simulation experiments conducted in the"Guangdong-Hong Kong-Macao"greater bay area(GBA)MAS-TMA demonstrate the effectiveness of the proposed method,successfully resolving over eight potential conflicts and performing robustly across various air traffic densities.关键词
空中交通管理/冲突解脱/多机场终端区/多智能体强化学习Key words
air traffic management/conflict resolution/multi-airport system terminal area(MAS-TMA)/multi-agent reinforcement learning引用本文复制引用
黄潇,田勇,李江晨,张乃中..基于改进多智能体强化学习的自主冲突解脱方法研究[J].南京航空航天大学学报（英文版）,2025,42(z1):91-101,11.基金项目
This work was supported by the Post-graduate Research&Practice Innovation Program of Jiangsu Province(No.KYCX25_0621),and the Foundation of Inter-disciplinary Innovation Fund for Doctoral Students of Nan-jing University of Aeronautics and Astronautics(No.KXKCXJJ202507). （No.KYCX25_0621）
