无线电通信技术2024，Vol.50Issue(5)：949-957,9.DOI:10.3969/j.issn.1003-3114.2024.05.013
基于深度强化学习的无人机切换管理研究
Research on UAV Handover Management Based on Deep Reinforcement Learning
摘要
Abstract
Providing network connections for drones is a major application of future cellular network systems.When drones serve as mobile base stations or mobile user equipment in cellular networks,they need to switch between different base stations to maintain high-speed and reliable network connections.Aiming at the problems of frequent handovers and handover failures of UAVs between cellular base stations caused by high mobility of UAVs and complex flight environment,a method for optimizing handover of UAVs connected to cellular networks based on deep reinforcement learning is proposed.First of all,based on a deep reinforcement learning framework,on-line learning and decision-making for adaptive base station switching of UAVs are realized,which overcomes the shortcomings of previ-ous algorithms that result in long training time and poor generalization ability when the state space is too large.Secondly,two indicators of reference signal received power and handover times are integrated as a joint reward function to ensure that the UAV has a stable cel-lular network connection and reduces the number of invalid handovers between the UAV and the cellular base station.Experimental re-sults show that after 1 000 rounds of training,the proposed algorithm has significantly reduced the average number of handovers for UAV,effectively avoiding unnecessary handovers,reducing the probability of handover failures,and improving the receive power of UAV when connecting to cellular networks.关键词
无人机通信/蜂窝网络/参考信号接收功率/深度强化学习Key words
UAV communication/cellular network/reference signal receiving power/deep reinforcement learning分类
信息技术与安全科学引用本文复制引用
段盈江,赵一帆,丁广恩,赵毅,唐嘉宁..基于深度强化学习的无人机切换管理研究[J].无线电通信技术,2024,50(5):949-957,9.基金项目
国家自然科学基金(61963038,62063035) National Natural Science Foundation of China(61963038,62063035) （61963038,62063035）
