现代信息科技2024,Vol.8Issue(1):67-70,76,5.DOI:10.19850/j.cnki.2096-4706.2024.01.014
一种基于深度Q网络改进的低轨卫星路由算法
An Improved Low-orbit Satellite Routing Algorithm Based on DQN
许向阳 1彭文鑫 1李京阳1
作者信息
- 1. 河北科技大学 信息科学与工程学院,河北 石家庄 050018
- 折叠
摘要
Abstract
To deal with the problem of fast-changing link-state between satellite nodes due to high-speed movement of satellite nodes,a satellite routing algorithm based on deep reinforcement learning is studied,and an improved satellite routing algorithm based on DQN is proposed.The algorithm adopts the idea of virtual nodes,and sets the number of hops and distance as the related parameters of reward function based on the principle of minimum hops.Meanwhile,a priority experience replay mechanism is set up to train the algorithm by learning samples with the highest value.Finally,the network is set in parameters and is trained.The simulation results show that there are significant improvements in network transmission delay,system throughput,and rate of packet loss,effectively adapting to high dynamic changes in link-state between satellite nodes.关键词
卫星路由/虚拟节点/优先经验回放/深度Q网络Key words
satellite routing/virtual node/priority experience replay/DQN分类
信息技术与安全科学引用本文复制引用
许向阳,彭文鑫,李京阳..一种基于深度Q网络改进的低轨卫星路由算法[J].现代信息科技,2024,8(1):67-70,76,5.