聊城大学学报(自然科学版)2024,Vol.37Issue(4):23-32,10.DOI:10.19728/j.issn1672-6634.2023120005
基于DQN出价策略的多无人机目标分配拍卖算法
Multi Drones Target Allocation Auction Algorithm Based on DQN Bidding Strategy
摘要
Abstract
To maximize the revenue of task matching and success rate for multi drone monitoring target al-location,as well as minimize the costs of path length and obstacle collision risks,this paper proposes an autonomous evolutionary auction algorithm based on a data-driven reinforcement learning method that in-tegrates deep Q-network(DQN)bidding strategy.This algorithm first constructs a Markov decision mod-el for multi drone task target auction,and constructs a new type of DQN bidding and auctioning decision neural network model with taking the remaining bidding capacity of bidders as the environment,output-ting the price increase factor as the action,and the increase in auction revenue before and after the two rounds as the return.This model constructs a reinforcement learning training sample library that includes elements such as auction environment,markup factors,and returns.During the auction process,the DQN neural network is continuously trained in an offline learning mode,allowing it to output markup factors based on the auction environment according to the DQN strategy during the auction process,achieving op-timization of auction results and revenue.Finally,the simulation of multi drone and multi monitoring tar-get allocation verifies the effectiveness of the target allocation method based on the DQN auction mecha-nism proposed in this paper.Compared with the results of traditional auction algorithms,the auction reve-nue obtained by this method is increased by 21.4%.关键词
多无人机/拍卖算法/DQN/多目标分配/拍卖收益Key words
multi drones/auction algorithm/DQN/multi-objective allocation/auction proceeds分类
信息技术与安全科学引用本文复制引用
陈梓豪,胡春鹤..基于DQN出价策略的多无人机目标分配拍卖算法[J].聊城大学学报(自然科学版),2024,37(4):23-32,10.基金项目
国家自然科学基金项目(61703047)资助 (61703047)