计算机应用研究2023，Vol.40Issue(12)：3766-3771,3777,7.DOI:10.19734/j.issn.1001-3695.2023.04.0159
灾害应急场景下基于多智能体深度强化学习的任务卸载策略
Multi-intelligence deep reinforcement learning-based task offloading strategy for disaster emergency scenarios
摘要
Abstract
For the problems of slow convergence and low utilization of empirical replay groups in traditional DRL,this paper proposed a multi agent deep reinforcement learning(MADRL)based task offloading strategy for disaster emergency scenarios.Firstly,it established a task offloading model based on MADRL for disaster emergency scenarios to deal with the problem of time slot changes in MEC network environment and multi-hop sensor data transmission when disasters occur.Secondly,for the slow convergence problem caused by high-dimensional action space in traditional DRL,it used the mutation and crossover operations of the adaptive differential evolution algorithm(ADE)to explore the action space.And it proposed an adaptive pa-rameter adjustment strategy to adjust the iteration number of ADE,this avoided a large amount of useless exploration of the ac-tion space by DRL in the early stages of training.Finally,it added the prioritized experience replay technique to speed up the network training process and improve the data utilization in the experience replay group of DRL.Simulation results show that this adaptive differential evolution algorithm improved deep deterministic policy gradient(ADE-DDPG)saves 35％of the overall overhead compared with the improved original deep deterministic policy gradient(DDPG)network.This verifies the effectiveness of ADE-DDPG in terms of performance.关键词
灾害应急/任务卸载/多智能体深度强化学习/自适应差分进化算法Key words
disaster emergency/task offloading/MADRL/ADE分类
计算机与自动化引用本文复制引用
米德昌,王霄,李梦丽,秦俊康..灾害应急场景下基于多智能体深度强化学习的任务卸载策略[J].计算机应用研究,2023,40(12):3766-3771,3777,7.基金项目
国家自然科学基金资助项目(61861007,61640014) （61861007,61640014）
贵州省科技计划资助项目(黔科合基础-ZK[2021]一般303) （黔科合基础-ZK[2021]一般303）
贵州省科技支撑计划资助项目(科合支撑[2022]一般017,黔科合支撑[2023]一般096,黔科合支撐[2022]一般264) （科合支撑[2022]一般017,黔科合支撑[2023]一般096,黔科合支撐[2022]一般264）
贵州省教育厅创新群体项目(黔教合KY字[2021]012) （黔教合KY字[2021]012）
贵大引进人才项目(贵大人基合字(2014)08号) （贵大人基合字(2014）
