中国电力2025，Vol.58Issue(10)：14-26,13.DOI:10.11930/j.issn.1004-9649.202503014
基于改进双深度Q网络的微电网群能量管理策略
Energy Management Strategy for Microgrid Cluster Based on Improved Double Deep Q-Network
摘要
Abstract
To address the overestimation bias and poor decision accuracy of conventional microgrid cluster energy management methods,an energy management strategy based on improved double deep Q-network is proposed.Firstly,this study constructed a dual-objective value network framework based on clipped double Q-learning,which enhances decision-making precision by suppressing value overestimation bias through parallel computation of temporal difference(TD)targets for dual value networks and clipping high TD target values.And then,a dynamic greedy strategy was adopted to calculate the value function of all possible actions based on the current state,avoiding persistent exploitation of the greedy actions to ensure sufficient exploration and prevent premature convergence of the agent.Finally,a case study of a microgrid cluster with three sub-microgrids was conducted for verification.The simulation results show that compared to the energy management strategies based on model predictive control and conventional double deep Q-network,the proposed method achieves superior optimization performance and convergence characteristics,while reducing system operating costs by 44.62%and 26.39%respectively.关键词
微电网群/能量管理/改进双深度Q网络/裁剪双Q值/贪婪策略Key words
microgrid cluster/energy management/improved double deep Q-network/clipped double Q values/greedy strategy引用本文复制引用
何锦涛,王灿,王明超,程本涛,刘于正,常文涵,王锐,余涵..基于改进双深度Q网络的微电网群能量管理策略[J].中国电力,2025,58(10):14-26,13.基金项目
国家自然科学基金资助项目(52107108). This work is supported by National Natural Science Foundation of China(No.52107108). （52107108）
