全球能源互联网（英文）2022，Vol.5Issue(6)：604-617,14.DOI:10.1016/j.gloei.2022.12.003
基于多智能体深度强化学习的电-气-热综合能源系统分布式优化
Distributed optimization of electricity-Gas-Heat integrated energy system with multi-agent deep reinforcement learning
摘要
Abstract
The coordinated optimization problem of the electricity-gas-heat integrated energy system (IES) has the characteristics of strong coupling, non-convexity, and nonlinearity. The centralized optimization method has a high cost of communication and complex modeling. Meanwhile, the traditional numerical iterative solution cannot deal with uncertainty and solution efficiency, which is difficult to apply online. For the coordinated optimization problem of the electricity-gas-heat IES in this study, we constructed a model for the distributed IES with a dynamic distribution factor and transformed the centralized optimization problem into a distributed optimization problem in the multi-agent reinforcement learning environment using multi-agent deep deterministic policy gradient. Introducing the dynamic distribution factor allows the system to consider the impact of changes in real-time supply and demand on system optimization, dynamically coordinating different energy sources for complementary utilization and effectively improving the system economy. Compared with centralized optimization, the distributed model with multiple decision centers can achieve similar results while easing the pressure on system communication. The proposed method considers the dual uncertainty of renewable energy and load in the training. Compared with the traditional iterative solution method, it can better cope with uncertainty and realize real-time decision making of the system, which is conducive to the online application. Finally, we verify the effectiveness of the proposed method using an example of an IES coupled with three energy hub agents.关键词
综合能源系统/多智能体系统/分布式优化/多智能体深度确定性策略梯度算法/实时决策Key words
Integrated energy system/Multi-agent system/Distributed optimization/Multi-agent deep deterministic policy gradient/Real-time optimization decision引用本文复制引用
董雷,魏静,林灏,王新迎..基于多智能体深度强化学习的电-气-热综合能源系统分布式优化[J].全球能源互联网（英文）,2022,5(6):604-617,14.基金项目
This work was supported by The National Key R&D Program of China (2020YFB0905900): Research on artificial intelligence application of power internet of things. （2020YFB0905900）
