电工技术学报2024，Vol.39Issue(19)：6104-6118,15.DOI:10.19595/j.cnki.1000-6753.tces.231352
考虑网络安全约束的分布式智能电网边云协同优化调度方法
Network Security Constrained Distributed Smart Grid Edge-Cloud Collaborative Optimization Scheduling
摘要
Abstract
With the increasing penetration of distributed generation and the growing demand for power system flexibility,issues like voltage rise at the edge of distribution networks and network congestion under bidirectional power flow are becoming more prominent.Integrating and coordinating flexible resources at the user side through Distributed Smart Grids(DSG)is significant for enhancing the accommodation of distributed generation and the real-time supply-demand balancing capability of distribution systems.Considering the large quantity and high dispersion of flexible resource devices and the distinct characteristics of different prosumers,traditional centralized optimization and dispatch schemes as well as distributed computing methods will face greater challenges in solving efficiency and decision delivery timeliness.Against this background,this paper aims to develop a DSG system collaborative optimization and dispatch method that takes into account operational economy,energy network security,and decision timeliness concurrently. Firstly,mapping real-world prosumers who control and own flexible resources to intelligent agents in reinforcement learning,the optimization and dispatch of flexible resources in DSG is formulated as a multi-agent collaborative optimization model.The existing edge-cloud collaborative framework is extended to the optimization of flexible resources considering energy network security constraints,and a hierarchical optimization and dispatch framework of flexible resource-prosumer-DSG is established.Secondly,considering the differentiated characteristics of prosumers in aspects like types of flexible resource devices,photovoltaics(PV)is taken as distributed generation,and electric vehicles(EV),heating,ventilation and air conditioning(HVAC)of buildings,and energy storage systems(ESS)are taken as demand-side flexible resources.A heterogeneous intelligent agent interactive environment model is built based on the operational characteristics of different flexible resources.Meanwhile,to balance flexible resource operational requirements,overall economic efficiency and energy network security of the DSG system,user satisfaction evaluation of EV and HVAC operation and ESS operation cost are considered as local rewards,while system energy cost and energy network security evaluation are taken as global rewards,and a combined global-local reward mechanism for heterogeneous intelligent agents is proposed.Finally,to adapt to the collaborative training task of the heterogeneous intelligent agent system,an improved multi-agent proximal policy optimization(MAPPO)algorithm is proposed based on asynchronous update of agent policies in random order. Case studies on the IEEE 33-node system are conducted for analysis.Firstly,the proposed improved MAPPO algorithm is compared with existing multi-agent collaborative training schemes in the offline training stage.Secondly,the differences in flexible resource prosumers'power decisions with and without considering energy network constraints are analyzed in the online dispatch stage.Finally,the proposed method is compared with traditional mathematical programming and particle swarm optimization methods regarding optimization performance in real-time dispatch.The main conclusions are:(1)The edge-cloud collaborative hierarchical optimization and dispatch framework for DSG systems is established,which can obtain dispatch decisions faster in real-time dispatch compared to traditional centralized optimization and thus improve the timeliness of DSG power dispatch decisions.(2)The combined global-local reward mechanism for heterogeneous intelligent agents can achieve overall DSG system optimization and collaborative training objectives of balancing user comfort,economic efficiency and energy network security.(3)The proposed improved MAPPO algorithm adapted for heterogeneous intelligent agent training can maintain independent decision spaces for each agent while ensuring environment state stability in collaborative training through asynchronous policy updates in random order.关键词
分布式智能电网/灵活资源/边云协同/深度强化学习/网络安全约束Key words
Distributed smart grid/flexible resources/edge-cloud collaboration/deep reinforcement learning/network safety constrain分类
信息技术与安全科学引用本文复制引用
潘玺安,艾欣,胡俊杰,王坤宇,王昊洋..考虑网络安全约束的分布式智能电网边云协同优化调度方法[J].电工技术学报,2024,39(19):6104-6118,15.基金项目
国家自然科学基金面上项目(52177080)和北京市科技新星计划项目(Z201100006820106)资助. （52177080）
