电力系统自动化2026,Vol.50Issue(19):189-198,10.DOI:10.7500/AEPS20250626004
考虑灵活性资源的用户侧综合能源系统分层鲁棒强化学习方法
Hierarchical Robust Reinforcement Learning Method for User-side Integrated Energy System Considering Flexibility Resources
摘要
Abstract
To address the issue that small-and medium-sized flexibility resources with regulable capacity in integrated energy systems are not effectively utilized,this paper establishes a user-side integrated energy system(UIES)model.Aiming at the uncertainty in UIES solution that may arise during the utilization of flexibility resources,a hierarchical robust reinforcement learning method is proposed to enhance the robustness of solution results.First,certain flexible reserve margins are reserved for regulable devices during model construction to satisfy the regulation requirements that may occur during different time periods.Then,a hierarchical robust reinforcement learning method is designed to handle the uncertainties in the UIES model.In this method,the upper layer is a reinforcement learning model,which is intended to handle long-term actions affecting the future states of the system.The lower layer is a robust optimization model,which focuses on solving short-term actions that only affect the real-time operation of the system.The combination of reinforcement learning and robust optimization simplifies the complexity of the agent′s decision-making process,while fully taking into account the robustness of solution outcomes.Case studies demonstrate that the proposed method can effectively mobilize user-side flexibility resources and facilitate the economic,low-carbon and stable operation of the system.关键词
用户侧/综合能源系统/灵活性资源/不确定性/强化学习/鲁棒优化Key words
user side/integrated energy system(IES)/flexibility resource/uncertainty/reinforcement learning/robust optimization引用本文复制引用
徐雪松,曾子洋,何远兴,蒋鸿涛,管敏,徐凯..考虑灵活性资源的用户侧综合能源系统分层鲁棒强化学习方法[J].电力系统自动化,2026,50(19):189-198,10.基金项目
国家自然科学基金面上基金资助项目(72472049) (72472049)
国家自然科学基金卓越研究群体项目(72088101). This work is supported by National Natural Science Foundation of China(No.72472049,No.72088101). (72088101)