| 注册
首页|期刊导航|电力系统自动化|考虑灵活性资源的用户侧综合能源系统分层鲁棒强化学习方法

考虑灵活性资源的用户侧综合能源系统分层鲁棒强化学习方法

徐雪松 曾子洋 何远兴 蒋鸿涛 管敏 徐凯

电力系统自动化2026,Vol.50Issue(19):189-198,10.
✕
电力系统自动化2026,Vol.50Issue(19):189-198,10.DOI:10.7500/AEPS20250626004

考虑灵活性资源的用户侧综合能源系统分层鲁棒强化学习方法

Hierarchical Robust Reinforcement Learning Method for User-side Integrated Energy System Considering Flexibility Resources

徐雪松 1曾子洋 2何远兴 3蒋鸿涛 3管敏 3徐凯4

作者信息

  • 1. 湖南工商大学智能工程与智能制造学院,湖南省 长沙市 410205||湘江实验室,湖南省 长沙市 410205
  • 2. 国网邵阳供电公司,湖南省 邵阳市 422000
  • 3. 湖南工商大学智能工程与智能制造学院,湖南省 长沙市 410205
  • 4. 多能源系统智慧互联技术湖南省重点实验室,湖南省 长沙市 410073
  • 折叠

摘要

Abstract

To address the issue that small-and medium-sized flexibility resources with regulable capacity in integrated energy systems are not effectively utilized,this paper establishes a user-side integrated energy system(UIES)model.Aiming at the uncertainty in UIES solution that may arise during the utilization of flexibility resources,a hierarchical robust reinforcement learning method is proposed to enhance the robustness of solution results.First,certain flexible reserve margins are reserved for regulable devices during model construction to satisfy the regulation requirements that may occur during different time periods.Then,a hierarchical robust reinforcement learning method is designed to handle the uncertainties in the UIES model.In this method,the upper layer is a reinforcement learning model,which is intended to handle long-term actions affecting the future states of the system.The lower layer is a robust optimization model,which focuses on solving short-term actions that only affect the real-time operation of the system.The combination of reinforcement learning and robust optimization simplifies the complexity of the agent′s decision-making process,while fully taking into account the robustness of solution outcomes.Case studies demonstrate that the proposed method can effectively mobilize user-side flexibility resources and facilitate the economic,low-carbon and stable operation of the system.

关键词

用户侧/综合能源系统/灵活性资源/不确定性/强化学习/鲁棒优化

Key words

user side/integrated energy system(IES)/flexibility resource/uncertainty/reinforcement learning/robust optimization

引用本文复制引用

徐雪松,曾子洋,何远兴,蒋鸿涛,管敏,徐凯..考虑灵活性资源的用户侧综合能源系统分层鲁棒强化学习方法[J].电力系统自动化,2026,50(19):189-198,10.

基金项目

国家自然科学基金面上基金资助项目(72472049) (72472049)

国家自然科学基金卓越研究群体项目(72088101). This work is supported by National Natural Science Foundation of China(No.72472049,No.72088101). (72088101)

电力系统自动化

1000-1026

访问量0
|
下载量0
段落导航相关论文