电力系统自动化2026，Vol.50Issue(18)：17-31,15.DOI:10.7500/AEPS20251101008
基于改进约束强化学习的风光水火储多能互补日内调度方法
Intra-day Scheduling Method for Wind-Solar-Hydro-Thermal-Storage Multi-energy Complementarity Based on Improved Constrained Reinforcement Learning
摘要
Abstract
The large-scale clean energy base is a critical component of China's new power system.Their inherent characteristics—strong uncertainty,low flexibility,and numerous controllable resources—pose dual challenges of timeliness and complexity for intra-day dispatching.This paper proposes an intra-day scheduling method for wind-solar-hydro-thermal-storage multi-energy complementarity based on improved constrained reinforcement learning.First,an intra-day optimal scheduling model for power system is established,incorporating the coordination of wind,solar,hydro,thermal,storage,and DC transmission,and reformulated as a constrained Markov decision process.Second,a policy network architecture embedded with temporal memory units is designed to capture the temporal dependencies of system states,while self-supervised auxiliary tasks are introduced into the value network to enhance feature representation capability.Third,the Lagrangian relaxation method is employed to derive the optimal scheduling policy under safety constraints,and an action correction module based on expert experience is incorporated to jointly ensure satisfaction of both single-step constraints and long-term coupling constraints.Finally,the effectiveness of the proposed method is validated using a modified IEEE 39-bus system and an actual power grid.关键词
清洁能源/新型电力系统/多能互补/风光水火储/日内调度/约束强化学习Key words
clean energy/new power system/multi-energy complementarity/wind-solar-hydro-thermal-storage/intra-day scheduling/constrained reinforcement learning引用本文复制引用
司睿绮,陈思远,余菀雅,张俊,徐箭..基于改进约束强化学习的风光水火储多能互补日内调度方法[J].电力系统自动化,2026,50(18):17-31,15.基金项目
国家重点研发计划资助项目(2022YFB2403500). This work is supported by National Key R&D Program of China(No.2022YFB2403500). （2022YFB2403500）
