中国电机工程学报2025，Vol.45Issue(24)：9617-9631,中插12,16.DOI:10.13334/j.0258-8013.pcsee.241513
基于改进型深度确定性策略梯度算法的城轨地面式储能系统能量管理策略
Energy Management Strategy of Urban Rail Wayside Energy Storage System Based on Improved Deep Deterministic Policy Gradient Algorithm
摘要
Abstract
Wayside storage regenerative braking energy recovery system can effectively absorb and reuse the residual regenerative braking energy of trains,and has been widely used in urban rail transit.This paper proposes an energy management strategy based on improved deep deterministic policy gradient algorithm for the characteristics of the traction power supply system in the actual scenario of multi-substations and multi-energy storage systems(ESSs).On the one hand,this strategy solves the continuous control problem proposed by the efficient utilization of regenerative braking energy for the ESS in the actual operation condition;On the other hand,fuzzy logic control is used to guide the agent learning to solve the reward shaping difficulties and sparse rewards when applying deep reinforcement learning.In addition,the proposed strategy is verified by simulation based on actual line conditions,and the results show that the proposed strategy can significantly optimize the control effect of the ESS to achieve better energy saving and voltage regulation.关键词
城轨交通/地面式储能系统/能量管理策略/深度强化学习/模糊逻辑控制Key words
urban rail transit/wayside energy storage system/energy management strategy/deep reinforcement learning/fuzzy logic control分类
信息技术与安全科学引用本文复制引用
李炎,林飞,钟志宏,杨中平..基于改进型深度确定性策略梯度算法的城轨地面式储能系统能量管理策略[J].中国电机工程学报,2025,45(24):9617-9631,中插12,16.基金项目
中央高校基本科研业务费专项资金项目(2023YJS065).The Fundamental Research Funds for the Central Universities(2023YJS065). （2023YJS065）
