电网技术2026，Vol.50Issue(3)：中插75,1129-1139,中插76,13.DOI:10.13335/j.1000-3673.pst.2025.0405
基于改进柔性动作-评价算法的电动汽车实时充放电策略
Real-time Charging/discharging Strategy for Electric Vehicle Based on Improved Soft Actor-critic
摘要
Abstract
The randomness of user travel behavior and electricity prices poses a severe challenge to the charging and discharging optimization of electric vehicles under the guidance of real-time electricity prices.To meet this challenge,this paper proposes a real-time charging and discharging strategy for the electric vehicle based on an improved soft actor-critic.First,considering the characteristics of the efficiency changing with power during the charging and discharging process of the electric vehicle and the power boundary constraints,a nonlinear charging and discharging efficiency model and a power boundary model are established respectively to more accurately model the SOC update process.Secondly,a user anxiety model is constructed to characterize their range and time requirements to alleviate the irrational charging behavior caused by anxiety and the decision-making bias caused by it.The user travel uncertainty is characterized by the Markov chain,and their charging location and time behavior are simulated.Then,the electric vehicle charging and discharging optimization problem is modeled as a Markov decision process with unknown transition probability,and then an improved soft actor-critic integrating a triple critic network and a comprehensive experience playback mechanism is proposed to formulate the strategy for electric vehicle charging and discharging in real time.The simulation results of the example show that the proposed optimization method based on the improved soft actor-critic can meet user needs and reduce charging costs under the premise of ensuring reliable charging and discharging power,and has good adaptability to uncertainty.关键词
电动汽车/用户焦虑/充放电优化/深度强化学习/用户出行行为Key words
electric vehicle/user anxiety/charging and discharging optimization/deep reinforcement learning/user travel behavior分类
信息技术与安全科学引用本文复制引用
赵黎媛,徐富广,张献,李慕松..基于改进柔性动作-评价算法的电动汽车实时充放电策略[J].电网技术,2026,50(3):中插75,1129-1139,中插76,13.基金项目
天津市自然科学基金项目(23JCQNJC01060) （23JCQNJC01060）
河北省自然科学基金项目(F2024202005).Project Supported by Natural Science Foundation of Tianjin(23JCQNJC01060) （F2024202005）
Hebei Natural Science Foundation(F2024202005). （F2024202005）
