计量学报2023，Vol.44Issue(12)：1863-1871,9.DOI:10.3969/j.issn.1000-1158.2023.12.12
基于改进深度强化学习的HEV能量分配策略研究
Research on HEV Energy Distribution Strategy Based on Improved Deep Reinforcement Learning
摘要
Abstract
A parallel hybrid vehicle was studied to establish the demand power and power system model of the whole vehicle and proposed an energy distribution strategy based on improved Deep Reinforcement Learning(DRL).The DRB-TD3 algorithm was proposed to improve the sampling efficiency of the original algorithm by improving the Twin Delayed Deep Deterministic Policy Gradient(TD3)algorithm in DRL and introduced dual replay buffers.A rule-based constraint controller was designed and embedded into the algorithm structure to eliminate unreasonable torque allocation.The performance of the Dynamic Planning(DP)-based energy distribution strategy was used as a benchmark for simulation experiment under UDDS driving conditions.The experimental results show that the DRB-TD3 algorithm has the best convergence performance compared with the Deep Deterministic Policy Gradient(DDPG)algorithm and the conventional TD3 algorithm,with 61.2%and 31.6%improvement in convergence efficiency,respectively.The proposed energy distribution strategy reduces the average fuel consumption by 3.3%and 2.3%compared with the DDPG-and TD3-based energy distribution strategies,respectively.The fuel performance reaches 95.2%of DP-based,which with the best fuel economy,and the battery state of charge(SOC)can be maintained at a better level,which helps to extend the battery life.关键词
并联式混合动力汽车/能量分配策略/深度强化学习/TD3算法/荷电状态Key words
parallel hybrid electric vehicle/energy distribution strategy/deep reinforcement learning/TD3 algorithm/SOC引用本文复制引用
吴忠强,马博岩..基于改进深度强化学习的HEV能量分配策略研究[J].计量学报,2023,44(12):1863-1871,9.基金项目
河北省自然科学基金(F2020203014) （F2020203014）
