湖北电力2024，Vol.48Issue(3)：9-19,11.DOI:10.19308/j.hep.2024.03.002
基于多智能体图强化学习的电动汽车充电引导策略优化
Optimization of EV Charging Guidance Strategy Based on Multi-Agent Graph Reinforcement Learning
摘要
Abstract
In order to solve a series of problems such as high charging cost caused by a large number of electric vehicles(EVs)charging in a complex power-transportation coupling system,inadequate utilization of charging station resources,and instability of the grid caused by a large number of EV loading connected to the grid,this paper takes into account the interests of EVs,charging stations and power grid,and proposes a multi-agent graph reinforcement learning(MAGRL)algorithm to optimize EV charging guidance strategy.First,under the power-transportation coupling system,a multi-objective EV fast charging demand model is constructed with EV charging time cost and economic cost,unbalance of charging station and average voltage deviation of power grid as multiple objectives.Then,a real-time online charging path guidance framework with dual timescale is constructed.On the slow timescale,second-order cone optimization is used to solve the optimal power flow of the distribution network to obtain the node marginal price,and on the fast timescale,a MAGRL algorithm is proposed to solve the charging strategy of electric vehicles.On this basis,in order to protect the privacy of EV users,a feature processing method is proposed of using independent information module to extract EV information.Finally,simulations are carried out on a regional 25-node traffic network and IEEE 33-node power system.The simulation results show that compared with the shortest path method,the proposed MAGRL algorithm can effectively reduce the time cost and economic cost of EV users,promote the balanced operation of charging stations and reduce voltage offset.In addition,it is verified that the proposed MAGRL algorithm can adapt to the scenarios with different charging needs,thus with good scalability.关键词
电动汽车/电力-交通耦合系统/充电引导/多智能体/图强化学习Key words
electric vehicle/power-transportation coupling system/charging guidance/multi-agent/graph reinforcement learning分类
信息技术与安全科学引用本文复制引用
梁华彬,林兼,袁羽娟..基于多智能体图强化学习的电动汽车充电引导策略优化[J].湖北电力,2024,48(3):9-19,11.基金项目
福建省自然科学基金(项目编号:2022J05125). （项目编号:2022J05125）
