南方电网技术2026,Vol.20Issue(3):74-88,15.DOI:10.13648/j.cnki.issn1674-0629.2026.03.008
基于深度强化学习的建筑综合能源系统主从博弈优化调度
Stackelberg Game Optimization Scheduling in Building Integrated Energy Systems Based on Deep Reinforcement Learning
摘要
Abstract
As the global society is increasingly concerned about the transition to sustainable energy practices,building integrated energy systems optimization is significant in improving low-carbon and economic energy consumption.Therefore,research is conducted on the scheduling and pricing strategies of building energy operators.Firstly,the information interaction characteristics of both the supply side and the demand side are considered.A two-side optimization model of the building integrated energy system based on the Stackelberg game framework is established with the supply side as the leader and the demand side as the follower.Secondly,a deep deterministic strategy gradient algorithm is proposed based on the adaptive action exploration mechanism to solve the constructed model efficiently given the multiple information interactions between the two sides of the Stackelberg game framework.The adaptive action exploration mechanism constructs the action selection strategy of the adaptive exploration coefficient improvement algorithm based on the variance of the cumulative rewards and the average loss value of the critic network,ensuring the algorithm's accuracy and stability.Finally,the effectiveness of the proposed algorithm is verified by examples.The experimental results show that compared with other deep reinforcement learning algorithms,the proposed algorithm can improve the convergence accuracy and stability of the algorithm,as well as the total revenue of the energy operator,thus assisting the energy supply side in making better decisions.关键词
深度强化学习/建筑综合能源系统/智能调度/主从博弈/能源定价Key words
deep reinforcement learning/building integrated energy system/intelligent scheduling/Stackelberg game/energy pricing分类
信息技术与安全科学引用本文复制引用
申晓宁,陈星晖,陈文言,许新苏..基于深度强化学习的建筑综合能源系统主从博弈优化调度[J].南方电网技术,2026,20(3):74-88,15.基金项目
国家自然科学基金资助项目(61502239) (61502239)
江苏省自然科学基金资助项目(BK20150924). Supported by the National Natural Science Foundation of China(61502239) (BK20150924)
the Natural Science Foundation of Jiangsu Province(BK20150924). (BK20150924)