天然气工业2026，Vol.46Issue(8)：125-138,14.DOI:10.3787/j.issn.1000-0976.2026.08.010
基于强化学习的压裂泵注自主决策模型
A reinforcement learning-based autonomous decision-making model for fracturing pumping
摘要
Abstract
Existing decision-making methods for fracturing pumping mostly rely heavily on human experience and monitoring data,leading to response lag and uncertainty,so they struggle to fully adapt to the rapid and complex changes during the fracturing process.Focusing on the online optimization of fracturing operations,this paper proposes a deep reinforcement learning-based autonomous decision-making method for fracturing pumping,which perceives fracturing states in real time using agents and autonomously determine pumping rate and proppant concentration.In addition,tests are carried out on 20 fracturing stages not involved in training to verify the generalization capacity of the agent.The following results are obtained.First,compared with other network structures,the GRU+MLP dynamic-static feature fusion network achieves higher average value estimation and more stable convergence.Second,the TD3 algorithm,combined with training mechanisms including experience replay and target network soft update can reduce value-estimation fluctuations and improve strategy optimization stability.Third,in the test fracturing stages,the agent achieves an average response time of less than 0.1 s under a 60 s decision window,increases the conformity rate of fracture half-length from 85.4%to 96.0%and that of fracture width from 77.4%to 82.8%,improves the final reward from 6.28 to 6.66,and weakens wellhead and bottomhole pressure fluctuations.In conclusion,the proposed closed-loop decision-making system based on deep reinforcement learning can achieve real-time autonomous control of fracturing pumping parameters,promote the transformation of fracturing operations from static design driven to dynamic intelligent decision-making,providing a novel technical idea for intelligent fracturing of unconventional reservoirs.关键词
非常规油气/水力压裂/压裂泵注/智能压裂/深度强化学习/TD3算法/智能体/自主决策Key words
Unconventional oil and gas/Hydraulic fracturing/Fracturing pumping/Intelligent fracturing/Deep reinforcement learning/TD3 algorithm/Agent/Autonomous decision-making分类
能源科技引用本文复制引用
胡忠宇,盛茂,李荣耀,魏朝阳,朱丹丹,田守嶒,李根生..基于强化学习的压裂泵注自主决策模型[J].天然气工业,2026,46(8):125-138,14.基金项目
国家自然科学基金创新研究群体项目"新型射流钻井完井"(编号:52421002)、国家自然科学基金国际(地区)合作与交流项目"水力压裂多尺度多场耦合问题的智能表征理论与方法"(编号:52320105002). （编号:52421002）
