化工学报2025，Vol.76Issue(4)：1617-1634,18.DOI:10.11949/0438-1157.20241058
基于多智能体强化学习的造纸污水多目标优化
Multi-objective optimization of papermaking wastewater based on multi-agent reinforcement learning
摘要
Abstract
Papermaking wastewater treatment process is susceptible to uncertain factors such as production process conditions switching and raw material heterogeneity.In the context of the coordinated development of pollution reduction and carbon reduction in the industry,how to ensure the discharge of sewage treatment in the water quality standard,and achieve synchronous reduction of treatment costs,energy consumption,and greenhouse gas emissions is an important issue restricting the development of the industry.In this paper,a multi-objective wastewater optimization method based on Kriging method and high dimensional model representation(HDMR)is proposed for the dynamic uncertainty of papermaking wastewater treatment.In this study,benchmark simulation model No.1(BSM1)was used to simulate the biochemical and precipitation processes of papermaking wastewater treatment process.Based on biochemical metabolism mechanism and data fusion,a Kriging-HDMR proxy model for real-time solving of greenhouse gas emissions in wastewater treatment process was established.By integrating the agent model into reinforcement learning,a multi-agent system based on"solving-decision-observation"for dynamic optimization of the wastewater treatment process was established,and a coordinated multi-objective optimization model for pollution reduction and carbon reduction was obtained.The study scenario results show that compared with the open-loop system,the dynamic optimization system can reduce operating cost by 4.10%,energy consumption by 22.10%,and greenhouse gas emissions by 10.30%,and can obtain and maintain an effective multi-objective dynamic optimization control strategy.关键词
污水/优化/多目标/温室气体/运行成本/能源消耗/深度强化学习Key words
wastewater/optimization/multi-objective/greenhouse gases/operational cost/energy consumption/deep reinforcement learning分类
资源环境引用本文复制引用
何正磊,胡丁丁..基于多智能体强化学习的造纸污水多目标优化[J].化工学报,2025,76(4):1617-1634,18.基金项目
广州市基础与应用基础研究项目(2023A04J1367) （2023A04J1367）
先进纺纱织造及清洁生产国家地方联合工程实验室开放基金项目(FX20230016) （FX20230016）
