中国水利Issue(11):8-19,12.DOI:10.3969/j.issn.1000-1123.2025.11.002
引调水工程安全智慧监管多模态大模型构建技术研究
Multimodal large model construction technology for intelligent safety supervision of water diversion projects
摘要
Abstract
With the comprehensive development of the"sky-space-earth-water-project"integrated monitoring system,safety management data of water diversion projects exhibit characteristics of multi-source heterogeneity,large volume,and dynamic complexity.Traditional analysis and mining methods based on single-modality data face significant limitations in the context of intelligent safety supervision.By integrating multimodal large models with knowledge graph technology,an intelligent supervision paradigm of"perception-cognition-decision"is proposed.Based on standards and specifications,risk and emergency management materials,inspection texts and images,and multispectral remote sensing imagery,a multimodal large model is fine-tuned and combined with a dynamic prompting strategy to construct a multimodal knowledge graph for engineering safety.Retrieval augmented generation(RAG)and the structured knowledge within the knowledge graph are employed to enhance the model's reliability and reasoning capability in specialized domains.A collaborative multi-agent decision chain construction method is introduced,enabling the coupling of model capabilities through dynamic task orchestration to support risk identification,assessment,and contingency planning in safety management.Experimental results show that the proposed method achieves high accuracy in multimodal knowledge extraction,providing effective support for intelligent safety supervision of water diversion projects.关键词
智能监管/多模态大模型/多模态知识图谱/安全智慧监管/引调水工程Key words
intelligent supervision/multimodal large model/multimodal knowledge graph/intelligent safety supervision/water diversion projects分类
水利科学引用本文复制引用
王立虎,刘雪梅,李海瑞,陈晓楠..引调水工程安全智慧监管多模态大模型构建技术研究[J].中国水利,2025,(11):8-19,12.基金项目
国家重点研发计划(2024YFC3210802) (2024YFC3210802)
国家自然科学基金项目(72271091) (72271091)
2022年度水利部重大科技项目(SKS-2022029) (SKS-2022029)
河南省科学院科技开放合作项目(220901008) (220901008)
河南省高等教育重点研发项目(24A520021). (24A520021)