水利学报2025，Vol.56Issue(4)：519-530,12.DOI:10.13243/j.cnki.slxb.20240575
多模态知识图谱与大模型协同的水利工程风险应对决策推荐
Multimodal knowledge graph collaborated with large model for decision recommendation of water projects risk response
摘要
Abstract
With the development of water projects and the increasing demand for informatization,it becomes in-creasingly crucial to effectively process and use inspection data from water project to make risk response decisions.The risk inspection texts of the South-to-North Water Diversion Project involve numerous influencing factors,com-plex interrelationships,and multi-source heterogeneous data.To effectively utilize the inspection text and ensure the timeliness and effectiveness of the engineering risk response,a method that integrates multimodal knowledge graph with multimodal large model(MLLM)based on inspection text data is proposed,aiming to provide targeted decision-making recommendations for risks in the operation of the South-to-North Water Diversion Project.Firstly,the open-source multimodal large language model VIP-LLaVA,which focuses more on regional locations,is chosen as the dialog model.Secondly,a domain-specific multimodal knowledge graph is constructed based on water project inspection data.Lastly,the multimodal knowledge graph(MMKG)of the water conservancy domain is used as the augmented knowledge of the multimodal large model,and the retrieval and generation of collaborative and iterative approach is adopted to identify the most pertinent solutions and to formulate risk response decisions.The results indicate that the method works well on BLEU,ROUGE-L and METEOR evaluation indexes when gen-erating risk response decisions,and can formulate corresponding response decision recommendations to the opera-tional risks in the project in time.The related research can effectively improve the reliability of engineering safety maintenance management and reduce the impact of engineering risks on water supply safety.关键词
多模态知识图谱/多模态大模型/风险应对/南水北调工程Key words
multimodal knowledge graph/multimodal large model/risk response/South-to-North Water Diver-sion Project分类
信息技术与安全科学引用本文复制引用
杨阳蕊,潘世峰,刘雪梅,马威,冯岭..多模态知识图谱与大模型协同的水利工程风险应对决策推荐[J].水利学报,2025,56(4):519-530,12.基金项目
国家自然科学基金项目(72271091) （72271091）
河南省高等学校重点科研项目(25A520006) （25A520006）
河南省科学院科技开放合作项目(220901008) （220901008）
华北水利水电大学硕士研究生创新能力提升工程项目(NCWUYC-202416098) （NCWUYC-202416098）
