基于知识图谱增强大语言模型双碳领域服务OACSTPCD
Enhanced Big Language Model Dual Carbon Domain Services Based on Knowledge Graph
随着大语言模型的不断发展,其已经在很多领域中得到了广泛的应用.由于大语言模型缺乏双碳领域的知识,直接将大语言模型应用于双碳领域,回复结果准确性偏低.因此,采用构建双碳知识图谱作为知识库的方法,来增强大语言模型在碳达峰碳中和领域中的应用.采用LoRA方法对大语言模型进行微调,提高模型对碳达峰碳中和领域关键词的提取能力,构建双碳知识图谱作为本地知识库为模型提供双碳领域知识,将知识作为问题的上下文,让大语言模型学习,并设计提示工程辅助模型生成回复,最后对回复进行效果评估.实验结果表明,与直接使用大语言模型相比,基于知识图谱增强大语言模型双碳领域服务的方法,在碳达峰碳中和领域的智能化回复结果准确率高,为碳达峰碳中和领域建设提供了有效助力.
With the continuous development of the large language model,it has been widely applied in many fields.Due to the lack of knowledge in the dual carbon field in the big language model,the accuracy of the response results is low if the large lan-guage model is directly applied to the field of double carbon.Therefore,the method of constructing dual carbon knowledge graph as a knowledge base is adopted to enhance the application of large language models in the field of carbon peaking and carbon neu-trality.The LoRA method is used to fine-tune the large language model to improve its ability to extract keywords in the carbon peaking and carbon neutrality fields.A dual carbon knowledge graph is constructed as local knowledge base to provide dual car-bon domain knowledge for the model.The knowledge is used as the context of the problem,allowing the large language model to learn,and a prompt engineering assistance model is designed to generate responses.Finally,the effectiveness of the responses is evaluated.The experimental results show that,compared with the direct use of large language model,the method based on knowl-edge graph to enhance the dual carbon domain service of large language model has a high accuracy of intelligent response results in the field of carbon peaking and carbon neutrality,and provides an effective assistance for the construction of carbon peaking and carbon neutrality.
齐俊;曲睿婷;教传铭;周巧妮;郭彦良;覃文军
沈阳工业大学电气工程学院,辽宁 沈阳 110870||国网辽宁省电力有限公司信息通信分公司,辽宁 沈阳 110006国网辽宁省电力有限公司信息通信分公司,辽宁 沈阳 110006东北大学计算机科学与工程学院,辽宁 沈阳 110819
计算机与自动化
大语言模型知识图谱知识库LoRA方法碳达峰碳中和
large language modelknowledge graphknowledge baseLoRA methodpeak carbon dioxide emissions and car-bon neutrality
《计算机与现代化》 2024 (009)
8-14 / 7
国家电网有限公司总部科技项目(5108-202218280A-2-404-XG)
评论