基于大语言模型的命名实体识别研究进展OA北大核心CSTPCD
Research Progress of Named Entity Recognition Based on Large Language Model
命名实体识别旨在从非结构化的文本中识别出命名实体及类型,是问答系统、机器翻译、知识图谱构建等自然语言处理技术中一项重要的基础任务.随着人工智能技术的发展,基于大语言模型的命名实体识别技术成为一大研究热点.对基于大语言模型的命名实体识别最新研究进展进行综述,概述大语言模型和命名实体识别的发展历程,简要介绍命名实体识别任务常用的数据集和评估方法,从基于规则和字典、基于统计机器学习和基于深度学习的命名实体识别方法这三方面对目前传统命名实体识别研究工作进行梳理.按照模型架构详细阐述不同大语言模型如何应用于不同领域的命名实体识别任务,并对存在的问题和改进的方向进行分析.总结当前基于大语言模型的命名实体识别任务面临的挑战,并展望未来的研究方向.
Named entity recognition aims to identify named entities and their types from unstructured text,which is an important basic task in natural language processing technologies such as question answering system,machine translation and knowledge graph.With the development of artificial intelligence,named entity recognition based on large language model has become a hot research topic.This paper reviews the latest research progress of named entity recognition based on large language model.Firstly,the development process of large language model and named en-tity recognition is summarized,and the commonly used datasets and evaluation methods for named entity recogni-tion tasks are briefly introduced.This paper sorts out the traditional research work on named entity recognition from three aspects:rule-based and dictionary-based,statistical machine learning-based and deep learning-based.Secondly,how to apply different big language models to different fields of named entity recognition tasks is described in detail according to the model architecture,and the existing problems and improvement directions are analyzed.Finally,the challenges faced by named entity recognition tasks based on big language models are summarized,and future re-search directions are prospected.
梁佳;张丽萍;闫盛;赵宇博;张雅雯
内蒙古师范大学 计算机科学技术学院,呼和浩特 010022
计算机与自动化
大语言模型命名实体识别神经网络深度学习
large language modelnamed entity recognitionneural networkdeep learning
《计算机科学与探索》 2024 (010)
2594-2615 / 22
国家自然科学基金(61462071);内蒙古自然科学基金(2023LHMS06009,2024MS06020);内蒙古自治区教育科学研究"十四五"规划2023年度课题(2023NGHZXZH119,NGJGH2023234).This work was supported by the National Natural Science Foundation of China(61462071),the Natural Science Foundation of Inner Mongolia(2023LHMS06009,2024MS06020),and the Subject of the"14th Five-Year Plan"of Educational Science Research in Inner Mongolia Autonomous Region in 2023(2023NGHZXZH119,NGJGH2023234).
评论