计算机技术与发展2025,Vol.35Issue(5):214-220,7.DOI:10.20165/j.cnki.ISSN1673-629X.2024.0404
基于BERT的猕猴桃病虫害命名实体识别
Named Entity Recognition of Kiwifruit Pests and Diseases Based on BERT
摘要
Abstract
Aiming at the difficulties in the field of kiwifruit pests and diseases,such as the scarcity of training data,the complex and variable entity structure,the variety of entity types,and the uneven distribution of entities,a BERT model based on data enhancement was introduced.Firstly,the kiwifruit pest and disease dataset KIVINER,which contains 11 entity categories,was constructed after analyzing the information of six collected books,and then in order to effectively expand the kiwifruit pest and disease dataset,two data enhancement methods,namely,sentence restructuring and language model-based generation,were used.In the preliminary study,the performance of five models,namely IDCNN-CRF,BERT-BiLSTM-CRF,RoBERT-BiLSTM-CRF,ALBERT,and BERT,were tested on the original kiwifruit pest and disease dataset.The experimental results showed that the BERT model achieved F1 values of over 90%on all 10 classes of entities,with an overall F1 value of 93.4%.Subsequently,the effects of different data enhancement strategies on the performance of the BERT model in the kiwifruit pest and disease named entity recognition task were explored.The experimental results showed that the F1 values of the sentence restructuring approach and the language model-based approach were improved to 94.29%and 94.11%,respectively.Combining the two data enhancement methods resulted in the highest precision,recall and F1 values of 94.12%,95.17%and 94.64%,respectively,while the model also achieved good results on the public dataset Resume,indicating that the model has some generalization ability.关键词
猕猴桃病虫害/数据增强/BERT/句子重组/语言模型生成/命名实体识别Key words
kiwifruit pests and diseases/data enhancement/BERT/sentence restructuring/language model generation/named entity recog-nition分类
信息技术与安全科学引用本文复制引用
文青青,李金星,王虎,李莉婕,赵泽英,郭雷风..基于BERT的猕猴桃病虫害命名实体识别[J].计算机技术与发展,2025,35(5):214-220,7.基金项目
贵州省科技支撑项目(黔科合支撑[2023]一般189) (黔科合支撑[2023]一般189)
贵州省科研机构创新能力建设专项资金(黔科合服企[2021]15号) (黔科合服企[2021]15号)