现代信息科技2026，Vol.10Issue(3)：40-44,5.DOI:10.19850/j.cnki.2096-4706.2026.03.009
基于大模型标签蒸馏的搜索意图识别
Search Intent Recognition Based on Large Model Label Distillation
李睿琪 1秦志鹏2
作者信息
- 1. 科大讯飞股份有限公司,安徽 合肥 230088
- 2. 安徽皖通科技股份有限公司,安徽 合肥 230088
- 折叠
摘要
Abstract
In search engines,accurately recognizing the intent of user queries is crucial for improving search experience.Search intent recognition belongs to the task of short text classification.Traditional methods rely on massive manually labeled data,which implies high costs and difficulty in adapting to the rapid emergence of new intents.This paper proposes a search intent recognition method based on large model label distillation.It utilizes the powerful semantic understanding capabilities of Large Language Models(such as GPT4o,DeepSeek-R1,and Spark x1)to generate high-quality intent labels for unlabeled query instructions and construct training datasets.Furthermore,through Knowledge Distillation technology,the knowledge of large models is transferred to lightweight pre-trained models(such as ERNIE 3.0 and BERT)for fine-tuning.Experimental results show that this method significantly improves model performance on a Chinese dataset with a scale of 136 000,and effectively enhances intent recognition efficiency while reducing labeling costs.关键词
意图识别/文本分类/标签蒸馏/大模型/预训练模型Key words
intent recognition/text classification/label distillation/large model/pre-trained model分类
信息技术与安全科学引用本文复制引用
李睿琪,秦志鹏..基于大模型标签蒸馏的搜索意图识别[J].现代信息科技,2026,10(3):40-44,5.
