计算机科学与探索2026，Vol.20Issue(7)：1841-1860,20.DOI:10.3778/j.issn.1673-9418.2512024
词嵌入模型研究综述
Survey of Word Embedding Models Research
摘要
Abstract
As a foundational technology in natural language processing,word embedding models map discrete linguistic symbols into continuous vector representations that computers can process.Their representational capacity and generalization performance directly impact the effectiveness of downstream tasks.Traditional word representation methods struggle to capture semantic relationships between words,while static word embedding methods fail to handle polysemy effectively.With the development of pre-trained language models and large language models,word embedding technology has gradually evolved from fixed vector representations to dynamic representations with contextual awareness.However,current research has yet to systematically incorporate the new paradigms of embedding models in the era of large language models.This paper comprehensively reviews the development trajectory of word embedding models,dividing their evolution into four stages based on typical technical paradigms:static word embeddings based on statistics,static word embeddings based on feedforward neural networks,dynamic word embeddings based on pre-trained language models,and dynamic word embeddings based on large language models.For each stage,the representative models,core principles,and their advan-tages and disadvantages are elaborated.The dynamic word embedding methods based on large language models are systematically categorized into three technical approaches:pooling,prompt engineering,and fine-tuning.The intrinsic and extrinsic evaluation methods for word embedding models and their interrelationships are examined.Addressing the current limitations of word embedding models,future research directions such as multimodal fusion,efficiency optimization,low-resource adaptation,and interpretability are proposed.关键词
自然语言处理/词嵌入模型/神经网络/大语言模型/微调Key words
natural language processing/word embedding models/neural networks/large language models/fine-tuning分类
信息技术与安全科学引用本文复制引用
文永琪,杨若鹏,陶宇,钟义豪,黄博..词嵌入模型研究综述[J].计算机科学与探索,2026,20(7):1841-1860,20.基金项目
国家社会科学基金重点项目(2025SKJJB027). This work was supported by the Key Project of the National Social Science Foundation of China(2025SKJJB027). （2025SKJJB027）
