集成技术2026，Vol.15Issue(5)：147-159,13.DOI:10.12146/j.issn.2095-3135.20260119001
大语言模型推理基础设施的技术挑战与应对策略
Technical Challenges and Solutions for Large Language Model Inference Infrastructure
摘要
Abstract
Currently,large language models have become mature enough and are demonstrating application potential in various scenarios.With the development of the AI agent ecosystem,the inference workload of large language models have surpassed the training workload,becoming the core engine driving the growth of computing power demand.However,this shift in focus from model"training"to"inference"has placed significant pressure on inference infrastructure.This article analyzes the evolutionary trends of large language model inference infrastructure,summarizes the technical challenges it faces across the four dimensions of"computing,communication,storage,and scheduling",and in combination with Lenovo's innovative practices,proposes targeted hardware-software collaborative solutions.关键词
基础设施/大语言模型/推理/软硬件协同设计Key words
infrastructure/large language model/inference/hardware-software co-design分类
信息技术与安全科学引用本文复制引用
蒋超,肖利民,祝明发..大语言模型推理基础设施的技术挑战与应对策略[J].集成技术,2026,15(5):147-159,13.
