计算机应用研究2026，Vol.43Issue(9)：2561-2574,14.DOI:10.19734/j.issn.1001-3695.2025.12.0526
基于Transformer的整数运算学习综述
Survey on learning integer arithmetic based on Transformer
摘要
Abstract
Integer arithmetic serves as the foundation of symbolic computation and mathematical reasoning.While Transformer-based large language models have significantly advanced natural language processing,their competence in mathematical rea-soning increasingly stands as a key criterion for assessing model performance.Although several surveys have systemically sum-marized researches on mathematical reasoning with Transformer,a detailed analysis of progress in learning integer arithmetic using such model remains lacking.To provide a reference for further investigation,this paper firstly introduced technologies in Transformer and large language model,followed by a systematic review of studies on integer arithmetic learning based on Transformer,where this paper partitioned existing works into those employing models trained from scratch and those utilizing pretrained models by technological approaches.It then subdivided the latter into in-context learning and finetuning.Further-more,the paper also presented a comparison and relevance analysis,in which this paper investigated learning mechanisms of integer arithmetic and then reported a summary and analysis of relevant datasets.Finally,the paper discussed current challen-ges and potential research directions,with the aim of informing future research towards more advanced computation and reaso-ning tasks.关键词
Transformer/大语言模型/整数运算/数学推理Key words
Transformer/large language model/integer arithmetic/mathematical reasoning分类
信息技术与安全科学引用本文复制引用
宋宇轩,陈长波..基于Transformer的整数运算学习综述[J].计算机应用研究,2026,43(9):2561-2574,14.基金项目
国家重点研发计划资助项目(2023YFA1009402) （2023YFA1009402）
重庆英才计划青年拔尖项目(2021000263) （2021000263）
