自动化学报2025，Vol.51Issue(7)：1403-1422,20.DOI:10.16383/j.aas.c240538
前额叶皮层启发的Transformer模型应用及其进展
The Application and Progress of Prefrontal Cortex-inspired Transformer Model
摘要
Abstract
This article focuses on the integration of biological network connectomes and brain-inspired intelligence,exploring how the structure and cognitive functions of the prefrontal cortex can inspire transformer models in the field of artificial intelligence.The prefrontal cortex plays a critical role in cognitive control and decision-making.Firstly,the article introduces some advancements of biological research related to the prefrontal cortex's attention mechanisms,biological encoding,and multisensory integration.Then,it discusses how these biological mechanisms can inspire novel brain-inspired transformer architectures,with a focus on enhancing their biological plausibility and computational efficiency in self-attention,positional encoding,and multimodal integration.Finally,it summarizes the development and potential of new brain-inspired models influenced by the prefrontal cortex,highlighting their support for the integration of various neural network types,multi-domain applications,and the construction of world models in reinforcement learning,thereby building a bridge between the fields of biology and artificial intelli-gence.关键词
生物结构/类脑智能/前额叶皮层/Transformer/世界模型Key words
Biological structures/brain-inspired intelligence/prefrontal cortex/transformer/world model引用本文复制引用
潘雨辰,贾克斌,张铁林..前额叶皮层启发的Transformer模型应用及其进展[J].自动化学报,2025,51(7):1403-1422,20.基金项目
北京市科技新星(20230484369),上海市市级科技重大专项(2021SHZDZX),中国科学院青促会基金,多模态人工智能系统全国重点实验室开放课题基金资助Supported by Beijing Nova Program(20230484369),Shanghai Municipal Science and Technology Major Project(2021SHZDZX),Youth Innovation Promotion Association of Chinese Academy of Sciences,and Open Projects Program of State Key Laboratory of Multimodal Artificial Intelligence Systems （20230484369）
