电子学报2024，Vol.52Issue(5)：1783-1800,18.DOI:10.12263/DZXB.20231198
多GPU系统非一致存储访问优化:研究进展与展望
Non-Uniform Memory Access Optimization on Multi-GPU Systems:Research Progress and Prospect
摘要
Abstract
Due to the slowdown of transistor scaling,it has become increasingly difficult to enhance the performance of a single GPU(Graphics Processing Units).Therefore,multi-GPU systems have become the main means to improve the performance of GPU systems.However,due to the constraints of off-chip physical design,the bandwidth imbalance be-tween processors in multi-GPU systems leads to non-uniform memory access(NUMA)problems,which seriously affects the performance of multi-GPU systems.In order to reduce the performance loss caused by non-uniform memory access,this paper first analyzes the causes of non-uniform memory access and compares existing solutions for non-uniform memory ac-cess.For non-uniform memory access with different dimensions,this paper summarizes optimization solutions for non-uni-form memory access from two directions:reducing remote access traffic and improving remote access performance.Finally,combining the advantages and disadvantages of these solutions,this paper proposes the future development direction of non-uniform memory access optimization for multi-GPU systems.关键词
多GPU系统/非一致存储访问/GPU访存Key words
multi-GPU system/non-uniform memory access/GPU memory access分类
信息技术与安全科学引用本文复制引用
李晨,刘畅,葛一漩,郭阳..多GPU系统非一致存储访问优化:研究进展与展望[J].电子学报,2024,52(5):1783-1800,18.基金项目
国家自然科学基金(No.62202478) （No.62202478）
国防科技大学自主创新科学基金(No.23-ZZCX-JDZ-12) National Natural Science Foundation of China(No.62202478) （No.23-ZZCX-JDZ-12）
NUDT Innovation Science Foundation(No.23-ZZCX-JDZ-12) （No.23-ZZCX-JDZ-12）
