四川大学学报(自然科学版)2026,Vol.63Issue(2):275-286,12.DOI:10.19907/j.0490-6756.250241
一种基于权重重构的忆阻神经网络剪枝方法
A pruning method for RRAM neural networks based on weight reconstruction
摘要
Abstract
Resistive Random Access Memory(RRAM),with its inherent processing-in-memory capability,has emerged as an efficient hardware platform for neural network acceleration.Pruning techniques effectively compress neural networks by removing redundant weights,thereby reducing the hardware cost of RRAM-based accelerators.However,existing RRAM-oriented structured pruning methods often suffer from exces-sively coarse granularity,which can lead to accuracy degradation.Moreover,they typically neglect the nu-merical patterns shared among weights,leaving potential redundancy underexploited and limiting further im-provements in compression and hardware efficiency.To address these challenges,we propose a pruning method for RRAM neural networks based on Weight Reconstruction.Specifically,an integer scaling weight reconstruction strategy is designed to extract and share common numerical structures among weights,while discarding components with minimal impact on model accuracy.The essential weight information is then mapped onto the RRAM crossbar for network inference,achieving a compact weight representation.Further-more,a progressive retraining mechanism is introduced,where the discarded components are leveraged as guidance signals that are gradually attenuated to refine the model,thereby recovering accuracy while maintain-ing high compression and hardware efficiency.Experiments show that,compared to the state-of-the-art works,the proposed method achieves up to 1.2×,1.2×,and 1.3×improvements in compression rate,area efficiency,and energy efficiency,respectively,with negligible accuracy loss.关键词
电阻式随机存取存储器;/神经网络;/剪枝;/模型压缩;/神经网络加速器Key words
RRAM/Neural network/Pruning/Model compression/Neural network accelerator分类
信息技术与安全科学引用本文复制引用
刘静,刘鹏,姚廉,武继刚..一种基于权重重构的忆阻神经网络剪枝方法[J].四川大学学报(自然科学版),2026,63(2):275-286,12.基金项目
国家自然科学基金(62374047,62174038) (62374047,62174038)
计算机体系结构国家重点实验室开放课题(CLQ 202407) (CLQ 202407)