信号处理2026，Vol.42Issue(8)：1302-1320,19.DOI:10.12466/xhcl.2026.08.009
面向嵌入式部署的全尺寸卷积核渐进压缩方法
A Progressive Compression Method for Full-Size Convolutional Kernels Oriented Toward Embedded Deployment
摘要
Abstract
To address the issues of the expansion of the size of computational models and their adaptability to tasks in computer vision models designed for embedded deployment with low latency,we propose a progressive compression method for full-size convolutional kernels based on tensor decomposition and singular value truncation.We further pro-pose an efficient and general accelerated deployment scheme based on neural processing unit(NPU)devices.Firstly,a tensor decomposition technique was applied to replace the commonly used 3×3 large-sized convolutional kernels with lightweight convolutional derived structures,while the energy distribution of downstream 1×1 convolution kernels re-sponsible for channel combination was reshaped.Secondly,leveraging the induced energy decay characteristics,singu-lar value decomposition(SVD)was applied to perform compression on 1×1 convolution kernels to construct a light-weight and deployment-friendly vision model through a progressive compression process.Finally,in response to the common challenges faced by embedded chips-namely relatively static computational resource scheduling and the diffi-culty of directly migrating NVIDIA-oriented quantization strategies,we propose a queue-based adaptive dynamic thread adjustment strategy and a layer-sensitivity-aware mixed quantization strategy.Through finer-grained,task-aware dy-namic allocation of inference threads and the introduction of hardware feasibility weights for layer sensitivity evalua-tion,mixed quantization was ultimately achieved to fully exploit chip computational potential and realize low-latency real-time inference.Experimental results showed that the parameter compression ratios of YOLOv5s,YOLOv8s,YO-LOv8n,and YOLOv11n models reached 2.4×,3.9×,1.3×,and 1.5×,respectively,with inference speed improvements generally exceeding 30 FPS over baseline models on an RTX 3070 GPU after progressive full-size convolution kernel compression.For ResNet50 and MobileNetV2 models,parameter compression ratios of 3.7×and 1.3×were achieved with accuracy losses within 1%,which validates the generality and robustness of the proposed method.After mixed quantization,the inference speeds of the YOLO series reached 215 FPS,196 FPS,209 FPS,and 203 FPS,achieving speedups by a factor of 1.5 to 2,while the number of parameters and memory overhead were further reduced to better meet embedded deployment requirements.Real-time task processing speeds of up to 112 FPS were achieved in deploy-ment on the Huawei Ascend 310B chip despite limited hardware resources.These results demonstrate that the proposed approach effectively balances compression,deployment efficiency,and real-time performance,which makes it suitable for low-latency embedded vision applications.关键词
全尺寸卷积核/渐进压缩/动态线程调整/混合量化/嵌入式部署Key words
full-size convolutional kernel/progressive compression/dynamic thread adjustment/hybrid quantization/embedded deployment分类
信息技术与安全科学引用本文复制引用
张祥宝,杨朝旭,荣海军,李国齐..面向嵌入式部署的全尺寸卷积核渐进压缩方法[J].信号处理,2026,42(8):1302-1320,19.基金项目
陕西省重点研发计划(2023-YBGY-235) （2023-YBGY-235）
咸阳市重大科技创新项目(L2023-ZDKJ-JSGG-GY-018) （L2023-ZDKJ-JSGG-GY-018）
国家自然科学基金(61976172,12002254) Key Research and Development Program of Shaanxi(2023-YBGY-235) （61976172,12002254）
Major Scientific and Technological Innovation Project of Xianyang(L2023-ZDKJ-JSGG-GY-018) （L2023-ZDKJ-JSGG-GY-018）
The National Natural Science Foundation of China(61976172,12002254) （61976172,12002254）
