计算机科学与探索2024，Vol.18Issue(3)：718-730,13.DOI:10.3778/j.issn.1673-9418.2301050
面向图像复原和增强的轻量级交叉门控Transformer
Lightweight Cross-Gating Transformer for Image Restoration and Enhancement
摘要
Abstract
Recent image restoration and image enhancement methods are difficult to balance the robustness of multi-ple subtasks with the small number of parameters and computational costs.To solve this problem,this paper proposes a lightweight cross-gating transformer(CGT)for efficient image restoration task.On the one hand,this paper sum-marizes the limitations of traditional global self-attention mechanism to capture global dependencies,and improves the global self-attention mechanism to a cross-level cross-gating self-attention mechanism.Meanwhile,a light-weight feed-forward neural network is proposed to learn cross-level local dependencies at a very small computational cost and reconstruct clear features in the adjacent locality.On the other hand,in view of the defect that the traditional method of adding or concatenating encoder and decoder equally leads to information interference,a long-distance re-set update module is proposed to suppress and update useless information and clear features respectively.This paper conducts extensive quantitative experiments and is compared with 25 state-of-the-art methods on 9 datasets for image denoising,image deraining and low-light image enhancement,respectively.Experimental results prove that the pro-posed lightweight cross-gating transformer achieves high peak signal-to-noise ratio and structural similarity in im-age restoration and image enhancement tasks with a small number of parameters and computation,and reconstructs clear images close to real-world scenes,achieving state-of-the-art image restoration performance.关键词
图像复原/图像增强/深度学习/Transformer/轻量化/特征融合Key words
image restoration/image enhancement/deep learning/Transformer/lightweight/feature fusion分类
信息技术与安全科学引用本文复制引用
薛金强,吴秦..面向图像复原和增强的轻量级交叉门控Transformer[J].计算机科学与探索,2024,18(3):718-730,13.基金项目
国家自然科学基金(61972180).This work was supported by the National Natural Science Foundation of China(61972180). （61972180）
