液晶与显示2024，Vol.39Issue(8)：1103-1115,13.DOI:10.37188/CJLCD.2023-0280
基于双流增强编码和注意优化解码的图像篡改定位算法
Dual-stream enhancement encoder and attention optimization decoder for image manipulation localization
摘要
Abstract
Mainstream image manipulation localization methods usually fuse inconsistent features of different streams through simple operations,resulting in feature redundancy and pixel misdetection of tampered regions.Therefore,we propose a novel network of dual-stream enhancement encoder and attention optimization decoder for image manipulation localization.Firstly,the dual-stream enhancement encoder module can self-reinforce and interact with the extracted dual-stream multi-scale features,and can make full use of a variety of tampered information,so that a variety of tampered information can be complemented by interaction,and more attention is paid to the tampering features.Then,a multi-scale receptive field strategy is introduced to explore multi-scale context information,and an adjacent-level feature aggregation module is designed to fuse multi-scale adjacent features.Finally,the capability of manipulation localization is enhanced with the cooperation of tamper region and genuine region,the attention optimization decoder module is designed to eliminate the wrong prediction of edge pixels in the initial tamper region prediction,and the manipulation localization is refined step by step.Extensive experiments are constructed on four mainstream public datasets,NIST16,Coverage,Columbia and CASIA,and two realistic challenge datasets,IMD20 and Wild,to compare with mainstream manipulation localization methods.Our proposed method has superior performance under six datasets in the settings of none fine-tuning and fine-tuning model,which demonstrates that our proposed method can make full use of various forgery clues to achieve greater localization accuracy and stronger robustness.关键词
图像篡改定位/双流增强编码/注意优化解码/邻阶特征聚合Key words
image manipulation localization/dual-stream enhancement encoder/attention optimization decoder/adjacent feature aggregation module分类
信息技术与安全科学引用本文复制引用
朱叶,赵晓祥,于洋..基于双流增强编码和注意优化解码的图像篡改定位算法[J].液晶与显示,2024,39(8):1103-1115,13.基金项目
国家自然科学基金青年项目(No.62102129) （No.62102129）
河北省自然科学基金(No.F2021202030) （No.F2021202030）
石家庄市驻冀高校基础研究项目(No.241790817A)Supported by Youth Program of National Natural Science Foundation of China(No.62102129) （No.241790817A）
Natural Science Foundation of Hebei Province(No.F2021202030) （No.F2021202030）
Basic Research Project of Hebei Universities in Shijiazhuang(No.241790817A) （No.241790817A）
