光学精密工程2025，Vol.33Issue(7)：1152-1168,17.DOI:10.37188/OPE.20253307.1152
基于多尺度空间注意力互补的红外与可见光图像融合
Infrared and visible image fusion based on multi-scale spatial attention complementary
摘要
Abstract
Current infrared and visible image fusion methods tend to introduce excessive redundant infrared information,impairing the ability to balance complex scene details and resulting in suboptimal fusion out-comes.To address these limitations,a novel fusion approach based on multi-scale spatial attention com-plementarity is proposed.This method employs a dual-branch convolutional network to separately extract features from infrared and visible images,followed by difference-based complementary processing.Multi-scale spatial attention mechanisms are then applied to the feature maps,culminating in regression-based su-perposition to achieve balanced fusion of complementary features.Experimental evaluations demonstrate that,compared to mainstream methods such as Densefuse and PIAFusion,the proposed approach achieves improvements of 4.1%and 4.3%in mutual information(MI),and 5.0%and 2.3%in visual in-formation fidelity(VIF),respectively.These results indicate enhanced retention of target features and ef-fective suppression of redundant information within complex scenes.The method exhibits strong feature balancing capabilities and holds significant potential for applications in target detection and recognition un-der challenging environmental conditions.关键词
图像融合/红外和可见光图像/双分支卷积网络/差异互补/多尺度空间注意力/回归叠加Key words
image fusion/infrared and visible image/double branch convolutional network/complemen-tary difference/multi-scale spatial attention/regression overlay分类
信息技术与安全科学引用本文复制引用
张永兴,连博文,顾乃庭,李方召,李杨..基于多尺度空间注意力互补的红外与可见光图像融合[J].光学精密工程,2025,33(7):1152-1168,17.基金项目
国家重点研发计划资助项目(No.2021YFC2202200) （No.2021YFC2202200）
国家自然科学基金资助项目(No.12293031,No.12403088) （No.12293031,No.12403088）
四川省自然科学基金资助项目(No.2024NSFSC1391) （No.2024NSFSC1391）
