|国家科技期刊平台
首页|期刊导航|计算机科学与探索|基于深度学习的多聚焦图像融合方法前沿进展

基于深度学习的多聚焦图像融合方法前沿进展OA北大核心CSTPCD

Critical Review of Multi-focus Image Fusion Based on Deep Learning Method

中文摘要英文摘要

多聚焦图像融合是一种有效的图像融合技术,旨在将来自同一场景的不同焦平面的源图像组合起来以获得良好的融合结果,这意味着融合后的图像将在所有焦平面都聚焦,也就是包含着更丰富的场景信息.深度学习的发展促进了图像融合的巨大进步,而神经网络强大的特征提取和重构能力使融合结果大有可为.近年来,出现了越来越多的基于深度学习的多聚焦图像融合方法,如卷积神经网络(CNN)、生成对抗网络(GAN)和自动编码器等.为了给相关研究人员和技术人员提供有效的参考和理解,介绍了多聚焦图像融合的概念和一些评价指标,分析了十几种近几年基于深度学习的多聚焦图像融合前沿方法,讨论了各种方法的特点和创新性,并总结了它们的优缺点,回顾了多聚焦图像融合技术在各种场景中的应用,包括摄影可视化、医疗诊断和遥感检测等领域,介绍了目前多聚焦图像融合相关领域面临的一些挑战并展望了未来可能的研究趋势.

Multi-focus image fusion is an effective image fusion technology,which aims to combine source images from different focal planes of the same scene to obtain a good fusion result.This means that the fused image will fo-cus on all focal planes,that is,it contains more abundant scene information.The development of deep learning pro-motes the great progress of image fusion,and the powerful feature extraction and reconstruction ability of neural net-work makes the fusion result promising.In recent years,more and more multi-focus image fusion methods based on deep learning have been proposed,such as convolutional neural network(CNN),generative adversarial network(GAN)and automatic encoder,etc.In order to provide effective reference for relevant researchers and technicians,firstly,this paper introduces the concept of multi-focus image fusion and some evaluation indicators.Then,it analyzes more than ten advanced methods of multi-focus image fusion based on deep learning in recent years,discusses the characteristics and innovation of various methods,and summarizes their advantages and disadvantages.In addition,it reviews the application of multi-focus image fusion technology in various scenes,including photographic visualization,medical diagnosis,remote sensing detection and other fields.Finally,it proposes some challenges faced by current multi-focus image fusion related fields and looks forward to future possible research trends.

李子奇;苏宇轩;孙俊;张永宏;夏庆锋;尹贺峰

无锡学院 自动化学院,江苏 无锡 214105南京信息工程大学 自动化学院,南京 210044江南大学 人工智能与计算机学院,江苏 无锡 214122

计算机与自动化

深度学习图像融合多聚焦

deep learningimage fusionmulti-focus

《计算机科学与探索》 2024 (009)

2276-2292 / 17

国家重点研发计划政府间国际科技创新合作重点专项(2021YFE0116900);国家自然科学基金面上项目(42175157);江苏省高等学校自然科学研究面上项目(22KJB520037,23KJB520036);无锡市"太湖之光"科技攻关项目(K20231003,K20231010);无锡学院引进人才科研启动专项(2021r032). This work was supported by the National Key Research and Development Program of China(2021YFE0116900),the National Natural Science Foundation of China(42175157),the General Project of Natural Science Research of Jiangsu Higher Education Institutions(22KJB520037,23KJB520036),the"Taihu Light"Science and Technology Project of Wuxi(K20231003,K20231010),and the Research Start-up Fund for Introduced Talents of Wuxi University(2021r032).

10.3778/j.issn.1673-9418.2306058

评论