液晶与显示2024,Vol.39Issue(8):1024-1036,13.DOI:10.37188/CJLCD.2023-0255
基于多特征融合的人像HDR图像处理算法
HDR image processing algorithm for portrait based on multi feature fusion
摘要
Abstract
Deep learning based high dynamic range(HDR)image processing algorithms has the problem of skin color deviation when processing images containing human figures.In response to this issue,this article proposes a portrait HDR image processing algorithm based on multi feature fusion-U2HDRnet.This algorithm consists of three parts:skin feature extraction module,trilateral feature extraction module and color reconstruction module.Firstly,the skin feature extraction module separates the color and position information of the skin region.Secondly,the trilateral feature extraction module extracts local features,global features and semantic features of the image,and fuses them with skin features.Finally,the color reconstruction module interpolates the grid in terms of space and color depth.In addition,this article adds an improved fusion module of self attention and convolution to improve the processing performance of HDR.At the same time,this article also produces the PortraitHDR dataset for portraits,filling the gap in the dataset in this field.The test results show that the PSNR of U2HDRnet reaches 31.42 dB,and the SSIM reaches 0.985,both of which are superior to the commonly used HDR algorithms.They obtain high-quality portrait HDR images while avoiding skin distortion.关键词
深度学习/高动态范围/皮肤特征提取/注意力机制/色彩重建Key words
deep learning/high dynamic range/skin feature extraction/attention mechanism/color reconstruction分类
信息技术与安全科学引用本文复制引用
吴春林,张永爱,林志贤,郭太良,林鹏飞,林坚普..基于多特征融合的人像HDR图像处理算法[J].液晶与显示,2024,39(8):1024-1036,13.基金项目
国家重点研发计划(No.2021YFB3600603) (No.2021YFB3600603)
福建省自然科学基金(No.2020J01468) (No.2020J01468)
福建省教育厅中青年教师教育科研项目(No.JAT210030)Supported by National Key R&D Program of China(No.2016YFB0401503) (No.JAT210030)
Natural Science Foundation of Fujian Province(No.2020J01468) (No.2020J01468)
Educational Research Project for Young and Middle-aged Teachers of Fujian Provincial Department of Education(No.JAT210030) (No.JAT210030)