基于边缘优先填充的自适应深度图像修复方法OA
Adaptive Depth Image Inpainting Method Based on Edge-first Filling
针对传统深度图像空洞修复方法引起的物体边缘扭曲、模糊以及修复较大空洞速度缓慢的问题,提出了一种基于边缘优先填充的自适应深度图像修复方法.该方法利用多通道检测提取RGBD图像边缘,经过去除空洞虚假边缘和无用细节信息处理,生成物体的显著性边缘;将此边缘引入到图像修复过程中,优先填充空洞区域的边缘位置,有效解决边缘模糊虚化问题,使修复后的深度图像边缘结构清晰;在曲率驱动扩散(Curvature Driven Diffusion,CDD)模型的扩散项中引入梯度引导函数,使模型在空洞的平坦区域和边缘区域自适应地选择不同的扩散方向和扩散强度,实现对较大空洞区域的准确填充.实验结果表明,所提方法在RGBZ数据集上与其他方法进行比较,峰值信噪比(Peak Signal to Noise Ratio,PSNR)和平均结构相似性(Mean Structural Similarity,MSSIM)分别提高了 8~13 dB、0.009 9~0.021 4,在提高迭代效率的同时有效修复了较大空洞,保持了较为清晰完整的物体边缘轮廓信息.
To solve the problems of object edge distortion and blur caused by traditional depth image hole inpainting methods and the slow speed of repairing large holes,an adaptive depth image inpainting method based on edge-first filling is proposed.Firstly,multi-channel detection is used to extract the edges of the Red,Green,Blue and Depth(RGBD)image,and after removing the false edges of the holes and useless detail information,a salient edge of the object is generated;then,this edge is introduced into the image inpainting process,and the edge position of the hole area is filled first to effectively solve the problem of edge blurring and make the edge structure of the repaired depth image clear;finally,a gradient guidance function is introduced into the diffusion term of the Curvature Driven Diffusion(CDD)model,allowing the model to adaptively select different diffusion directions and diffusion strengths in the flat area and edge area of the hole to achieve accurate filling of large hole areas.Experimental results show that the Peak Signal to Noise Ratio(PSNR)and Mean Structural Similarity(MSSIM)of the proposed method are improved by 8~13 dB and 0.009 9~0.021 4 respectively compared with other methods on the RGBZ dataset.The proposed method can effectively repair large holes while improving iteration efficiency,and maintain clear and complete object edge contour information.
孙梦欣;牟琦;夏蕾;李洪安;李占利
西安科技大学计算机科学与技术学院,陕西西安 710054西安科技大学计算机科学与技术学院,陕西西安 710054||西安科技大学机械工程学院,陕西西安 710054西安科技大学计算机科学与技术学院,陕西西安 710054||北京航空航天大学虚拟现实技术与系统全国重点实验室,北京 100191
计算机与自动化
深度图像空洞修复边缘提取曲率驱动扩散模型自适应扩散
depth imagehole inpaintingedge extractionCDD modeladaptive diffusion
《无线电工程》 2024 (010)
2339-2346 / 8
陕西省自然科学基础研究计划(2023-JC-YB-517);北京航空航天大学虚拟现实技术与系统国家重点实验室开放项目(VRLAB2023B08)Natural Science Basis Research Program of Shaanxi Province(2023-JC-YB-517);Open Project of State Key Laboratory of Virtual Reality Technology and Systems of Beihang University(VRLAB2023B08)
评论