计算机工程2024，Vol.50Issue(7)：293-302,10.DOI:10.19678/j.issn.1000-3428.0068126
基于空间传播的多视图三维重建
Spatial Propagation-based Multi-View 3D Reconstruction
摘要
Abstract
This study proposes a Spatial Propagation-based Multi-View Stereo depth estimation Network(SP-MVSNet)to address the issue of poor point-cloud integrity in multi-view 3D reconstruction tasks.The concept of spatial propagation is introduced for dense point-cloud reconstruction under complex conditions.Hybrid depth assumption strategies and spatial perception optimization modules are designed based on spatial propagation.The hybrid depth assumption strategy adopts a deep inference approach from rough to fine,treating depth estimation as a multilabel classification task.Cross-entropy loss is applied to the regularized probability volume to constrain the cost volume.This approach helps to prevent overfitting and moderates the convergence speed of the regression methods.The spatial perception optimization module obtains guidance from feature maps containing advanced semantic feature representations.After conducting confidence checks,it uses a convolutional spatial propagation network to refine the final depth map by constructing an affinity matrix.To address the issue of low reconstruction quality in regions that lack multi-view consistency,a dynamic feature extraction network with sample adaptation ability is developed.This network incorporates an attention mechanism to enhance the model's local perception capabilities.Experimental results demonstrate that on the DTU dataset,the reconstruction integrity of SP-MVSNet improves by 32.8%compared with CVP-MVSNet,and the overall quality improves by 11.4%.On the Tanks and Temples benchmark and BlendedMVS dataset,SP-MVSNet outperformed most established methods,achieving notable 3D reconstruction results.关键词
立体视觉/空间传播/稠密点云重建/注意力机制/深度估计Key words
stereoscopic vision/spatial propagation/dense point-cloud reconstruction/attention mechanism/depth estimation分类
信息技术与安全科学引用本文复制引用
张锡英,孙守东,于海浩,边继龙..基于空间传播的多视图三维重建[J].计算机工程,2024,50(7):293-302,10.基金项目
国家自然科学基金青年项目(6210114) （6210114）
黑龙江省哲学社会科学研究规划项目(21TQB117). （21TQB117）
