计算机技术与发展2026，Vol.36Issue(2)：38-45,8.DOI:10.20165/j.cnki.ISSN1673-629X.2025.0237
IgDccmNet:图像引导的双通道跨模态点云补全网络
IgDccmNet:Image-guided Dual-channel Cross-modal Point Cloud Completion Network
摘要
Abstract
Point cloud completion refers to the process of reconstructing a complete 3D shape from a partial shape.Existing multimodal point cloud completion methods primarily focus on the point cloud modality,often underutilizing the information provided by the image modality.To maximize the geometric information provided by images and generate 3D point clouds with sufficient geometric details,we propose an image-guided dual-channel cross-modal point cloud completion network,IgDccmNet.Firstly,an encoder is employed to extract features from the incomplete point cloud and the corresponding image of the complete point cloud.In the point cloud path,PointNet is used as the backbone network for point cloud feature extraction,while ResNet18 is used as the image encoder.Then,to achieve deep interaction and learning between point cloud and image features,a dual-channel cross-modal fusion module is proposed.This module strengthens the internal feature correlation of each modality via a self-attention mechanism,and establishes semantic correlations between modalities using a cross-attention mechanism,enabling effective fusion of point cloud and image features under the guidance of complementary information.Finally,a style-based point cloud decoder is designed to decode the global features and generate the predicted point cloud,which is then fused with the input incomplete point cloud.Farthest Point Sampling(FPS)is applied to obtain the completed point cloud.Experiments conducted on the ShapeNet-ViPC dataset show that the proposed method outperformsother state-of-the-art methods,achieving a 21％to 66％reduction in chamfer distance and a 4％to 78％increase in F-score.关键词
点云补全/特征融合/跨模态/注意力机制/双通道Key words
point cloud completion/feature fusion/cross modality/attention mechanism/dual-channel分类
信息技术与安全科学引用本文复制引用
杜晓飞,高宏娟,王帅杰..IgDccmNet:图像引导的双通道跨模态点云补全网络[J].计算机技术与发展,2026,36(2):38-45,8.基金项目
宁夏回族自治区重点研发项目(2023BDE03006) （2023BDE03006）
