计算机工程2024，Vol.50Issue(3)：191-199,9.DOI:10.19678/j.issn.1000-3428.0067369
基于深度监督隐空间构建的语义分割改进方法
Semantic Segmentation Improvement Method Based on Deep Supervision for the Construction of Latent Space
摘要
Abstract
The existing convolution operations cannot effectively capture the relationships between long-distance regions in semantic segmentation tasks,resulting in segmentation results that do not conform to human common sense.Accordingly,a semantic segmentation improvement method based on deep supervised latent space construction is proposed.This article adopts the"feature map-hidden space-feature map"process to convert pixel features in an image space into node features in a hidden space,and convert the position and semantic relationships between regions into connection weights between nodes,thereby achieving feature conversion from the feature map to the hidden space.In the process of constructing the hidden space,the Kullback-Leibler divergence loss function is used to supervise the projection matrix,to avoid losing features during the transformation process from feature maps to hidden space nodes.It uses Information Noise Contrastive Estimation(InfoNCE)loss function to supervise node feature and real label representations,ensuring consistency between image features and labels.The proposed method uses Graph Neural Network(GNN)for semantic inference on the constructed latent space,learning the relationships between nodes and endowing the model with the ability to learn semantic relationships between regions,thereby improving the anti-common sense phenomenon in segmentation results.The experimental results on the publicly available dataset CityScapes demonstrate that compared to the baseline segmentation network,the mean Intersection over Union(mIoU)of the proposed method is 81.1%,which is 2.6 percentage points higher than that of the baseline segmentation network and can effectively improve the segmentation results.关键词
语义分割/卷积神经网络/深度监督/图神经网络/反常识现象Key words
semantic segmentation/Convolutional Neural Network(CNN)/deep supervision/Graph Neural Network(GNN)/anti-common sense phenomenon分类
信息技术与安全科学引用本文复制引用
王柏涵,姜晓燕,范柳伊..基于深度监督隐空间构建的语义分割改进方法[J].计算机工程,2024,50(3):191-199,9.基金项目
国家自然科学基金联合项目(U2033218) （U2033218）
国家自然科学基金重点项目(61831018). （61831018）
