计算机工程2025，Vol.51Issue(2)：344-355,12.DOI:10.19678/j.issn.1000-3428.0068781
基于调制-全局推理的弱监督语义分割算法研究
Research on Weakly Supervised Semantic Segmentation Algorithm Based on Modulation-Global Reasoning
摘要
Abstract
To reduce the annotation burden,a weakly supervised semantic method based on image-level labels can be used to train a network using a few annotations.However,existing methods based on class activation mapping suffer from incomplete segmentation.To overcome this limitation,a weakly supervised semantic segmentation method based on modulation-global reasoning is proposed.First,a spatial-channel activation modulation module is designed to extract more complete features of the target object and prevent class activation maps from focusing excessively on salient regions in the classification network.Moreover,a global inference unit module is proposed,which can be used to capture the global relationship between the disjoint and distant regions in the feature map to select more complete target objects and enhance the features of non-saliency areas.Finally,a potential object mining module is designed to reduce the false negative rate and extract missing information in pseudo labels,thus solving the issue of incomplete target regions in the initial pseudo labels.In the segmentation network,the initial prediction generated by the classification network is combined with the pseudo label,and a masking pseudo label is generated by the non-saliency region mining module to improve segmentation.Experimental results on Pascal VOC 2012 validation and test datasets indicate that the accuracy of the method is 69.5％and 69.8％,respectively,and 32.8％on the MS COCO2014 validation dataset upon using only image-level labels.The proposed method effectively resolves the issue of incomplete segmentation regions and is superior to state-of-the-art methods.关键词
语义分割/弱监督/非显著区域/激活调制/全局推理单元Key words
semantic segmentation/weakly supervised/non-saliency region/activation modulation/global inference unit分类
信息技术与安全科学引用本文复制引用
刘洲峰,李冰芮,杨瑞敏,李春雷,何媛,丁淑敏..基于调制-全局推理的弱监督语义分割算法研究[J].计算机工程,2025,51(2):344-355,12.基金项目
国家自然科学基金(62072489) （62072489）
河南省高校科技创新团队项目(21IRTSTHN013) （21IRTSTHN013）
中原科技创新领军人才项目(234200510009) （234200510009）
河南省科技攻关项目(222102210008,232102211002,232102211030). （222102210008,232102211002,232102211030）
