液晶与显示2024，Vol.39Issue(7)：990-1000,11.DOI:10.37188/CJLCD.2023-0200
融合自监督对比学习的雾天街景语义分割算法
Semantic segmentation algorithm for foggy cityscapes images by fusing self-supervised contrastive learning
摘要
Abstract
To address the problems of difficult street object recognition and slow segmentation due to low visibility in foggy scence,a foggy cityscapes semantic segmentation algorithm incorporating self-supervised contrastive learning is proposed.The algorithm selects the lightweight network MobileNetV2 as the backbone network.Deep aggregation atrous spatial pyramid pooling module is designed and a deep separable convolution with dilation rate is used to replace the normal convolution to enrich feature diversity.Then,we increase the similarity of semantically similar pixels and maintain the distance between different semantic pixels by fusing the contrastive learning framework,so as to improve the model's ability to represent and discriminate the detailed edges of small target objects.Finally,a new fusion loss function is proposed,and supervised learning and self-supervised learning are used to jointly guide the network training to learn deep feature representation.The experimental results show that the model can achieve MIoU of 74.35%,MPA of 83.59%,and PA of 95.85%on the Foggy Cityscapes dataset,which improves 3.82%,3.99%and 1.02%respectively,compared with the semantic segmentation network DeepLabV3+model.Meanwhile,the number of model parameters is 2.88M,which is nearly 55%less than the number of DeepLabV3+model,optimizing the network computation consumption.The algorithm has good performance in foggy cityscapes semantic segmentation,reducing the number of model parameters while maintaining high segmentation accuracy and good robustness.关键词
语义分割/自监督学习/深度聚合/对比学习/损失函数Key words
semantic segmentation/self-supervised learning/deep aggregation/contrastive learning/loss function分类
信息技术与安全科学引用本文复制引用
刘丽伟,王芮,孟续涛..融合自监督对比学习的雾天街景语义分割算法[J].液晶与显示,2024,39(7):990-1000,11.基金项目
国家自然科学基金(No.61803043) （No.61803043）
吉林省科技厅项目(No.YDZJ202201ZYTS414)Supported by National Natural Science Foundation of China(No.61803043) （No.YDZJ202201ZYTS414）
Project of Science and Tech-nology Department of Jilin Province(No.YDZJ202201ZYTS414) （No.YDZJ202201ZYTS414）
