|国家科技期刊平台
首页|期刊导航|计算机技术与发展|基于改进Yolov5s的增强现实文物识别方法

基于改进Yolov5s的增强现实文物识别方法OACSTPCD

An Augmented Reality Cultural Relics Recognition Method Based on Improved Yolov5s

中文摘要英文摘要

将增强现实技术应用于数字博物馆的文物展览,有助于拉近参观者与文物的距离,使展览更具趣味性.针对增强现实技术在文物展览应用场景中,增强现实设备采集的文物目标图像背景复杂、文物形状纹理丰富而导致的误检、识别准确率低的问题,提出一种基于改进的Yolov5s的文物识别方法.在Yolov5s网络结构中的骨干网络与颈部网络之间引入了CBAM注意力机制,并在骨干网络中的Bottleneck模块中,使用多头注意力机制替换普通卷积,有效捕获局部信息,降低了无用信息的干扰.为了提高识别网络对于目标文物的边界框定位精度,采用DIoU-NMS方法挑选最优的目标识别框作为最终的预测框.实验结果表明,该方法提高了文物的平均识别精度,比原模型更适用于AR应用文物的目标识别.

Applying augmented reality technology to the cultural relics exhibition of the digital museum helps to shorten the distance between the visitors and the cultural relics,and make the exhibition more interesting.Aiming at the problems of false detection and low recognition accuracy caused by complex background and rich shape and texture of cultural relics collected by augmented reality equipment in the application scene of cultural relics exhibition,an improved cultural relics recognition method based on Yolov5s is proposed.The CBAM attention mechanism is introduced between the backbone network and the neck network in the Yolov5s network structure.In addition,a multi-head attention mechanism is used to replace common convolution in the Bottleneck module of the backbone network,which effectively captures local information and reduces the interference of unnecessary information.In order to improve the location accuracy of the boundary frame of the target cultural relics,the DIoU-NMS method is used to select the optimal target identification frame as the final prediction frame.Experimental results show that the proposed algorithm improves the average detection accuracy of the cultural relics,which is more suitable for the target detection of cultural relics than the original algorithm in AR application.

张元;关瑜;熊风光;庞敏;况立群

中北大学 计算机科学与技术学院,山西 太原 030051||机器视觉与虚拟现实山西省重点实验室,山西 太原 030051||山西省视觉信息处理及智能机器人工程研究中心,山西 太原 030051

计算机与自动化

增强现实文物识别Yolov5s注意力机制多头自注意力机制DIoU-NMS

augmented realitycultural relic identificationYolov5sattention mechanismmulti-head self-attentionDIoU-NMS

《计算机技术与发展》 2024 (007)

17-23 / 7

山西省科技重大专项计划"揭榜挂帅"项目(202201150401021)

10.20165/j.cnki.ISSN1673-629X.2024.0118

评论