|国家科技期刊平台
首页|期刊导航|华中科技大学学报(自然科学版)|基于深度学习图像特征的动态环境视觉SLAM方法

基于深度学习图像特征的动态环境视觉SLAM方法OA北大核心CSTPCD

Visual SLAM method for dynamic environment based on deep learning image features

中文摘要英文摘要

针对传统的视觉同时定位与地图构建(SLAM)算法依赖的特征提取方法多为人为设计的图像特征,存在动态物体、光照条件改变等动态情形不够稳定,容易产生丢失跟踪的问题,提出了一种基于深度学习的、稳定的、实时的图像特征提取与匹配方法.对带有注意力机制的神经网络模型通过多任务蒸馏训练的方式进行训练,实现面向光线条件剧烈改变的场景特征提取与匹配,并且基于全局特征与局部特征,提出基于分级特征的重定位方法,提高系统整体的精度与稳定性,同时具有实时性.在同一场景不同光照角度的图像对上与Superpoint特征进行特征提取匹配对比测试,并且在TUM数据集上与ORB SLAM2及GCN SLAM进行定位精度对比测试,结果表明:所提出的方法能够在光照条件剧烈改变情况下提取足够稳定的特征,并且在fr3/sitting_static与fr3/walking_static上表现优于其他两种方法,轨迹均方根误差为6.131 mm和124.493 mm.最后在真实室内环境下进行了稀疏建图,并且验证了改进的重定位方法的有效性.

Aiming at the problem that traditional visual simultaneous localization and mapping(SLAM)algorithms rely on hand-crafted features,which are not stable enough for dynamic objects and change of illumination conditions and are prone to lose tracking,a stable and real-time method of image feature extraction and matching was presented based on deep learning.The neural network model with attention mechanism was trained through multi-task distillation training to realize feature extraction and matching for scenes with dramatic changes in illumination conditions.Based on the global and local features,a relocalization method based on hierarchical features was proposed to improve the overall accuracy and stability of the system,and it was real-time.Feature extraction and matching tests were performed on images with different illumination and angles in the same scene compared with Superpoint,and localization accuracy tests were performed on TUM datasets compared with ORB SLAM2 and GCN SLAM.Results show that the proposed method can extract sufficient stable features when illumination conditions change dramatically,and it performs better on fr3/sitting_static and fr3/walking_static than the other two methods.The root mean square error of tracks were 6.131 mm and 124.493 mm.Finally,sparse mapping was carried out in real indoor environments,and the effectiveness of the improved relocalization method was verified.

刘冬;于涛;丛明;杜宇

大连理工大学机械工程学院,辽宁 大连 116024大连交通大学机械工程学院,辽宁 大连 116028

计算机与自动化

视觉同时定位与地图构建(SLAM)深度学习注意力多任务蒸馏特征提取

visual SLAMdeep learningattentionmulti-task distillationfeature extraction

《华中科技大学学报(自然科学版)》 2024 (006)

156-163 / 8

装备预研教育部联合基金资助项目(8091B022119);国家自然科学基金资助项目(62173064);中央高校基本科研业务费专项资金资助项目(DUT22JC13).

10.13245/j.hust.240658

评论