北京交通大学学报2024,Vol.48Issue(5):69-77,9.DOI:10.11860/j.issn.1673-0291.20220135
基于雷视融合的轨道三维点云重构研究
Research on 3D point cloud reconstruction of railway tracks based on LiDAR-vision fusion
摘要
Abstract
To address the limitations of single sensors,such as the inability of LiDAR to capture true color information and the low accuracy of image-based 3D reconstruction point clouds,this paper pro-poses a method for 3D track reconstruction by integrating LiDAR point cloud data and image data.First,real-time laser point cloud mapping of the track is achieved using LiDAR Inertial Odometry via Smoothing and Mapping(LIO-SAM),a tightly coupled radar-inertial odometry method.Next,the Scale Invariant Feature Transform(SIFT)algorithm is employed to extract feature points from mul-tiple images,and the geometric relationships between multi-view images are determined by matching corresponding feature points.Structure From Motion(SFM)and Multi-View Stereo(MVS)algo-rithms are then applied to locate,cluster,and generate dense image-based point clouds enriched with texture and color information of the track.Finally,plane features of the track slabs and linear features of the rails are used as reference features,and the Iterative Closest Point(ICP)algorithm is employed to merge and register the image point cloud with the LiDAR point cloud.By using the spatial position information of the LiDAR point cloud as a baseline and fusing it with the texture and color information from the image point cloud,an accurate and realistic 3D track model is obtained.Experimental results demonstrate that,compared with traditional registration methods,the improved algorithm achieves an 83.4%and 85.9%enhancement in shape parameter accuracy and nearest-neighbor point distribution,respectively.When performing target recognition on the track point cloud,the fused point cloud im-proves overall accuracy by 7.7%over the original point cloud and performs better on metrics such as average precision and mean intersection-over-union.Furthermore,the comparison between the calcu-lated track gauge and height difference from the fused point cloud and the measured data reveals an er-ror margin within 3 mm,verifying the effectiveness of the proposed 3D track point cloud reconstruc-tion method.关键词
铁路轨道建模/雷视融合/数据融合/轨道点云模型Key words
railway track modeling/LiDAR-vision fusion/data fusion/track point cloud model分类
交通工程引用本文复制引用
何庆,付彬,王启航,曾楚琦,郝翔,王平,袁泉..基于雷视融合的轨道三维点云重构研究[J].北京交通大学学报,2024,48(5):69-77,9.基金项目
国家自然科学基金(U1934214,51878576) (U1934214,51878576)
中铁第一勘察设计院集团有限公司科技开发项目(2021KY20ZD(ZNGT)-09PT) (2021KY20ZD(ZNGT)
国家重点研发计划(2017YFB1201102) National Natural Science Foundation of China(U1934214,51878576) (2017YFB1201102)
Science and Technology Development Project of China Railway First Survey and Design Institute Group Co.,Ltd.(2021KY20ZD(ZNGT)-09PT) (2021KY20ZD(ZNGT)
National Key R&D Plan(2017YFB1201102) (2017YFB1201102)