农业机械学报2024，Vol.55Issue(4)：74-81,8.DOI:10.6041/j.issn.1000-1298.2024.04.007
基于多视角三维点云融合的采棉机器人视觉感知方法
Visual Perception Method for Cotton-picking Robots Based on Fusion of Multi-view 3D Point Clouds
摘要
Abstract
Traditional cotton-picking robots face visual perception challenges due to their reliance on single viewpoint and two-dimensional imagery.To address this,a multi-view 3D point cloud registration method was introduced,enhancing these robots'real-time 3D visual perception.Four fixed-pose Realsense D435 depth cameras were utilized to capture point cloud data of the cotton from multiple viewpoints.To ensure the quality of fusion registration,each camera underwent rigorous imaging distortion calibration and depth error adjustment before operation.With the help of AprilTags algorithm,the relative pose between the RGB imaging modules of the cameras and their AprilTag labels was calibrated,which clarified the transformation relationship between the coordinate systems of the RGB and stereo imaging modules.As a result,the transformations of point cloud coordinates between cameras can be deduced,ensuring accurate fusion and alignment.The findings showed that this method had an average global alignment error of 0.93 cm and took 0.025 s on average,highlighting its accuracy and efficiency against the commonly used methods.To cater to the real-time demands of cotton-picking robots,processes for point cloud acquisition,background filtering,and fusion registration were also optimized.Impressively,the algorithm's speed tops at 29.85 f/s,meeting the real-time demands of the robot's perception system.关键词
采棉机器人/视觉感知/三维点云/融合/AprilTags算法Key words
cotton-picking robots/visual perception/3D point cloud/fusion/AprilTags algorithm分类
信息技术与安全科学引用本文复制引用
刘坤,王晓,朱一帆..基于多视角三维点云融合的采棉机器人视觉感知方法[J].农业机械学报,2024,55(4):74-81,8.基金项目
江苏省高等学校基础科学(自然科学)研究项目(23KJA460008)和江苏省研究生科研与实践创新计划项目(SJCX23_1180) （自然科学）
