华中科技大学学报（自然科学版）2025，Vol.53Issue(11)：21-27,7.DOI:10.13245/j.hust.251160
基于3D视觉的林果采摘最佳观测点预测方法研究
Research on optimal observation position prediction method for fruit picking based on 3D vision
摘要
Abstract
Aiming at the problem of poor target localization accuracy caused by severe occlusion of forest fruits in unstructured agricultural scenarios,a 3D active vision-based optimal observation position prediction method for forest fruit picking was proposed,with a six degrees of freedom(6-DOF)robotic arm as execution body.The method mainly consisted of an active vision perception module,and the active vision perception module first accurately identified forest fruits through image processing methods and obtained occlusion status of the fruits.Then,taking the current observation position as starting point,the robotic arm was moved within a certain range to generate a confidence and occlusion rate distribution map.After a series of occlusion rate and confidence datasets were established,a deep learning network was designed to predict the pose with the minimum occlusion rate under current occlusion condition,i.e.,the optimal observation position.To verify the effectiveness of this method in improving the accuracy of target localization,field fruit picking experiments were conducted.After 100 trials,results show that the picking success rate of this method is 65%,which is 32%and 24%higher than the binocular camera method and the simple teaching method,respectively.关键词
机械臂/主动视觉/深度学习/林果采摘/最佳观测点Key words
manipulator/active vision/deep learning/fruit picking/optimal observation position分类
信息技术与安全科学引用本文复制引用
PENG Gang,LAI Cheng,YANG Jiaqi..基于3D视觉的林果采摘最佳观测点预测方法研究[J].华中科技大学学报（自然科学版）,2025,53(11):21-27,7.基金项目
湖北省农机装备补短板核心技术应用攻关项目(HBSNYT202213). （HBSNYT202213）
