基于注意力机制和视触融合的机器人抓取滑动检测OA北大核心CSTPCD

Slip detection for robot grasping is of great significance for grip tasks.In the grasping process,vision and touch are the key modal information for judging the grasping state.To achieve efficient visuotactile fusion remains challenging.A novel visual and tactile fusion model is pro-posed to address the issues of efficient slip detection for robot grasping based on the idea of visual and tactile fusion.First,the model extracts the spatial and temporal feature information of visual and haptic data using a convolutional neural network and a multiscale temporal convolutional net-work.Second,an attention mechanism is used to assign weights to visuotactile features,and multi-modal information fusion is performed through a multiscale temporal convolutional network.Final-ly,the detection results of the grasping state are acquired through one fully connected layer.Data acquisition is implemented using an XArm 7DOF robotic arm,D455 RGB camera,and XELA tact-ile sensor.The experimental results show that the accuracy rate of slip detection for robot grasping using the proposed model is as high as 9898％.The proposed model has good research and appli-cation value in the reliable and smooth execution of robot grip tasks.