计算机应用与软件2024，Vol.41Issue(1)：36-41,6.DOI:10.3969/j.issn.1000-386x.2024.01.006
基于深度学习的增强装配智能人机交互方法
INTELLIGENT HUMAN-COMPUTER INTERACTION METHOD FOR AUGMENTED ASSEMBLY BASED ON DEEP LEARNING
摘要
Abstract
Aimed at the problem of low level of intelligence of the augmented assembly system and poor interaction between the system and the user,a deep learning-based intelligent parts picking perception method is proposed.The target detection algorithm was used to extract the category and position information of the hand and the parts to be assembled,and the region intersection determination method was used to obtain the region-of-interest.A classification network was built to identify the pickup status of parts in a single frame depth image.Based on this,a continuous frame status recognition method was proposed to eliminate errors of single frame recognition result.The experimental results show that:in the assembly process of aero-engine parts,the proposed method has a single-frame sensing speed within 0.031 s,and the accuracy of continuous frames can reach 100％,which meets the accuracy and speed requirements of on-site recognition.关键词
增强装配/人机交互/深度学习/拾取感知Key words
Augmented assembly/Human-computer interaction/Deep learning/Pickup perception分类
信息技术与安全科学引用本文复制引用
李晗,郭宇,汤鹏洲,吴鹏兴,魏禛,郑冠冠..基于深度学习的增强装配智能人机交互方法[J].计算机应用与软件,2024,41(1):36-41,6.基金项目
国防基础科研资助项目(JCKY2018605C003,JCKY2018203A001,JCKY2017203B071). （JCKY2018605C003,JCKY2018203A001,JCKY2017203B071）
