计算机与数字工程2024，Vol.52Issue(3)：735-739,745,6.DOI:10.3969/j.issn.1672-9722.2024.03.017
基于Kinect V2和Unity3D的机械臂人机交互系统
Man-machine Interaction System of Manipulator Based on Kinect V2 and Unity3D
李子良 1李庆党 2王晓波 1和学泰1
作者信息
- 1. 青岛科技大学机电工程学院 青岛 266100
- 2. 青岛科技大学中德科技学院 青岛 266100
- 折叠
摘要
Abstract
Aiming at the problems of unintuitive and complex operation in the human-computer interaction,this paper devel-opes a human-computer interaction system based on Kinect V2 and Unity3D by using the hand tracking technology.Users can con-trol the movement of the robot arm by waving their hands directly,and the interaction mode is more simple,intuitive and flexible.This system uses Kinect V2 to obtain the trajectory of hand movement to realize hand tracking,and develops the interactive system on the Unity3D platform.FABRIK algorithm and Bézier curve are used to solve the inverse kinematics and record the motion path,respectively.The required script function is written in C#,and two interactive modes are developed,which are called real-time con-trol mode and teaching mode,these two modes can be selected through the UI panel.Finally,the two modes are tested respectively,and the experimental results prove the feasibility of the system.关键词
人机交互/手部追踪/Kinect V2/Unity3DKey words
human-computer interaction/hand tracking/Kinect V2/Unity3D分类
信息技术与安全科学引用本文复制引用
李子良,李庆党,王晓波,和学泰..基于Kinect V2和Unity3D的机械臂人机交互系统[J].计算机与数字工程,2024,52(3):735-739,745,6.
