现代电子技术2025，Vol.48Issue(20)：40-44,5.DOI:10.16652/j.issn.1004-373x.2025.20.007
基于虚拟现实技术的人机交互三维手势识别研究
Research on human-computer interaction 3D gesture recognition based on virtual reality technology
摘要
Abstract
In order to meet the needs of gesture recognition in complex scenes and ensure the reliability of continuous gesture change recognition,a method of human-computer interaction 3D gesture recognition based on virtual reality technology is proposed.In this method,RGB-D camera and VICON motion capture system are used to obtain 3D gesture pose data and construct 3D gesture motion dataset.Based on this dataset,a manual interactive gesture visualization model is constructed by means of virtual reality technology.Then,it is input into the graph convolutional mixed attention network,the undirected spatial graph of the gesture joint bone is constructed based on graph convolutional processing,and the features of the gesture bone are obtained.The mixed attention mechnism is used to screen and process bone features,and classification and identification of human-computer interaction 3D gestures are conducted according to the feature screening results.The testing results show that virtual reality technology can complete the visualization and 3D modeling of gesture actions,and obtain skeletal features that better describe the spatiotemporal features of gesture.The directional angle error Δθ of 3D gesture recognition is below 6.05°.关键词
虚拟现实技术/人机交互/三维手势识别/手势运动数据/手势骨骼特征/可视化Key words
virtual reality technology/human-computer interaction/3D gesture recognition/gesture motion data/gesture skeletal feature/visualization分类
信息技术与安全科学引用本文复制引用
刘鑫..基于虚拟现实技术的人机交互三维手势识别研究[J].现代电子技术,2025,48(20):40-44,5.基金项目
2024年度广东省哲学社会科学规划项目(GD24XYS004) （GD24XYS004）
2021年度广东省普通高校青年创新人才类项目(2021WQNCX069) （2021WQNCX069）
2022年度佛山市科学技术局佛山市自筹经费类科技创新项目(入库)(2220001005745) （入库）
2024年度广东省教育科学规划课题(高等教育专项)(2024GXJK663) （高等教育专项）
