现代信息科技2025，Vol.9Issue(8)：54-60,7.DOI:10.19850/j.cnki.2096-4706.2025.08.011
基于深度学习的动态手势检测与识别算法研究
Research on Dynamic Gesture Detection and Recognition Algorithm Based on Deep Learning
摘要
Abstract
Gesture recognition is of great significance to realize human-computer interaction.In order to realize high-precision target detection and recognition under dynamic conditions,this paper is based on YOLOv5 target detection firstly,and determines the coordinate information of the target gesture by using the feature pyramid structure and multi-scale fusion structural features inside the algorithm.Then it uses the MediaPipe model to detect the key points of the hand,determines the vector angle of the hand joints,and analyzes the finger bending situation,so as to judge the specific gesture.Using the methods of position determination and implementation by using separate models for action classification effectively improves the problem that the reduced recognition rate of gestures caused by factors such as rotation and occlusion in dynamic conditions.The training samples are selected from six categories in the open-source gesture dataset HaGRID.The experimental test results demonstrate that the mean value of one-hand recognition detection accuracy of the combined algorithm is up to mAP@0.5 and the detection speed is up to 40 FPS,and the model size is 88.5 MB.关键词
手势识别/YOLOv5/MediaPipe/手部关节点检测/手势数据集Key words
gesture recognition/YOLOv5/MediaPipe/hand joint point detection/gesture dataset分类
信息技术与安全科学引用本文复制引用
陈吴东..基于深度学习的动态手势检测与识别算法研究[J].现代信息科技,2025,9(8):54-60,7.
