计算机应用与软件2025,Vol.42Issue(5):137-145,190,10.DOI:10.3969/j.issn.1000-386x.2025.05.020
结合距离骨架的语义嵌入骨架行为识别
SEMANTIC EMBEDDING SKELETON ACTION RECOGNITION COMBINED WITH KINEMATIC SKELETON
摘要
Abstract
Aimed at the problem that the skeleton behavior recognition algorithm cannot fully extract the motion information of the human skeleton and does not use the semantic information,a dual-stream action recognition model that can embed the semantic information is proposed.In this model,the joint name semantics and velocity semantics were embedded into the skeleton data through the semantic embedding module,and different features were extracted through distance flow and joint flow respectively.In the distance flow,the distance graph structure was used as the input according to the relative positions of different joints during motion,and the distance information was extracted by the graph convolution network.The joint flow used the human skeleton as the model to construct the joint graph as the input,and the structural features were extracted by graph convolution.The distance information and structural features complemented each other for prediction.The recognition accuracy on the dataset NTU-RGBD reached 96.45%,and the accuracy on the Kinetics dataset reached 38.01%.关键词
行为识别/骨架/速度语义/语义嵌入/距离信息/相对位置Key words
Action recognition/Skeleton/Velocity semantics/Semantic embedding/Distance information/Rela-tive position分类
计算机与自动化引用本文复制引用
刘强,朱子奇..结合距离骨架的语义嵌入骨架行为识别[J].计算机应用与软件,2025,42(5):137-145,190,10.基金项目
国家自然科学基金项目(61702382). (61702382)