郑州大学学报（工学版）2024，Vol.45Issue(4)：46-52,7.DOI:10.13705/j.issn.1671-6833.2024.04.002
基于混合特征图卷积神经网络的人体行为识别方法
Human Activity Recognition Based on Hybrid Feature Graph Convolutional Neural Network
摘要
Abstract
The existing methods for human activity recognition using wearable sensors could not capture the struc-tural information between the sampling points of time series effectively and might ignore the potential connections between samples.To address this issue,a graph convolutional neural network model with hybrid time-frequency and structural characteristics was proposed for human activity recognition.Firstly,the time-frequency characteris-tics of the original signal were obtained by wavelet-packet transform,and the spatio-temporal graph was further con-structed to extract the structural characteristics to identify the dynamic characteristics between the sampling points.The distance constraint was added to the structural characteristics to weaken the influence of long-distance neighbors on the central node on the spatio-temporal graph.Considering that the extraction of structural characteristics was greatly affected by the topological relationship of the spatio-temporal graph.The time-frequency characteristics of the samples to construct the input topology of the graph convolutional neural network were selected,and the time-frequency and structural characteristics were combined as the input features of the network.Finally,the input fea-tures propagated along the input topology to obtain the final classification result.To evaluate the performance of the proposed model,experiments were conducted on the WHARF and DataEgo datasets.Results in terms of F1 scores indicated that the proposed model outperformed existing convolutional neural network-based methods,achieving a maximum improvement of 19.58 percentage points on the WHARF dataset and 26.44 percentage points on the Da-taEgo dataset.It demonstrated that the proposed model could effectively enhance the capability of activity recogni-tion by exploiting dynamic characteristics.关键词
图卷积神经网络/可穿戴设备/人体行为识别/时空图/特征提取Key words
graph convolutional neural networks/wearable device/human activity recognition/spatio-temporal graph/feature extraction分类
信息技术与安全科学引用本文复制引用
李志新,商樊淇,郇战,陈瑛,梁久祯..基于混合特征图卷积神经网络的人体行为识别方法[J].郑州大学学报（工学版）,2024,45(4):46-52,7.基金项目
国家自然科学基金资助项目(62201093) （62201093）
常州市科技计划资助项目(CJ20235026) （CJ20235026）
江苏省研究生科研与实践创新计划项目(KYCX23_3070) （KYCX23_3070）
