| 注册
首页|期刊导航|山西大学学报(自然科学版)|基于时空增强双分支图卷积网络的骨骼行为识别

基于时空增强双分支图卷积网络的骨骼行为识别

施宇航 何强 王恒友

山西大学学报(自然科学版)2025,Vol.48Issue(1):55-65,11.
山西大学学报(自然科学版)2025,Vol.48Issue(1):55-65,11.DOI:10.13451/j.sxu.ns.2024141

基于时空增强双分支图卷积网络的骨骼行为识别

Spatiotemporally Enhanced Dual-branch Graph Convolutional Network for Skeleton-based Action Recognition

施宇航 1何强 2王恒友2

作者信息

  • 1. 北京建筑大学 理学院,北京 102616
  • 2. 北京建筑大学 理学院,北京 102616||北京建筑大学大数据建模理论与技术研究所,北京 102616
  • 折叠

摘要

Abstract

There are issues with existing graph convolution methods for skeleton-based action recognition,such as fixed joint seg-mentation,an emphasis on spatial information while neglecting temporal information,and a high number of network parameters.To address these issues,firstly,the information of symmetric joint is introduced to increase the interactive features of symmetric action.Secondly,the Multi-scale pyramid(MSP)time graph convolution module is added to form a Dual-branch(DB)network structure to improve the ability of the network to extract time dimension information.Finally,this study employs feature mapping and spatial ag-gregation(FM-SA)to filter out redundant parts in the weight matrix while preserving the original topological structure information,and incorporate a Squeeze-and-Excitation(SE)module to effectively enhance the extraction of spatial features and the expressive power of the feature maps.The experimental results show that compared with the benchmark model,the number of network parame-ters is reduced by 51%,the recognition accuracy of joint and bone flow on the NTU RGB+D 120 dataset is increased by 0.5%and 1.3%,and the fusion accuracy is increased by 0.7%and 0.5%.The recognition accuracy of NTU RGB+D and NW-UCLA datasets is increased by 0.1%,0.2%and 1.5%,respectively.The validity and feasibility of this model are verified.

关键词

骨骼行为识别/关节分区/时空信息增强/多尺度金字塔/映射聚合

Key words

skeleton behavior recognition/joint partitioning/spatiotemporal information enhancement/multi-scale pyramid/map-ping aggregation

分类

数理科学

引用本文复制引用

施宇航,何强,王恒友..基于时空增强双分支图卷积网络的骨骼行为识别[J].山西大学学报(自然科学版),2025,48(1):55-65,11.

基金项目

国家自然科学基金(62072024 ()

12301581) ()

北京市教育委员会科学研究计划项目(KM202210016002) (KM202210016002)

北京建筑大学硕士研究生创新项目(09081024002) (09081024002)

山西大学学报(自然科学版)

OA北大核心

0253-2395

访问量0
|
下载量0
段落导航相关论文