|国家科技期刊平台
首页|期刊导航|智能系统学报|交互关系超图卷积模型的双人交互行为识别

交互关系超图卷积模型的双人交互行为识别OA北大核心CSTPCD

Two-person interaction recognition based on the interactive relationship hypergraph convolution network model

中文摘要英文摘要

为提高学校、商场等公共场所的安全性,实现对监控视频中的偷窃、抢劫和打架斗殴等异常双人交互行为的自动识别,针对现有基于关节点数据的行为识别方法在图的创建中忽略了 2 个人之间的交互信息,且忽略了单人非自然连接关节点间的交互关系的问题,提出一种基于交互关系超图卷积模型用于双人交互行为的建模与识别.首先针对每一帧的关节点数据构建对应的单人超图以及双人交互关系图,其中超图同时使多个非自然连接节点信息互通,交互关系图强调节点间交互强度.将以上构建的图模型送入时空图卷积对空间和时间信息分别建模,最后通过SoftMax分类器得到识别结果.该算法框架的优势是在图的构建过程中加强考虑双人的交互关系、非自然连接点间结构关系以及四肢灵活的运动特征.在NTU数据集上的测试表明,该算法得到了 97.36%的正确识别率,该网络模型提高了双人交互行为特征的表征能力,取得了比现有模型更好的识别效果.

To enhance the security of schools,shopping malls,and other public places,it is important to achieve auto-matic identification of abnormal two-person interaction behaviors,such as stealing,robbing,fighting,and assaulting,in surveillance videos.However,the current behavior recognition method based on joint data in graph creation neglects the two-person interaction information as well as the interaction relationship between the single unnatural connection joints.To address this issue,a two-person interaction behavior recognition model based on the interactive relationship hyper-graph convolution network is proposed to model and identify human interactions.First,the corresponding single hyper-graph and two-person interaction graph are created for the joint-point data of each frame,where the hypergraph makes the information of multiple unnaturally connected nodes interchangeable at the same time,and the interaction graph em-phasizes the interaction strength between nodes.The above-constructed graph models are fed into the spatiotemporal graph convolution to model the spatial and temporal information separately,and lastly,the recognition results are ac-quired by the SoftMax classifier.The benefits of the proposed algorithm framework are that the interactive relationship between two persons,the structural relationship between unnatural connections,and the flexible motion characteristics of limbs are regarded in the graph construction process.Tests on the NTU data set demonstrate that the algorithm at-tains a correct recognition rate of 97.36%.The findings indicate that the network model enhances the ability to represent the characteristics of two-person interaction and has better recognition performance than the current models.

代金利;曹江涛;姬晓飞

辽宁石油化工大学 信息与控制学院, 辽宁 抚顺 113001沈阳航空航天大学 自动化学院, 辽宁 沈阳 110136

计算机与自动化

双人交互行为识别关节点数据深度学习时空图卷积网络超图图结构神经网络

two-person interactionbehavior recognitionskeleton node datadeep learningST-GCNhypergraphgraph structureneural networks

《智能系统学报》 2024 (002)

面向需求有界变化的石化生产过程优化与控制方法研究

316-324 / 9

国家自然科学基金项目(61673199);辽宁省科技公益研究基金项目(2016002006).

10.11992/tis.202208001

评论