计算机与现代化Issue(7)：48-52,5.DOI:10.3969/j.issn.1006-2475.2017.07.009
基于深度学习框架的多模态动作识别
Multi-modal Action Recognition Based on Deep Learning Framework
摘要
Abstract
This paper proposes an approach for multi-modal action recognition based on deep neural networks.In order to process different modal video information,different artificial networks are utilized and combined to exploit the multi-modal features.We mainly consider the static and dynamic modalities of human action.With the assistance of Microsoft Kinect sensor camera,the visual and depth skeleton data of video can be captured simultaneously.For the static RGB information,we implement Convolutional Neural Networks,while for the dynamic information we use Recurrent Neural Networks.Finally,we combine the extraction features through these two networks and train the action classifier.The experiment results on the MSR 3D datasets show the effectiveness of our method.关键词
深度学习/多模态/动作识别Key words
deep learning/multi-modality/action recognition分类
信息技术与安全科学引用本文复制引用
韩敏捷..基于深度学习框架的多模态动作识别[J].计算机与现代化,2017,(7):48-52,5.基金项目
国家自然科学基金资助项目(61672285) （61672285）
