计算机工程与科学2018，Vol.40Issue(5)：872-879,8.DOI:10.3969/j.issn.1007-130X.2018.05.016
基于计算机视觉及深度学习的无人机手势控制系统
UAV gesture control system based on computer vision and deep learning
马乐乐 1李照洋 1董嘉蓉 1侯永宏1
作者信息
- 1. 天津大学电子信息工程学院,天津 300072
- 折叠
摘要
Abstract
The traditional Unmanned Aerial Vehicle (UAV) human-machine interaction requires specialized equipment and professional training,and convenient and innovative ways of interaction are often more popular.In this paper,with ordinary cameras,we study the UAV gesture control system based on computer vision and deep learning.The system first uses the fast tracking algorithm to extract the operator's region in the video sequence,greatly reducing the pressure of subsequent video processing while removing the influence of complex background and camera drift.Secondly,according to the time information of the actions,the optical flow features are encoded in different colors and superimposed on a picture,and the video is converted into a color texture map that contains both temporal features and spatial features.Finally,colored texture images are well learned and classified by a deep Convolutional Neural Network (CNN) and UAV controlling commands are generated according to the classified results.The proposed system estimates actions within 1.6s every 0.4s and uses CNN to classify pictures so as to achieve real-time human-computer interaction.The system has a recognition accuracy of over 93 ％ within 60 meters.In indoor and outdoor environments,the operator can conveniently control the UAV by imitating command actions.关键词
人机交互/深度学习/卷积神经网络/无人机/手势控制Key words
human machine interface/deep learning/CNN/UAV/gesture control分类
信息技术与安全科学引用本文复制引用
马乐乐,李照洋,董嘉蓉,侯永宏..基于计算机视觉及深度学习的无人机手势控制系统[J].计算机工程与科学,2018,40(5):872-879,8.
