南京航空航天大学学报（英文版）2023，Vol.40Issue(5)：547-554,8.DOI:10.16356/j.1005-1120.2023.05.004
基于机器学习的视线追踪方法及其在移动端四旋翼控制的应用
Machine Learning-Based Gaze-Tracking and Its Application in Quadrotor Control on Mobile Device
摘要
Abstract
A machine learning-based monocular gaze-tracking technology for mobile devices is proposed.This non-invasive,convenient,and low-cost gaze-tracking method can capture the gaze points of users on the screen of mobile devices in real time.Combined with the quadrotor's 3D motion control,the user's gaze information is converted into the quadrotor's control signal,solving the limitations of previous control methods,which allows the user to manipulate the quadrotor through visual interaction.A complex quadrotor track is set up to test the feasibility of this method.Subjects are asked to intervene their gaze into the control flow to complete the flight tasks.Flight performance is evaluated by comparing with the joystick-based control method.Experimental results show that the proposed method can improve the smoothness and rationality of the quadrotor motion trajectory,and can introduce diversity,convenience,and intuitiveness to the quadrotor control.关键词
视线追踪/无人机控制/机器学习/人机交互/眼球驱动Key words
gaze-tracking/UAV control/machine learning/HRI/eye-gaze drive分类
信息技术与安全科学引用本文复制引用
胡佳辉,陆永华,刘江伟,严长凯,刘韬..基于机器学习的视线追踪方法及其在移动端四旋翼控制的应用[J].南京航空航天大学学报（英文版）,2023,40(5):547-554,8.基金项目
This work was supported by the Na-tional Natural Science Foundation of China(No.51975293),the Aeronautical Science Foundation of China(No.2019ZD052010),and the Zhangjiagang Pre-research Fund of China(No.ZKCXY2101). （No.51975293）
