现代电子技术2024，Vol.47Issue(23)：1-7,7.DOI:10.16652/j.issn.1004-373x.2024.23.001
VR环境下基于多观测角度人眼成像特性的注视估计研究
Study on gaze estimation based on multi-angle eye imaging characteristics for VR environment
摘要
Abstract
In immersive virtual reality(VR)scenes,accurate gaze point rendering based on advanced gaze estimation technology can optimize computational resource allocation efficiency and alleviate possible dizziness during user experience.Currently,the available VR gaze estimation datasets only have eye images from a single observation angle,and lack eye image datasets from different observation angles.In this paper,a gaze estimation dataset containing 23 040 eye images with multiple observation angles and a pupil detection dataset including 15 824 pupil annotation images with multiple observation angles are constructed,and a multi-branch network model combining features of eye images with multiple observation angles compensating for each other is proposed.The samples of the gaze estimation dataset are used in the training process of the model and the predicted Euclidean distance loss can reach 7.68 pixels.Furthermore,the weight map containing pupil position information is fused with the image.The fusion and input of pupil position information enhances the performance of the model,and the Euclidean distance loss is reduced to 7.45 pixels.This study demonstrates that the developed model can improve the accuracy of gaze estimation in VR environments,so as to promote the widespread application of gaze estimation technology in VR products.关键词
注视估计/虚拟现实/卷积神经网络/多分支网络/特征融合/瞳孔检测Key words
gaze estimation/virtual reality/convolutional neural network/multi-branch network/feature fusion/pupil detection分类
电子信息工程引用本文复制引用
牛锐,房丰洲,任仲贺,侯高峰,李子豪..VR环境下基于多观测角度人眼成像特性的注视估计研究[J].现代电子技术,2024,47(23):1-7,7.基金项目
国家自然科学基金项目(52035009) （52035009）
