计量学报2024，Vol.45Issue(7)：982-988,7.DOI:10.3969/j.issn.1000-1158.2024.07.07
基于坐标注意力脉冲神经网络的注视估计方法
Gaze Estimation Method Based on Coordinate Attention and Spiking Neural Network
摘要
Abstract
The problems of dynamic blur and low temporal resolution in capturing eye movements with traditional cameras are addressed by employing an event camera for close-range capture and constructing a spiking-eye dataset.A spiking neural network model with a coordinate attention referred to as CA-SpikingRepVGG.The model reads encoded event data and performs feature extraction using the attention-based backbone network,followed by detection using the detection head.Experimental results demonstrate that CA-SpikingRepVGG achieves a mean average precision RP of 70.8%.Compared to SpikingVGG-16,the model shows a 15.9%improvement in RP and a 14.2%increase in Rr.With only one-third of the training time required by SpikingDensenet,the model achieves a 1.8%improvement in RP and a 0.9%improvement in Rr.These results indicate that the proposed model exhibits stronger eye detection and tracking capabilities in the context of eye movement,effectively accomplishing gaze estimation tasks.关键词
机器视觉/目标检测/脉冲神经网络/注视估计/坐标注意力/召回率/事件相机Key words
machine vision/object detection/spiking neural network/gaze estimation/coordinate attention/recall/event camera分类
通用工业技术引用本文复制引用
王红霞,赵志国..基于坐标注意力脉冲神经网络的注视估计方法[J].计量学报,2024,45(7):982-988,7.基金项目
辽宁省自然科学基金(2022-MS-276) （2022-MS-276）
