信息与控制2024，Vol.53Issue(3)：339-352,14.DOI:10.13976/j.cnki.xk.2024.3066
基于单目视觉的空中手写数据采集系统
In-air Handwriting Data Acquisition System Based on Monocular Vision
摘要
Abstract
Aiming at the shortcomings of the large and expensive three-dimensional(3D)sensor used in a vision-based in-air handwriting system,we propose a new type of in-air handwriting data acquisi-tion system based on monocular vision.The system uses a small and cheap monocular camera to replace the 3D sensor such as Kinect and Leap Motion,which is more suitable for integration and large-scale promotion with household devices such as mobile phones,air conditioners,and televi-sions.To solve the problem that existing in-air handwriting systems based on monocular vision can only write a single character or short text each time,and the length of the user's written text is lim-ited,we propose a coordinate system virtual sliding technology.First,the system uses the back-ground difference method and the HSV color space shadow elimination method to obtain the com-plete hand contour from the two-dimensional video frame.Second,we separate the palm and finger using the structural characteristics of the hand.Using the constructed fingertip template,we deter-mine the position of the fingertip by matching the segmented fingers.Finally,we connect the fin-gertip positions in continuous video frames to form in-air handwritten character trajectories.Through the proposed coordinate system virtual sliding technology,users can write continuously to form texts.The experimental results show that the system can allow users to write continuously in the air freely,and the detection accuracy of fingertips reaches 96.8％.关键词
空中手写/单目摄像头/数据采集/背景差分法Key words
in-air handwriting/monocular camera/data acquisition/background difference分类
信息技术与安全科学引用本文复制引用
屈喜文,韩瑶妹,胡冕军..基于单目视觉的空中手写数据采集系统[J].信息与控制,2024,53(3):339-352,14.基金项目
国家自然科学基金项目(61906003,61971004) （61906003,61971004）
安徽省高校协同创新项目(GXXT-2021-004) （GXXT-2021-004）
