电子器件2024，Vol.47Issue(4)：1128-1132,5.DOI:10.3969/j.issn.1005-9490.2024.04.039
基于数据手套的手语翻译系统研究
Research on Sign Language Translation System Based on Data Glove
摘要
Abstract
Targeting at the problem that the deaf-mute and normal people can't communicate effectively,a gesture recognition and sign lan-guage translation system based on multi-sensor is designed.Firstly,the gesture translation glove is researched and used based on the flexi-ble sensor and inertial measurement unit(IMU).Secondly,the gesture output by the deaf-mute is collected.The continuous gesture data are segmented by using template matching method,and the intercepted data are preprocessed and feature template is extracted.By using the feature template similarity algorithm,the gesture of the deaf-mute is compared and analyzed with the gestures in the template database to recognize the sign language information,and the sign language information and its corresponding voice entries are output based on the voice module.Finally,the experiment on the success rate of gesture segmentation and recognition is carried out.The results show that the success rates of single gesture segmentation and recognition are 97% and 98%,and the success rate of continuous sentence recognition is 84%,demonstrating that the proposed system can be used to help the deaf mute communicate with the normal people.关键词
数据手套/特征模板/手势切分/手势识别/相似度算法Key words
data glove/feature template/gesture segmentation/gesture recognition/similarity algorithm分类
信息技术与安全科学引用本文复制引用
姜维佳,韩亚丽,史金飞,许有熊,王垓然,朱文亮..基于数据手套的手语翻译系统研究[J].电子器件,2024,47(4):1128-1132,5.基金项目
国家自然科学基金青年基金项目(51205182) （51205182）
江苏省重点研发计划(社会发展项目)项目(BE2019724) （社会发展项目）
产学研前瞻性项目(CXY202007) （CXY202007）
