现代信息科技2024，Vol.8Issue(22)：15-19,24,6.DOI:10.19850/j.cnki.2096-4706.2024.22.004
基于深度学习的盲人辅助交流系统研究
Research on the Blind Auxiliary Communication System Based on Deep Learning
摘要
Abstract
In order to solve the communication obstacles caused by the visual defects of the blind,combining the research on ordinary people's communication theory with the existing model of communication,the blind communication model and the blind auxiliary communication model are constructed.Through the combination of hardware and software,the blind auxiliary communication system is designed.The hardware system mainly includes two parts of smart glasses and portable computing devices.The software system mainly collects images and sounds,identifies communication targets and their external features,and expression communication behaviors.Among them,expression recognition technology uses ResNet18 Residual Neural Network to achieve real-time expression recognition function,and finally the sound is synthesized and the result is output.关键词
盲人/交流模型/辅助交流/表情识别Key words
the blind/AC model/auxiliary communication/expression recognition分类
信息技术与安全科学引用本文复制引用
范稷源,林馨洋,谢亚文,吴韵晴,邓偲宸,涂桢..基于深度学习的盲人辅助交流系统研究[J].现代信息科技,2024,8(22):15-19,24,6.基金项目
中国矿业大学(北京)大学生创新训练项目资助(202304029) （北京）
