计算机工程与应用2024，Vol.60Issue(9)：283-291,9.DOI:10.3778/j.issn.1002-8331.2212-0373
面向桌面交互场景的双目深度测量方法
Binocular Depth Measurement Method for Desktop Interaction Scene
摘要
Abstract
Virtual reality interaction methods based on vision have no specific solution in desktop writing application scene.In order to provide accurate recognition of fine interactive action,a high precision three-dimensional recognition technology based on the combination of hand and pen is needed.Additionally,the depth accuracy is an important factor to the accuracy of three-dimensional recognition.Therefore,a high-precision depth measurement method in this study is pro-vided to use in this paper.The core concept of this method is using high-resolution and close-range image pairs as input for writing interaction,and proposing the idea of cross-fusion of global and local important information to improve speed and accuracy,and reduce computing cost.In the algorithm,the region detection module is used to extract the key areas of the hand and pen tip in the image pair,and then the input is scaled according to the degree of importance.The regional fea-ture pyramid structure is introduced to extract multi-scale semantic information.Meanwhile,disparity cascade module is used to narrow the matching range to improve the real-time performance.Finally,the experiments results confirm that this depth measurement method has high accuracy and good real-time performance in the interactive area between hand and pen tip,and can effectively assist to improve the three-dimensional recognition accuracy in further to provide better writ-ing interactive experience.In summary,this study may provide new understandings and theoretic basis for future prospect of the depth measurement application in writing interaction.关键词
双目视觉/深度学习/立体匹配/深度测量/桌面交互Key words
binocular vision/deep learning/stereo matching/depth measurement/desktop interaction分类
信息技术与安全科学引用本文复制引用
叶彬,朱兴帅,姚康,丁上上,付威威..面向桌面交互场景的双目深度测量方法[J].计算机工程与应用,2024,60(9):283-291,9.基金项目
中国科学院青年创新促进会优秀会员项目(E1290301). （E1290301）
