| 注册
首页|期刊导航|电子学报|基于多模态视觉特征的自然人机交互

基于多模态视觉特征的自然人机交互

管业鹏

电子学报Issue(11):2223-2229,7.
电子学报Issue(11):2223-2229,7.DOI:10.3969/j.issn.0372-2112.2013.11.017

基于多模态视觉特征的自然人机交互

Multimodal Visual Features Based Natural Human-Computer Interaction

管业鹏1

作者信息

  • 1. 上海大学通信与信息工程学院,上海 200072; 新型显示技术及应用集成教育部重点实验室,上海 200072
  • 折叠

摘要

Abstract

A novel human-computer interaction(HCI)is developed based on multimodal visual features aiming at some limits at present .Two-dimensional Gabor wavelet is adopted to extract some visual features of global face orientation ,which overcomes some difficulties including extraction of some facial distinct features ,discrimination among some different facial orientations .An ef-ficient and fast approach to locating center of eyes is proposed based on facial geometric distributions without considering facial res-olution ,eyes closing or opening and user′s wearing .Some prominent multimodal visual features for classification are selected to ma-chine learning and training to determine the pointing target after evaluating performance of some extracted visual features .Non-wearable and natural HCI modal can be realized in which user can move freely without wearing any markers when he points at some targets .Their daily skills can be exerted fully during HCI .Experiment results indicate that the developed approach is efficient and can be used to natural non-wearable HCI .

关键词

人机交互/多模态视觉特征/非穿戴/机器学习

Key words

Human-computer interaction/multimodal visual features/non-wearable/machine learning

分类

信息技术与安全科学

引用本文复制引用

管业鹏..基于多模态视觉特征的自然人机交互[J].电子学报,2013,(11):2223-2229,7.

基金项目

国家自然科学基金(No .11176016,No .60872117);高等学校博士学科点专项科研基金 ()

电子学报

OA北大核心CSCDCSTPCD

0372-2112

访问量0
|
下载量0
段落导航相关论文