电子学报Issue(4)：779-785,7.DOI:10.3969/j.issn.0372-2112.2014.04.024
基于时空相关度融合的语音唇动一致性检测算法
Lip Motion and Voice Consistency Algorithm Based on Fusing Spatiotemporal Correlation Degree
摘要
Abstract
This paper constructs a spatiotemporal lip motion model based on traditional simple pronunciation and lip motion spatial model ,and proposes methods for measuring the correlation degree between voice and the spatial ,temporal characteristic of lip motion .In addition ,a fusion scheme for the spatial and temporal correlation degree is proposed to measure the consistency of voice and lip motion .The temporal consistent score is defined as the correlation between lip shape (height and width) and the speech am-plitude .The Coinertia is used as the initial correlation degree of speech and lip spatial characteristic .Both the spatial and temporal correlation degrees are modified by audiovisual initial delay .Experimental results show that the proposed method reduces EER by about 8 .2% compared to the CoIA method .关键词
时空特性/一致性分析/协惯量分析/相关度融合Key words
spatiotemporal characteristic/consistent analysis/coinertia analysis(CoIA)/correlation degree fusion分类
信息技术与安全科学引用本文复制引用
朱铮宇,贺前华,奉小慧,叶婉玲,李艳雄,杨继臣..基于时空相关度融合的语音唇动一致性检测算法[J].电子学报,2014,(4):779-785,7.基金项目
国家自然科学基金（No ．61301300，No ．60972132）；博士后科学基金（No ．2013M531850）；中央高校基本科研业务费项目华南理工大学 （）
