计算机应用与软件Issue(11)：76-79,4.DOI:10.3969/j.issn.1000-386x.2013.11.022
基于图像可听化的视听信息融合方法研究
RESEARCH ON IMAGE SONIFICATION-BASED AUDIO-VIDEO INFORMATION FUSION
摘要
Abstract
While studying the traditional speech recognition system with audio-video dual mode , we found that the visual characteristics after image processing have the problems of large amount of data and important characteristics lost .Aiming at these problems , we plan to apply image sonification technology to extracting the characteristics of video image .By using BP neural network in genetic algorithm optimisation as the fusion model , we fuse the characteristics of audio and video at feature level .Experimental results show that , after being processed by the image sonification , the visual characteristics contain certain speech information , its recognition effect is stable in noise environment as well .The fusion model of neural network improves the robustness of the system .关键词
图像可听化/视觉特征/特征级融合/遗传算法/BP神经网络Key words
Image sonification/Visual characteristics/Feature-level fusion/Genetic algorithm/BP neural network分类
信息技术与安全科学引用本文复制引用
彭玉青,高洁,梁春娟,李铁军..基于图像可听化的视听信息融合方法研究[J].计算机应用与软件,2013,(11):76-79,4.基金项目
国家自然科学基金项目（51175145）。 （）
