计算机工程与应用2018,Vol.54Issue(9):1-4,4.DOI:10.3778/j.issn.1002-8331.1711-0361
多媒体情感标签标注中音频信号重要性分析
Analysis of importance of audio signals in multimedia emotion tagging
摘要
Abstract
Emotion tagging is one field of interest in affective computing.Several works are published on this topic focusing on emotion tagging for images,audios and multimedia clips.In this paper the importance of audio signals are analyzed under previous proposed EEG-based brain encoding emotion tagging framework.The open accessed affective computing dataset DEAP is employed as the benchmark.For the analysis,three kinds of visual features and one set of audio features are extracted from video clips. The visual features are used for emotion tagging under the proposed framework at first then the combination of audio and visual features are used through the same procedure.The results indicate that emotion tagging accuracies are improved by combining audio and visual features compared with accuracy using only visual features. Moreover,no performance loss is caused by the increasement of feature dimensions.关键词
情感计算/情感标签标注/脑电图/多模态融合Key words
affective computing/emotion tagging/electroencephalogram(EEG)/multimodal fusion分类
信息技术与安全科学引用本文复制引用
陈墨,郭雷..多媒体情感标签标注中音频信号重要性分析[J].计算机工程与应用,2018,54(9):1-4,4.基金项目
国家自然科学基金(No.61333017). (No.61333017)