自动化学报2018,Vol.44Issue(12):2142-2159,18.DOI:10.16383/j.aas.2018.c170644
多模态维度情感预测综述
A Survey of Dimensional Emotion Prediction by Multimodal Cues
摘要
Abstract
The dimensional emotion model characterizes emotion as a signal in a multi-dimensional space spanned by several continuously valued dimensions (such as arousal, valence, and dominance). Compared with the discrete emotion model, it has the advantages that it can distinguish subtle difference of emotion, can represent evolution of emotion, etc. So the dimensional emotion model has been paid more and more attention in recent years. Dimensional emotion prediction from multimodal cues is a complex task, the prediction performance is influenced by such as modalities used, features extracted from each modality, information fusion technique, annotation errors. In order to improve multimodal dimensional emotion prediction performance, researchers have made persistent efforts in all aspects. In the paper, concept and annotation of dimensional emotion, performance evaluation criteria of dimensional emotion prediction, and research status of multimodal dimensional emotion prediction are reviewed; influences of various factors on emotion prediction performance are analyzed; challenge and development trend of multimodal dimensional emotion prediction are summarized.关键词
情感识别/情感预测/维度情感模型/离散情感模型/信息融合/特征提取Key words
Emotion recognition/emotion prediction/dimensional emotion model/discrete emotion model/information fusion/feature extraction引用本文复制引用
李霞,卢官明,闫静杰,张正言..多模态维度情感预测综述[J].自动化学报,2018,44(12):2142-2159,18.基金项目
国家自然科学基金(61501249,61071167) (61501249,61071167)
江苏省重点研发计划项目(BE2016775) (BE2016775)
江苏省自然科学基金(BK20150855) (BK20150855)
江苏省研究生创新项目(KYLX15 0827,KYLX16 0660)资助 (KYLX15 0827,KYLX16 0660)