|国家科技期刊平台
首页|期刊导航|软件导刊|多维连续空间的多任务表情识别研究

多维连续空间的多任务表情识别研究OA

Multi-task Facial Expression Recognition Based on Multi-dimensional and Continuous Space

中文摘要英文摘要

研究设计一个多任务情感识别模型,通过结合Valence、Arousal、Dominance(VAD)三维连续情感分析与离散情感分类,为智能情感交互提供更全面、细致的情感测量工具.首先利用两个识别任务间的相关约束(类别标签为VAD三维情感空间中的点)提升模型的识别准确性;其次提供一种在VAD三维空间中识别多维连续情感的方法与数据集,利用他们之间的相关性进行多任务联合学习,并在情感类别和VAD多维情感空间之间建立约束,相较于传统固定情感类别标签能更全面、细致地描述情感状态,特别是在目前较少研究的维度D上;最后使用情感类别数据集FER2013中可用的情感标签与手动添加的VAD注释测量VAD情感.实验表明,V和类别、A和类别、D和类别的多任务学习能明显改善模型的识别性能.

A multi task emotion recognition model was designed to provide a more comprehensive and detailed emotion measurement tool for intelligent emotion interaction by combining Valence,Arousal,Dominance(VAD)three-dimensional continuous emotion analysis and dis-crete emotion classification.Firstly,utilize the relevant constraints between two recognition tasks(labeled as points in the VAD three-dimen-sional emotional space)to improve the recognition accuracy of the model;Then,a method and dataset for identifying multi-dimensional con-tinuous emotions in VAD three-dimensional space were provided,utilizing their correlation for multi task joint learning,and establishing con-straints between emotion categories and VAD multidimensional emotion space.Compared with traditional fixed emotion category labels,it can more comprehensively and meticulously describe emotional states,especially in dimension D,which is currently less studied;Finally,use the sentiment labels available in the sentiment category dataset FER2013 and manually added VAD annotations to measure VAD sentiment.The experiment shows that multi task learning with V and category,A and category,and D and category can significantly improve the recogni-tion performance of the model.

霍奕

北京联合大学师范学院 教育信息技术系,北京 100011

计算机与自动化

多维情感识别多任务学习VAD面部表情识别数据集离散情感类别智能情感交互

multi-dimensional emotion recognitionmulti-task learningVAD facial expression recognition datasetdiscrete categorial emotion recognitionintelligent emotion recognition

《软件导刊》 2024 (005)

17-23 / 7

教育部人文社会科学研究项目(23YJE880001)

10.11907/rjdk.241260

评论