软件导刊2024,Vol.23Issue(5):17-23,7.DOI:10.11907/rjdk.241260
多维连续空间的多任务表情识别研究
Multi-task Facial Expression Recognition Based on Multi-dimensional and Continuous Space
摘要
Abstract
A multi task emotion recognition model was designed to provide a more comprehensive and detailed emotion measurement tool for intelligent emotion interaction by combining Valence,Arousal,Dominance(VAD)three-dimensional continuous emotion analysis and dis-crete emotion classification.Firstly,utilize the relevant constraints between two recognition tasks(labeled as points in the VAD three-dimen-sional emotional space)to improve the recognition accuracy of the model;Then,a method and dataset for identifying multi-dimensional con-tinuous emotions in VAD three-dimensional space were provided,utilizing their correlation for multi task joint learning,and establishing con-straints between emotion categories and VAD multidimensional emotion space.Compared with traditional fixed emotion category labels,it can more comprehensively and meticulously describe emotional states,especially in dimension D,which is currently less studied;Finally,use the sentiment labels available in the sentiment category dataset FER2013 and manually added VAD annotations to measure VAD sentiment.The experiment shows that multi task learning with V and category,A and category,and D and category can significantly improve the recogni-tion performance of the model.关键词
多维情感识别/多任务学习/VAD面部表情识别数据集/离散情感类别/智能情感交互Key words
multi-dimensional emotion recognition/multi-task learning/VAD facial expression recognition dataset/discrete categorial emotion recognition/intelligent emotion recognition分类
信息技术与安全科学引用本文复制引用
霍奕..多维连续空间的多任务表情识别研究[J].软件导刊,2024,23(5):17-23,7.基金项目
教育部人文社会科学研究项目(23YJE880001) (23YJE880001)