计算机工程与应用2025，Vol.61Issue(10)：1-18,18.DOI:10.3778/j.issn.1002-8331.2410-0153
多模态驾驶员情绪识别研究综述
Review of Multi-Modal Driver Emotion Recognition
摘要
Abstract
Accurately identifying driver emotions can effectively prevent potential dangerous driving behaviors and reduce the occurrence of traffic accidents.It is an important technology to improve road safety and driving experience.With the progress of artificial intelligence and multi-modal data processing technology,emotion recognition technology has gradually developed from a single-modal approach to a multi-modal approach.This paper reviews the current research progress of multi-modal driver emotion recognition,and focuses on the recognition process of facial expression,voice signal,physiological signal and vehicle behavior.The key steps include data preprocessing,feature extraction and multi-modal fusion.By analyzing the existing research,the advantages and disadvantages of different methods are summarized,and several driver emotion-related datasets are introduced.Finally,combined with the current research challenges,five research directions in the field of multi-modal driver emotion recognition in the future are proposed.关键词
驾驶员情绪识别/多模态融合/特征提取/情感计算Key words
driver emotion recognition/multi-modal fusion/feature extraction/emotional computing分类
计算机与自动化引用本文复制引用
周欣颖,李雷孝,林浩,张虎成..多模态驾驶员情绪识别研究综述[J].计算机工程与应用,2025,61(10):1-18,18.基金项目
国家自然科学基金(62362055) （62362055）
内蒙古自治区重点研发与成果转化计划项目(2022YFSJ0013,2023YFHH0052) （2022YFSJ0013,2023YFHH0052）
内蒙古自治区高等学校青年科技英才支持计划项目(NJYT22084,NJYT24035) （NJYT22084,NJYT24035）
内蒙古自然科学基金(2023MS06008) （2023MS06008）
内蒙古自治区科技成果转化专项资金项目(2020CG0073,2021CG0033) （2020CG0073,2021CG0033）
内蒙古自治区直属高校科研项目(JY20220061,JY20230119,JY20230019) （JY20220061,JY20230119,JY20230019）
鄂尔多斯市重点研发计划项目(YF20232328). （YF20232328）
