液晶与显示2024，Vol.39Issue(7)：939-949,11.DOI:10.37188/CJLCD.2023-0225
基于颜色和光流的多注意力机制微表情识别
Multi-attention micro-expression recognition based on color and optical flow
摘要
Abstract
The optical flow method cannot fully exploit the facial color information of micro-expressions,resulting in low recognition accuracy.Therefore,this paper proposes a multi-attention dual-flow network method based on color and optical flow.Firstly,the facial color difference maps are obtained in the CIE Luv color space,and the emotional-physiological features are extracted to compensate for the singularity and limitation of the micro-expression optical flow features.Then,the PAM module and ECA block are combined in parallel to obtain the lightweight dual-attention module,which extracts the spatial and channel key features.Finally,a cross-attention mechanism is designed to obtain mixed features of color and optical flow.The mixed features are fused with spatial channel key features for micro-expression classification.The model is evaluated experimentally using leave-one-out cross-validation.The accuracy and F1 scores reach 69.18%and 67.04%on the SAMM dataset,and 72.38%and 70.85%on the CASME Ⅱ dataset.The experimental results are superior to the current mainstream algorithms,further proving the effectiveness of the proposed model and its modules in micro-expression recognition.关键词
计算机视觉/微表情识别/CIE Luv/颜色特征/光流特征/双流网络Key words
computer vision/micro-expression recognition/CIE Luv/color features/optical flow features/two-stream network分类
信息技术与安全科学引用本文复制引用
黄凯,王峰,王晔,常亦婷..基于颜色和光流的多注意力机制微表情识别[J].液晶与显示,2024,39(7):939-949,11.基金项目
山西省回国留学人员科研资助项目(No.2020-042) （No.2020-042）
山西省留学回国人员科技活动择优资助基金(No.20200017) （No.20200017）
山西省基础研究计划(No.20210302123186) （No.20210302123186）
国家级重点支持领域大创项目(No.20220058)Supported by Scientific Research Grant for Returned Overseas Chinese in Shanxi Province(No.2020-042) （No.20220058）
Science and Technology Activities for Returned Overseas Chinese in Shanxi Province(No.20200017) （No.20200017）
Basic Research Program of Shanxi Province(No.20210302123186) （No.20210302123186）
National Key Supporting Fields for College Students'Innovation and Entrepreneurship Projects(No.20220058) （No.20220058）
