机器人2026，Vol.48Issue(3)：506-517,591,13.DOI:10.13973/j.cnki.robot.240255
基于非对称注意与双池化筛选的情感识别网络
Emotion Recognition Network with Asymmetric Attention and Dual Pooling Screening
摘要
Abstract
To fully utilize the emotional relevance between facial expression and body language,and to suppress the re-dundant information of non-emotional key frames,an AADPS(asymmetric attention and dual pooling screening)network for emotional recognition is proposed.The proposed network consists of an intra-frame spatial fusion subnet and an inter-frame spatio-temporal fusion subnet.In the intra-frame spatial fusion subnet,an asymmetric attention mechanism is constructed to capture the potential spatial correlation between facial expression and body language,and to hierarchically obtain the geometric semantics of body language guided by gesture cues and the intra-frame emotional correlation semantics guided by facial cues.In the inter-frame spatio-temporal fusion subnet,the average pooling and max pooling operations are used to generate the video-level emotional semantics and measure the similarity between the video-level emotional semantics and frame-level semantics.Meanwhile,a dual pooling key-frame screening strategy is designed to suppress the influence of non-peak frames.The experimental results demonstrate that the AADPS network achieves emotion recognition accuracies of 94.95％and 88.69％on FABO and CAER datasets,respectively,representing improvements of 12.22％and 13.49％over the baseline network.Compared with the single-modal methods based on facial expression or body language and the multi-modal methods based on the fusion of two emotional cues,the proposed method exhibits superior emotion recognition performance in complex scenarios.关键词
情感识别/面部表情/身姿语/非对称注意/关键帧筛选Key words
emotion recognition/facial expression/body language/asymmetric attention/key-frame screening引用本文复制引用
黄忠,张远坤,任福继,胡敏,刘娟..基于非对称注意与双池化筛选的情感识别网络[J].机器人,2026,48(3):506-517,591,13.基金项目
国家自然科学基金(62176084) （62176084）
安徽省自然科学基金(1908085MF195) （1908085MF195）
安徽省教育厅自然科学重点研究项目(2022AH051038). （2022AH051038）
