| 注册
首页|期刊导航|自动化学报|基于多层级信息融合网络的微表情识别方法

基于多层级信息融合网络的微表情识别方法

陈妍 吴乐晨 王聪

自动化学报2024,Vol.50Issue(7):1445-1457,13.
自动化学报2024,Vol.50Issue(7):1445-1457,13.DOI:10.16383/j.aas.c230641

基于多层级信息融合网络的微表情识别方法

A Micro-expression Recognition Method Based on Multi-level Information Fusion Network

陈妍 1吴乐晨 2王聪3

作者信息

  • 1. 湖南工商大学计算机学院 长沙 410205||湘江实验室 长沙 410205
  • 2. 湖南工商大学计算机学院 长沙 410205
  • 3. 天津科技大学人工智能学院 天津 300457
  • 折叠

摘要

Abstract

Micro-expressions are subtle and involuntary changes during emotional expression.Accurate and effi-cient recognition of these is crucial for the early diagnosis and treatment of mental illnesses.Most of the existing methods often neglect the connections between key facial areas in micro-expressions,making it difficult to capture the subtle changes in small sample image spaces,resulting in low recognition rates.To address this,a micro-expres-sion recognition method is proposed based on a multi-level information fusion network.This method includes a video frame selection strategy based on frequency amplitude,which can select frames with high-intensity expres-sions from micro-expression videos.Additionally,this method includes a multi-level information extraction network using self-attention mechanisms and graph convolutional networks,and a fusion network that incorporates global image information,which can capture the subtle changes of facial micro-expressions from different levels to improve the recognition of specific categories.Experiments on public datasets show that our method effectively improves the accuracy and outperforms other advanced methods.

关键词

微表情识别/深度学习/图卷积网络/多层级融合

Key words

Micro-expression recognition/deep learning/graph convolutional network/multi-level fusion

引用本文复制引用

陈妍,吴乐晨,王聪..基于多层级信息融合网络的微表情识别方法[J].自动化学报,2024,50(7):1445-1457,13.

基金项目

国家自然科学基金(62273140,72342018)资助Supported by National Natural Science Foundation of China(62273140,72342018) (62273140,72342018)

自动化学报

OA北大核心CSTPCD

0254-4156

访问量0
|
下载量0
段落导航相关论文