|国家科技期刊平台
首页|期刊导航|信息安全研究|融合卷积神经网络和Transformer的人脸欺骗检测模型

融合卷积神经网络和Transformer的人脸欺骗检测模型OACSTPCD

Face Spoofing Detection Model with Fusion of Convolutional Neural Network and Transformer

中文摘要英文摘要

在人脸反欺骗领域,大多数现有检测模型都是基于卷积神经网络(convolutional neural network,CNN),该类方法虽能以较少的参数学习人脸识别,但其感受野是局部的;而基于Transformer的方法虽然能够全局感知,但参数量和计算量极大,无法在移动或边缘设备广泛部署.针对以上问题,提出一种融合CNN和Transformer的人脸欺骗检测模型,旨在保持人脸全局和局部特征提取能力的前提下,实现参数量和准确度的平衡.首先,裁剪选取局部人脸图像作为输入,有效避免过拟合现象;其次,设计基于坐标注意力的特征提取模块;最后,设计融合CNN和Transformer模块,通过局部-全局-局部的信息交换实现图像局部特征和全局特征的提取.实验结果表明,该模型在CASIA-SURF(Depth模态)数据集上获得了 99.31%的准确率以及0.54%的平均错误率;甚至在CASIA-FASD和Replay-Attack这2个数据集上实现了零错误率,且模型参数量仅0.59 MB,远小于Transformer系列模型.

In the field of face anti-spoofing,the methods based on Convolutional Neural Network(CNN)can learn feature representation with fewer parameters,yet their receptive fields remain local.In contrast,Transformer-based methods offer global perception but entail an impractical volume of parameters and computations,hindering widespread deployment on mobile or edge devices.To address these challenges,this paper proposed a face spoofing detection model that integrates CNN and Transformer,aiming to achieve a balance between the amount of parameters and accuracy while maintaining the ability to extract global and local features.Firstly,local face images are cropped and selected as input to effectively avoid overfitting.Secondly,the feature extraction module based on coordinate attention is designed.Finally,the fusion of CNN and Transformer modules are designed to extract local and global features of images through local-global-local information exchange.The experimental results show that the model achieved an accuracy of 99.31%and an average error rate of 0.54%on the CASIA-SURF(Depth modality)dataset;Moreover zero error rate is achieved on the CASIA-FASD and Replay-Attack datasets,and the model parameters are only 0.59MB,much smaller than the Transformer series models.

黄灵;何希平;贺丹;杨楚天;旷奇弦

重庆工商大学人工智能学院 重庆 400067重庆工商大学人工智能学院 重庆 400067||检测控制集成系统重庆市工程实验室(重庆工商大学)重庆 400067

计算机与自动化

人脸欺骗检测CNNTransformer模型融合注意力机制

face spoofing detectionCNNTransformermodel fusionattention mechanisy

《信息安全研究》 2024 (001)

25-33 / 9

重庆市教育委员会科学技术研究项目(KJZD-K20220080);重庆工商大学研究生科研创新项目(yjscxx2022-112-180)

10.12379/j.issn.2096-1057.2024.01.05

评论