软件导刊2024，Vol.23Issue(12)：1-9,9.DOI:10.11907/rjdk.241740
基于混合脑机接口通道选择与分层特征融合的认知工作负荷识别
Cognitive Workload Recognition Based on Hybrid Brain-Computer Interface Channel Selection and Hierarchical Feature Fusion
摘要
Abstract
Research on the recognition of cognitive workload based on electroencephalogram(EEG)and functional near-infrared spectrosco-py(fNIRS)physiological data has garnered significant attention in the field of brain-computer interfaces.However,the complex data acquisi-tion environment introduces uncontrollable effects on inter-channel data,severely limiting the accuracy and integrity of models simulating hu-man brain information transmission processes.Therefore,this paper proposes an improved dynamic graph attention-based channel selection method.The method utilizes attention scores returned by a Graph Attention Network(GAT)to select channels,thereby reducing environmen-tal interference and enhancing model robustness.Moreover,simple feature fusion can overlook the heterogeneity between different modalities,leading to the loss of critical information.To mitigate this,we designed a hierarchical feature fusion module.We validated our approach using two publicly available datasets provided by the Berlin Institute of Technology:a mental arithmetic task and an N-Back task.Employing a sub-ject-dependent training strategy and ten-fold cross-validation for each participant,our method achieved average accuracies of 85.44%and 91.72%,respectively.Compared to current state-of-the-art methods,our approach demonstrates certain advantages.The experimental results indicate that the proposed model effectively recognizes cognitive workload in complex data environments.Additionally,the proposed channel selection method is significant for reducing computational cost and eliminating irrelevant channels.关键词
脑电图/功能性近红外光谱/通道选择/认知工作负荷识别/分层特征融合Key words
electroencephalogram/functional near-infrared spectroscopy/channel selection/cognitive workload relognition/hierarchical feature fusion分类
信息技术与安全科学引用本文复制引用
张恒千,詹志远,尹钟..基于混合脑机接口通道选择与分层特征融合的认知工作负荷识别[J].软件导刊,2024,23(12):1-9,9.基金项目
国家自然科学基金项目(61703277) （61703277）
上海青年科技英才扬帆计划项目(17YF1427000) （17YF1427000）
