基于新一代脑磁图的语义视听单试次检测OACSTPCD
Semantic Audiovisual Single-trial Detection Based on the New Generation of Magnetoencephalography
为解码人脑在语义情境下的视听双模态与单模态中的响应差异,本研究设计了相关任务范式并应用新一代脑磁图(OPM-MEG)结合机器学习方法对采集信号从行为学响应、事件相关场(ERF)和单试次检测3个角度进行分析.结果显示单模态语义响应主要集中在枕叶,而双模态语义响应主要集中在顶叶.同时,双模态下的被试响应速率及单试次检测准确率显著高于单模态.此外,支持向量机(SVM)在4种机器学习模型中显示出了最佳分类效能,在被试内分类平均准确率可达75.16%,被试间平均准确率达80.56%.结果表明基于OPM-MEG结合机器学习为实现解码语义情境下的视听双模态与单模态响应差异提供了一条新的有效途径.
In order to decode the difference between audiovisual bimodal and unimodal responses of the human brain in semantic context,this study designed a related task paradigm and applied a new generation magnetoencephalogram combined with the machine learning model to analyze the collected signals from three perspectives:behavioral response,event-related field(ERF)and single-trial detection.Results show that the unimodal semantic response was mainly concentrated in the occipital cortex,while the bimodal semantic response was mainly concentrated in the parietal cortex.At the same time,respondents'response rate and the detection accuracy of single-trial in bimodal mode were significantly higher than that in unimodal mode.Moreover,the support vector machine(SVM)showed the best classification performance among the four machine learning models,with an average classification accuracy of 75.16%for within-subject classification and 80.56%for between-subject classification.This research concludes that the combination of optically pumped magnetometer-magnetoencephalography(OPM-MEG)and machine learning model provides an efficient approach to decode the difference between audiovisual bimodal and unimodal responses of the human brain in semantic context.
郭旭;王晨旭;张欣;常严;崔峰;郭清乾;胡涛;杨晓冬
徐州医科大学医学影像学院,江苏徐州 221004||中国科学院苏州生物医学工程技术研究所,江苏苏州 215163中国科学院苏州生物医学工程技术研究所,江苏苏州 215163||季华实验室,广东 佛山 528200中国科学院苏州生物医学工程技术研究所,江苏苏州 215163徐州医科大学医学影像学院,江苏徐州 221004||中国科学院苏州生物医学工程技术研究所,江苏苏州 215163||季华实验室,广东 佛山 528200
物理学
新一代脑磁图语义视听双模态机器学习事件相关场
OPM-MEGsemanticaudiovisual bimodalmachine learningevent-related field
《波谱学杂志》 2024 (003)
304-314 / 11
季华实验室项目-新一代可穿戴脑磁图仪研制(X190131TD190).
评论