实验科学与技术2025,Vol.23Issue(4):1-11,11.DOI:10.12179/1672-4550.20240391
多任务师生模型的语音情感识别实验设计
Experimental Design of Speech Emotion Recognition with the Multi-Task Teacher-Student Model
摘要
Abstract
Aiming at the research hotspots of speech emotion recognition in human-computer intelligent interaction,noisy speech emotion recognition based on the multi-task constrained teacher-student model is designed as a research-oriented teaching experiment.In this experiment,the guiding role of the teacher model,the learning process of the student model and the constraining force of multi-level enhanced loss are observed.The design is based on the Wav2vec 2.0 teacher-student model and the multi-level enhanced loss mechanism.A speech enhancement auxiliary task is introduced into the student model,enabling it to acquire the feature representation ability of the teacher model through learning.In the testing phase,the student model directly extracts key emotional features from noisy speech for emotion classification.Finally,a large number of experiments are conducted to analyze the performance and robustness of the emotion recognition system.The experimental design based on the teacher-student model helps to improve students'thinking ability,scientific research innovation and exploration awareness.关键词
语音情感识别/多任务约束/语音增强/Wav2vec 2.0/教师学生模型Key words
speech emotion recognition/multi-task constraint/speech enhancement/Wav2vec 2.0/teacher-student model分类
信息技术与安全科学引用本文复制引用
孙林慧,李平安,雷云龙,张子晓..多任务师生模型的语音情感识别实验设计[J].实验科学与技术,2025,23(4):1-11,11.基金项目
国家自然科学基金(61901227) (61901227)
南京邮电大学校重点教改项目(JG06219JX08) (JG06219JX08)
姑苏创新创业领军人才项目(ZXL2022472). (ZXL2022472)