远程教育杂志2026，Vol.44Issue(5)：48-57,10.DOI:10.15881/j.cnki.cn33-1304/g4.2026.05.006
生成式多智能体支持的开放式协作问题解决能力测评系统设计与验证
Design and Validation of an Open-Ended CPS Assessment System Powered by Generative Multi-Agent Systems
摘要
Abstract
The assessment of collaborative problem-solving(CPS)competence has long faced a fundamental challenge:balanc-ing the authenticity of collaborative contexts with the independence of individual assessment.Traditional human-human collaborative assessments are susceptible to peer effects,whereas human-computer assessments based on predefined response options are limited in their ability to capture the dynamic interactions inherent in complex collaboration.To address this challenge,this study developed an open-ended CPS assessment system powered by generative multi-agent technology.Grounded in the PISA 2015 CPS framework and informed by situated cognition theory,group dynamics theory,and Evidence-Centered Design(ECD),the system follows an assessment logic of"context construction-behavior elicitation-evidence inference"and incorporates multiple role-based agents,a dialogue control mechanism,and an evidence analysis module.Building on this system,an automated procedure was further established to map dia-logue units onto CPS competency dimensions and evaluate learners' performance across different proficiency levels.The system was validated with Grade 10 students.The results indicate that the system can effectively differentiate learners with varying levels of CPS competence,while demonstrating a high degree of consistency with conventional assessment approaches.Moreover,open-ended natu-ral language interaction generates richer and more continuous process-based behavioral evidence,providing a viable approach for leveraging large language models to assess higher-order thinking skills.关键词
协作问题解决/生成式多智能体/开放式人机协作/过程性测评/大语言模型Key words
Collaborative problem solving/Generative multi-agent systems/Open-ended human-agent collaboration/Process-based assessment/Large language models分类
社会科学引用本文复制引用
胡艺龄,陈煜,闵雪,何雨桐,吴忭..生成式多智能体支持的开放式协作问题解决能力测评系统设计与验证[J].远程教育杂志,2026,44(5):48-57,10.基金项目
全国教育科学"十四五"规划2023年国家一般项目"数据赋能的教师数字素养培养模式与可视化环境设计研究"(项目编号:BCA230274). （项目编号:BCA230274）
