远程教育杂志2025，Vol.43Issue(2)：31-44,14.DOI:10.15881/j.cnki.cn33-1304/g4.2025.02.004
基于多智能体与混合检索的学科核心素养表现性评价设计研究
Research on the Design of Performance Assessments for Disciplinary Core Competencies Based on Multi-Agent Systems and Hybrid Retrieval
摘要
Abstract
Intelligent assessment centered on core competencies has become a prevailing trend in global education reform.Among various approaches,performance assessment has emerged as a critical method for evaluating students'higher-order thinking skills and plays a pivotal role in contemporary evaluation systems.However,current practices face several challenges,including insufficient alignment with curriculum standards,limited incorporation of authentic contexts,and low efficiency in the reasoning of assessment rules.In order to address these issues,this study proposes an intelligent performance assessment design system grounded in the conceptual assessment framework(CAF).The system integrates multi-agent collaborative reasoning with a hybrid retrieval-augmented generation(RAG)strategy,enabling the automated design of assessment objectives,task scenarios,and evaluation rubrics within a unified framework.An experimental study was conducted to validate this system and selected three representative teaching units from the Information Technology curriculum in secondary vocational schools.The results indicate that:(1)the system-generated assessment objectives achieved high levels of semantic accuracy and content completeness;(2)in task design,the system demonstrated strong performance in terms of authenticity,diversity,and goal alignment;(3)and in rubric development,the system significantly outperformed teacher-generated rubrics in both core competency alignment and higher-order thinking progression.This study offers a novel,evidence-driven paradigm for performance assessment design through the deep integration of multi-agent systems and hybrid RAG strategies.It provides both theoretical insights and practical solutions for enhancing the scientific rigor and efficiency of assessments targeting disciplinary core competencies,contributing to the advancement of intelligent evaluation practices in competency-based education.关键词
以证据为中心/核心素养/表现性评价/多智能体/检索增强生成Key words
Evidence-centered assessment/Core competencies/Performance assessment/Multi-agent systems/Retrieval-Augmented Generation分类
社会科学引用本文复制引用
王永固,刘泉,李晓娟,余泽宇..基于多智能体与混合检索的学科核心素养表现性评价设计研究[J].远程教育杂志,2025,43(2):31-44,14.基金项目
本文系国家自然科学基金面上项目"多模态特征融合的自闭症教育机器人情感社交智能感知模型及应用研究"(项目编号:62177043)、国家社会科学基金项目"新时代大学生社会主义核心价值观知行转化机理及促进策略研究"(项目编号:20BKS099)的研究成果. （项目编号:62177043）
