心理科学进展2025，Vol.33Issue(8)：1340-1357,中插2-中插6,23.DOI:10.3724/SP.J.1042.2025.1340
心理与教育测验分类信度:分类一致性评估方法
Classification consistency for measuring classification reliability of psychological and educational tests
摘要
Abstract
Classification consistency reflects the probability that a participant will obtain the same classification on two parallel tests.It is widely used by test administrators to assess the reliability of psychological tests,educational tests,and medical diagnostic classifications.Since administering parallel tests is often challenging in practice and the internal consistency is not appropriate for classification tests or criterion-referenced tests,many methods are focused on estimating classification consistency based on results from a single test administration in psychological and educational measurement.These estimation methods are crucial for assessing and improving the reliability and fairness of tests.The study focused on the investigation of the general approach and representative methods based on criterion-referenced tests for estimating classification consistency under classical measurement theory,item response theory,cognitive diagnostic models,and machine learning models.The ideal and procedures of the representative methods under each model were introduced in details.A series of examples were illustrated about how to apply classification consistency indices for evaluating test reliability.Their advantages,disadvantages,and applicability in different testing contexts were also analyzed.Future research should consider the methods of estimating the confidence intervals of classification consistency.Researchers and practitioners should widely apply and report classification consistency to better evaluate the quality of test classification results.关键词
分类信度/分类一致性/决策规则/认知诊断/机器学习Key words
classification reliability/classification consistency/decision rules/cognitive diagnosis/machine learning分类
社会科学引用本文复制引用
陈静仪,宋丽红,汪文义..心理与教育测验分类信度:分类一致性评估方法[J].心理科学进展,2025,33(8):1340-1357,中插2-中插6,23.基金项目
国家自然科学基金(62267004,62467003,62067005)和江西省普通本科高校教育教学改革研究课题(JXJG-22-2-44,JXJG-23-2-6)资助. （62267004,62467003,62067005）
