数学教育学报2018,Vol.27Issue(3):39-44,6.
初中学业水平考试中固定分数法标准设定的信度分析——以中考数学为例
Reliability of Current Standard Setting Method of Fixed Score in Academic Level Examination for Secondary School
摘要
Abstract
The main purposes of this study were to examine the reliability of current standard setting method of Fixed Score in academic level examination for Secondary School. Using stratified random sampling design to select three counties from the East, Middle, and West of China respectively, 3 000 students of each county are chosen. The data from the Academic Level Examination for Secondary School was used. A comprehensive application of modern measurement theory to analyze the reliability indicators of standard setting, including Decision Consistency Index (Kappa) in Classical Testing Theory (CTT), Cut-score Dependability Φ(λ)in Generalizability Theory (GT), and the amount of information index I(θ)from Item Response Theory. The results showed that: (i) the Decision Consistency Index of current Entrance Examination for Secondary School approaching 0.7; (ii) Φ(λ)of the cut-scores was greater than 0.7, mostly beyond 0.8; (iii) I(θ)were less than 16 regardless of methods to Fix Score or Fix Ratio. All these results suggested that the quality of existing tests' standards setting method of Fixed Score was barely satisfactory, and it should be improved for high-stakes examinations.关键词
学业水平考试/标准设定/固定分数法/信度Key words
academic level examination/standard setting/fixed score method/reliability分类
社会科学引用本文复制引用
卜文娟,温红博,刘先伟..初中学业水平考试中固定分数法标准设定的信度分析——以中考数学为例[J].数学教育学报,2018,27(3):39-44,6.基金项目
北京师范大学研究生院精品课程建设项目——研究生培养—方法课群教学团队建设—SPSS数(1601121A2) (1601121A2)