复杂结构语言试卷信度的多元概化理论分析——以CET-6数据为例

通过对170名大学生在一套旧式大学英语六级考试客观题上的反应数据的分析,演示了如何用多元概化理论这一工具计算复杂结构语言试卷测试结果的信度系数.结果显示,对于这组学生,总分信度系数达0.921与达0.907,但各部分的差异很大,词汇和语法部分的信度系数最高,为0.802与0.782,听力部分的信度系数次之.为0.769与0.744,阅读理解部分的最低,为0.551与0.782,听力部分的信度系数次之,为0.769与0.744,阅读理解部分的最低,为0.551与0.503.进一步的分析揭示,在这套试卷的70道客观题中,与各自部分不融洽的题目有23个,其中听力部分6道,阅读部分10道,词汇语法部分7道.如果这些不融洽题目上的成绩不记入总成绩,总分和各部分成绩的信度系数都大幅度提高,其中总分信度系数提高到0.937,听力部分提高到0.831,阅读部分提高到0.773,词汇语法部分提高到0.859.在分析的基础上,对语言测试工作者提出了5条积极的建议.

Evaluating the Reliability Coefficient of a Complex Language Test with Multivariate Generalizability Theory

By analyzing the response data set of 170 tertiary level students on the old version CET-6 test form,we demonstrated how multivariate generalizability theory can be employed in the evaluation of reliability coefficient for a language test form with a complex structure.The result shows that for the given group of students and the population it represents,the objective section of the test as whole has a generalizability coefficient of 0.921 and an independence index of 0.907,but the three sections vary greatl...