天津市初等信息技术考试标准设定方法的研究与实践
|
摘要
天津市初等信息技术考试是面向社会测试应试者计算机应用能力的评测系统,作为一种标准参照考试,从2004年开始实施以来,一直以60分作为合格标准,但实践证明,60分并不能作为判断考生是否合格的永恒标准。该考试系统是上机考试,社会考生自愿报名参加,考试对象年龄差异较大,覆盖小学2-6年级,且每个级别会有不同年龄学生参加,60分的划界分数忽略了每次参加测试的被试者的平均能力不同这一事实,也忽略了同一次考试不同考生抽到的题目不完全一致的事实。这样可能会产生一个问题,即我们只能了解考生的相对能力和相对位置。如果不能正确地将考生归入恰当的等级类别中,这种等级考试的价值就会受很大影响。因此,本文对该考试系统的"合格"标准分数的设定进行研究,利用Angoff法设定划界分数,客观地应用到被试群体中,在提高考试信度、效度的研究与应用方面进行了有益的探索。
The Tianjin Elementary Information Technology Exam is an open examination designed to test candidates' computer skills. Since the inception of this test in 2004 the passing criteria has been 60 points. But it has been proven that 60 points can not be used as a universal standard to determine which candidate meet the qualification. The examination is computer based and questions are randomly picked from an item bank. This exam covers students from Grade 2 to Grade 6. Each level of the exam will have candidates of different ages. Applying the same 60 points as the passing score ignores the fact that candidates are from different grade levels and also ignores the fact that during the same exam,each candidate may receive different items as the items are generated randomly. The above situation may cause a big problem that is we can only understand the relative ability and relative position of the candidates. If we can not classify the candidates correctly into the proper level,there will be a negative impact on the value of this kind of level exam.Therefore,the author has conducted research to analyze the "qualified"standard scores set for this examination score system. Applying the Angoff method to set boundary scores and objectively apply them to groups of subjects,this article has made a meaningful exploration to improve the validity and reliability of the exam score system and understand related applications.
The Tianjin Elementary Information Technology Exam is an open examination designed to test candidates' computer skills. Since the inception of this test in 2004 the passing criteria has been 60 points. But it has been proven that 60 points can not be used as a universal standard to determine which candidate meet the qualification. The examination is computer based and questions are randomly picked from an item bank. This exam covers students from Grade 2 to Grade 6. Each level of the exam will have candidates of different ages. Applying the same 60 points as the passing score ignores the fact that candidates are from different grade levels and also ignores the fact that during the same exam,each candidate may receive different items as the items are generated randomly. The above situation may cause a big problem that is we can only understand the relative ability and relative position of the candidates. If we can not classify the candidates correctly into the proper level,there will be a negative impact on the value of this kind of level exam.Therefore,the author has conducted research to analyze the "qualified"standard scores set for this examination score system. Applying the Angoff method to set boundary scores and objectively apply them to groups of subjects,this article has made a meaningful exploration to improve the validity and reliability of the exam score system and understand related applications.
引文
[1]杨志明.标准参照测验及其等级线信度的概化理论分析[J].心理学探新,2003,(3):52-56.
[2]曹怡.标准参照测验中若干标准设定方法的心理计量学比较初探[D].上海:华东师范大学,2003.
[3]崔丽娟,赵鑫.用安戈夫(Angoff)方法对网络成瘾的标准设定[J].心理科学,2004,(3).
[4]景汇泉.以Angoff法为基础确定医师资格实践技能考试合格标准的研究[A].见:国家医学考试中心.科研基金项目计划任务书[M].北京:2007.
[5]孟昭鏸.标准设定及其方法[R].天津:天津教育招生考试院,2008.
[6]孟昭鏸.天津市初等信息技术考试技术报告(1-3级)[R].天津:天津教育招生考试院,2010.
[2]曹怡.标准参照测验中若干标准设定方法的心理计量学比较初探[D].上海:华东师范大学,2003.
[3]崔丽娟,赵鑫.用安戈夫(Angoff)方法对网络成瘾的标准设定[J].心理科学,2004,(3).
[4]景汇泉.以Angoff法为基础确定医师资格实践技能考试合格标准的研究[A].见:国家医学考试中心.科研基金项目计划任务书[M].北京:2007.
[5]孟昭鏸.标准设定及其方法[R].天津:天津教育招生考试院,2008.
[6]孟昭鏸.天津市初等信息技术考试技术报告(1-3级)[R].天津:天津教育招生考试院,2010.