Item difficulty parameter estimation using the idea of the graded response model and computerized adaptive testing

Abstract:  In test operations using IRT (item response theory), items are included in a test before being used to rate subjects and the response data is used to estimate their item parameters. However, this method of test operation may lead to item content leakage and an adequate test operation can become difficult. To address this problem, Ozaki and Toyoda (2005, 2006 ) developed item difficulty parameter estimation methods that use paired comparison data from the perspective of the difficulty of items as judged by raters familiar with the field. In the present paper, an improved method of item difficulty parameter estimation is developed. In this new method, an item for which the difficulty parameter is to be estimated is compared with multiple items simultaneously, from the perspective of their difficulty. This is not a one-to-one comparison but a one-to-many comparison. In the comparisons, raters are informed that items selected from an item pool are ordered according to difficulty. The order will provide insight to improve the accuracy of judgment.     

A Bayesian Nonparametric Approach to Test Equating

A Bayesian nonparametric model is introduced for score equating. It is applicable to all major equating designs, and has advantages over previous equating models. Unlike the previous models, the Bayesian model accounts for positive dependence between distributions of scores from two tests. The Bayesian model and the previous equating models are compared through the analysis of data sets famous in the equating literature. Also, the classical percentile-rank, linear, and mean equating models are each proven to be a special case of a Bayesian model under a highly-informative choice of prior distribution.     

Coefficients Alpha,Beta, Omega,and the glb: Comments on Sijtsma

There are three fundamental problems in Sijtsma (Psychometrika, 2008): (1) contrary to the name, the glb is not the greatest lower bound of reliability but rather is systematically less than ω _t (McDonald, Test theory: A unified treatment, Erlbaum, Hillsdale, 1999), (2) we agree with Sijtsma that when considering how well a test measures one concept, α is not appropriate, but recommend ω _t rather than the glb, and (3) the end user needs procedures that are readily available in open source software.     

应用项目反应理论创建图形推理测验题库

自编235个图形推理测验题目。采用铆测验等值设计,以72个联合型瑞文测验题目为铆题,对初中到大学各能力层次的1733名男性进行了测验。使用BILOG MG3.0（边际极大似然估计）对实测数据进行了分析,采用Logsitic 3参数模型。剔除数据与模型拟合不好的题目以及信息函数最大值小于0.3的题目,最终建立一个包含181道题目的题库。该题库可以用于淘汰智力较低的应征青年     

初级军官心理选拔的预测性

目的：通过建立院校学员胜任特征及初级军官评价模型,探讨初级军官心理选拔检测系统的预测性。方法：某军校340名男性本科学员入校时完成初级军官心理选拔检测,毕业前进行院校胜任特征评价,对162名学员毕业后1~5年进行部队工作表现追踪评价。结果：中国MBTI-G人格类型测验对院校学员管理能力、影响力、约束力、口头表达、军人气质、人际关系等有较好的预测性,预测符合率72.13%;中国军人明尼苏达个性调查表6项精神障碍维度对情绪稳定性有较好的预测,预测符合率71.90%;院校学员一般能力倾向测验对学业成绩、文字表达、口头表达、人际关系和决策能力等胜任特征也有一定的预测性,预测符合率66.70%;三项测验院校胜任特征总预测符合率达81.70%,部队胜任特征总预测符合率76~87%。结论：为我军初级军官心理选拔提供了实用工具,为提高心理选拔预测准确性提供了科学依据     

内隐地域刻板印象的IAT和SEB比较研究

本研究以上海行政区为划分标准,探讨了"上海人"和"非上海人"群体的地域刻板印象以及"内-外群体效应"。结果发现:(1)IAT结果表明,被试在不相容条件下的反应时显著高于相容条件(t(25)=3.282,p<0.01);(2)SEB结果表明,被试对于不符合刻板印象的句子做出解释的次数显著多于符合刻板印象的句子(t(73)=2.844,p<0.01),且不同地域来源的被试做出的内、外归因也有显著差异(t(72)=3.172,p<0.01)。研究采用两种测验方法证实了地域刻板印象的存在,并且通过实践验证了SEB作为内隐社会认知研究方法的有效性。     

外显和内隐攻击性表现方式的性别差异实验研究

本研究同时运用问卷法和内隐联想测验(IAT)来研究我国大学生的攻击性。结果发现:1.整体外显攻击性不存在性别差异,但在身体攻击因素上男性显著高于女性。2.内隐攻击性在表现方式上存在性别差异,男性与身体攻击联系更紧密;女性与言语攻击联系更紧密。3.外显攻击性和内隐攻击性间的关系不能简单地根据相关系数来判断。     

从词频和新旧效应探讨再认测验中的定向遗忘

本文采用字表方式,从高低词频和新旧效应角度,探讨内隐和外显测验中定向遗忘效应的存在性及其机制问题。结果发现:(1)低频词在两种测验中都存在定向遗忘效应,而高频词仅存在于外显测验中。(2)两种测验中都存在指示记住的新旧效应,而外显测验中不存在指示忘记的新旧效应。由此推断,测验间在没有"意识和无意识"相互污染的理想情况下,只有外显测验可获得定向遗忘效应;定向遗忘的机制可能是选择性编码机制。     

论心理测验项目编写的科学性

本文以作为心理测验科学性最基本保证的项目编写为核心,论证了心理测验编制的前提、方法,心理测验项目编写的依据、项目的来源以及项目的分析指标等方面的科学性问题。     

刺激的知觉辨认难度与大脑两半球间的分布式加工

采用半视野速示术将标准刺激在中间视野呈现,比较刺激以不同偏心视角（3.5°,5°和6.5°）在左或右视野同时呈现,以检查不同偏心视角引起比较刺激知觉辨认难度的改变对汉字大写数字奇－偶概念同/异判断任务在大脑两半球间分布式加工的影响。结果显示：随偏心视角的增大正确反应时和错误百分数均显著提高;三种视角条件下左右手的正确反应时均有明显的右视野（左半球）优势;3.5°视角右视野（左半球）呈现时右手反应明显快于左手,5°视角右视野（左半球）与左视野（右半球）呈现时均为右手反应明显快于左手,6.5°视角右视野（左半球）与左视野（右半球）呈现时均为左手反应明显快于右手。这些结果提示：本研究条件下只有比较刺激在6.5°偏心视角呈现时刺激和反应可能出现大脑两半球间分布式加工,3.5°和5°视角呈现时可能为左半球单独加工。6.5°视角刺激呈现的分布加工明显由于大视角呈现时比较刺激辨认难度与注意要求的提高所致。