基于项目作答反应时间的作弊甄别研究进展

随着基于计算机的测试逐渐普及,搜集、记录、分析考生的项目作答反应时间数据成为可能,越来越多的研究者开始基于这一数据开展考试的作弊甄别研究。然而,此类研究国外较多,国内则非常之少。提出“两种三类”的作弊行为分类标准,从参数建模法、非参数建模法两个维度,对基于项目作答反应时间的作弊研究进行梳理,评述其在甄别各类作弊行为中的应用实践和甄别效果,并对未来的研究方向做出展望。     

CAT中结合贝叶斯方法与序贯监测程序的题库质量监控技术

Zhang(2013)提出了序贯监测程序(SMP)用以检测CAT中的题目在作答过程中是否发生泄漏。然而,该方法会出现虚报且未关注在题目泄漏后,对能力估计精度产生的影响。本研究在SMP基础上引入个人拟合指标,提出SMP_PFI方法,拟在给定的置信度上核实被SMP标记的题目是否真正泄漏,并探查SMP_PFI方法对能力估计精度与被封存题目数量关系的影响。实验结果表明：新方法能够有效降低SMP单独运行时的一类错误。通过控制CPFI值能够平衡能力估计精度与被封存题目数量之间的关系。     

选项具有诊断信息的多选题认知诊断测验编制

编制选项具有诊断信息的多选题是提高多选题认知诊断测验诊断效果的有效方法.研究从认知诊断的目标出发,根据认知诊断测验质量的评价标准,结合多选题的特点,探讨选项具有诊断信息的多选题认知诊断测验编制的原则.同时,结合多选题的特点和多选题采用称名计分方式的需要,对编制选项具有诊断信息的多选题提出两点要求.根据多选题认知诊断测验编制的原则和要求,给出具有可操作性的多选题认知诊断测验编制的步骤.模拟研究结果表明：根据所提出的原则和要求编制的多选题认知诊断测验具有较好的诊断效果,说明这些原则和要求合理、可行.由于这些原则、要求和步骤具有较强的可操作性,因此它对于编制多选题认知诊断测验具有一定的指导意义.     

多项选择题认知诊断潜能的最大化

多项选择题是认知诊断中常用的测验项目形式, 其正确答案选项和经过特殊编制的干扰项都能提供诊断信息。为了提取干扰项的信息, 需要采用不同于传统认知诊断模型的心理计量模型。分类介绍能使干扰项提供诊断信息的多项选择题编制方法, 分析这类多项选择题的认知诊断模型, 认为未来应加强干扰项编制方法和能提取干扰项信息的认知诊断模型的选择和开发等方面的研究。     

Linking the fits, fitting the links: Connecting different types of PO fit to attitudinal outcomes

In this paper we explore the linkages among various types of person-organization (PO) fit and their effects on employee attitudinal outcomes. We propose and test a conceptual model which links various types of fits—objective fit, perceived fit and subjective fit—in a hierarchical order of cognitive information processing and relate them to employee organizational commitment and job satisfaction. By unveiling how the different types of fit relate to each other in influencing individual outcomes, we address some of the theoretical and methodological concerns in the use of different methods in measuring PO fit.     

Examining differential item functioning due to item difficulty and alternative attractiveness

A method for analyzing test item responses is proposed to examine differential item functioning (DIF) in multiple-choice items through a combination of the usual notion of DIF, for correct/incorrect responses and information about DIF contained in each of the alternatives. The proposed method uses incomplete latent class models to examine whether DIF is caused by the attractiveness of the alternatives, difficulty of the item, or both. DIF with respect to either known or unknown subgroups can be tested by a likelihood ratio test that is asymptotically distributed as a chi-square random variable.     

A Person Fit Test For Irt Models For Polytomous Items

A person fit test based on the Lagrange multiplier test is presented for three item response theory models for polytomous items: the generalized partial credit model, the sequential model, and the graded response model. The test can also be used in the framework of multidimensional ability parameters. It is shown that the Lagrange multiplier statistic can take both the effects of estimation of the item parameters and the estimation of the person parameters into account. The Lagrange multiplier statistic has an asymptotic χ²-distribution. The Type I error rate and power are investigated using simulation studies. Results show that test statistics that ignore the effects of estimation of the persons’ ability parameters have decreased Type I error rates and power. Incorporating a correction to account for the effects of the estimation of the persons’ ability parameters results in acceptable Type I error rates and power characteristics; incorporating a correction for the estimation of the item parameters has very little additional effect. It is investigated to what extent the three models give comparable results, both in the simulation studies and in an example using data from the NEO Personality Inventory-Revised.     

Revealed Indifference and Models of Choice Behavior

This paper introduces an approach to the study of rational choice behavior which is based on the concept of subjective indifference, as well as its relationships with both the classical preference-based approach and the choice behavior approach. With regard to the first relationship (which has already been studied in Alcantud, 2001, as a purely topological and order-theoretical problem) new considerations are now put forward in the decision theory context. In short, if a decisionmaker has some indifference classes defined on a choice set, then we know the conditions under which his/her tastes can be modeled by a continuous preference yielding these indifference classes. The second problem is posed and tackled here and gives place to a theory of revealed indifference, where both the decisive, and indecisive cases will be considered.     

Psychological determinants of decision attitude

Decision attitude — an analog of risk attitude — is the propensity to make (or avoid making) a decision: in decision aversion, a person finds it more desirable to receive through fiat the better of two options than to have a choice between them; in decision seeking, the choice is more desirable, even though it can lead to nothing better than the best option. Both decision aversion and decision seeking were found in hypothetical scenarios. Experimental manipulations and subjects' justifications point to anticipated regret, fear of blame for poor outcomes, and desire for equitable distributions as sources of decision aversion. One source of decision seeking (for self) and decision aversion (when deciding for others) appears to be the desire for the self-determination of the affected parties. We consider the implications of our results for personal choice and public policy decisions.