演绎推理的形式和内容启动加工

聚焦推理加工初期,研究通过指导语操控主观加工倾向,考察不同指导语条件下内容可信度和形式有效性对演绎推理结果的影响,检验内容和形式两类加工过程的启动加工动态变化性。结果表明,指导语条件显著影响推理初期加工。在无提示指导语和形式判定指导语条件下,推理结果受到了形式有效性和内容可信度的影响;内容判定指导语下只受到了内容可信度的影响。证明主观加工倾向影响了内容和形式的启动加工关系,支持了动态变化性的假设。     

An IRT analysis of motive questionnaires: The Unified Motive Scales

Multiple inventories claiming to assess the same explicit motive (achievement, power, or affiliation) show only mediocre convergent validity. In three studies (N = 1685) the structure, nomological net, and content coverage of multiple existing motive scales was investigated with exploratory factor analyses. The analyses revealed four approach factors (achievement, power, affiliation, and intimacy) and a general avoidance factor with a facet structure. New scales (the Unified Motive Scales; UMS) were developed using IRT, reflecting these underlying dimensions. In comparison to existing questionnaires, the UMS have the highest measurement precision and provide short (six-item) and ultra-short (three-item) scales. In a fourth study (N = 96), the UMS demonstrated incremental validity over existing motive scales with respect to several outcome criteria.     

The influence of item order on intentional response distortion in the assessment of high potentials: Assessing pilot applicants

An experiment was conducted to investigate the effects of item order and questionnaire content on faking good or intentional response distortion. It was hypothesized that intentional response distortion would either increase towards the end of a long questionnaire, as learning effects might make it easier to adjust responses to a faking good schema, or decrease because applicants' will to distort responses is reduced if the questionnaire lasts long enough. Furthermore, it was hypothesized that certain types of questionnaire content are especially vulnerable to response distortion. Eighty‐four pre‐selected pilot applicants filled out a questionnaire consisting of 516 items including items from the NEO five factor inventory (NEO FFI), NEO personality inventory revised (NEO PI‐R) and business‐focused inventory of personality (BIP). The positions of the items were varied within the applicant sample to test if responses are affected by item order, and applicants' response behaviour was additionally compared to that of volunteers. Applicants reported significantly higher mean scores than volunteers, and results provide some evidence of decreased faking tendencies towards the end of the questionnaire. Furthermore, it could be demonstrated that lower variances or standard deviations in combination with appropriate (often higher) mean scores can serve as an indicator for faking tendencies in group comparisons, even if effects are not significant.     

一种非参数化的Q矩阵估计方法：ICC-IR方法开发

摘要：相对于参数化的方法,本研究根据题目测量模式关系开发出ICC指标,并提出基于理想得分的ICC指标法进行Q矩阵估计。Monte Carlo模拟研究与实证研究发现（1）基于理想得分ICC指标法估计Q矩阵具有很好的效果,当属性个数越少、基础题个数越多,估计效果越好。（2）相对于以往方法——D2统计量的方法,ICC-IR法效果更好,并且是一种非参数化的方法,计算简单快捷。（3）实证数据分析表明,ICC-IR法估计的Q矩阵在模型拟合度上也优于D2统计量方法。     

高中英语阅读测验中题组模型的选择与应用

本研究通过高中英语阅读测验实测数据,对比分析双参数逻辑斯蒂克模型 (2PL-IRT)和加入不同数量题组的双参数逻辑斯蒂克模型 (2PL-TRT), 探究题组数量对参数估计及模型拟合的影响。结果表明：(1) 2PL-IRT模型对能力介于-1.50到0.50的被试,能力参数估计偏差较大;(2)将题组效应大于0.50的题组作为局部独立题目纳入模型,会导致部分题目区分度参数的低估和大部分题目难度参数的高估;(3)题组效应越大,将其当作局部独立题目纳入模型估计项目参数的偏差越大。     

The Situational Test of Emotional Management – Brief (STEM-B): Development and validation using item response theory and latent class analysis

This study uses a 3-Parameter Logistic item response theory (IRT) model to develop an 18-item short-form of the Situational Test of Emotion Management (STEM). In a sample of 900 people, the short form showed acceptable reliability (reliability index = .87; Cronbach’s alpha = .84) and a meaningful correlation with another indicator of emotional intelligence (i.e., r = .30 with the Situational Test of Emotional Understanding). Latent class analysis of the short-form detected two classes. For all items, participants in Class 2 had a higher probability of selecting the best option than Class 1. When response options were coded to represent different emotion regulation strategies, Class 2 had a higher probability of endorsing “situation modification” and Class 1 had a higher probability of endorsing “no regulation”. These results provide validity evidence for the STEM-B as an assessment of emotion regulation.     

A Bayesian-optimal principle for learner-friendly adaptation in learning games

Adaptive learning games should provide opportunities for the student to learn as well as motivate playing until goals have been reached. In this paper, we give a mathematically rigorous treatment of the problem in the framework of Bayesian decision theory. To quantify the opportunities for learning, we assume that the learning tasks that yield the most information about the current skills of the student, while being desirable for measurement in their own right, would also be among those that are efficient for learning. Indeed, optimization of the expected information gain appears to naturally avoid tasks that are exceedingly demanding or exceedingly easy as their results are predictable and thus uninformative. Still, tasks that are efficient for learning may be experienced as too challenging, and the resulting failures can lower motivation. Therefore, in addition to quantifying the expected informational benefit for learning of any prospective task to be presented next, we also model the expected motivational cost of its presentation, measured simply as the estimated probability of failure in our example model. We propose a “learner-friendly” adaptation algorithm that chooses the learning tasks by optimizing the expected benefit divided by the expected cost. We apply this algorithm to a Rasch-like student model implemented within a real-world application and present initial results of a pilot experiment.     

最大信息量法在CCSPC评分中应用的效度证据

采用基于最大信息量法的多维项目反应理论模型估计计算机模拟心理咨询病例系统（CCSPC）的合成分数及四个模块分数,并收集效标效度证据、成长变化效度证据和内容效度证据,结果表明：五个指标与心理咨询师考试三级技能成绩的相关均达到显著,且高于其与三级理论成绩的相关;所有指标得分均随着心理学学历升高而升高;多数指标分数随心理学本科年级提高而提高;获得心理咨询师资格认证的被试在CCSPC上有更高的得分.     

Latent variables should remain as such: Evidence from a Monte Carlo study

Use of subject scores as manifest variables to assess the relationship between latent variables produces attenuated estimates. This has been demonstrated for raw scores from classical test theory (CTT) and factor scores derived from factor analysis. Conclusions on scores have not been sufficiently extended to item response theory (IRT) theta estimates, which are still recommended for estimation of relationships between latent variables. This is because IRT estimates appear to have preferable properties compared to CTT, while structural equation modeling (SEM) is often advised as an alternative to scores for estimation of the relationship between latent variables. The present research evaluates the consequences of using subject scores as manifest variables in regression models to test the relationship between latent variables. Raw scores and three methods for obtaining theta estimates were used and compared to latent variable SEM modeling. A Monte Carlo study was designed by manipulating sample size, number of items, type of test, and magnitude of the correlation between latent variables. Results show that, despite the advantage of IRT models in other areas, estimates of the relationship between latent variables are always more accurate when SEM models are used. Recommendations are offered for applied researchers.     

Putting the “IRT” in “Dirty”: Item response theory analyses of the Dark Triad Dirty Dozen—An efficient measure of narcissism,psychopathy, and Machiavellianism

The Dark Triad Dirty Dozen is a new, concise personality inventory designed to measure individual differences in narcissism, psychopathy, and Machiavellianism in sub-clinical populations. To date, the psychometric work on this measure has used classical test theory to assess its validity, reliability, and structure. In two independent samples (N = 1014), we provide the first analyses of this measure using item response theory. In both samples, the Dark Triad Dirty Dozen efficiently recovered information and showed some evidence of differential scale functioning by sex, with a lower endorsement threshold for men compared to women. Results shed new light on the measurement of these “dark” personality traits.