The influence of item order on intentional response distortion in the assessment of high potentials: Assessing pilot applicants

An experiment was conducted to investigate the effects of item order and questionnaire content on faking good or intentional response distortion. It was hypothesized that intentional response distortion would either increase towards the end of a long questionnaire, as learning effects might make it easier to adjust responses to a faking good schema, or decrease because applicants' will to distort responses is reduced if the questionnaire lasts long enough. Furthermore, it was hypothesized that certain types of questionnaire content are especially vulnerable to response distortion. Eighty‐four pre‐selected pilot applicants filled out a questionnaire consisting of 516 items including items from the NEO five factor inventory (NEO FFI), NEO personality inventory revised (NEO PI‐R) and business‐focused inventory of personality (BIP). The positions of the items were varied within the applicant sample to test if responses are affected by item order, and applicants' response behaviour was additionally compared to that of volunteers. Applicants reported significantly higher mean scores than volunteers, and results provide some evidence of decreased faking tendencies towards the end of the questionnaire. Furthermore, it could be demonstrated that lower variances or standard deviations in combination with appropriate (often higher) mean scores can serve as an indicator for faking tendencies in group comparisons, even if effects are not significant.     

CAT选题策略分类概述

选题是计算机化自适应测验（CAT）测试过程的关键环节,选题策略的目标是要达到较高的测量精度,同时也实现试题曝光率控制及其他测验目标的实现.本文根据选题策略的基本原理和衍生发展,将众多CAT选题策略分为五大选题策略系列：Fisher函数系列、K-LI函数系列、α分层系列、贝叶斯系列、b匹配系列;并根据测验目标（测验精度、试题曝光率控制、内容平衡、多条件约束）对这些选题策略进行了细分,并对CAT选题策略的选择思路进行归纳.     

Learning to Make Selection and Detection Decisions: The Roles of Base Rate and Feedback

The effects of type of feedback and base rate on threshold learning in a multiple‐cue decision task were examined. In most such decision experiments, participants receive feedback after every trial (full feedback), and a single base rate (usually 0.5) is used. Our experiment explored conditional feedback (feedback only after positive decisions) representing common selection and detection tasks (such as hiring), where the decision maker receives no feedback unless the decision is positive (e.g., hire the applicant). We used three base rates (0.2, 0.5, and 0.8). As expected, performance was best in full feedback, but after 300 learning trials, the difference was small. Conditional feedback generally resulted in fewer positive decisions than full feedback, but this difference was not found in the low (0.2) base rate condition. There were interactions between base rates and types of feedback. Results provide partial support for the constructivist encoding hypothesis of Elwin and colleagues. Simulation results suggest that our results may reflect overconfidence when feedback is not given. With respect to rate of learning, when the base rate was 0.2, conditional feedback participants reached approximately the same selection rate but did so more slowly than the full feedback participants. Partial feedback participants learned slower and appeared to be still learning after 500 trials. When the base rate was 0.5 or 0.8, partial feedback was nearly as good as full feedback, but conditional feedback resulted in a systematically lower rate of positive decisions. Copyright © 2011 John Wiley & Sons, Ltd.     

Effects of a meaningful, a discriminative, and a meaningless stimulus on equivalence class formation

Thirty college students attempted to form three 3-node 5-member equivalence classes under the simultaneous protocol. After concurrent training of AB, BC, CD, and DE relations, all probes used to assess the emergence of symmetrical, transitive, and equivalence relations were presented for two test blocks. When the A-E stimuli were all abstract shapes, none of 10 participants formed classes. When the A, B, D, and E stimuli were abstract shapes and the C stimuli were meaningful pictures, 8 of 10 participants formed classes. This high yield may reflect the expansion of existing classes that consist of the associates of the meaningful stimuli, rather than the formation of the ABCDE classes, per se. When the A-E stimuli were abstract shapes and the C stimuli became S(D)s prior to class formation, 5 out of 10 participants formed classes. Thus, the discriminative functions served by the meaningful stimuli can account for some of the enhancement of class formation produced by the inclusion of a meaningful stimulus as a class member. A sorting task, which provided a secondary measure of class formation, indicated the formation of all three classes when the emergent relations probes indicated the same outcome. In contrast, the sorting test indicated "partial" class formation when the emergent relations test indicated no class formation. Finally, the effects of nodal distance on the relatedness of stimuli in the equivalence classes were not influenced by the functions served by the C stimuli in the equivalence classes.     

Using individual differences to predict job performance: correcting for direct and indirect restriction of range

The present study investigates the relationship between individual differences, indicated by personality (FFM) and general mental ability (GMA), and job performance applying two different methods of correction for range restriction. The results, derived by analyzing meta-analytic correlations, show that the more accurate method of correcting for indirect range restriction increased the operational validity of individual differences in predicting job performance and that this increase primarily was due to general mental ability being a stronger predictor than any of the personality traits. The estimates for single traits can be applied in practice to maximize prediction of job performance. Further, differences in the relative importance of general mental ability in relation to overall personality assessment methods was substantive and the estimates provided enables practitioners to perform a correct utility analysis of their overall selection procedure.     

Reinforcing saccadic amplitude variability

Saccadic endpoint variability is often viewed as the outcome of neural noise occurring during sensorimotor processing. However, part of this variability might result from operant learning. We tested this hypothesis by reinforcing dispersions of saccadic amplitude distributions, while maintaining constant their medians. In a first experiment we reinforced the least frequent saccadic amplitudes to increase variability, and then reinforced the central part of the amplitude distributions to reduce variability. The target was placed at a constant distance from the fovea after the saccade to maintain the postsaccadic visual signal constant and an auditory reinforcement was delivered depending on saccadic amplitude. The second experiment tested the effects of the contingency. We reinforced high levels of variability in 4 participants, whereas 4 other participants were assigned to a yoked control group. On average, saccadic amplitude standard deviations were doubled while the medians remained mostly unchanged in the experimental participants in both experiments, and variability returned to baseline level when low variability was reinforced. In the control group no consistent changes in amplitude distributions were observed. These results, showing that variability can be reinforced, challenge the idea of a stochastic neural noise. We instead propose that selection processes constrain saccadic amplitude distributions.     

Do physical and relational aggression explain adolescents' friendship selection? The competing roles of network characteristics,gender, and social status

The role of physical and relational aggression in adolescents' friendship selection was examined in a longitudinal sample of 274 Chilean students from 5th and 6th grade followed over 1 year. Longitudinal social network modeling (SIENA) was used to study selection processes for aggression while influence processes were controlled for. Furthermore, the effects of network characteristics (i.e., reciprocity and transitivity), gender, and social status on friendship selection were examined. The starting assumption of this study was that selection effects based on aggression might have been overestimated in previous research as a result of failing to consider influence processes and alternative characteristics that steer friendship formation. The results show that selection effects of both physical and relational aggression disappeared when network effects, gender, and social status were taken into account. Particularly gender and perceived popularity appeared to be far more important determinants of friendship selection over time than aggression. Moreover, a peer influence effect was only found for relational aggression, and not for physical aggression. These findings suggest that similarity in aggression among befriended adolescents can be considered to be mainly a by-product rather than a leading dimension in friendship selection.     

有时间压力下学习率对学习时间分配议程的影响:来自眼动的证据

利用眼动分析技术,通过设置不同难度和分值的计算项目,探讨了在有时间压力下学习者的学习时间分配。结果发现:(1)在首次项目选择上,学习者优先选择学习率最高的项目;(2)在学习过程中,学习者的项目选择次序也是根据学习率由高到低。总之,在学习时间分配上,如果需要权衡难度与分值,学习者会考虑单位时间的获益,也就是以学习率为议程的主要依据。研究不仅利用眼动分析技术证实了基于议程的学习时间分配模型,而且进一步揭示了学习率是设置学习时间分配议程的重要依据。     

项目反应理论观察分数核等值的影响因素

探究带宽选择方法、样本量、题目数量、等值设计、数据模拟方式对项目反应理论观察分数核等值的影响。通过两种数据模拟方式,获得研究数据,并计算局部与全域评价指标。研究发现,在随机组设计中,带宽选择方法表现相似;考生样本量和题目数量影响甚微。在非等组设计中,惩罚法与Silverman经验准则表现优异;增加题目量可降低百分相对误差和随机误差;增加样本量导致百分相对误差变大,随机误差减小。数据模拟方式可影响等值评价。未来应重点关注等值系统评估。