The effects of ongoing task absorption on event-based prospective memory in preschoolers

The current study applied a 2 × 2 experimental design to investigate the effects of ongoing task absorption on event-based prospective memory performance of children aged 3 and 5 years. Children were required to label pictures as ongoing task but to remember to refrain from picture naming and to respond to the target cues in a different way as the prospective memory task. Two differently absorbing ongoing tasks (high absorbing scenario game task vs. low absorbing computer-based task) were administered. Results indicated that prospective memory performance of 5-year-old children was significantly better than that of 3-year-old children. Ongoing task absorption affected the ongoing task performance of preschoolers, but not overall prospective memory performance. Only the 3-year-olds were negatively affected by high ongoing task absorption, which was not the case for the 5-year-olds. The findings are discussed within the light of the multiprocess theory.     

Evaluating the Impact of Careless Responding on Aggregated-Scores: To Filter Unmotivated Examinees or Not?

When examinees' test-taking motivation is questionable, practitioners must determine whether careless responding is of practical concern and if so, decide on the best approach to filter such responses. As there has been insufficient research on these topics, the objectives of this study were to: a) evaluate the degree of underestimation in the true mean when careless responses are present, and b) compare the effectiveness of two filtering procedures in purifying biased aggregated-scores. Results demonstrated that: a) the true mean was underestimated by around 0.20 SDs if the total amount of careless responses exceeded 6.25%, 12.5%, and 12.5% for easy, moderately difficult, and difficult tests, respectively, and b) listwise deleting data from unmotivated examinees artificially inflated the true mean by as much as .42 SDs when ability was related to careless responding. Findings from this study have implications for when and how practitioners should handle careless responses for group-based low-stakes assessments.     

心理与教育测验中反应时模型应用的优势与举例

基于计算机形式的测验使得收集作答反应时信息成为可能,这些信息的有效利用对心理与教育测验的理论研究和实际应用产生了重大影响。首先,归纳并总结了测验中使用反应时信息的五大优势。其次,分别介绍了4种不同取向下较典型的反应时模型与模型特征,并分别进行评价。再次,较系统地梳理了反应时模型在实践中的应用,使读者了解反应时信息在测验中所发挥的作用。最后,探讨了未来将反应时应用于心理与教育测量领域的几个研究方向。     

Developing new online calibration methods for multidimensional computerized adaptive testing

Multidimensional computerized adaptive testing (MCAT) has received increasing attention over the past few years in educational measurement. Like all other formats of CAT, item replenishment is an essential part of MCAT for its item bank maintenance and management, which governs retiring overexposed or obsolete items over time and replacing them with new ones. Moreover, calibration precision of the new items will directly affect the estimation accuracy of examinees’ ability vectors. In unidimensional CAT (UCAT) and cognitive diagnostic CAT, online calibration techniques have been developed to effectively calibrate new items. However, there has been very little discussion of online calibration in MCAT in the literature. Thus, this paper proposes new online calibration methods for MCAT based upon some popular methods used in UCAT. Three representative methods, Method A, the ‘one EM cycle’ method and the ‘multiple EM cycles’ method, are generalized to MCAT. Three simulation studies were conducted to compare the three new methods by manipulating three factors (test length, item bank design, and level of correlation between coordinate dimensions). The results showed that all the new methods were able to recover the item parameters accurately, and the adaptive online calibration designs showed some improvements compared to the random design under most conditions.     

Introducing a forced-choice recognition task to the California Verbal Learning Test – Children’s Version

The importance of performance validity tests (PVTs) is increasingly recognized in pediatric neuropsychology. To date, research has focused on investigating whether PVTs designed for adults function similarly in children. The downward extension of adult cutoffs is counter-intuitive considering the robust effect of age-related changes in basic cognitive skills in children and adolescents. The purpose of this study was to examine the signal detection properties of a forced-choice recognition trial (FCR-C) for the California Verbal Learning Test – Children’s Version. A total of 72 children aged 6–15 years (M = 11.1 , SD = 2.6) completed the FCR-C as part of a larger neuropsychological assessment battery. Cross-validation analyses revealed that the FCR-C had good signal detection performance against reference PVTs. The first level of failure (≤14/15) produced the best combination of overall sensitivity (.31) and specificity (.87). A more conservative FCR-C cutoff (≤13) resulted in a predictable trade-off between sensitivity (.15) and specificity (.94), but also a net loss in discriminant power. Lowering the cutoff to ≤12 resulted in a slight improvement in specificity (.97) but further deterioration in sensitivity (.14). These preliminary findings suggest that the FCR-C has the potential to become the newest addition to a growing arsenal of pediatric PVTs.     

Taking theoretical risks in a world of directional predictions

As Meehl (1978) observed, one major reason for the painfully slow progress of soft psychology is our field’s heavy reliance on directional predictions, which leads to feeble tests of theories. In the present commentary, I outline six ways of taking theoretical risks in a world of directional predictions: (1) constructive replication of findings, (2) generating multiple maximally independent predictions, (3) adherence to the total evidence rule, (4) discriminant validation of measures, (5) incremental validation of measures, and (6) according attention to higher-order personality dimensions.     

Wofür sprechen die Daten?

What Do the Data Tell Us? Justification of scientific theories is a three-place relation between data, theories, and background knowledge. Though this should be a commonplace, many methodologies in science neglect it. The article will elucidate the significance and function of our background knowledge in epistemic justification and their consequences for different scientific methodologies. It is argued that there is no simple and at the same time acceptable statistical algorithm that justifies a given theory merely on the basis of certain data. And even if we think to know the probability of a theory, that does not decide whether we should accept it or not.     

人员选拔中的不准确性来源及对策

在组织人员选拔中存在着一些不准确性来源．这些不准确性直接影响组织人员招募与配置的效果。该文从主观和客观两个维度探讨了人员选拔中的不准确性来源,并提出了减少人员选拔中不准确性来源的对策。     

“儿童认知发展水平诊断工具”动态测验的初步编制与应用

本研究旨在将“儿童认知发展水平诊断工具” (Inventory of Piaget’s Developmental Task, IPDT)中的守恒与关系领域分测验改编成动态测验, 并应用于不同程度学业成绩儿童当中以探查其认知发展的潜在水平。在实验研究基础上结合以往动态测验的编制技术, 把动态施测过程分为“前测—干预—迁移—后测”4个阶段, 分别确定各阶段的测题并构建了6等级提示系统。在中等学业成绩儿童(n = 33)和低学业成绩儿童(n = 35)中的应用发现, 动态测验测得的能力获得变量对儿童的学业成绩具有重要的预测作用, 证实了所改编测验的有效性; 动态测验情境下中、低学业成绩儿童的潜在认知水平基本相同, 所改编的动态测验有助于发掘儿童的潜在认知发展水平。     

The Factor Structure of the Frost Multidimensional Perfectionism Scale in University Students

The Frost Multidimensional Perfectionism Scale (FMPS) is a widely used measure of perfectionism. Previous studies of the nature of the factors of the FMPS have resulted in mixed findings and have failed to identify a stable factor structure. This study investigated the factor structure of the FMPS using both exploratory and confirmatory factor analysis (CFA), addressing previous methodological limitations. Participants were 6,449 students from two Australian universities. Exploratory factor analysis suggested a five‐factor model and a reduction in variables from 35 to 29 (FMPS‐29). CFA demonstrated goodness of fit of the revised measure. We also compared our model with a number of existing measurement models of perfection and found the proposed model provided a superior fit for this university student population. Support was found for the two second‐order constructs commonly referred to as adaptive and maladaptive perfectionism, although there appears to be little benefit in using this model over the first‐order model. Implications of the findings are discussed.