A multitrait-multimethod model with minimal assumptions

A new model of confirmatory factor analysis (CFA) for multitrait-multimethod (MTMM) data sets is presented. It is shown that this model can be defined by only three assumptions in the framework of classical psychometric test theory (CTT). All other properties of the model, particularly the uncorrelated-ness of the trait with the method factors are logical consequences of the definition of the model. In the model proposed there are as many trait factors as different traits considered, but the number of method factors is one fewer than the number of methods included in an MTMM study. The covariance structure implied by this model is derived, and it is shown that this model is identified even under conditions under which other CFA-MTMM models are not. The model is illustrated by two empirical applications. Furthermore, its advantages and limitations are discussed with respect to previously developed CFA models for MTMM data.     

艾森克人格问卷简式量表中国版(EPQ-RSC)的修订

该文引进艾森克人格问卷简式量表（EPQ-RShortScale,EPQ-RS）,首次在国内加以修订。根据来自30个省市56个地区的8637人（含汉族7725人）的样本数据,修订形成了艾森克人格问卷简式量表中国版（EPQ-RSC）,共包括4个分量表,各12个项目,这一形式和EPQ-RS相同。作者并基于本研究的样本提供了EPQ-RSC的中国常模。研究表明该问卷的E、N和L三个分量表具有令人满意的信度和效度,P量表的信度和效度基本达到有关的心理测量学标准。作者最后对此问卷的信效度结果以及问卷结果反映的当代中国人人格特点进行了讨论。     

Analysing multisource feedback with multilevel structural equation models: Pitfalls and recommendations from a simulation study

When multisource feedback instruments, for example, 360-degree feedback tools, are validated, multilevel structural equation models are the method of choice to quantify the amount of reliability as well as convergent and discriminant validity. A non-standard multilevel structural equation model that incorporates self-ratings (level-2 variables) and others’ ratings from different additional perspectives (level-1 variables), for example, peers and subordinates, has recently been presented. In a Monte Carlo simulation study, we determine the minimal required sample sizes for this model. Model parameters are accurately estimated even with the smallest simulated sample size of 100 self-ratings and two ratings of peers and of subordinates. The precise estimation of standard errors necessitates sample sizes of 400 self-ratings or at least four ratings of peers and subordinates. However, if sample sizes are smaller, mainly standard errors concerning common method factors are biased. Interestingly, there are trade-off effects between the sample sizes of self-ratings and others’ ratings in their effect on estimation bias. The degree of convergent and discriminant validity has no effect on the accuracy of model estimates. The χ² test statistic does not follow the expected distribution. Therefore, we suggest using a corrected level-specific standardized root mean square residual to analyse model fit and conclude with further recommendations for applied organizational research.     

Rethinking Epistemic Relativism

“Relativism” is often treated as a dirty word in philosophy, but relativistic theories are not entirely unappealing—they have features that might be tempting if they weren't thought to be outweighed by problematic consequences. The aim of this paper is to rethink both our attitude to epistemic relativism and the basic features of the view itself. The paper discusses four objections and uses them to isolate five constraints on a more plausible epistemic relativism. It then sketches out a view that meets all of these constraints. This stratified epistemic relativism offers a complex, socially informed picture of justification that accounts for the many different kinds of roles that epistemic agents act, and think, in accordance with each day, and can serve as a starting point for constructing a more detailed epistemic relativism, which could secure its appealing benefits without incurring the costs traditionally associated with relativist views.     

Simple Structure Detection Through Bayesian Exploratory Multidimensional IRT Models

In modern validity theory, a major concern is the construct validity of a test, which is commonly assessed through confirmatory or exploratory factor analysis. In the framework of Bayesian exploratory Multidimensional Item Response Theory (MIRT) models, we discuss two methods aimed at investigating the underlying structure of a test, in order to verify if the latent model adheres to a chosen simple factorial structure. This purpose is achieved without imposing hard constraints on the discrimination parameter matrix to address the rotational indeterminacy. The first approach prescribes a 2-step procedure. The parameter estimates are obtained through an unconstrained MCMC sampler. The simple structure is, then, inspected with a post-processing step based on the Consensus Simple Target Rotation technique. In the second approach, both rotational invariance and simple structure retrieval are addressed within the MCMC sampling scheme, by introducing a sparsity-inducing prior on the discrimination parameters. Through simulation as well as real-world studies, we demonstrate that the proposed methods are able to correctly infer the underlying sparse structure and to retrieve interpretable solutions.     

Does category-training facilitate 11-month-olds’ acquisition of unfamiliar category-property associations?

The ability to form category-property links allows infants to extend a property from one category member to another. In two experiments, we examined whether orienting infants to the demands of the task, through categorization training, would facilitate 11-month-old infants’ category-property extensions when familiarized with a single exemplar of an unfamiliar animal category. In Experiment 1, 11-month-olds (N = 35) were trained with two familiar animal-sound pairings (i.e., dog-bark, cat-meow), familiarized with two unfamiliar animal-sound pairings and then tested on their learning and generalization of the unfamiliar animal-sound associations. Across two conditions, Experiment 2 familiarized 11-month-olds (N = 69) to one familiar (i.e., dog-bark) and one novel animal-sound pairing. Conditions differed in their presentation of familiarization trials (i.e., random or blocked). Infants were then tested on their learning and extension of the animal-sound associations. In both experiments, infants did not demonstrate learning of the original animal sound pairing, nor generalization of the sound property to new members of the animal categories. These results indicate that the two category training paradigms implemented in the current studies did not facilitate 11-month-olds’ ability to learn or generalize an unfamiliar animal-sound association, when familiarized with a single exemplar.     

Construct validity for the verbal associated pairs screen

The present study introduces the Verbal Associated Pairs Screen (VAPS) as a new measure for assessing performance validity in pediatric populations. This study presents initial data on psychometric properties and establishes construct validity for the VAPS in a sample of 30 adolescent healthy controls and 206 youths with traumatic brain injury (TBI: moderate/severe, N = 30; mild, N = 176). The control group’s age (M = 14.93, SD = 1.8) was significantly higher than the moderate/severe TBI (M = 13.9, SD = 2.8), t(68.508) = ?3.038, p = .003, and mild TBI (mTBI) groups (M = 14, SD = 2.8), t(54.147) = 2.038, p = .046. The TBI groups were administered the VAPS in accord with other established performance validity tests (PVTs) and well-established memory tests as part of routine clinical evaluations. The healthy control group was administered the VAPS only. VAPS score distributions for the control group were negatively skewed and highly kurtotic. VAPS scores from the moderate/severe TBI and control groups were indistinguishable for Trial 2 (U = 274, p < .01) and the Delay (U = 396, p = .218). In the mTBI group, convergent and divergent validity was established with other well-validated PVTs and memory tests, respectively. ROC curve analyses identified optimal cutoff scores for the VAPS Total Score, with acceptable sensitivity (55%) and excellent specificity (100%), as well as strong detectability (AUC = .829, 95% CI: 0.731 – 0.928, p < .001). Clinical applications, limitations, and directions for future research with the VAPS are discussed.     

Concordance of teacher-rated and performance-based measures of executive functioning in preschoolers

The most common method used to evaluate child behavior and functioning is rating scales completed by parents and/or teachers. Given that executive functioning (EF) plays a fundamental role in the developing child’s cognitive, behavioral, and social-emotional development, it would be ideal if ratings of EF and performance-based EF measures assess the same construct. However, most studies report a small to negligible association between performance-based measures and ratings of EF. There are few studies investigating this association for preschoolers, and most only include parent ratings. Teachers may be more reliable reporters of EF behaviors due to the higher demand for EF skills in the preschool setting than at home and because teachers may have a better sense of what behaviors are normative. In this study, we reviewed the associations between three EF rating scales completed by teachers on 243 preschool children. Results showed small to moderate correlations with EF measures of inhibition and cognitive flexibility/switching for all three scales, with the strongest associations observed between Child Behavior Rating Scale (CBRS) Behavioral Regulation subscale and child EF measures. Exploratory multivariate path analyses showed that, after controlling for age, sex, and socioeconomic status (SES), Behavioral Regulation significantly predicted performance-based measures of EF and accounted for incrementally more variance in the models. We conclude that in ideal situations, it is best to measure EF using both rating scales and performance-based measures of EF. The CBRS seems to be a sensitive measure of EF in preschoolers and may be a helpful brief screening tool for use with teachers.     

儿童青少年正念量表(CAMM)在中国青少年群体中的信效度检验

目的:检验儿童青少年正念量表(CAMM)在中国青少年群体中应用的信效度,为青少年正念研究提供科学工具。方法:选取310名中学生(样本1)进行条目分析和探索性因素分析,再选取309名中学生(样本2)进行验证性因素分析、效标效度、增量效度和信度分析。结果:中文版CAMM抽取2个因素最为合适,并具有良好的结构效度、效标效度、增量效度及较高的信度。结论:中文版CAMM具有良好的心理测量学指标,可以在中国青少年群体中使用。     

The reciprocal relation between sleep and memory in infancy: Memory‐dependent adjustment of sleep spindles and spindle‐dependent improvement of memories

Sleep spindle activity in infants supports their formation of generalized memories during sleep, indicating that specific sleep processes affect the consolidation of memories early in life. Characteristics of sleep spindles depend on the infant's developmental state and are known to be associated with trait‐like factors such as intelligence. It is, however, largely unknown which state‐like factors affect sleep spindles in infancy. By varying infants’ wake experience in a within‐subject design, here we provide evidence for a learning‐ and memory‐dependent modulation of infant spindle activity. In a lexical‐semantic learning session before a nap, 14‐ to 16‐month‐old infants were exposed to unknown words as labels for exemplars of unknown object categories. In a memory test on the next day, generalization to novel category exemplars was tested. In a nonlearning control session preceding a nap on another day, the same infants heard known words as labels for exemplars of already known categories. Central–parietal fast sleep spindles increased after the encoding of unknown object–word pairings compared to known pairings, evidencing that an infant's spindle activity varies depending on its prior knowledge for newly encoded information. Correlations suggest that enhanced spindle activity was particularly triggered, when similar unknown pairings were not generalized immediately during encoding. The spindle increase triggered by previously not generalized object–word pairings, moreover, boosted the formation of generalized memories for these pairings. Overall, the results provide first evidence for a fine‐tuned regulation of infant sleep quality according to current consolidation requirements, which improves the infant long‐term memory for new experiences.