Parent-report measure of Theory of Mind: Adaptation to Polish of the Children’s Social Understanding Scale

The main aim of the study was to investigate whether the Children’s Social Understanding Scale (CSUS), a parent report technique, is a valid and reliable measure of Theory of Mind (ToM) abilities in Polish-speaking children. Additionally, the role of language abilities in ToM development was explored. A group of 225 parents of approximately 3.5-year-old Polish children was tested using the Polish version of the CSUS. Their children were tested with a word comprehension test and five behavioural ToM tasks. Satisfactory psychometric properties of the Polish CSUS were observed and positive correlations between the CSUS and behavioural ToM tasks were found. A two-factor structure was found in the CSUS: Mental State Talk (MST) and Mental State Comprehension. The MST factor was significantly related to word comprehension. The utility of the Polish version of the CSUS for future cross-cultural research with this population is discussed.     

The criterion-related validity of conscientiousness in personnel selection: A meta-analytic reality check

A key finding in personnel selection is the positive correlation between conscientiousness and job performance. Evidence predominantly stems from concurrent validation studies with incumbent samples but is readily generalized to predictive settings with job applicants. This is problematic because the extent to which faking and changes in personality affect the measurement likely vary across samples and study designs. Therefore, we meta-analytically investigated the relation between conscientiousness and job performance, examining the moderating effects of sample type (incumbent vs. applicant) and validation design (concurrent vs. predictive). The overall correlation of conscientiousness and job performance was in line with previous meta-analyses ($\overline{r}=.17,k=102,n=23,305$). In our analyses, the correlation did not differ across validation designs (concurrent: $\overline{r}=.18,k=78,n=19,132$; predictive: $\overline{r}=.15,k=24,n=4173$), sample types (incumbents: $\overline{r}=.18,k=92,n=20,808$; applicants: $\overline{r}=.14,k=10,n=2497$), or their interaction. Critically, however, our review revealed that only a small minority of studies (~12%) were conducted with real applicants in predictive designs. Thus, barely a fraction of research is conducted under realistic conditions. Therefore, it remains an open question if self-report measures of conscientiousness retain their predictive validity in applied settings that entail faked responses. We conclude with a call for more multivariate research on the validity of selection procedures in predictive settings with actual applicants.     

Improving theory,measurement, and reality to advance the future of emotion research

ABSTRACT

In this short contribution, I reflect on three domains I think are important to advance emotion research. The first concerns theoretical progress, which I hope will occur in the form of theoretical unification that will allow for a consensual definition and understanding of its main object of study. The second concerns measurement where in parallel to technological advances to measure behaviour and biology, particularly the measurement of experience deserves more attention. The third concerns reality, where I advocate the need to study real-world phenomena.     

Confirmatory factor analysis of the five-item version of the Francis scale of attitude towards Christianity in adolescent students

ABSTRACT

The brief scale of Francis for religiosity (Francis-5) has shown acceptable psychometric performance in Colombian adolescents. However, a confirmatory factorial analysis (CFA) has not been performed. The objective of the researche was to make a CFA to the Francis-5 in a sample of students of Santa Marta, Colombia. A validation study was performed. 350 students between 10 and 17 years old, and 54% were female. A CFA was performed to test the dimensionality of different versions of five and four items of the scale. Authors calculated five goodness of fit indexes indices (Chi square, RMSEA, CFI, TLI, and SMSR). The Francis-5 presented as goodness-of-fit coefficients, chi squared = 18.5, gl = 5, p = .002, RMSEA = .09 (CI90% .05 to .13), CFI = .99, TLI = .99, and SMSR = .01. And the version with the best coefficients of goodness was the Francis-5 without the fourth item (‘Pray helps me a lot’) with chi squared = .55, gl = 2, p = .76, RMSEA = .00 (CI90% .00 to .07), CFI = 1.00, TLI = 1.00, and SMSR = .01. As conclusions, the dimensionality of the Francis-5 is questionable. For a version without the item 4 the data are better fit.     

Identifying Misfitting Achievement Estimates in Performance Assessments: An Illustration Using Rasch and Mokken Scale Analyses

Researchers apply individual person fit analyses as a procedure for checking model-data fit for individual test-takers. When a test-taker misfits, it means that the inferences from their test score regarding what they know and can do may not be accurate. One problem in applying individual person fit procedures in practice is the question of how much misfit it takes to make the test score an untrustworthy estimate of achievement. In this paper, we argue that if a person’s responses generally follow a monotonic pattern, the resulting test score is “good enough” to be interpreted and used. We present an approach that applies statistical procedures from the Rasch and Mokken measurement perspectives to examine individual person fit based on this good enough criterion in real data from a performance assessment. We discuss how these perspectives may facilitate thinking about applying individual person fit procedures in practice.     

I’m lonely,can’t you tell? Convergent validity of self- and informant ratings of loneliness

To what degree do self-ratings of loneliness converge with informant ratings? In this study, we obtained self-ratings of loneliness from 463 young adults and informant ratings from their parents, friends, and romantic partners. Convergence among these ratings was estimated using structural equation models for multitrait-multimethod data and compared to self-informant convergence of life-satisfaction ratings. Self- and informant ratings were moderately correlated and comparable to self-informant correlations obtained for life satisfaction. Romantic partners were more accurate in their judgments than both friends and parents, who did not differ significantly from each other in terms of accuracy. Together, these findings indicate that informant ratings of loneliness can be used as valid indicators of loneliness in applied contexts and in future research.     

Effects of measurement aggregation on predicting externalizing problems from preschool behaviour

In long‐term studies of psychological development, the initial assessment of etiologically significant child behaviours is often carried out at a single point in time only. However, one‐time assessments of behaviour are likely to possess limited reliability, leading to attenuated longitudinal correlation coefficient magnitudes. How much this bias might have affected behavioural continuity estimates in longitudinal research is presently unknown. Using a data set from the Mauritius Child Health Project, we particularize the attenuating effects of single‐occasion behavioural assessments on consistency estimates of impulsive–aggressive behaviour over time. Specifically, two nursery teachers provided 15 consecutive weekly ratings of the aggressive behaviour of 99 four‐year‐old children. The same children were reassessed for the presence of externalizing behaviour problems at the ages of 8 and 10. There were substantial increases in both reliability and predictive correlation coefficient magnitudes when the preschool scores were aggregated across several weekly ratings. A further increase resulted after the two outcome assessments were combined into a composite score of school‐age externalizing symptoms. A generalized procedure, developed from the correction for attenuation formula, is introduced to describe the relation of aggregation to predictive validity in longitudinal research.