Item response theory analyses of the Delis-Kaplan Executive Function System card sorting subtest

In the current study, we examined the dimensionality of the 16-item Card Sorting subtest of the Delis-Kaplan Executive Functioning System assessment in a sample of 264 native English-speaking children between the ages of 9 and 15 years. We also tested for measurement invariance for these items across age and gender groups using item response theory (IRT). Results of the exploratory factor analysis indicated that a two-factor model that distinguished between verbal and perceptual items provided the best fit to the data. Although the items demonstrated measurement invariance across age groups, measurement invariance was violated for gender groups, with two items demonstrating differential item functioning for males and females. Multigroup analysis using all 16 items indicated that the items were more effective for individuals whose IRT scale scores were relatively high. A single-group explanatory IRT model using 14 non-differential item functioning items showed that for perceptual ability, females scored higher than males and that scores increased with age for both males and females; for verbal ability, the observed increase in scores across age differed for males and females. The implications of these findings are discussed.     

Utility of the REDFLAGS Model for Supporting Community College Students’ Mental Health: Implications for Counselors

The counseling literature is lacking in research on supporting the mental health needs of the growing community college student population. A number of past investigators have demonstrated the utility of mental health literacy for supporting college students’ mental health on 4‐year universities. The present researchers examined the validity of the REDFLAGS model (a theoretical model for promoting mental health literacy) with a national stratified random sample (N = 640, stratified by age, gender, and ethnicity) of community college students. Collectively, the results of the confirmatory factor analysis, hierarchical logistic regression, and factorial analysis of variance supported the use of the model with community college students. Implications for enhancing counseling practice as well as directions for future research are provided.     

基于多层验证性因素分析的各种信度系数方法

近年来,心理学研究的复现性受到广泛关注,许多实证研究难以重复验证,信度较低。大量研究使用多层技术,但只报告整体信度,导致研究可重复危机。基于各种信度系数和验证性因素分析的理论,以二层模型为例,总结多层信度计算方法,通过文献综述检索应用情况,并用MPLUS进行实例演示,最后讨论单层信度估计存在的偏差及分层估计的好处。总之,对多层数据进行分层信度估计是很有必要的,可消除因测量工具缺乏信度而导致的研究不可重复。     

A mechanism for biasing the appraisal process in affective agents

In this paper we present a mechanism to model the influence of agents’ internal and external factors on the emotional evaluation of stimuli in computational models of emotions. We propose the modification of configurable appraisal dimensions (such as desirability and pleasure) based on influencing factors. As part of the presented mechanism, we introduce influencing models to define the relationship between a given influencing factor and a given set of configurable appraisal dimensions utilized in the emotional evaluation phase. Influencing models translate factors’ influences (on the emotional evaluation) into fuzzy logic adjustments (e.g., a shift in the limits of fuzzy membership functions), which allow biasing the emotional evaluation of stimuli. We implemented a proof-of-concept computational model of emotions based on real-world data about individuals’ emotions. The obtained empirical evidence indicates that the proposed mechanism can properly affect the emotional evaluation of stimuli while preserving the overall behavior of the model of emotions.     

The Ethnic Adornment Survey (EAS): Measuring Individuals’ Use of Clothing to Express Ethnic Identity

The present paper introduces the Ethnic Adornment Survey as a measure of the relative frequency with which individuals use clothing to express their ethnic identity. Results of exploratory factor analyses in a pilot study (n = 174) and confirmatory factor analyses in a main study (n = 217) revealed that the Ethnic Adornment Survey measures two positively correlated, yet distinct, ethnic adornment factors (i.e., socially desirable and undesirable aspects). Moreover, results of regression analyses indicated that (1) self-esteem was positively predicted by socially desirable aspects of ethnic adornment (p’s < .05 in both studies); whereas (2) self-esteem was negatively predicted by socially undesirable aspects of ethnic adornment (p’s < .05 in the pilot study and < .10 in the main study). Implications for research on ethnic identity are discussed.     

Brief report: How many dimensions in the prosocial behavior scale? Psychometric investigation in French-speaking adolescents

The purpose of the study was to evaluate the factor structure and the reliability of the Prosocial Behavior Scale (PBS). To our knowledge, no factorial validity of the multifactorial structure of PBS has been published to date. The psychometric characteristics of the PBS were examined in several samples of French adolescents (aged 11–19, N1 = 1141, N2 = 1071, and N3 = 1640) using Confirmatory factor analyses (CFA). The original four-factor structure was not confirmed due to lack of discriminant validity. CFA led us to retain a two-factor solution with a good fit and a satisfactory reliability. Furthermore, the results support the convergent validity of the PBS: helping and caring dimensions were positively correlated with empathy. In addition, partial measurement invariance across gender and grade was attested. In conclusion, the results indicate that the French version of the PBS is a useful instrument for the assessment of prosocial behaviors in adolescence.     

The assessment of autistic traits with the Autism Spectrum Quotient: Contribution of the French version to its construct validity

IntroductionThe Autism Spectrum Questionnaire (AQ, Baron-Cohen et al., 2001) is a self-report assessment tool aiming at screening autistic traits in normal intelligence adults. While numerous versions in other languages than English now exist, few factorial evidence do sustain the valid use of this instrument as it was conceived, based upon five distinct dimensions (Social skills, Communication, Attention to detail, Attention switching, Imagination); no such study exists with a French version of the AQ. The aim of our study is therefore to present the French version of the scale and to explore its factorial validity with confirmatory factorial analyses and, possibly, its invariance across men and women.MethodSeveral confirmatory factorial analyses, with the robust WLSMV estimator for categorical response format, were run on the questionnaire data from 788 French-speaking students (17–25 years old) at university faculties or schools for higher education in Belgium. The original five-factor measurement model of the AQ was assessed as well as alternative models. An exploratory factorial analysis was also applied to get more insight as to possible sources of misfit.ResultsNo measurement model – neither the original five-factor one nor any of the six other models tested – did produce statistics or fit indices close to significant values: there was no fit to the data. The internal consistency of the subscales was weak; the exploratory factorial analysis further confirmed that as much as ten factors were needed to explain 45% of the data variance.ConclusionOur results, with a French version of the scale, add to many other ones which suggest that the AQ is a too heterogeneous questionnaire with somewhat ill-defined dimensions and non specific/ambiguous items. The questionnaire should probably be shortened and its content realigned to core features of the autism spectrum.     

Transcultural validation and reliability of the Spanish version of the behaviour of young novice drivers scale (BYNDS) in a Colombian young driver population

The overrepresentation of young drivers in road crashes, and the fatalities and injuries arising from those crashes, is an intractable problem around the world. A plethora of research has led to the development and application of a range of research tools, including self-report survey instruments. One such instrument, the five-factor Behaviour of Young Novice Driver Scale (BYNDS), was developed in an Australian young driver population, and has recently been validated in a New Zealand young driver population. The current study aimed to validate the BYNDS in a Colombian young driver population, the first application of the instrument in a developing country. Translation from English to Spanish, and back translation from Spanish to English, in addition to culturally-appropriate modifications (such as changing ‘right hand side’ to ‘left hand side’) resulted in a Spanish version of the BYNDS (BYNDS-Sp). The BYNDS-Sp was administered to a sample of 392 young drivers aged 16–24 years (n = 353 aged 19–24 years) with a valid driver’s licence. An exploratory factor analysis revealed a six factor structure using 40 of the original 44 BYNDS-Sp items, accounting for 58.5% of the variance in self-reported risky driving behaviour. Ninety-three percent of participants reported having ready access to their own vehicle (42% owned their own vehicle), with Colombian young drivers most likely to report driving at night and on the weekend. The majority of participants reported driving in excess of posted speed limits (e.g., only one third of participants reported never driving 10–20 km/h over the speed limit), and driving in response to their mood (e.g., only one third of participants reported they never drove faster if in a bad mood). As such, the BYNDS-Sp can reveal patterns of problematic behaviours (such as risky driving exposure), in addition to specific behaviours of concern (such as carrying passengers at night, and driving when tired), guiding the development and implementation of interventions targeting the risky driving behaviour of young drivers in Colombia. In addition, the BYNDS-Sp can be used as a measure of intervention success if used as a baseline and as a follow-up tool. Further research can investigate the utility and applicability of the BYNDS-Sp in other Spanish-speaking countries, such as Spain and Mexico.     

Validation of a reflective thinking instrument for third-year undergraduate nursing students participating in high-fidelity simulation

Background: nursing students are required to think reflectively in both real and simulated clinical practice. Although the Reflective Thinking instrument is reliable in its measurement of reflective thinking, its validity is unknown. Method: confirmatory factor analysis was undertaken in an iterative manner within a non-equivalent control-group study to measure nursing students’ reflective thinking and satisfaction with high-fidelity simulation. The validity and reliability of the Reflective Thinking instrument was tested. Results: the resulting instrument consisted of 15 items across four factors. The final model was plausible as it demonstrated ‘goodness of fit’; however, it had neither convergent or discriminatory validity, nor reliability. Internal consistency was fair to reasonable for the four subscales. Conclusion: the testing of the Reflective Thinking instrument using confirmatory factor analysis is a vital initial step in the modification of this instrument. Further development using exploratory factor analysis will enhance the instrument’s relevance within high-fidelity simulation.     

Iteration of Partially Specified Target Matrices: Application to the Bi-Factor Case

The current study proposes a new bi-factor rotation method, Schmid-Leiman with iterative target rotation (SLi), based on the iteration of partially specified target matrices and an initial target constructed from a Schmid-Leiman (SL) orthogonalization. SLi was expected to ameliorate some of the limitations of the previously presented SL bi-factor rotations, SL and SL with target rotation (SLt), when the factor structure either includes cross-loadings, near-zero loadings, or both. A Monte Carlo simulation was carried out to test the performance of SLi, SL, SLt, and the two analytic bi-factor rotations, bi-quartimin and bi-geomin. The results revealed that SLi accurately recovered the bi-factor structures across the majority of the conditions, and generally outperformed the other rotation methods. SLi provided the biggest improvements over SL and SLt when the bi-factor structures contained cross-loadings and pure indicators of the general factor. Additionally, SLi was superior to bi-quartimin and bi-geomin, which performed inconsistently across the types of factor structures evaluated. No method produced a good recovery of the bi-factor structures when small samples (N = 200) were combined with low factor loadings (0.30–0.50) in the specific factors. Thus, it is recommended that larger samples of at least 500 observations be obtained.