The assessment of school engagement: examining dimensionality and measurement invariance by gender and race/ethnicity

The construct of school engagement has attracted growing interest as a way to ameliorate the decline in academic achievement and increase in dropout rates. The current study tested the fit of a second-order multidimensional factor model of school engagement, using large-scale representative data on 1103 students in middle school. In order to make valid model comparisons by group, we evaluated the extent to which the measurement structure of this model was invariant by gender and by race/ethnicity (European-American vs. African-American students). Finally, we examined differences in latent factor means by these same groups. From our confirmatory factor analyses, we concluded that school engagement was a multidimensional construct, with evidence to support the hypothesized second-order engagement factor structure with behavioral, emotional, and cognitive dimensions. In this sample, boys and girls did not substantially differ, nor did European-American and African-American students, in terms of the underlying constructs of engagement and the composition of these constructs. Finally, there were substantial differences in behavioral and emotional engagement by gender and by racial/ethnic groups in terms of second-order factor mean differences.     

Factorial structure and psychometric properties of the French adaptation of the Dissociative Experiences Scale (DES) in non-clinical participants

IntroductionThe Dissociative Experiences Scale (DES) is a widely used instrument for assessing dissociation. However, there is disagreement regarding the internal structure of the DES and scores tend to be highly skewed.ObjectiveThe present study was designed to test the psychometric properties of a French version of the DES in non-clinical participants, in addition to applying a response scale as recommended by Wright and Loftus (1999) in order to resolve the problem of skewed scores.ResultsExploratory and confirmatory factor analysis (computed in two independent samples) suggested a two-factor solution, which seem to represent two forms of dissociation (“automatic pilot” related dissociation episodes and “defensive” dissociation episodes). Results also revealed high internal consistency, and satisfactory results in terms of skewness and floor effects. Finally, significant associations with other measures (anxiety, depression, traumatic experiences) indicate good concurrent validity.ConclusionsThis study offers evidence that the present version of the French adaptation of the DES reveals good psychometric properties. Analyses of the internal structure of the DES suggest that two types of dissociative experiences are being measured: automatic pilot-related dissociation episodes (e.g., associated with different types of cognitive failures) and defensive dissociation episodes that may act as defensive mechanisms, especially in persons who have been traumatized (e.g., the avoidance of a memory related to a traumatic event).     

Factorial validation and measurement invariance of the French version of the multidimensional competitive orientation inventory (FVMCOI) in the sport field

IntroductionLittle is known about the importance of the adaptive, maladaptive and neutral facets of competitive orientations among French athletes.ObjectiveThe aim of this study is to test the factorial validation and measurement invariance of the French version of the multidimensional competitive orientation inventory (FVMCOI) from the original version (MCOI, Orosz et al., 2018), which included 12 items and four factors (i.e., hypercompetitive orientation, self-developmental competitive orientation, anxiety-driven competition avoidance, and lack of interest toward competition).MethodA series of three complementary studies was carried out with a total sample of 891 competitors.ResultsFollowing cross-cultural validation methods a preliminary version of the FVMCOI was constructed and the clarity of its items was established (study 1). Then, exploratory structural equation modeling (ESEM) confirmed that the four-factor model for the FVMCOI was factorially valid, and consistent with the model of the original version. As such, the multiple-group invariance tests showed that the FVMCOI was partially invariant across both age and gender and fully invariant across type of sport, level of competition and over time (study 2). Finally, the concurrent validity of the FVMCOI was demonstrated through its expected relationships with achievement goals, competitive aggressiveness and anger in sport (study 3).ConclusionThe establishment of the FVMCOI extends the research in sport psychology by allowing an extensive psychometric study of the MCOI in the sport domain and providing deeper insights into the healthy, unhealthy, and neutral nature of competitive orientation in this context. The FVMCOI's potential practical applications in sport context, with some limitations and perspectives of this study, are also discussed.     

On the relationship between sources of within- and between-group differences and measurement invariance in the common factor model

Investigating sources of within- and between-group differences and measurement invariance (MI) across groups is fundamental to any meaningful group comparison based on observed test scores. It is shown that by placing certain restrictions on the multigroup confirmatory factor model, it is possible to investigate the hypothesis that within- and between-group differences are due to the same factors. Moreover, the modeling approach clarifies that absence of measurement bias implies common sources of within- and between-group variation. It is shown how the influence of background variables can be incorporated in the model. The advantages of the modeling approach as compared with other commonly used methods for group comparisons is discussed and illustrated by means of an analysis of empirical data.     

The Childhood Executive Functioning Inventory (CHEXI): Factor structure,measurement invariance,and correlates in US preschoolers

This study tests the factor structure, measurement invariance, and correlates of the Childhood Executive Functioning Inventory (CHEXI) with a large and diverse sample of 3- to 5-year-olds (n = 844). Consistent with previous studies, a two-factor model that distinguishes working memory from inhibition provides the best fit to the observed data. This two-factor model has been shown to demonstrate strong measurement invariance for different subgroups of children (boys vs. girls, high vs. low income). Whereas boys tend to have greater working memory and inhibition difficulties (Cohen’s d = 0.15 and 0.20, respectively), children from low-income households tend to have more working memory problems than their peers from high-income households (Cohen’s d = 0.25). Finally, correlations between CHEXI scores, examiner reports of child behavior, and child performance on a battery of executive function (EF) tasks were investigated. CHEXI scores were found to be more consistently related to examiner reports of child behavior than child performance on EF tasks. Tthe strengths and weaknesses of the CHEXI as a questionnaire measure of EF are discussed, and directions for future research are suggested.     

The assessment of autistic traits with the Autism Spectrum Quotient: Contribution of the French version to its construct validity

IntroductionThe Autism Spectrum Questionnaire (AQ, Baron-Cohen et al., 2001) is a self-report assessment tool aiming at screening autistic traits in normal intelligence adults. While numerous versions in other languages than English now exist, few factorial evidence do sustain the valid use of this instrument as it was conceived, based upon five distinct dimensions (Social skills, Communication, Attention to detail, Attention switching, Imagination); no such study exists with a French version of the AQ. The aim of our study is therefore to present the French version of the scale and to explore its factorial validity with confirmatory factorial analyses and, possibly, its invariance across men and women.MethodSeveral confirmatory factorial analyses, with the robust WLSMV estimator for categorical response format, were run on the questionnaire data from 788 French-speaking students (17–25 years old) at university faculties or schools for higher education in Belgium. The original five-factor measurement model of the AQ was assessed as well as alternative models. An exploratory factorial analysis was also applied to get more insight as to possible sources of misfit.ResultsNo measurement model – neither the original five-factor one nor any of the six other models tested – did produce statistics or fit indices close to significant values: there was no fit to the data. The internal consistency of the subscales was weak; the exploratory factorial analysis further confirmed that as much as ten factors were needed to explain 45% of the data variance.ConclusionOur results, with a French version of the scale, add to many other ones which suggest that the AQ is a too heterogeneous questionnaire with somewhat ill-defined dimensions and non specific/ambiguous items. The questionnaire should probably be shortened and its content realigned to core features of the autism spectrum.     

Assessing conspiracist beliefs across societies: Validation of the Serbian adaptation of the Generic Conspiracist Beliefs Scale (GCBS)

Initial validation of the Generic Conspiracist Beliefs Scale (GCBS) identified five correlated factors: Government Malfeasance, Malevolent Global Conspiracies, Extraterrestrial Cover-up, Personal Well-being and Control of Information. Despite replications of this structure, ensuing research, mostly using translated versions of the GCBS (i.e., Persian and Japanese), has reported factorial alternatives. Concomitantly, researchers postulated that belief in conspiracies was higher in historically troubled societies (e.g., Serbia). To further assess the cultural stability of the five correlated factor solution and test the assumption that GCBS scores are affected by social-political instability, a Serbian adaptation of the GCBS was assessed alongside the standard English language version. Data were collected from Serbian (n = 259, 44.40% males) and UK samples (n = 402, 52.25% males). Within samples, confirmatory factor analysis replicated the five-factor solution. Additionally, national and gender invariance was confirmed. National comparisons (Serbia vs. UK) revealed that the Serbian sample scored higher on Government Malfeasance, Malevolent Global Conspiracies, Personal Well-being and Control of Information, whereas the UK sample scored higher on Extraterrestrial Cover-up. There were no gender differences on GCBS factors. Findings indicated that while the Serbian GCBS was interpreted similarly to the GCBS, societal factors influenced endorsement of belief facets.     

Factor structure and measurement invariance of the multidimensional driving style inventory across gender and age: An ESEM approach

The Multidimensional Driving Style Inventory (MDSI) is the most comprehensive measure of typical driving behavior to date and has been frequently used to compare driving styles across different groups of drivers, particularly between gender- and age-related groups. However, the factor structure of MDSI has not been clearly established and its measurement invariance has not been demonstrated. The goal of the present study was to examine the internal structure and measurement invariance of the MDSI across gender and age. A sample of 1277 drivers from Argentina responded to the Argentinian version of the MDSI. Exploratory structural equation modeling (ESEM) was used to test the factor structure and measurement invariance across females (n = 602) and males (n = 675), and across young (18–29, n = 558), adult (30–49, n = 395) and older (50 and older, n = 317) drivers. The results showed that a 36-item six-factor ESEM model represented by risky, angry, dissociative, anxious, distress-reduction and careful and patient driving styles was the best model based on fit indices and interpretability. Configural, weak and strong invariance of the six-factor ESEM model across gender and age was also supported. The MDSI in its Argentinian version is equivalent across gender and age, supporting the validity of previous research findings examining gender and age differences in driving styles. Future studies should examine the measurement invariance of the MDSI across other relevant driving-related variables.     

Psychometrics properties of the French version of the van Dam's Employability Questionnaire

IntroductionThe importance of employability is related to the fact that various studies show that this resource allows people to enter and maintain their employment or to progress in their career.ObjectiveThe aim of this study is to analyse the psychometric characteristics of the French version of van Dam's Employability Scale.MethodOne hundred and ninety French workers and job seekers completed the questionnaire. Confirmatory factor analysis was carried out, and reliability and discriminant validity between employability orientation and employability activities were tested.ResultsThe results confirm two related but independent factors.ConclusionVan Dam's scale offers the professional community an excellent short instrument to measure the two dimensions of employability: employability orientation and employability activities.     

Cross-validation of the very short form of the Physical Self-Inventory (PSI-VS): invariance across genders, age groups, ethnicities and weight statuses

In a recent review of various physical self-concept instruments, Marsh and Cheng (in press) noted that the very short 12-item version of the French Physical Self-Inventory (PSI-VS) represents an important contribution to applied research but that further research was needed to investigate the robustness of its psychometric properties in new and diversified samples. The present study was designed to answer these questions based on a sample of 1103 normally achieving French adolescents. The results show that the PSI-VS measurement model is quite robust and fully invariant across subgroups of students formed according to gender, weight, age and ethnicity. The results also confirm the convergent validity and scale score reliability of the PSI-VS subscales.     

Stress assessment during adolescence: Psychometric properties and measurement invariance of the Student Stress Inventory-Stress Manifestations across gender and age

The main purpose of this study was to analyze the psychometric properties and measurement invariance across gender and age of the Student Stress Inventory-Stress Manifestations (SSI-SM) scores in a large sample of adolescents. The sample was comprised by a total of 1108 students (482 were male), with a mean age of 14.61 years (SD = 1.71). The results indicated that the SSI-SM scores presented adequate psychometric properties from both classical test theory and Item Response Theory (IRT). Confirmatory factorial analysis (CFA), showed that both the bifactor model and a three-factor model (emotional, physiological, and behavioural) were adequate. Multi-group CFA showed that the three-factor model had strong measurement invariance across gender and age. Statistically significant differences in gender were found between latent means as well as raw scores of SSI-SM. Ordinal alpha was .78 for Physiological, .90 for the Emotional, and .79 for the Behavioural subscales. Using IRT, the SSI-SM provides more accuracy information at the medium level of the latent trait. SSI-SM subscales were associated with emotional and behavioural problems. These results provided new sources of validity evidence of the SSI-SM scores in adolescents from general population. The SSI-SM appears to be a useful, brief, and easy to administrate self-report instrument for the screening of stress manifestations at school and educational settings.     

French Validation of the Competitive Aggressiveness and Anger Scale (FVCAAS)

The aim of this study was to propose a French Validation of the Competitive Aggressiveness and Anger Scale (FVCAAS). The instrument was developed from the original version, which is composed of two subscales (six items by subscales) assessing aggressiveness and anger in competitive athletes (CAAS, Maxwell & Moores, 2007). Four studies have been conducted with 1428 competitors. In the first study, the exploratory factor analysis extracted the two-factor structure from the original version, both with good internal consistency. The second study confirmed that the two-factor structure of the instrument was consistent with the original version and showed its partial invariance across genders. The third study demonstrated the temporal stability of the FVCAAS. In the fourth study, both concurrent and discriminant validities were confirmed, supporting the validity and reliability of the FVCAAS. The contributions of this study and limitations are discussed, together with perspectives for future studies of aggressiveness in competitive sports.     

The Italian version of the Empathy Questionnaire for 18- to 36-months-old children: psychometric properties and measurement invariance across gender of the EmQue-I13

Empathy is the basic ability to respond affectively to the emotions of others and is observed early in human development. This study (N = 304) tested the Italian version of the Empathy Questionnaire (EmQue), which is a parent scale assessing empathy-related behaviors in toddlers. For this study, it was completed by participants’ mothers only. The EmQue measurement model and its factorial invariance across children’s gender were tested via confirmatory factor analysis. Highly satisfactory goodness-of-fit indexes were found for a three factor-structure (contagion, attention to the feelings of others and prosocial actions) with 13 loading items. Furthermore, the data supported invariance of measurement across gender groups. These results suggest that the EmQue-I13 is a reliable instrument for investigating empathy and prosocial behavior in 18- to 36-month-old children in the Italian context.     

Measuring individualism and collectivism: The importance of considering differential components,reference groups,and measurement invariance

A new instrument of individualism and collectivism (I/C) was developed and three key issues in I/C measurement were addressed: differentiating components of I/C, understanding the impact of reference groups, and testing of measurement invariance. Three components of I/C were assessed in China and the U.S.: independence, competitiveness, and uniqueness for individualism; considering of one’s decisions on others, sharing of positive outcomes, and sharing of negative outcomes for collectivism. Collectivism was measured with respect to parents, friends, and general others. Results indicate that Chinese participants are less unique but more independent and competitive than their counterparts in the U.S. The expected cultural difference is found for parent collectivism across all three components and for sharing negative outcome with respect to all three reference groups. These results suggest that individualism is a multidimensional construct, whereas the dimensionality of collectivism appears to be a function of social distance. Measurement invariance was tested at configural, factor loading, and intercept levels for all components of I/C.     

The Conners Parent Rating Scale: Psychometric properties in typically developing 4- to 12-year-old Belgian French-speaking children

IntroductionThe Conners Parent Rating Scale – 48 items (CPRS) is one of the most widely used behavioral scales in clinical and research settings with children.ObjectiveThe principal aim of this study was to validate the five-factor structure of the French version of the CPRS in 4- to 12-year-old Belgian French-speaking children. Secondly, a sample of children with Attention Deficit and Hyperactivity Disorder (ADHD) was assessed and their ADHD CPRS profile was examined.MethodsA total of 382 typically developing children from 4 to 12 years old were included in this study. Furthermore, 15 children (aged 6 to 12 years old) diagnosed with ADHD participated in this study.ResultsConfirmatory factor analysis shows that the CPRS presents good psychometric properties and has a factor structure similar to the original version. Furthermore, the CPRS shows high rates of sensitivity and specificity when the ADHD and control group scores are compared.ConclusionsThis study confirms the original five-factor structure of the CPRS when used with French-speaking children. Our results highlight the fact that the CPRS is a reliable measure of parental perception of their children's disruptive behaviors, and encourage the use of culturally adapted normative data for 4- to 12-year-old children.     

Factorial structure of the perceived stress scale and implications for scoring

IntroductionThe 10-item Perceived Stress Scale (PSS-10) is a brief, widely-used measure of perceived stressful experiences that evaluates the degree to which people perceive their lives as unpredictable, uncontrollable or overloaded.ObjectiveThe present study examined the factor structure of the Greek version of the PSS-10.MethodUsing a representative sample of 320 adults from Cyprus, alternative confirmatory factor analytic models were compared to specifically assess bidimensional versus unidimensional specifications for the scale.ResultsA bifactor model with a general factor which loads on all items and a specific one which loads on positively-worded items that capture the notion of self-efficacy to deal with stressful situations, was found to fit well to the data, while providing evidence of a robust latent factor of general distress. Reliability and construct validity evidence with multiple criterion variables were also examined.ConclusionsAlthough a simple unidimensional specification has not been empirically supported in previous research, bifactor modeling exemplifies the extent of multidimensionality and implies that a single score may be reliably used for practical purposes.     

Personal values and unsanctioned aggression inherent in contact sports: The role of self-regulatory mechanisms,aggressiveness, and demographic variables

IntroductionTo date, research-examining factors related to the sociocognitive self-regulatory mechanisms governing unsanctioned aggression have received scant attention in applied sport psychology.ObjectiveA mediating model as influenced by various demographic variables was applied to explore the relationships between athletes’ personal values and their unsanctioned aggression directly and indirectly through the mediating role of resistive self-regulatory efficacy, moral disengagement, and aggressiveness.MethodA sample of 301 French competitors of different age (young: n = 200 and adult: n = 101), gender (male: n = 172 and female: n = 129), type of sport (high: n = 131 and low contact: n = 170), level of competition (beginner: n = 115, intermediate: n = 110, and advanced: n = 76), and length of practice (brief: n = 109, intermediate: n = 49, and extensive: n = 143) completed a questionnaire assessing the aforementioned variables.ResultsStructural equation modelling demonstrates that self-transcendence and self-enhancement values have only indirect negative and positive effects, respectively, on unsanctioned aggression through the full mediating effect of the mediators. Also, age, gender, and type of sport were predictive only of some personal values and mediators.ConclusionThese findings offer evidence that resistive self-regulatory efficacy, moral disengagement, and aggressiveness are mediators that fully govern the impact of athletes’ personal values and certain demographic variables on their unsanctioned aggression. Several limitations, implications and suggestions for further research are discussed.     

Psychometric evaluation of the satisfaction with life scale in Togo: A three-step approach

IntroductionThe Satisfaction with life scale (SWLS) developed by Diener, Emmons, Larsen, and Griffin (1985) is considered the most widely used psychometric scale for assessing life satisfaction. Despite plethora of cross-cultural research that provided evidences of its robustness, none was conducted in French-speaking sub-Saharan countries such as Togo.ObjectiveAccordingly, the purpose of the present study was to investigate the validity of the SWLS extensively among Togolese college students (n = 460) in a three-step approach from 2012 to 2014.Method and resultsFirstly, social representations of well-being were explored qualitatively. Then, the original version of the SWLS was administered. Based on the results we gathered, a scale item was altered. Psychometric properties of the revised version of the SWLS were examined, revealing adequate construct validity, reliability, temporal stability, measurement invariance across gender, convergent validity with a single measure of life satisfaction, and discriminant validity with various life domain satisfactions.ConclusionLimitations and implications in life satisfaction measurement are also discussed with regards to the Togolese cultural context.     

Representations of guidance counselors,psychologists, and psychoeducators regarding psychological assessment

IntroductionSocial representations related to collaborative/therapeutic and information-gathering assessment could explain some psychological assessment practices. However, no other study has attempted to examine the actual place of these models in psychological assessment practices.ObjectiveThe goal of this study was to examine the social representations of different groups of professionals with regard to their preferred approach to psychological assessment.MethodA latent profile analysis was conducted on a sample of licensed Canadian guidance counselors (n = 382), psychologists (n = 235), and psychoeducators (n = 97).ResultsResults revealed three psychological assessment profiles, which significantly differ in terms of a few social factors. Results also showed that some psychological assessment practices differ across profiles.ConclusionThis study provides a better understanding of psychometric instruments users’ approaches to assessment and the influence of social factors.     

Weight stigmatization and disordered eating in obese women: The mediating effects of self-esteem and fear of negative appearance evaluation

ObjectiveThe aim of this study is to examine whether self-esteem and fear of negative appearance evaluation are significant mediators in the association between weight-related self-devaluation and disordered eating.MethodA sample of obese Canadian women (N = 111, M age = 40.9, SD = 10.2) completed the Weight Self-Stigma Questionnaire (WSSQ), the Rosenberg Self-Esteem Scale (RSES), the Fear of Negative Appearance Evaluation Scale (FNAES), and the Eating Disorder Examination Questionnaire (EDE-Q).ResultsSelf-esteem mediated the relationship between weight-related self-devaluation and restraint and weight concerns, whereas fear of negative appearance evaluation mediated the relationship with weight, shape and eating concerns.ConclusionSince, for obese women, self-esteem and fear of negative appearance evaluation are likely to maintain disordered eating, they should be more frequently taken into consideration by researchers, health professionals and public policy stakeholders.