Testing the Factor Structure and Measurement Invariance Across Gender of the Big Five Inventory Through Exploratory Structural Equation Modeling

Confirmatory factor analyses (CFAs) typically fail to support the a priori 5-factor structure of Big Five self-report instruments, due in part to the overly restrictive CFA assumptions. We show that exploratory structural equation modeling (ESEM), an integration of CFA and exploratory factor analysis, overcomes these problems in relation to responses to the 44-item Big Five Inventory (BFI) administered to a large Italian community sample. ESEM fitted the data better and resulted in less correlated factors than CFA, although ESEM and CFA factor scores correlated at near unity with observed raw scores. Tests of gender invariance with a 13-model taxonomy of full measurement invariance showed that the factor structure of the BFI is gender-invariant and that women score higher on Neuroticism, Agreeableness, Extraversion, and Conscientiousness. Through ESEM one could address substantively important issues about BFI psychometric properties that could not be appropriately addressed through traditional approaches.     

The Eating Attitudes Test-26 Revisited using Exploratory Structural Equation Modeling

Most previous studies have failed to replicate the original factor structure of the 26-item version of the Eating Attitudes Test (EAT-26) among community samples of adolescents. The main objective of the present series of four studies (n?=?2178) was to revisit the factor structure of this instrument among mixed gender community samples of adolescents using both exploratory structural equation modeling (ESEM) and confirmatory factor analysis (CFA). First, results from the ESEM analyses provided satisfactory goodness-of-fit statistics and reliability coefficients for a six-factor model of the EAT with 18 items (EAT-18) closely corresponding to the original seven-factor structure proposed for the 40-item version of the EAT. Second, these analyses were satisfactorily replicated among a new sample of community adolescents using CFA. The results confirmed the factor loading and intercept invariance of this model across gender and age groups (i.e., early and late adolescence), as well as the complete invariance of the EAT-18 measurement model between ethnicities (i.e., European versus African origins) and across weight categories (i.e., underweight, normal weight and overweight). Finally, the last study provided support for convergent validity of the EAT-18 with the Eating Disorder Inventory and with instruments measuring global self-esteem, physical appearance, social physique anxiety and fear of negative appearance evaluation.     

Multidimensional structure and measurement invariance of school engagement

This study examined the multidimensional structure and measurement invariance of a school engagement instrument using confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), bifactor CFA (BCFA), and bifactor ESEM (BESEM). Participants consisted of 1731 students in Grades 9 - 11 from the 4-H Study of Positive Youth Development in the United States. The use of the CFA, ESEM, BCFA, and BESEM models was expected to provide more insight into the cross-loading and hierarchical structures of school engagement. We found empirical evidence to support the (a) tripartite factor structure of school engagement, (b) existence of cross-loadings and hierarchical structures, (c) measurement invariance across gender (male vs female) and race (European American vs African American), and (d) expected latent means differences by gender.     

Cross-cultural confirmatory factor analysis of the CES-D in Spanish and Mexican dementia caregivers

The Center for Epidemiologic Studies-Depression Scale (CES-D) is the most frequently used scale for measuring depressive symptomatology in caregiving research. The aim of this study is to test its construct structure and measurement equivalence between caregivers from two Spanish-speaking countries. Face-to-face interviews were carried out with 595 female dementia caregivers from Madrid, Spain, and from Coahuila, Mexico. The structure of the CES-D was analyzed using exploratory and confirmatory factor analysis (EFA and CFA, respectively). Measurement invariance across samples was analyzed comparing a baseline model with a more restrictive model. Significant differences between means were found for 7 items. The results of the EFA clearly supported a four-factor solution. The CFA for the whole sample with the four factors revealed high and statistically significant loading coefficients for all items (except item number 4). When equality constraints were imposed to test for the invariance between countries, the change in chi-square was significant, indicating that complete invariance could not be assumed. Significant between-countries differences were found for three of the four latent factor mean scores. Although the results provide general support for the original four-factor structure, caution should be exercised on reporting comparisons of depression scores between Spanish-speaking countries.     

Evaluating the Factor Structure of the MIDI Personality Scale Using Exploratory Structural Equation Modeling

This study investigated the factor structure of the 26‐item Midlife Development Inventory (MIDI) Personality Scale in a sample of 2,720 Americans. It was found that whereas confirmatory factor analysis (CFA) did not provide an acceptable fit to the data, exploratory structural equation modeling (ESEM) provided an acceptable fit. The results of ESEM revealed that the a priori five‐factor structure of personality was generally consistent with the data, and all items had salient loadings on their target factors. ESEM also revealed that some of the items contributed significantly to more than one personality factor. The results are in line with previous research, and indicate that ESEM is more suitable than CFA for the study of personality traits.     

数学家庭作业动机量表在中国青少年群体中的信效度检验

目的:在中国青少年中对数学家庭作业动机量表进行修订并考察其信效度。方法:采用方便取样选取762名青少年,对数学家庭作业动机量表进行项目分析、探索性因素分析、验证性因素分析、测量等值性检验以及信效度分析。结果:中文版数学家庭作业动机量表包括认同调节、内部动机、外在调节和内摄调节4个因素,并具有跨性别和跨年龄组的测量等值性以及良好的效标效度和信度。结论:修订后的数学家庭作业动机量表具有良好的心理测量学指标,可以作为测量和评估中国青少年数学家庭作业动机的有效工具。     

Evidence for a Higher-Order ESEM Structure of ADHD in a Sample of Chinese Children

Exploratory structural equation modeling (ESEM) solutions have been proposed to represent the factor structures of attention-deficit/hyperactivity disorder (ADHD) in recent literature, yet no studies have assessed those structures in Chinese children. The primary aim of this study was to comprehensively examine the factor structures of the Chinese version of the ADHD Rating Scale-IV (ADHD RS-IV): Home Version. Data on 458 Chinese children aged 3–8 years (boys: 246; 54%) were used to test and compare eleven factor models: confirmatory factor analysis (CFA) models (one-factor, two-factor and three-factor), second-order CFA model, bifactor CFA models (two and three specific factors), ESEM models (two-factor and three-factor), second-order ESEM model, and bifactor ESEM models (two and three specific factors). The results showed that, overall, ESEM models displayed better fit than CFA models. Specifically, the second-order ESEM model with three first-order factors best represented of the ADHD factor structure in our sample. In addition, measurement invariance testing results showed that scalar invariance was established across gender, age and informant groups. Implications for future research are discussed.

     

Factor analysis of the Revised Illness Perception Questionnaire in adults with atopic dermatitis

The objective of this study was to examine the psychometric properties of the revised Illness Perceptions Questionnaire (IPQ-R) in adult participants with atopic dermatitis (AD). Two hundred and eighty-four participants who had a GP or dermatologist confirmed diagnosis of AD completed the IPQ-R. The factor structure of the IPQ-R was examined using confirmatory (CFA) and exploratory factor analysis (EFA). The results of the CFA did not indicate a good comparative fit with the IPQ-R subscales, while the EFA and a fixed six-factor principal components analysis largely replicated the original factor structure of the IPQ-R. The existence of the acute/chronic and cyclical timeline dimensions, and the illness coherence subscale was most strongly supported, while all items of the consequences and emotional representation subscales consistently loaded onto one factor. The EFA for causal attributions did not produce a stable solution. The findings indicate that although the factor structure of the IPQ-R was not confirmed in the sample of patients with AD using CFA, it was partly reproduced using EFA. Overall, the results suggest that in patients with AD the IPQ-R, in particular the consequences and emotional representations subscales, should be employed and interpreted with care.     

The Value of Exploratory Structural Equation Modeling in Identifying Factor Overlap in the Mental Health Continuum-Short Form (MHC-SF): A Study with a New Zealand Sample

This study is the first to investigate the factor structure of the Mental Health Continuum-Short Form (MHC-SF) in New Zealand. Towards this end, traditional Confirmatory Factor Analysis (CFA) and the new method of Exploratory Structural Equation Modeling (ESEM) were used. Both ESEM and CFA supported the tripartite model of mental well-being in comparison to the one- and two-factor models; however, ESEM provided better fit with the data. Moreover, interfactor correlations were considerably lower in ESEM than they were in CFA, indicating greater factor distinctiveness in ESEM. ESEM also revealed a number of important cross-loadings for items in the measurement model of the MHC-SF. The results supported full metric and full scalar invariance of the MHC-SF across gender. The attenuated correlations among well-being factors obtained by ESEM here provide an important insight about the ongoing controversy regarding the failure of empirical research to identify distinct eudaimonic and hedonic factors in well-being measures. An overreliance on CFA methods may have led the field to rely on inflated estimates of shared variance between eudaimonia and hedonia.     

Factor Structure Validation of the Alcohol Dependence Scale in a Heavy Drinking College Sample

The prevalence of alcohol use disorders in college students necessitates that adequate measures exist to assess students for abuse and dependence. The Alcohol Dependence Scale (ADS) is a continuous measure of the severity of alcohol involvement found to have a unidimensional factor structure in clinical samples. The latent factor structure of the ADS in college drinkers has not been examined and this study sought to replicate unidimensionality. Heavy college drinkers (N = 343) completed the ADS. Performance was examined using confirmatory factor analysis (CFA) and exploratory factor analysis (EFA). The CFA did not support a single factor solution. Follow-up EFA revealed a two factor structure. The first, termed “Acute Excessive Drinking” consisted of relatively commonly endorsed items relating to loss of behavioral control, blackouts, and obsessive/compulsive drinking. The second, termed “Severe Withdrawal Symptoms,” consisted of relatively infrequently endorsed items relating to withdrawal symptoms. The ADS does not appear to have the same factor structure in college and clinical samples, making it inadvisable as a linear measure of alcohol problems within a college population.     

大学生恋爱动机问卷的初步编制

目的:探讨大学生恋爱动机的结构并编制相应的测量工具。方法:运用文献法、开放式问卷和访谈法设计问卷,多次施测修改问卷,采用相关分析、探索性分析和验证性分析对问卷的信、效度进行检验。结果:大学生恋爱动机问卷包括功利性、面子性、性爱性,情感性、消遣性和婚姻性六个维度,累计贡献率57.459%,共27项;问卷的信度和效度均符合心理测量学的要求。结论:大学生恋爱动机问卷可作为测评大学生恋爱动机的工具。     

Measuring cancer patients' psychological distress and well-being: a factor analytic assessment of the Mental Health Inventory

This study examined the psychometric structure of the Mental Health Inventory (MHI) in 433 cancer patients. Using structural equation modeling, confirmatory factor analyses (CFAs) were conducted. Next, exploratory factor analysis (EFA) was used to explore an alternative MHI factor structure with a randomly chosen subsample. Finally, CFAs were conducted on 6 MHI models with the second subsample. Convergent validity was examined by administering the Positive and Negative Affect Schedule (PANAS) and the Dyadic Adjustment Scale (DAS). The CFAs with the original MHI factor structure indicated inadequate fit, supporting the need to conduct an EFA. Results of the EFA indicated support for a 5-factor solution but numerous differences in item factor loadings. The CFA indicated that the 5-factor correlated model was the best fitting model. Correlations between the PANAS and the DAS with the MHI provided preliminary support for the convergent validity of the MHI. Together, these results indicate that the original MHI factor structure may require modification for use in patients with cancer.     

中国人善良人格量表的编制及信效度检验

中国的心理学研究充满了道德色彩,研究以善良人格概念及结构为基础,编制了中国人善良人格量表。研究根据已有的善良人格词汇对应编写具体条目,经过分析整合后初步保留29个善良人格条目,在此基础上研究招募960名被试,分别进行探索性因素分析和验证性因素分析,并建构了善良人格的二阶四因子结构。研究结果表明善良人格量表具有良好的信效度,是测量中国人善良人格的有效工具。     

Initial validation of the coach-created Empowering and Disempowering Motivational Climate Questionnaire (EDMCQ-C)

This article employs Duda's (2013) hierarchical conceptualization of the coach-created motivational climate to inform the validation of a questionnaire (Empowering and Disempowering Motivational Climate Questionnaire-Coach; EDMCQ-C) that assesses junior athletes' perceptions of the social environmental dimensions proposed by achievement goal theory and self-determination theory. Confirmatory factor analyses (CFA) were initially employed to reduce the number of items required to measure the targeted climate dimensions. A series of competing models were then tested to determine the best representation of the questionnaire's factor structure. The findings revealed that exploratory structural equation modelling (ESEM) provided a better fit of the data to the hypothesised model than CFA solutions. Specifically, the bi-factor ESEM provided the best fit, although parameter estimates suggest that none of the ESEM solutions replicated the underlying theoretical model of the motivational climate proposed by Duda (2013). The evidence from this study suggests that the EDMCQ-C is a promising, parsimonious questionnaire to assess empowering and disempowering facets of the motivational climate albeit the development of the questionnaire remains a work in progress.     

大学生传统人际价值观的探索性与验证性研究

选取传统谚语、俗语中关于人际关系的语句编制成传统人际价值观问卷,通过探索性因子分析,构建传统人际价值观的维度。并通过验证性因子分析检验理论构想的拟合性。探索性因子分析中,一阶因子分析抽取了14个因子,对14个因子进行二阶因子分析又抽取了人际道德、人际亲疏性、人际防御、人际智慧4个主因子。根据这一结果建构了一个含有人际道德、人际亲疏性、人际防御三个主因子的模型。在验证性因子分析中,对模型进行修正,使之分别含有4个、3个、2个次因子,经检验,模型的拟合比较良好。     

Validation of the NEO Personality Inventory and the five-factor model. Can findings from exploratory and confirmatory factor analysis be reconciled?

The aims of the study were (i) to analyse a Norwegian version of the NEO Personality Inventory (NEO-PI), using both exploratory factor analysis (EFA) and confirmatory factor analysis (CFA); (ii) to compare the results of the two factor analytic strategies, both within the present study and across different studies; and (iii) to discuss possible causes of discrepant findings (across factor-analytic methods and across samples). The sample comprised 961 subjects representative of the non-institutionalized Norwegian adult population. Using an EFA strategy, very high coefficients of factor comparability (r=0.93–0.99) across sexes were found. None of the five main domains turned out to be as homogeneous as suggested by the original five-factor model, but most of the deviations from the assumed simple structure were comparable to results from recent American studies. However, none of the revised EFA-based models were supported using CFA methods. Moreover, a large number of modifications were necessary to obtain a model with acceptable fit. It is argued that these discrepant findings can be accounted for, at least in part, by (i) consequences of different model acceptance criteria in the EFA and CFA tradition, (ii) the inherent logical–semantical structure of the NEO-PI, and (iii) consequences of selection effects (factorial invariance problem). © 1997 by John Wiley & Sons, Ltd.     

Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and Set-ESEM: Optimal Balance Between Goodness of Fit and Parsimony

Abstract

CFAs of multidimensional constructs often fail to meet standards of good measurement (e.g., goodness-of-fit, measurement invariance, and well-differentiated factors). Exploratory structural equation modeling (ESEM) represents a compromise between exploratory factor analysis’ (EFA) flexibility, and CFA/SEM’s rigor and parsimony, but lacks parsimony (particularly in large models) and might confound constructs that need to be kept separate. In Set-ESEM, two or more a priori sets of constructs are modeled within a single model such that cross-loadings are permissible within the same set of factors (as in Full-ESEM) but are constrained to be zero for factors in different sets (as in CFA). The different sets can reflect the same set of constructs on multiple occasions, and/or different constructs measured within the same wave. Hence, Set-ESEM that represents a middle-ground between the flexibility of traditional-ESEM (hereafter referred to as Full-ESEM) and the rigor and parsimony of CFA/SEM. Thus, the purposes of this article are to provide an overview tutorial on Set-ESEM, juxtapose it with Full-ESEM, and to illustrate its application with simulated data and diverse “real” data applications with accessible, heuristic explanations of best practice.     

Parental Attitudes Towards Inclusiveness Instrument (PATII): Psychometric evaluation of a new instrument measuring parental beliefs about gender and sexuality diversity inclusions in schools

Despite ad hoc claims that parents often are in opposition to a schooling curriculum that is inclusive of gender and sexuality diversity, there exists no research to date that has canvassed the reasons why parents may oppose or support such educational policy via a psychometrically sound instrument. The aim of the present study was to address this gap by developing and testing a new, multidimensional measure of the theorized nature of parental attitudes towards inclusiveness, the Parental Attitudes Towards Inclusiveness Instrument (PATII). The pilot sample of 998 parents who had a child attending school in any grade from Kindergarten to Year 12 were drawn from the United Kingdom (UK) and the United States (U.S.) via the online recruitment platform, Prolific. The PATII was evaluated for its reliability using McDonald's omega, construct and criterion validity, and measurement invariance utilizing exploratory structural equation modelling (ESEM), with initial ESEM analyses also compared to traditional confirmatory factor analysis (CFA) methods. Scores derived from this measure and inferences based upon those scores were reliable, valid, and also invariant across sex, religiosity, and nationality groups within this sample. Parental sex, religiosity, and nationality group membership were differentially correlated with support for and opposition to an inclusive curriculum. Lastly, the criterion validity of the PATII was supported, with the instrument's factors differentially correlated to parents' desired providers of inclusive education as predicted. Future national and international use of the PATII offers a critical first step to informing school and curriculum policy on inclusivity.