Beyond congruence measures for the evaluation of personality factor structure replicability: An exploratory structural equation modeling approach

The present study aims to illustrate an encompassing approach to the evaluation of personality factor structure replicability based on novel exploratory structural equation modeling (ESEM) methods. This approach comprises formal tests of measurement invariance applied to the flexible ESEM framework and overcomes the limitations of congruence measures that have traditionally been used to assess factor replicability in personality research. On the basis of 1566 responses to the widely-used NEO Five-Factor-Inventory (NEO-FFI), we demonstrate this ESEM approach in the context of examining the invariance of the NEO-FFI factor structure across gender. The approach is shown to converge with traditional congruence measures and extend these measures for examining factorial structure consistency. In addition, more general replicative data supporting the validity of the NEO-FFI are reported. We discuss the ESEM approach as a viable alternative to the congruence approach and acknowledge some important limitations of the method.     

The Psychometric Evaluation of the Satisfaction with Life Scale Using a Nationally Representative Sample of China

This study examined the psychometric properties of the Satisfaction with Life Scale (SWLS) in terms of internal consistency reliability, factorial validity, and measurement invariance across gender, age, residential region (metropolitan area/county town/rural area), educational level, and household income with a nationally representative sample of 4,795 participants in China. The percentages of male (47.0%) and female (53.0%) participants were about equal, and the mean age was 38.56 years (SD = 11.87). The results show that the SWLS has a high internal consistency reliability, a one-factor structure (with a wording effect on Items 4 and 5), strict invariance across gender, partial strict invariance across education (Items 1, 2 and 3), and partial strong invariance across age, income (Items 1, 2 and 3) and residential region (Items 1 and 2). The non-invariance of some items across age and region is discussed in terms of the rapid economic and social transitions of China in the past three decades.     

Factor structure and measurement invariance of the multidimensional driving style inventory across gender and age: An ESEM approach

The Multidimensional Driving Style Inventory (MDSI) is the most comprehensive measure of typical driving behavior to date and has been frequently used to compare driving styles across different groups of drivers, particularly between gender- and age-related groups. However, the factor structure of MDSI has not been clearly established and its measurement invariance has not been demonstrated. The goal of the present study was to examine the internal structure and measurement invariance of the MDSI across gender and age. A sample of 1277 drivers from Argentina responded to the Argentinian version of the MDSI. Exploratory structural equation modeling (ESEM) was used to test the factor structure and measurement invariance across females (n = 602) and males (n = 675), and across young (18–29, n = 558), adult (30–49, n = 395) and older (50 and older, n = 317) drivers. The results showed that a 36-item six-factor ESEM model represented by risky, angry, dissociative, anxious, distress-reduction and careful and patient driving styles was the best model based on fit indices and interpretability. Configural, weak and strong invariance of the six-factor ESEM model across gender and age was also supported. The MDSI in its Argentinian version is equivalent across gender and age, supporting the validity of previous research findings examining gender and age differences in driving styles. Future studies should examine the measurement invariance of the MDSI across other relevant driving-related variables.     

Social communication fears: Factor analysis and gender invariance of the short-form of the personal report of confidence as a speaker in Spain

Public speaking is a highly prevalent fear that prevents from successful social communication. The Personal Report of Confidence as a Speaker (PRCS) is one of the most commonly used measures to assess people’s fear of public speaking. However, few studies have evaluated its factor structure. In this paper, two studies analyzed the psychometric properties of the short form of the PRCS (Hook, Smith, & Valentiner, 2008) and its convergent validity with the Self Statements During Public Speaking (SSPS) scale in Spain. Study 1 (N = 190) provided information about exploratory factor analysis and internal consistency. Study 2, with a different sample (N = 392), complemented Study 1 with confirmatory factor analysis, internal consistency, convergent validity with SSPS and test of measurement invariance across gender groups. Results of exploratory factor analysis yielded a one factor solution. Different indices of the confirmatory factor analysis (CFI, TLI, SRMR, RMSEA) confirmed a good fit. Internal consistency was high in both studies and convergent validity with SSPS was found. Evidence of configural, metric and scalar invariance across gender groups was obtained. These findings support the use of the short form of the PRCS and suggest that it is a useful instrument for public speaking assessment.     

Psychometric properties of beliefs about relationship violence against women and gender stereotypes scale

This article describes psychometric properties of the Gender-Based Relationship Violence Beliefs Scale (BEREVIWOS) and the Gender Stereotypes and Beliefs (GESTABE) scale in a Nigerian setting. Analysis was based on a convenience sample of 202 respondents. Confirmatory factor analysis (CFA) was used to determine construct validity of the three-factor structure of each scale and measurement invariance procedures were utilised to determine whether the factor structure was equivalent across gender. Convergent and discriminant validity of the scales, and predictive and incremental validity were examined for consistency with theory on gender beliefs/stereotypes and violence in patriarchal society. A single-factor CFA model approach was used to examine common method bias. Results suggest the BEREVIWOS and GESTABE are multidimensional scales with an intercorrelated three-factor structure. The fit of the models and composite reliability were adequate. Scores from the BEREVIWOS and GESTABE appear reliable and valid measures of underlying beliefs and stereotypes associated with violence against women in Nigeria.     

Exploring social and personal relationships: The issue of measurement invariance of non‐independent observations

In social psychology, some research questions address a comparison of individuals belonging to different social or relational contexts. As measurement invariance literature has indicated, before comparing two or more groups (gender, cultures, and relationship types), the question of whether a measurement of the construct used for the comparison is invariant must be verified. Measurement invariance helps to assure the validity of the measurement and the construct equivalence across groups. However, when non‐independent data are used for comparison (the same individual provides data for his or her different relationship types), the standard multigroup analyses for testing measurement invariance are not accurate. The current study presents a modified correlated uniqueness model that may be applied in these specific cases. As an example, we analyzed the invariance of the Intimate Disclosure scale and the Conflict scale in mother–child, father–child, and romantic relationships of young adults. Results indicate a partial invariance: only configural invariance, factor loading invariance, and factor covariance invariance were found. The consequences for validity of the measurement are then discussed. Copyright © 2014 John Wiley & Sons, Ltd.     

正念注意觉知量表儿童版~MAAS-C在中国城市及农村儿童中使用的信效度检验

目的:修订中文版正念注意觉知量表儿童版(the Mindful Attention Awareness Scale—Children,MAAS-C),考察其在中国文化背景下的适用性及信效度。方法:城市及农村地区共619名小学4-6年级学生参与研究。对数据进行项目分析、探索性因素分析、验证性因素分析、信度分析、效标关联效度分析、性别及城乡地区等值性检验。结果:中文版MAAS-C为单维结构,具有良好的结构效度、效标效度及信度。测量不变性检验表明,该量表在不同性别儿童间达到严格等值,城乡地区儿童间达到弱等值。结论:正念觉知量表儿童版的中文版本各项心理测量学指标良好,适宜在我国儿童群体中使用。     

And justice for all: Revisiting the Global Belief in a Just World Scale

The Global Belief in a Just World Scale (GBJWS) has been widely used in measuring the Belief in a Just World (BJW) personality trait. Despite its widespread application across the social sciences, the validity of this scale has not been sufficiently tested in the literature. In this research, the authors examine the internal and external validity of the GBJWS using both standard correlational analyses and structural equation modeling (SEM). Specifically, the authors test the concurrent validity, internal consistency, unidimensional structure, convergent validity, and both measurement and latent mean invariance of the scale across gender and culture. The results of a pilot study suggest strong concurrent validity of the GBJWS with other BJW scales, and the findings of the two main studies support the internal and external validity of GBJWS across gender and culture. The authors’ results further show an overall greater level of BJW of Chinese individuals compared to Americans. The present research provides a much needed investigation of the validity of the GBJWS, and answers calls for research examining the scale’s utility across different populations.     

Psychometric Properties of the Posttraumatic Growth Inventory–Short Form Among Chilean Adults

This study evaluated the factorial structure, internal consistency, and construct validity of the Chilean version of the Posttraumatic Growth Inventory–Short Form. The participants were 1,817 Chilean adults who had experienced the 2010 earthquake in Chile or other highly stressful events. Confirmatory factorial analysis supported the correlated five-factor structure of the PTGI-SF. A multigroup confirmatory factor analysis confirmed measurement invariance across different samples. Concurrent validity was assessed by correlation. These findings suggest that the psychometric properties of the PTGI-SF are adequate to measure posttraumatic growth in the Chilean and Latin American population.     

Psychometric Properties of the Mental Health Continuum-Short Form: A Study of Portuguese Speaking Children/Youths

The development of measures of children and adolescents’ subjective well-being is crucial to the conceptualization and evaluation of positive mental health. The aim of this study was to investigate the factorial structure and invariance of the Mental Health Continuum-Short Form (MHC-SF—adolescents) across children and youths. Participants were from two different samples: 208 elementary school children (sample 1) and 216 middle school youths (sample 2). Results confirmed the three-dimensional structure of subjective well-being in both samples. The three sub-scales of the MHCSF yielded high internal consistency and results from the HTMT85 indicated discriminant validity. Measurement invariance testing across three different age groups (7–8, 9–10 and 11–14 years) confirmed the full metric and approximate scalar invariance of the MHC-SF. Full scalar invariance was achieved across gender. The study also compared the latent means for mental well-being in the three age groups, and found that the younger groups showed significantly higher levels of wellbeing. The present research study strongly suggests that the MHC-SF (adolescents) is an appropriate instrument to measure the positive mental health and well-being of children and pre-adolescents as multidimensional construct.     

Validation of the Chinese Version of the Body Image Acceptance and Action Questionnaire and the Mediating Role of Body Image Flexibility in the Relationship Between Body Dissatisfaction and Psychological Distress

The psychometric properties of the Chinese version of the Body Image Acceptance and Action Questionnaire (C-BI-AAQ) and its short form (C-BI-AAQ-5) were examined with a sample of Chinese undergraduates (n = 1,068, 52.6% female). The factor structure, measurement reliability, measurement invariance across gender, and latent gender mean difference of the two scales were explored. Confirmatory factor analysis was used to examine the factor structure of the C-BI-AAQ and the C-BI-AAQ-5. The original one-factor structure was replicated for both the C-BI-AAQ and the C-BI-AAQ-5. Both the C-BI-AAQ and C-BI-AAQ-5 showed good internal consistency, test-retest reliability, and convergent and discriminant validity (e.g., relationship patterns in the expected directions with theoretically similar psychological flexibility, and with theoretically dissimilar body dissatisfaction, and psychological distress). The C-BI-AAQ-5 was shown to be equivalent to the C-BI-AAQ. Furthermore, strict measurement invariance across gender was confirmed for both the C-BI-AAQ and C-BI-AAQ-5, and latent mean difference tests showed that men had higher levels of body image flexibility than women. Thus, both the C-BI-AAQ and C-BI-AAQ-5 appear to be psychometrically sound instruments for use in the Chinese young adult population. In addition, body image flexibility measured by both the C-BI-AAQ and the C-BI-AAQ-5 fully mediated the relationship between body dissatisfaction and psychological distress.     

Effects of varying numbers of Likert scale points on factor structure of the Rosenberg Self‐Esteem Scale

Likert‐type rating scales are among the most widely used tools in psychological research. Different numbers of response categories would likely affect response style, data distribution, reliability, and construct validity. There is a lack of research in factor structure invariance under Likert scales with different numbers of categories. The purpose of this study is to examine the effects of varying numbers of Likert points (4–11) on scale properties such as factor structure, external validity, and latent means based on the Rosenberg Self‐Esteem Scale (M. Rosenberg, 1989 ). The sample consists of 1,807 students from secondary schools in Macau. Confirmatory factor analysis shows that the correlated two‐factor model is the most appropriate one; longitudinal invariance analysis reveals that measurement invariance across Likert scales was satisfied at the scalar level. In addition, latent mean scores on the two factors as well as observed means on the subscales are comparable across Likert scales. Moreover, the measurement model across Likert scales exhibit similar external validity. Although psychometric properties are mostly similar among a different number of points, the 4‐point Likert scale is not recommended for its higher skewness and lower loadings; the 11‐point Likert scale from 0 to 10 is slightly preferred for its higher loadings and composite reliability.     

Psychometric properties of the Highly Sensitive Child scale across developmental stage,gender, and country

Adolescents differ in their degree of Environmental Sensitivity, that is, the ability to perceive and process information about their environment. The present study aimed to investigate the psychometric properties of the Highly Sensitive Child scale (HSC), a self-report measure of Environmental Sensitivity, in two Belgian and UK samples with a total of 3056 adolescents. First, the factor structure, internal consistency, dimensionality, and construct validity of the HSC scale were examined. Second, measurement invariance of the HSC scale across developmental stage, gender, and country was tested. Results supported a bifactor model with a general sensitivity factor and three group factors: Ease of Excitation (EOE), Low Sensory Threshold (LST), and Aesthetic Sensitivity (AES). Cronbach’s alpha and McDonalds’s (hierarchical) omega indicated that the HSC scale is a reliable measure of Environmental Sensitivity, except for AES. Furthermore, AES was associated with different personality traits than EOE and LST. Second, the HSC scale was partially measurement invariant across developmental stage, gender, and country. The results provide important insights in the psychometrics of a first measurement of Environmental Sensitivity in early to late adolescents. Implications for further research are discussed.

     

The Multidimensional Scale of Perceived Social Support: Analyses of Internal Reliability,Measurement Invariance,and Correlates Across Gender

In this study, we examined estimates of internal consistency reliability, measurement invariance, and differential correlates of the Multidimensional Scale of Perceived Social Support (MSPSS; Zimet, Dahlem, Zimet, & Farley, 1988) in samples of undergraduate men (n = 270) and women (n = 340). The MSPSS is designed to assess 3 sources of perceived social support: family, friends, and significant others. The participants ranged in age from 18 to 24 years (M _age = 19.60, SD = 1.4 years). First, composite scale reliability and coefficient omega methods provided adequate estimates of internal consistency reliability for the original MSPSS total and subscale scores. Second, results of multiple-groups invariance confirmatory factor analysis provided support for configural and metric invariance. Partial measurement invariance was attained for scalar and strict measurement invariance across men and women. Additionally, given the high correlations among the first-order factors, we conducted multiple-groups bifactor item response theory (bifactor-IRT) analysis to evaluate further the performances of the individual MSPSS items across gender. Support for the bifactor model was strong. Third, we conducted a series of simultaneous regression analyses to identify potential correlates of the social support construct for women and men.     

Cognitive Fusion Questionnaire—Body Image: Psychometric Properties and Its Incremental Power in the Prediction of Binge Eating Severity

Given the clinical usefulness of the CFQ-BI (Cognitive Fusion Questionnaire—Body Image; the only existing measure to assess the body-image-related cognitive fusion), the present study aimed to confirm its one-factor structure, to verify its measurement invariance between clinical and non-clinical samples, to analyze its internal consistency and sensitivity to detect differences between samples, as well as to explore the incremental and convergent validities of the CFQ-BI scores in Brazilian samples. This was a cross-sectional study, which was conducted in clinical (women with overweight or obesity in treatment for weight loss) and non-clinical samples (women from the general population). The one-factor structure was confirmed showing factorial measurement invariance across clinical and non-clinical samples. The CFQ-BI scores presented an excellent internal consistency, were able to discriminate clinical and non-clinical samples, and were positively associated with binge eating severity, general cognitive fusion, and psychological inflexibility. Furthermore, body-image-related cognitive fusion scores (CFQ-BI) presented incremental validity over a general measure of cognitive fusion in the prediction of binge eating symptoms. This study demonstrated that CFQ-BI is a short scale with reliable and robust scores in Brazilian samples, presenting incremental and convergent validities, measurement invariance, and sensitivity to detect differences between clinical and non-clinical groups of women, enabling comparative studies between them.     

The Eating Attitudes Test-26 Revisited using Exploratory Structural Equation Modeling

Most previous studies have failed to replicate the original factor structure of the 26-item version of the Eating Attitudes Test (EAT-26) among community samples of adolescents. The main objective of the present series of four studies (n?=?2178) was to revisit the factor structure of this instrument among mixed gender community samples of adolescents using both exploratory structural equation modeling (ESEM) and confirmatory factor analysis (CFA). First, results from the ESEM analyses provided satisfactory goodness-of-fit statistics and reliability coefficients for a six-factor model of the EAT with 18 items (EAT-18) closely corresponding to the original seven-factor structure proposed for the 40-item version of the EAT. Second, these analyses were satisfactorily replicated among a new sample of community adolescents using CFA. The results confirmed the factor loading and intercept invariance of this model across gender and age groups (i.e., early and late adolescence), as well as the complete invariance of the EAT-18 measurement model between ethnicities (i.e., European versus African origins) and across weight categories (i.e., underweight, normal weight and overweight). Finally, the last study provided support for convergent validity of the EAT-18 with the Eating Disorder Inventory and with instruments measuring global self-esteem, physical appearance, social physique anxiety and fear of negative appearance evaluation.     

Validating the Student-Teacher Relationship Scale: testing factor structure and measurement invariance across child gender and age in a Dutch sample

The Student-Teacher Relationship Scale (STRS) is widely used to examine teachers' relationships with young students in terms of closeness, conflict, and dependency. This study aimed to verify the dimensional structure of the STRS with confirmatory factor analysis, test its measurement invariance across child gender and age, improve its measurement of the dependency construct, and extend its age range. Teachers completed a slightly adapted STRS for a Dutch sample of 2335 children aged 3 to 12. Overall, the 3-factor model showed an acceptable fit. Results indicated metric invariance across gender and age up to 8years. Scalar invariance generally did not hold. Lack of metric invariance at ages 8 to 12 primarily involved Conflict items, whereas scale differences across gender and age primarily involved Closeness items. The adapted Dependency scale showed strong invariance and higher internal consistencies than the original scale for this Dutch sample. Importantly, the revealed non-invariance for gender and age did not influence mean group comparisons.     

Analysis of the factor structure of the Sociocultural Attitudes Towards Appearance Questionnaire (SATAQ-3) in Spanish secondary-school students through exploratory structural equation modeling

The aims of the present study were: (1) to assess the factor structure of the SATAQ-3 in Spanish secondary-school students by means of exploratory factor analysis (EFA), confirmatory factor analysis (CFA) and exploratory structural equation modeling (ESEM) models; and (2) to study its invariance by sex and school grade. ESEM is a technique that has been proposed for the analysis of internal structure that overcomes some of the limitations of EFA and CFA. Participants were 1559 boys and girls in grades seventh to tenth. The results support the four-factor solution of the original version, and reveal that the best fit was obtained with ESEM, excluding Item 20 and with correlated uniqueness between reverse-keyed items. Our version shows invariance by sex and grade. The differences between scores of different groups are in the expected direction, and support the validity of the questionnaire. We recommend a version excluding Item 20 and without reverse-keyed items.     

Collective moral disengagement: Initial validation of a scale for adolescents

Collective moral disengagement refers to shared group beliefs that morally justify negative actions. This study reports an initial validation of the newly developed Classroom Collective Moral Disengagement Scale (CCMDS) for adolescents. This self-report instrument assesses the degree to which mechanisms of moral disengagement are shared by students in their class. Data were collected from two samples of 486 and 654 adolescents attending middle and high schools in Italy. Through exploratory and confirmatory factor analyses the unidimensional structure of the scale was established. Multigroup analyses demonstrated configural, metric and scalar invariance of the model across age and gender groups. The final version of the scale consists of 17 items and it has good internal consistency and validity. It is concluded that the scale is a promising measure for research concerning group level morality.     

矛盾年龄偏见量表在中国大学生群体中的修订及信效度检验

目的：修订矛盾年龄偏见量表(the Ambivalent Ageism Scale, AAS),并在中国大学生群体中进行信、效度检验。方法：对1182名大学生施测AAS中文翻译版,探索并验证其因子结构,分析信、效度和测量等值性。其中347人还完成老化知识量表(FAQ)和容纳他人量表(AOS),用以检验AAS中文版的校标关联效度。另有74人在4周后重测AAS中文版。结果：AAS中文修订版包含认知帮助/保护、不想要的帮助和敌意年龄偏见三因子,总量表和各维度的Cronbach’s α系数依次为0.83、0.80、0.85、0.76,重测信度依次为0.78、0.62、0.78、0.71。AAS中文修订版及各维度与FAQ和AOS负相关(r=-0.23～-0.48,ps<0.001)。验证因素分析表明AAS中文修订版的拟合良好(χ²/df=3.51,CFI=0.96,TLI=0.94,RMSEA=0.07,SRMR=0.05)。且该量表跨性别形态、弱等值、部分强等值和部分严格测量等值成立。结论：修订后的矛盾年龄偏见量表(AAS)中文版的信、效度良好,具备跨性别的测量部分...