Measurement invariance and age-related differences of trait anger across the adult lifespan

The present study examined measurement invariance of trait anger with respect to age. In addition, age-related differences in latent variables (factor variances, factor covariances, and factor means) were investigated. A sample of 1216 participants, divided into six age groups, ranging from under 30 to over 70 years, was tested using the angry temperament and angry reaction scales from the State-Trait Anger Expression Inventory (STAXI; Spielberger, 1988). Results show that strong measurement invariance held across the six age groups. For both angry temperament and angry reaction, factor variances tended to decrease into middle age and then increase again into old age. Factor correlations decreased into old age, implying a differentiation of trait anger. Finally, regarding factor means, older adults showed less anger than younger adults, suggesting higher levels of self-regulation or less exposure to anger-provoking contexts in later life.     

Measurement invariance of the Mental Health Continuum-Short Form (MHC-SF) across three cultural groups

This study investigated the factorial structure and invariance of the Mental Health Continuum-Short Form (MHC-SF) across cultural groups from three nations, namely, the Netherlands, South Africa, and Iran (N = 1120). The three-dimensional structure of mental well-being was supported in all the groups. The results of measurement invariance testing confirmed the full metric and partial scalar invariance of the MHC-SF. The study also compared the latent means for the aspects of mental well-being in the three cultural groups, and found significant differences. The significance and implications of the results are discussed.     

Measuring current achievement motivation with the QCM: Short form development and investigation of measurement invariance

This article explores the measurement properties of the Questionnaire on Current Motivation (QCM; Rheinberg, Vollmeyer, & Burns, 2001), which measures four factors of current achievement motivation (anxiety, challenge, interest, and probability of success) in the context of taking an abstract reasoning test. Two studies were conducted. In study 1, the measurement model of the QCM was tested, and a short form consisting of 12 of the original 18 QCM items was derived. Data were obtained from N = 350 students completing the QCM in anticipation of working on a test of Latin Square Tasks. In study 2, the measurement properties of the short form were replicated with data from a sample of N = 509 students. Measurement invariance with respect to gender was investigated using multigroup CFA models. The results showed that the assumptions of equal numbers of factors, factor loadings, and residual variances could be confirmed, but evidence for full intercept invariance was not obtained. There were significant differences in the latent means for anxiety and probability of success between female and male test takers, but none of these two factors had an influence on actual test performance, which was instead significantly predicted by interest in the task.     

Factorial invariance and latent mean differences of scores on trait emotional intelligence across gender and age

Little is known about the factorial invariance and latent mean difference across sex and age in trait emotional intelligence (EI). The purpose of this study was to examine whether the measurement structure underlying trait EI is equivalent across sex and age groups. The sample consisted of 2919 teenagers, youths and adults. In order to investigate the above hypothesis the measurement and structural equivalence as well as the equality of latent means of scores across sex and age were tested. The multi-group confirmatory factor analysis results revealed that configural, metric, scalar and structural invariance exist across sex and age samples. Findings regarding the latent mean differences across sex and age groups are discussed with reference to recent and past findings.     

Multidimensional structure and measurement invariance of school engagement

This study examined the multidimensional structure and measurement invariance of a school engagement instrument using confirmatory factor analysis (CFA), exploratory structural equation modeling (ESEM), bifactor CFA (BCFA), and bifactor ESEM (BESEM). Participants consisted of 1731 students in Grades 9 - 11 from the 4-H Study of Positive Youth Development in the United States. The use of the CFA, ESEM, BCFA, and BESEM models was expected to provide more insight into the cross-loading and hierarchical structures of school engagement. We found empirical evidence to support the (a) tripartite factor structure of school engagement, (b) existence of cross-loadings and hierarchical structures, (c) measurement invariance across gender (male vs female) and race (European American vs African American), and (d) expected latent means differences by gender.     

Measurement invariance,factor analysis and factorial invariance

Several concepts are introduced and defined: measurement invariance, structural bias, weak measurement invariance, strong factorial invariance, and strict factorial invariance. It is shown that factorial invariance has implications for (weak) measurement invariance. Definitions of fairness in employment/admissions testing and salary equity are provided and it is argued that strict factorial invariance is required for fairness/equity to exist. Implications for item and test bias are developed and it is argued that item or test bias probably depends on the existence of latent variables that are irrelevant to the primary goal of test constructers.Presidential address delivered at the Annual Meeting of the Psychometric Society in Berkeley, California, June 18–20, 1993.     

Social communication fears: Factor analysis and gender invariance of the short-form of the personal report of confidence as a speaker in Spain

Public speaking is a highly prevalent fear that prevents from successful social communication. The Personal Report of Confidence as a Speaker (PRCS) is one of the most commonly used measures to assess people’s fear of public speaking. However, few studies have evaluated its factor structure. In this paper, two studies analyzed the psychometric properties of the short form of the PRCS (Hook, Smith, & Valentiner, 2008) and its convergent validity with the Self Statements During Public Speaking (SSPS) scale in Spain. Study 1 (N = 190) provided information about exploratory factor analysis and internal consistency. Study 2, with a different sample (N = 392), complemented Study 1 with confirmatory factor analysis, internal consistency, convergent validity with SSPS and test of measurement invariance across gender groups. Results of exploratory factor analysis yielded a one factor solution. Different indices of the confirmatory factor analysis (CFI, TLI, SRMR, RMSEA) confirmed a good fit. Internal consistency was high in both studies and convergent validity with SSPS was found. Evidence of configural, metric and scalar invariance across gender groups was obtained. These findings support the use of the short form of the PRCS and suggest that it is a useful instrument for public speaking assessment.     

A checklist for testing measurement invariance

The analysis of measurement invariance of latent constructs is important in research across groups, or across time. By establishing whether factor loadings, intercepts and residual variances are equivalent in a factor model that measures a latent concept, we can assure that comparisons that are made on the latent variable are valid across groups or time. Establishing measurement invariance involves running a set of increasingly constrained structural equation models, and testing whether differences between these models are significant. This paper provides a step-by-step guide to analysing measurement invariance.     

Depression Anxiety Stress Scales-21: Factor Structure and Test-Retest Invariance,and Temporal Stability and Uniqueness of Latent Factors in Older Adults

This study examined the factor structure and test-retest invariance, and temporal stability and uniqueness of the latent factors (depression, anxiety, and stress) of the Depression Anxiety Stress Scales-21 (DASS-21; Lovibond & Lovibond, 1995) in group a of 269 older adults (age ranging from 60 to 85 years) from the general community. Participants completed the DASS-21 twice, 3 months apart. Confirmatory factor analysis (CFA) of their ratings at Time 1 indicated support for the original 3-factor oblique model (factors for depression, anxiety, and stress). Additional analyses showed support for test-retest invariance for both the measurement (configural, metric and thresholds) and structural (variances and covariances) components of this model. Results also indicated temporal stability and uniqueness of the latent factors. The practical, theoretical, research and clinical implications of the findings are discussed.     

Age-related invariance of abilities measured with the Wechsler Adult Intelligence Scale--III

Examination of measurement invariance tests the assumption that the model underlying a set of test scores is directly comparable across groups. The observation of measurement invariance provides fundamental evidence for the inference that scores on a test afford equivalent measurement of the same psychological traits among diverse groups. Groups may be derived from different psychosocial backgrounds or different clinical presentations. In the Wechsler Adult Intelligence Scale-III (WAIS-III)/Wechsler Memory Scale-III (WMS-III) Technical Manual (Psychological Corporation, 2002), there appears to be a breakdown in factor structure among the standardization cases in older adults. In this study, the authors evaluated the invariance of the measurement model of the WAIS-III across 5 age bands. All components of the measurement model were examined. Overall, the evidence pointed to invariance across age of a modified 4-factor model that included cross-loadings for the Similarities and Arithmetic subtests. These results support the utility of the WAIS-III as a measure of stable intelligence traits across a wide age range.     

Factorial invariance,differential item functioning,and norms of the Orgasm Rating Scale

Background/Objective: Orgasm Rating Scale (ORS) assess the subjective orgasm experience in context of sexual relationship. It is composed of four dimensions attributed to the orgasm (Affective, Sensory, Intimacy, and Rewards). The purpose is to analyse the factorial invariance of the ORS across groups, to examine the metric equivalence across sex, and to present the standard scores. Method: A total of 1,472 Spanish adults (715 men and 757 women) were evaluated. They were distributed across age groups (18-34, 35-49 and 50 years old and older). Factorial invariance across different groups and the differential functioning of the items across sex were analyzed, internal consistency was examined, and the standard scores were developed. Results: The structure of the ORS showed strict measurement invariance across sex, relationship status, sexual orientation and education level. It also reached a scalar measurement invariance across age range and duration of the relationship. Some items showed a differential functioning between sexes. Conclusions: The Spanish version of the ORS is invariant across different groups at a factorial level, and it shows equivalence across sex in most of its items at a metric level. The standard scores allow a more accurate assessment of the subjective orgasm experience in context of sexual relationship.     

Factor structure and measurement invariance of the multidimensional driving style inventory across gender and age: An ESEM approach

The Multidimensional Driving Style Inventory (MDSI) is the most comprehensive measure of typical driving behavior to date and has been frequently used to compare driving styles across different groups of drivers, particularly between gender- and age-related groups. However, the factor structure of MDSI has not been clearly established and its measurement invariance has not been demonstrated. The goal of the present study was to examine the internal structure and measurement invariance of the MDSI across gender and age. A sample of 1277 drivers from Argentina responded to the Argentinian version of the MDSI. Exploratory structural equation modeling (ESEM) was used to test the factor structure and measurement invariance across females (n = 602) and males (n = 675), and across young (18–29, n = 558), adult (30–49, n = 395) and older (50 and older, n = 317) drivers. The results showed that a 36-item six-factor ESEM model represented by risky, angry, dissociative, anxious, distress-reduction and careful and patient driving styles was the best model based on fit indices and interpretability. Configural, weak and strong invariance of the six-factor ESEM model across gender and age was also supported. The MDSI in its Argentinian version is equivalent across gender and age, supporting the validity of previous research findings examining gender and age differences in driving styles. Future studies should examine the measurement invariance of the MDSI across other relevant driving-related variables.     

Achievement Emotions Questionnaire-Mathematics (AEQ-M) in adolescents: Factorial structure,measurement invariance and convergent validity with personality

ABSTRACT

The Achievement Emotions Questionnaire-Mathematics (AEQ-M) is a self-report measure of emotions experienced in class, when self-studying, and during tests for the domain of mathematics. Our aim was to present a Portuguese version of this instrument for use with adolescents and to test its reliability, factorial structure, measurement invariance, and construct validity with personality dimensions. Our sample comprised 1,387 Portuguese students from the 7th, 8th and 9th grades (mean age = 13.2 years). Student responses to the AEQ-M were found to be reliable. Confirmatory factor analysis validated a seven-emotion × three-setting factorial structure. This model demonstrated measurement invariance across gender and grade. As a demonstration of construct validity, the emotions measured by the AEQ-M showed a pattern of associations with psychobiological personality dimensions that were in line with theoretical predictions. These results validate the AEQ-M as a suitable instrument for assessing adolescents’ mathematics-related achievement emotions and their associations with personality.     

Stability and Invariance of Psychopathic Traits from Late Adolescence to Young Adulthood

The current study examined the longitudinal stability and invariance of psychopathic traits in a large community sample of male twins from ages 17 to 23. Participants were assessed across 6 years to gauge the stability and measurement invariance of the Minnesota Temperament Inventory (MTI), a Cleckley-based measure of psychopathic personality traits, and how family functioning and externalizing behavior were linked to these traits. A latent variable approach was used to model the structure of the MTI and provide a statistical test of measurement invariance across time. The results revealed support for invariance and moderate to strong stability of the MTI factors, which showed significant associations with the external correlates in late adolescence but not early adulthood.     

Exploring social and personal relationships: The issue of measurement invariance of non‐independent observations

In social psychology, some research questions address a comparison of individuals belonging to different social or relational contexts. As measurement invariance literature has indicated, before comparing two or more groups (gender, cultures, and relationship types), the question of whether a measurement of the construct used for the comparison is invariant must be verified. Measurement invariance helps to assure the validity of the measurement and the construct equivalence across groups. However, when non‐independent data are used for comparison (the same individual provides data for his or her different relationship types), the standard multigroup analyses for testing measurement invariance are not accurate. The current study presents a modified correlated uniqueness model that may be applied in these specific cases. As an example, we analyzed the invariance of the Intimate Disclosure scale and the Conflict scale in mother–child, father–child, and romantic relationships of young adults. Results indicate a partial invariance: only configural invariance, factor loading invariance, and factor covariance invariance were found. The consequences for validity of the measurement are then discussed. Copyright © 2014 John Wiley & Sons, Ltd.     

Measurement invariance of the Satisfaction With Life Scale (SWLS) by gender and age in Angola

Subjective well-being is a research arena that has grown almost exponentially: over the last 20 years, the number of publications on subjective well-being has increased approximately 16-fold (Diener, 2009). The cognitive aspect of subjective well-being or life satisfaction is referred to a conscious cognitive judgment of life (Diener, Emmons, Larsen, & Griffin 1985), in which person’s quality of life is globally assessed (Shin & Johnson, 1978). The Satisfaction With Life Scale (SWLS, Diener et al., 1985) is the most widely used instrument for its measurement. A reliable, valid and invariant measurement is critical for meaningful comparisons. The aim of this study is to examine the configural, metric and scalar invariance across age in the Portuguese version of the SWLS with a sample of 5630 Angolans. A standard measurement invariance procedure has been applied both across gender and age. Results shown that scalar invariance of the SWLS held across gender and age. This strong invariance allowed for meaningful latent mean comparisons. There were latent mean differences due to gender and age, but while gender differences were modest, the age differences were larger. Results are discussed in their relation with existing literature.     

Measurement invariance related to gender of the institutional integration scale

The Institutional Integration Scale (IIS) is claimed to measure five facets of college student academic and social integration. A revised two-factor model measuring the same facets but including social and academic integration in faculty and student factors was examined for invariance. Specifically, the invariance of the latent structure of the IIS across gender was investigated through multiple sample confirmatory factor analysis (MCFA). Two independent samples (n₁ = 1077, n₂ = 1547) of undergraduate students from a large Midwestern United States university made cross-validation of results possible. MCFA results revealed that the factor structure was essentially invariant and results replicated across the second sample. Latent means were not examined due to a lack of invariant intercepts.     

Psychometric properties and measurement invariance of the Weight Self-Stigma Questionnaire and Weight Bias Internalization Scale in children and adolescents

Background/ObjectiveGiven the negative consequences of weight bias, including internalized weight stigma, on health outcomes, two instruments—the Weight Self-Stigma Questionnaire (WSSQ) and Weight Bias Internalization Scale (WBIS)—have been developed. However, their psychometric properties are yet to be tested for Asian pediatric populations. Method:Participants aged 8 to 12 years (N = 287; 153 boys) completed the WSSQ and the WBIS, and they were classified into either a group with overweight or a group without overweight based on self-reported weight and height. Results:Both WSSQ and WBIS had their factor structures supported by confirmatory factor analyses (CFAs). The measurement invariance of two-factor structure was further supported for WSSQ across gender and weight status. The measurement invariance of single-factor structure was supported for WBIS across gender but not across weight status. Conclusions:WSSQ and WBIS were both valid to assess the internalization of weight bias. However, the two instruments demonstrated different properties and should be applied in different situations.     

The Borderline Personality Features Scale for Children (BPFS-C): Factor Structure and Measurement Invariance across Time and Sex in a Community-Based Sample

The factor structure and measurement invariance of the Borderline Personality Features Scale for Children (BPFS-C; Crick et al. 2005) was examined in a community-based sample of Canadian adolescents (N?=?252 boys; N?=?314 girls) assessed yearly from age 13 to age 16. Attempts to confirm the originally proposed four factor structure of the BPFS-C were not successful. Follow-up exploratory and confirmatory factor analyses provided evidence for an eleven-item, two-factor latent structure of the BPFS-C, consisting of an intra- and interpersonal preoccupation factor and an impulsivity/reactivity factor. Measurement invariance modeling provided evidence for the longitudinal invariance of the two-factor structure and suggested it possessed largely the same empirical meaning for boys and girls at each time point. Examination of latent means in the context of measurement invariance suggested that the BPFS-C two factor structure was: (1) relatively stable across mid-adolescence; and (2) relative to boys, girls showed elevations on the intra-and interpersonal preoccupation factor, providing further evidence for ‘true’ sex differences in rates of borderline personality features. The importance of measurement science for providing a solid, empirically-based foundation for developmental research on the emergence of borderline personality features in children and adolescence is discussed.     

Confirmatory factor structure and measurement invariance of the Memory Compensation Questionnaire

Recent research with the Memory Compensation Questionnaire (MCQ) has examined changes, functions, and correlates of compensatory strategy use in older adults. The twofold aim of this study was to test (a) the hypothesized structure of the MCQ and (b) structural equivalence across age, gender, and time. The 7-scale MCQ was designed to measure 5 compensatory mechanisms and 2 general aspects of compensatory awareness. The authors assembled a 3-wave (6-year) sample (N = 521; age = 55-85 years) from the Victoria Longitudinal Study. The results of structural equation modeling supported (a) the a priori structure of the MCQ and (b) the inference of measurement invariance across the 3 dimensions. Accordingly, the MCQ is available for measuring self-reported efforts to compensate for everyday memory losses.