Item response theory analyses of the Delis-Kaplan Executive Function System card sorting subtest

In the current study, we examined the dimensionality of the 16-item Card Sorting subtest of the Delis-Kaplan Executive Functioning System assessment in a sample of 264 native English-speaking children between the ages of 9 and 15 years. We also tested for measurement invariance for these items across age and gender groups using item response theory (IRT). Results of the exploratory factor analysis indicated that a two-factor model that distinguished between verbal and perceptual items provided the best fit to the data. Although the items demonstrated measurement invariance across age groups, measurement invariance was violated for gender groups, with two items demonstrating differential item functioning for males and females. Multigroup analysis using all 16 items indicated that the items were more effective for individuals whose IRT scale scores were relatively high. A single-group explanatory IRT model using 14 non-differential item functioning items showed that for perceptual ability, females scored higher than males and that scores increased with age for both males and females; for verbal ability, the observed increase in scores across age differed for males and females. The implications of these findings are discussed.     

The Satisfaction with Life Scale in Adolescent Samples: Measurement Invariance across 24 Countries and Regions,Age, and Gender

Measurement of adolescent life satisfaction across cultures has not received much attention in previous empirical research. The present study evaluated measurement invariance of the Satisfaction with Life Scale (SWLS) among adolescents in 24 countries and regions (N = 22,710; age range = 13–19 years; 53% female). A single-factor model with residual covariance between a pair of items tapping past life satisfaction fitted well in 19 countries and regions and showed a partial metric invariance. In a subset of nine countries and regions, partial scalar invariance was supported. Partial metric invariance across all 24 countries and regions was achieved when custom model modifications in five countries and regions were included. Three SWLS items showed evidence of noninvariance across cultures. The measurement model was found to operate similarly across gender and age. Our findings suggest that caution is needed when using the SWLS for measuring life satisfaction among adolescents from different cultures.

     

Measurement invariance across gender and ethnicity on the Emotional Quotient Inventory 2.0

This study investigated the measurement invariance of the Emotional Quotient Inventory 2.0 across gender and ethnic groups in South Africa. The sample consisted of 1 144 working adults (female = 49.8%. black = 36.2%, white = 29.8%; other = 34%; age range = 18 to 74 years). Multiple group factor analysis was conducted to test for configural, metric, and scalar invariance. Results suggest that the assessment is largely invariant at configural and metric levels across gender and ethnic groups. At scalar level, full invariance was achieved for ten of the fifteen scales across gender and one scale across ethnicity. Partial scalar models were explored for all other scales. Overall, the evidence seems to suggest that the scores from the Emotional Quotient Inventory 2.0 scales had similar meanings for different gender and ethnic groups. However, for a few scales across gender, and more so for ethnicity, it seems that participant responses might also be influenced by factors other than the underlying latent constructs. Thus, while the scales of the assessment appears to be largely invariant at the configural and metric levels, a more nuanced picture emerged at scalar level with partially invariant models, especially across ethnic groups.     

Measurement invariance of the appearance schemas inventory-revised and the body image quality of life inventory across age and gender

The majority of body image measures have largely been developed with younger female samples. Before these measures can be applied to men, and to middle-aged and older women, and used to make gender and age comparisons, they must exhibit adequate cross-group measurement invariance. This study examined the age and gender cross-group measurement invariance of the Appearance Schemas Inventory-Revised (ASI-R) and the Body Image Quality of Life Inventory (BIQLI), with a sample of 1,262 adults (422 men and 840 women) aged 18 to 98 years. For the ASI-R, all groups met requirements for configural and metric invariance. Scalar invariance was found only for the three age groups, which indicated that mean comparisons may be conducted across gender for young, middle-aged, and older adults but should not be conducted across age groups within either gender. Results for the BIQLI indicated that observed mean comparisons may be conducted across all age and gender groups.     

A gender-based measurement invariance study of the Sociocultural Attitudes Toward Appearance Questionnaire-3

The current study sought to explore the measurement invariance of the SATAQ-3 across gender using a single mixed gender sample consisting of 122 men and 268 women. Participants' age ranged from 18 to 36 years (M=19.6, SD=1.9). Preliminary results indicate that the 28 item scale was a poor fit for either gender in the current sample. Reverse scored items were deleted as they formed a unique method factor with low factor loadings. The resulting 21 items were a good fit to the hypothesized four factor model for both males and females and established evidence of both strict factorial invariance and population heterogeneity across groups. Coefficient alpha estimates of internal consistency reliability ranged from .79 to .94. These findings support use of the SATAQ-3 in mixed gender samples and validate previous research that reported analysis of gender-based mean differences.     

Factorial invariance,differential item functioning,and norms of the Orgasm Rating Scale

Background/Objective: Orgasm Rating Scale (ORS) assess the subjective orgasm experience in context of sexual relationship. It is composed of four dimensions attributed to the orgasm (Affective, Sensory, Intimacy, and Rewards). The purpose is to analyse the factorial invariance of the ORS across groups, to examine the metric equivalence across sex, and to present the standard scores. Method: A total of 1,472 Spanish adults (715 men and 757 women) were evaluated. They were distributed across age groups (18-34, 35-49 and 50 years old and older). Factorial invariance across different groups and the differential functioning of the items across sex were analyzed, internal consistency was examined, and the standard scores were developed. Results: The structure of the ORS showed strict measurement invariance across sex, relationship status, sexual orientation and education level. It also reached a scalar measurement invariance across age range and duration of the relationship. Some items showed a differential functioning between sexes. Conclusions: The Spanish version of the ORS is invariant across different groups at a factorial level, and it shows equivalence across sex in most of its items at a metric level. The standard scores allow a more accurate assessment of the subjective orgasm experience in context of sexual relationship.     

Measurement invariance of the Satisfaction With Life Scale (SWLS) by gender and age in Angola

Subjective well-being is a research arena that has grown almost exponentially: over the last 20 years, the number of publications on subjective well-being has increased approximately 16-fold (Diener, 2009). The cognitive aspect of subjective well-being or life satisfaction is referred to a conscious cognitive judgment of life (Diener, Emmons, Larsen, & Griffin 1985), in which person’s quality of life is globally assessed (Shin & Johnson, 1978). The Satisfaction With Life Scale (SWLS, Diener et al., 1985) is the most widely used instrument for its measurement. A reliable, valid and invariant measurement is critical for meaningful comparisons. The aim of this study is to examine the configural, metric and scalar invariance across age in the Portuguese version of the SWLS with a sample of 5630 Angolans. A standard measurement invariance procedure has been applied both across gender and age. Results shown that scalar invariance of the SWLS held across gender and age. This strong invariance allowed for meaningful latent mean comparisons. There were latent mean differences due to gender and age, but while gender differences were modest, the age differences were larger. Results are discussed in their relation with existing literature.     

正念注意觉知量表儿童版~MAAS-C在中国城市及农村儿童中使用的信效度检验

目的:修订中文版正念注意觉知量表儿童版(the Mindful Attention Awareness Scale—Children,MAAS-C),考察其在中国文化背景下的适用性及信效度。方法:城市及农村地区共619名小学4-6年级学生参与研究。对数据进行项目分析、探索性因素分析、验证性因素分析、信度分析、效标关联效度分析、性别及城乡地区等值性检验。结果:中文版MAAS-C为单维结构,具有良好的结构效度、效标效度及信度。测量不变性检验表明,该量表在不同性别儿童间达到严格等值,城乡地区儿童间达到弱等值。结论:正念觉知量表儿童版的中文版本各项心理测量学指标良好,适宜在我国儿童群体中使用。     

Psychometric Properties of the Training Parenting Style Scale in a Malaysian Sample of Adolescents: Factor Analysis,Internal Consistency,and Measurement Invariance

The importance of parenting styles on children’s outcomes, including cognitive, social, academic, and values makes this topic a central concern to social researchers and psychologists. However, past research has reported controversial evidence on the relationship between authoritarian parenting and children’s outcomes in non-Western cultural contexts. This raises awareness on the implication of cultural differences in parenting styles. As a result, the training parenting style scale (TPSS) was proposed based on the Confucian concept of ‘Guan’ and ‘Chiao Shu.’ This scale is allegedly more reflective of the Asian parenting style. The present study examined the psychometric properties and measurement invariance of the Malay version of the TPSS across adolescents’ perceived maternal and paternal training and by adolescent gender. Of the 8 items in the original TPSS, confirmatory factor analysis supported 6-item scale with error correlations was the best-fitting model. Internal consistency was also good for the 6-item scale. Furthermore, support for configural, metric, scalar, residual, and structural invariance emerged across adolescents’ perceived maternal and paternal training and across adolescent gender. Results of this study supported the psychometric properties of the 6-item TPSS after taking into account several cautiously considered limitations.     

网络测验和纸笔测验的测量不变性研究：以生活满意度量表为例

以生活满意度量表为例,运用实证性因素分析,考察在中国文化下网络测验和传统纸笔测验之间的测量不变性。结果显示,网络测验和纸笔测验之间存在弱不变性,即网络测验和纸笔测验有着相同的测量单位;但网络测验和纸笔测验只存在部分的强不变性和部分的严格不变性,测验实施环境对结果的影响不可忽视。该研究表明,恰当设计的网络测验是可靠的,同时还提示,当一个测验在不同情境下运用时,检验测量不变性十分必要     

Measuring anxiety by ordered categorical items in data with subgroup structure: the case of the Hungarian version of the trait anxiety scale of the state-trait anxiety inventory for children (staic-h)

The present study suggests a modelling methodology for examining measurement invariance of ordered categorical item indicators of latent constructs such as anxiety, coping, motives etc., in research settings with few subgroups and a large sample of individuals. The Hungarian version of the Anxiety Trait scale of the State-Trait Anxiety Inventory for Children (STAIC-H) was administered to 605 boys and 975 girls of age 10–15 in 12 schools. A MIMIC model was suggested for examining measurement invariance across subgroups of schools and ages, while a multi-group analysis was recommended for investigating invariance across gender. High degree of invariance across groups was obtained for the Anxiety Trait scale in terms of item factor loadings, item thresholds and item homogeneity with respect to group contrast variables. Based on the diagnostic information obtained by the present methodology, the few item indicators showing non-invariance were discussed with reference to methodological and conceptual considerations.     

Factor structure and measurement invariance of the multidimensional driving style inventory across gender and age: An ESEM approach

The Multidimensional Driving Style Inventory (MDSI) is the most comprehensive measure of typical driving behavior to date and has been frequently used to compare driving styles across different groups of drivers, particularly between gender- and age-related groups. However, the factor structure of MDSI has not been clearly established and its measurement invariance has not been demonstrated. The goal of the present study was to examine the internal structure and measurement invariance of the MDSI across gender and age. A sample of 1277 drivers from Argentina responded to the Argentinian version of the MDSI. Exploratory structural equation modeling (ESEM) was used to test the factor structure and measurement invariance across females (n = 602) and males (n = 675), and across young (18–29, n = 558), adult (30–49, n = 395) and older (50 and older, n = 317) drivers. The results showed that a 36-item six-factor ESEM model represented by risky, angry, dissociative, anxious, distress-reduction and careful and patient driving styles was the best model based on fit indices and interpretability. Configural, weak and strong invariance of the six-factor ESEM model across gender and age was also supported. The MDSI in its Argentinian version is equivalent across gender and age, supporting the validity of previous research findings examining gender and age differences in driving styles. Future studies should examine the measurement invariance of the MDSI across other relevant driving-related variables.     

Does body dissatisfaction have the same meaning for males and females? A measurement invariance study

ObjectivesThe aim of this study was to assess the psychometric equivalence of body dissatisfaction (BD) between males and females.MethodTwo scales, BD and Drive to Thinness (DT), from the Eating Disorder Inventory-3 were evaluated. The sample was comprised of 1616 adolescent males and 1429 adolescent females. Factorial invariance across gender of two scales was assessed in order to evaluate the equivalence of scores.ResultsThe results showed full invariance for the DT scale items, and partial invariance for BD scale items. The content analysis of the items confirmed that items related to the perception of thighs, stomach and hips showed differential functioning across gender.ConclusionsDifferent representation of the BD construct between males and females was concluded, and caution was recommended in assessing and interpreting BD in male samples with questionnaires designed for women.     

The Eyberg Child Behavior Inventory: Factorial invariance in problem behaviors across gender and age

The Eyberg Child Behavior Inventory (ECBI) assesses problem behaviors in children, and is a widely used instrument in both clinical work and research. Evidence suggests that the short ECBI version, comprising 22 items, can be reduced into the three oblique factors: Oppositional defiant behavior; Conduct problem behavior; and Inattentive behavior. The present study aimed to evaluate this three‐factor model in a Norwegian sample of 554 children, and examine multi‐group invariance across gender and age. Consistent with previous research, results confirmed a tripartite model, with the same residual covariances and cross‐loading appearing across groups. Multi‐group confirmatory factor analysis demonstrated partial measurement invariance across gender and age. Overall, findings support a meaningful comparison of the short ECBI across gender and age. The study makes a contribution to the generalizability issue of the ECBI.     

Confirming the three-factor structure of the quality of relationships inventory within couples

The current study further validates the Quality of Relationships Inventory (QRI; G. R. Pierce, I. G. Sarason, & B. R. Sarason, 1991) by evaluating its factor structure in a sample of 572 partners from 286 couples. Confirmatory factor analysis was used to compare 3 different models of the QRI and to investigate the invariance of the factor structure of the QRI across gender and across relationship satisfaction. Analyses revealed that a 3-factor solution--consisting of 3 different but interrelated factors (a 7-item support factor, a 12-item conflict factor, and a 6-item depth factor)--best accounted for the data. The authors' findings suggest that full metric invariance holds across gender and across relationship satisfaction in the female subsample, whereas only partial metric invariance could be established for relationship satisfaction in the male subsample.     

Measurement Invariance of Personal Well-Being Index (PWI-8) Across 26 Countries

This report examines the measurement invariance of the Personal Well-being Index with 8 items (PWI-8). University students (N = 5731) from 26 countries completed the measure either through paper and pencil or electronic mode. We examined uni-dimensional structure of PWI and performed a Multi-group CFA to assess the measurement invariance across the 26 countries, using conventional approach and the alignment procedure. The findings provide evidence of configural and partial metric invariance, as well as partial scalar invariance across samples. The findings suggest that PWI-8 can be used to examine correlates of life satisfaction across all included countries, however it is impossible to compare raw scores across countries.     

Examining the cross‐cultural validity of the positive affect and negative affect schedule between an Asian (Singaporean) sample and a Western (American) sample

The positive affect and negative affect schedule (PANAS) is a popular measure of positive (PA) and negative affectivity (NA). Developed and validated in Western contexts, the 20‐item scale has been frequently administered on respondents from Asian countries with the assumption of cross‐cultural measurement invariance. We examine this assumption via a rigorous multigroup confirmatory factor analysis, which allows us to assess between‐group differences in both strength of scale item‐to‐latent factor relationship (metric invariance test) and mean of each scale item (scalar invariance test), on a large sample of 1,065 respondents recruited from Singapore (Asian sample) and the United States (Western sample). We found that two items assessing PA (“excited” and “proud”) and three items assessing NA (“guilty,” “hostile,” and “ashamed”) exhibited metric noninvariance whereas 11 of the remaining metric invariant items exhibited scalar noninvariance, suggesting that the PA and NA constructs differ from what the PANAS is expected to measure for Asian respondents. Our findings serve as a cautionary note to researchers who intend to administer the PANAS in future studies as well as to researchers interpreting the results of past studies involving respondents from Asian countries.     

The Multidimensional Scale of Perceived Social Support: Analyses of Internal Reliability,Measurement Invariance,and Correlates Across Gender

In this study, we examined estimates of internal consistency reliability, measurement invariance, and differential correlates of the Multidimensional Scale of Perceived Social Support (MSPSS; Zimet, Dahlem, Zimet, & Farley, 1988) in samples of undergraduate men (n = 270) and women (n = 340). The MSPSS is designed to assess 3 sources of perceived social support: family, friends, and significant others. The participants ranged in age from 18 to 24 years (M _age = 19.60, SD = 1.4 years). First, composite scale reliability and coefficient omega methods provided adequate estimates of internal consistency reliability for the original MSPSS total and subscale scores. Second, results of multiple-groups invariance confirmatory factor analysis provided support for configural and metric invariance. Partial measurement invariance was attained for scalar and strict measurement invariance across men and women. Additionally, given the high correlations among the first-order factors, we conducted multiple-groups bifactor item response theory (bifactor-IRT) analysis to evaluate further the performances of the individual MSPSS items across gender. Support for the bifactor model was strong. Third, we conducted a series of simultaneous regression analyses to identify potential correlates of the social support construct for women and men.     

Factorial structure and age-related psychometrics of the MIDUS personality adjective items across the life span

The present study addresses issues of measurement invariance and comparability of factor parameters of Big Five personality adjective items across age. Data from the Midlife in the United States (MIDUS) survey were used to investigate age-related developmental psychometrics of the MIDUS personality adjective items in 2 large cross-sectional samples (exploratory sample: N = 862; analysis sample: N = 3,000). After having established and replicated a comprehensive 5-factor structure of the measure, increasing levels of measurement invariance were tested across 10 age groups. Results indicate that the measure demonstrates strict measurement invariance in terms of number of factors and factor loadings. Also, we found that factor variances and covariances were equal across age groups. By contrast, a number of age-related factor mean differences emerged. The practical implications of these results are discussed, and future research is suggested.     

The Psychometric Evaluation of the Satisfaction with Life Scale Using a Nationally Representative Sample of China

This study examined the psychometric properties of the Satisfaction with Life Scale (SWLS) in terms of internal consistency reliability, factorial validity, and measurement invariance across gender, age, residential region (metropolitan area/county town/rural area), educational level, and household income with a nationally representative sample of 4,795 participants in China. The percentages of male (47.0%) and female (53.0%) participants were about equal, and the mean age was 38.56 years (SD = 11.87). The results show that the SWLS has a high internal consistency reliability, a one-factor structure (with a wording effect on Items 4 and 5), strict invariance across gender, partial strict invariance across education (Items 1, 2 and 3), and partial strong invariance across age, income (Items 1, 2 and 3) and residential region (Items 1 and 2). The non-invariance of some items across age and region is discussed in terms of the rapid economic and social transitions of China in the past three decades.