Measurement and Predictive Invariance of a Work–Life Boundary Measure Across Gender

Pervasive gender norms influence the way in which men and women create and experience work–life boundaries and work–life conflict, which may lead to differing conceptions of work–life boundary management. Measurement equivalence/invariance (ME/I) and predictive invariance analyses were conducted on the WorkLife Indicator^TM (WLI), a measure of work–life boundary management, to determine if men and women maintain similar conceptualizations of work–life boundary constructs and if work–life outcomes are predicted equally well by WLI scales across gender. Three of the five WLI scales exhibited ME/I; however, half of the WLI scale–criterion pairings failed to demonstrate predictive invariance. These results indicate that measurement and/or predictive invariance cannot be assumed when using work–life boundary assessments across gender.     

Invariance in Measurement and Prediction Revisited

Borsboom (Psychometrika, 71:425–440, 2006) noted that recent work on measurement invariance (MI) and predictive invariance (PI) has had little impact on the practice of measurement in psychology. To understand this contention, the definitions of MI and PI are reviewed, followed by results on the consistency between the two forms of invariance in the general case. The special parametric cases of factor analysis (strict factorial invariance) and linear regression analyses (strong regression invariance) are then described, along with findings on the inconsistency between the two forms of invariance in this context. Two numerical examples of inconsistency are reviewed in detail. The impact of violations of MI on accuracy of selection is illustrated. Finally, reasons for the slow dissemination of work on invariance are discussed, and the prospects for altering this situation are weighed. This paper is based on the Presidential Address given at the International Meeting of the Psychometric Society in Tokyo, Japan, on July 11, 2007. This research was supported by National Institute of Mental Health grants 1P30 MH 068685-01A1 and RO1 MH64707-01.     

In Search of Modal Hypodoxes using Paradox Hypodox Duality

Philosophia - The concept of hypodox is dual to the concept of paradox. Whereas a paradox is incompatibly overdetermined, a hypodox is underdetermined. Indeed, many particular paradoxes have dual...     

Self-Other Differentiation Scale: Dimensionality,IRT Parameterization,and Measurement Invariance

The Self-Other Differentiation Scale (Olver, Aries, &; Batgos, 1989 Olver, R. R., Aries, E., &; Batgos, J. (1989). Self-other differentiation and the mother-child relationship: The effects of sex and birth order. The Journal of Genetic Psychology, 150, 311–321. doi:10.1080/00221325.1989.9914600[Taylor &; Francis Online] , [Google Scholar]) is a self-report instrument assessing the experience of a separate sense of self from others. The authors aimed to examine its dimensionality, reliability, and measurement invariance across gender. It was completed by 348 participants (48% men) from 17 to 30 years old in Study 1, 348 participants (40% men) from 18 to 28 years old in Study 2, and 1,068 participants (49% men) from 17 to 28 years old in Study 3. The results supported the hypothesis of just one factor underlying the scale; they also showed an appropriate internal consistency and a partial measurement invariance across gender. Results also showed evidence for a 10-item version of the scale. Globally, the Self-Other Differentiation Scale can be considered a good scale to assess individual's sense of differentiation of one's own sense of self from others.     

Factorial Structure and Measurement Invariance of the Innovative Behavior Questionnaire

The article presents an analysis of the factorial structure and measurement invariance of the Innovative Behavior Questionnaire, developed by Scott and Bruce. Although the instrument is widely used to capture individuals' innovative behavior, very little evidence concerning its psychometric properties is available. A time‐lagged study among 382 employees was conducted to check the factorial structure of the questionnaire, using confirmatory factor analysis, as well as its measurement invariance across gender and time. One‐factor structure (with correlated error terms of first three items) and strict invariance across time and across gender of the Innovative Behavior Questionnaire were demonstrated. As such, the measure can be used as a reliable tool for capturing individuals' innovative behavior by self‐report.     

Structure and Measurement Invariance of Adult Romantic Attachment

Romantic attachment is a popular theory for explaining affect, cognition, and behavior in romantic contexts. This popularity has led to a surge of self-report measures assessing dimensions of attachment. In this study, we considered the ability of 2 common attachment measures, the Adult Attachment Questionnaire (AAQ) and the Experience in Close Relationships–Revised (ECR–R), to replicate the avoidant and anxious attachment factors. We also determined the degree of measurement invariance across, and mean differences between, genders and single and nonsingle individuals. Both the AAQ (N = 650) and the ECR–R (N = 1,271) successfully distinguished avoidant and attachment factors. The AAQ showed evidence for partial strong measurement invariance, whereas the ECR-R showed strict factorial invariance for both gender and relationship status. Gender differences were detected on both measures in a direction consistent with previous research, with males exhibiting higher levels of avoidant attachment (relative to females) and females exhibiting higher levels of anxious attachment (relative to males). Furthermore, when compared to individuals who were currently single, those in romantic relationships exhibited lower levels of avoidant tendencies. This research aligns with the notion that the AAQ and ECR–R reliably assess similar constructs, across genders and single and nonsingle individuals.     

Statistical Power for a Simultaneous Test of Factorial and Predictive Invariance

A common finding in studies of differential prediction across groups is that although regression slopes are the same or similar across groups, group differences exist in regression intercepts. Building on earlier work by Birnbaum (1979) Birnbaum, M. H. 1979. “Procedures for the detection and correction of salary inequities.”. In Salary equity Edited by: Pezzullo, T. R. and Brittingham, B. F. 121–144. Lexington, MA: Lexington Books..  [Google Scholar], Millsap (1998) Millsap, R. E. 1998. Group differences in regression intercepts: Implications for factorial invariance. Multivariate Behavioral Research, 33: 403–424. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] presented an invariant factor model that would explain such intercept differences as arising due to unique variance or measurement error in the predictors and criterion. The model can be tested even when only a single predictor (p = 1) and criterion are present, but Millsap (1998) Millsap, R. E. 1998. Group differences in regression intercepts: Implications for factorial invariance. Multivariate Behavioral Research, 33: 403–424. [Taylor & Francis Online], [Web of Science ®] , [Google Scholar] only illustrated the use of the test in very large samples. The present study investigates the Type I error and power performance of the test of fit across a range of sample sizes and effect sizes in simulated data, using an alternative model that includes group differences in measurement intercepts. Surprising results showed little power for the chi-square test in the p = 1 case but good power for a diagnostic indicator based on negative unique variance estimates. The p = 2 case showed better power in modest samples. A real example from an application on reading disabilities in Share and Silva (2003) Share, D. L. and Silva, P. A. 2003. Gender bias in IQ-discrepancy and post-discrepancy definitions of reading disability. Journal of Learning Disabilities, 36: 4–14. [Crossref], [PubMed], [Web of Science ®] , [Google Scholar] is given. The implications of the results for studies of differential prediction involving group differences in regression intercepts are discussed.     

贝叶斯多组比较——渐近测量不变性

在行为科学研究领域中,检验测量工具的测量不变性是进行群体差异比较的前提。目前,多组验证性因子分析(多组CFA)方法被广泛用于检验测量不变性,但是它对跨组等值的限制过于严格,在实际应用中常常存在大量局限。贝叶斯渐近测量不变性方法基于贝叶斯思想的优良特性,放宽了传统多组CFA方法对跨组差异的严格限制,避免了传统方法的问题,具有较高的应用价值。文章详细介绍了贝叶斯渐近测量不变性方法的原理及优势,同时通过实例展示了渐近测量不变性方法在Mplus软件中的具体分析过程。     

Perfectionism in Argentina and the United States: Measurement Structure,Invariance, and Implications for Depression

The Revised Almost Perfect Scale (APS–R; Slaney, Mobley, Trippi, Ashby, &; Johnson, 1996 Slaney, R. B., Mobley, M., Trippi, J., Ashby, J. S., &; Johnson, D. (1996). Almost Perfect Scale Revised. Psyctests. doi:10.1037/t02161-000[Crossref] , [Google Scholar]) was designed to measure perfectionistic strivings (standards), perfectionistic concerns (discrepancy), and preferences for neatness and organization (order). In this study, English and Spanish (Arana, Keegan, &; Rutsztein, 2009 Arana, F. G., Keegan, E. G., &; Rutsztein, G. (2009). Adaptación de una medida multidimensional de perfeccionismo: la Almost Perfect Scale–Revised (APS–R). Un estudio preliminar sobre sus propiedades psicométricas en una muestra de estudiantes universitarios argentinos [Adaptation of a measure of multidimensional perfectionism: The Almost Perfect Scale–Revised. A preliminary study about its psychometrical properties on a sample of Argentine university students]. Evaluar, 9, 35–53. [Google Scholar]) versions of the APS–R were compared in samples of 283 college students in Argentina and 311 U.S. students. The results offered support for cross-national scalar invariance for discrepancy and order items but standards items, with a few exceptions, raised concerns about their cross-national comparability. Tests of latent means revealed no differences between the countries for discrepancy, but the order factor mean was higher in the U.S. sample. Age and gender had negligible effects on measurement models. Discrepancy was strongly related to depressive symptoms for both samples. Unlike in the U.S. sample, there was a significant association for the Argentina sample between standards and discrepancy. Overall, results indicated that discrepancy items performed well, order items were adequate with some measurement adjustments, and standards items should be revisited for their cross-cultural utility. Translation issues and general values in Argentina and the United States (e.g., collectivism–individualism) are discussed that might affect how perfectionism is understood and measured in different cultural contexts.     

网络测验和纸笔测验的测量不变性研究：以生活满意度量表为例

以生活满意度量表为例,运用实证性因素分析,考察在中国文化下网络测验和传统纸笔测验之间的测量不变性。结果显示,网络测验和纸笔测验之间存在弱不变性,即网络测验和纸笔测验有着相同的测量单位;但网络测验和纸笔测验只存在部分的强不变性和部分的严格不变性,测验实施环境对结果的影响不可忽视。该研究表明,恰当设计的网络测验是可靠的,同时还提示,当一个测验在不同情境下运用时,检验测量不变性十分必要     

心理测量平衡性研究与实例

心理测量研究中,测量不变性(或称平衡性)是量表稳定性问题中的一个难题而且在比较研究中受到特别重视。结构方程模型因在平衡性形式捕捉方面功能强大而受到广泛应用。该研究讨论了测量平衡性的各种形式并演示了应用结构方程模型评估测量平衡性的过程。     

The Factor Structure and Measurement Invariance of the Daily Spiritual Experiences Scale

The current study has two main goals: (a) to identify a factor structure of the Daily Spiritual Experiences Scale (DSES) on a large archival data, collected from 1,325 adults in the United States (709 women, 616 men) by the U.S. General Social Survey in 2004 and (b) to examine the measurement invariance of the 16 DSES items between women and men in the same data to see whether any of the items are favoring or biased toward either women or men. The one-factor confirmatory factor analysis (CFA) model fit our data better than the two-factor CFA models because of high correlations between the two factors (r > .90). The fit of the one-factor CFA to our sample data was improved when we specified seven correlated residuals suggested by overlapping item content and large modification indices. The ensuing measurement invariance testing of the one-factor CFA model with seven correlated residuals supported full measurement invariance of factor loadings, thresholds, and residual variances, as well as factor variances between the women and the men. Yet the factor mean for the women was .841 units (Cohen’s d = .496) higher than it was for the men, indicating that higher levels of daily spiritual experiences for women reported in gender comparison studies in the United States are not likely to be an artifact of bias in the questionnaire.     

Gender-Based Measurement Invariance of the Emotion Regulation Questionnaire for Children and Adolescents

The aim of this study was to evaluate the measurement invariance of the Chinese version of the Emotion Regulation Questionnaire for Children and Adolescents (ERQ-CA; Gullone and Taffe (Psychological Assessment, 24(2), 409–417, 2011)) across gender. A total of 1388 Chinese adolescents (48.1% males), ranging in age from 11 to 16 years (M = 12.9, SD = 1.09) were recruited from four Chinese middle schools and completed the ERQ-CA. The Cronbach’s α values, omega coefficients, and item-total correlations for the two subscales of the ERQ-CA indicated adequate internal consistency reliability. The results of confirmatory factor analysis and multi-group confirmatory factor analysis revealed that all configural, metric, scalar, and partial strict invariance models provided acceptable fit to the data. The result of latent means analysis demonstrated statistically non-significant differences between boys and girls. In conclusion, these findings suggest that the ERQ-CA displays appropriate measurement invariance across gender for Chinese youth of ages 11 to 16.

     

Testing the Internal Consent Scale for Measurement Invariance Across Women and Men

The Internal Consent Scale (ICS) was created to measure feelings associated with a person’s willingness to engage in partnered sexual activity. Although previous studies using the ICS have assessed gender differences, evidence has not been provided to suggest that the ICS functions similarly for women and men. Using data from an online cross-sectional survey of adults (N = 874; 53.1% women), we subjected the 25-item ICS to tests of measurement invariance across gender. We found that only partial measurement invariance was tenable, which indicated that direct comparisons across gender should be interpreted with caution when using the ICS. Therefore, we created a gender-invariant short form. In support of construct validity, we found that this 15-item ICS–Short Form demonstrated similar associations with measures of sexual consent communication as the full 25-item ICS. If researchers aim to compare women and men on internal sexual consent, we recommend using the 15-item ICS–Short Form. Cognitive interviews should be conducted to further understand how women and men might differentially interpret ICS items.

     

Consequences of Ignoring Guessing Effects on Measurement Invariance Analysis

Pseudo-guessing parameters are present in item response theory applications for many educational assessments. When sample size is not sufficiently large, the guessing parameters may be ignored from the analysis. This study examines the impact of ignoring pseudo-guessing parameters on measurement invariance analysis, specifically, on item difficulty, item discrimination, and mean and variance of ability distribution. Results show that when non-zero guessing parameters are ignored from the measurement invariance analysis, item discrimination estimates tend to decrease particularly for more difficult items, and item difficulty estimates decrease unless the items are highly discriminating and difficult. As the guessing parameter increases, the size of the decrease in item discrimination and difficulty tends to increase, and the estimated mean and variance of ability distribution tend to be inaccurate. When two groups have heterogeneous ability distributions, ignoring the guessing parameter affects the reference group and the focal group differently. Implications of result findings are discussed.     

Rationality,Dispositions, and the Newcomb Paradox

Philosophical Studies -     

Psychometric Qualities and Measurement Invariance of the Modified Self‐Rated Creativity Scale

The 13‐item self‐rated creativity scale (SRCS) initially developed for supervisory rating of employees’ creativity was modified by some researchers and used as a self‐report of creativity. However, it is not clear if the modified SRCS is psychometrically sound. The present study addressed this gap in three studies (N = 1,033). The exploratory factor analysis (Study 1) revealed a two‐factor solution after removing Item 9 due to low factor loading. Confirmatory factor analysis was then used in Study 2 to examine and compare the conceptual one‐factor model with 13 items (Model 1), one‐factor model with 12 items (Model 2), two‐factor model with 12 items (Model 3), and the 12‐item bifactor model with one general factor and two specific factors (Model 4). The results indicated that Model 4 is more superior to all the competing models. Study 3 further confirmed that the bifactor model, showed support to the reliability and convergent validity, and found partial metric invariance across Chinese and Malay undergraduates. Taken together, the modified (12‐item) SRCS is a psychometrically sound tool for self‐rated creativity in the Malaysian context.     

Measurement Invariance and Informant Discrepancies of the KIDSCREEN-27 in Children with Mental Disorder

Applied Research in Quality of Life - Study objectives were to examine measurement invariance of the KIDSCREEN-27 between children with mental disorder and their parents; compare health-related...