A gender-based measurement invariance study of the Sociocultural Attitudes Toward Appearance Questionnaire-3

The current study sought to explore the measurement invariance of the SATAQ-3 across gender using a single mixed gender sample consisting of 122 men and 268 women. Participants' age ranged from 18 to 36 years (M=19.6, SD=1.9). Preliminary results indicate that the 28 item scale was a poor fit for either gender in the current sample. Reverse scored items were deleted as they formed a unique method factor with low factor loadings. The resulting 21 items were a good fit to the hypothesized four factor model for both males and females and established evidence of both strict factorial invariance and population heterogeneity across groups. Coefficient alpha estimates of internal consistency reliability ranged from .79 to .94. These findings support use of the SATAQ-3 in mixed gender samples and validate previous research that reported analysis of gender-based mean differences.     

Dimensions of perfectionism and goal commitment: A further comparison of two perfectionism measures

Research on perfectionism has suggested that a strong association exists between the setting and striving for excessively high standards. However, the motivational aspects of perfectionism have yet to be empirically identified. The purpose of the present study was to evaluate the usefulness and psychometric properties of a new goal commitment scale by assessing commitment to perfection in seven content areas. In addition to identifying individual differences in perfectionism goal commitment, the current research also investigated the association between commitment to perfectionism and trait indices of perfectionism. A sample of 261 students rated degree of commitment to perfectionistic goals and completed two multidimensional perfectionism scales that assess the personal and social aspects of perfectionism. Analyses confirmed the presence of individual differences in perfectionism goal commitment. Correlational tests revealed that the trait perfectionism dimensions were correlated with the goal commitment measure, but the findings varied as a function of the specific perfectionism goal. Overall, the current data are consistent with the view that the perfectionism construct has a salient motivational component. Our findings suggest that the assessment of goal commitment is a useful means of examining specific facets of the perfectionism construct.     

A nonparametric item analysis of a selected item subset of the Learning Process Questionnaire

Background: Although there have been numerous studies conducted on the psychometric properties of Biggs' Learning Process Questionnaire (LPQ), these have involved the use of traditional omnibus measures of scale quality such as corrected item total correlations, internal consistency estimates of reliability, and factor analysis. However, these omnibus measures of scale quality are sample dependent and fail to model item responses as a function of trait level. And since the item trait relationship is typically nonlinear, traditional factor analytic methods are inappropriate. Aims: The purpose of this study was to identify a unidimensional subset of LPQ items and examine the effectiveness of these items and their options in discriminating between changes in the underlying trait level. In addition to assessing item quality, we were interested in assessing overall scale quality with non‐sample dependent measures. Method: The sample was split into two nearly equal halves, and a undimensional subset of items was identified in one of these samples and cross‐validated in the other. The nonlinear relationship between the probability of endorsing an item option and the underlying trait level was modelled using a nonparametric latent trait technique known as kernel smoothing and implemented with the program TestGraf. After item and scale quality were established, maximum likelihood estimates of participants' trait level were obtained and used to examine grade and gender differences. Results: A undimensional subset of 16 deep and achieving items was identified. Slightly more than half of these items needed some of their options combined so that the probability of endorsing an item option as a function of increasing trait level corresponded to the ideal rank ordering of the item options. With this adjustment, scale quality as measured by the information function and standard error function was found to be good. However, no statistically significant gender differences were observed and, although statistically significant grade differences were observed, they were not substantively meaningful. Conclusions: The use of nonparametric kernel‐smoothing techniques is advocated over parametric latent trait methods for the analysis of attitudinal and psychological measures involving polychotomous ordered‐response categories. It is also suggested that latent trait methods are more appropriate than traditional test‐based measures for studying differential item functioning both within and between cultures. Nonparametric kernel‐smoothing techniques hold particular promise in identifying and understanding cross‐cultural differences in student approaches to learning at both the item and scale level.     

Assessing relationship quality across cultures: An examination of measurement equivalence

Researchers are increasingly studying close relationships across cultural contexts. One issue that arises when applying scales originally developed in Western countries to a different cultural context is measurement invariance. Researchers often do not examine whether scales show invariance across cultures and thus can be used with confidence. The goal of this article is to discuss the importance of measurement invariance, to discuss what testing invariance involves, and to test the measurement properties of scales of relationship satisfaction, commitment, intimacy, and trust across 4 samples (United States, Canada, Indonesia, and China). Analyses indicated that weak measurement invariance was met for all 4 scales, and assumptions of strong measurement invariance had to be relaxed for only a few items in each scale. Findings are discussed and recommendations are made regarding using these or other scales that have been shown to meet assumptions of invariance across different cultural groups.     

Examining the cross‐cultural validity of the positive affect and negative affect schedule between an Asian (Singaporean) sample and a Western (American) sample

The positive affect and negative affect schedule (PANAS) is a popular measure of positive (PA) and negative affectivity (NA). Developed and validated in Western contexts, the 20‐item scale has been frequently administered on respondents from Asian countries with the assumption of cross‐cultural measurement invariance. We examine this assumption via a rigorous multigroup confirmatory factor analysis, which allows us to assess between‐group differences in both strength of scale item‐to‐latent factor relationship (metric invariance test) and mean of each scale item (scalar invariance test), on a large sample of 1,065 respondents recruited from Singapore (Asian sample) and the United States (Western sample). We found that two items assessing PA (“excited” and “proud”) and three items assessing NA (“guilty,” “hostile,” and “ashamed”) exhibited metric noninvariance whereas 11 of the remaining metric invariant items exhibited scalar noninvariance, suggesting that the PA and NA constructs differ from what the PANAS is expected to measure for Asian respondents. Our findings serve as a cautionary note to researchers who intend to administer the PANAS in future studies as well as to researchers interpreting the results of past studies involving respondents from Asian countries.     

Revisiting the Psychometric Properties of the Levenson Self-Report Psychopathy Scale

A number of studies have addressed the dimensionality and the measurement invariance of the Levenson Self-Report Psychopathy scale (LSRP; Levenson, Kiehl, & Fitzpatrick, 1995). However, previous investigations exclusively relied on North American samples and mainly on statistical methods that assume data as normally and continuously distributed. The aim of this study was to further investigate dimensionality and differential item functioning for gender in the 26-item LSRP scale in a Brazilian population-based sample using analytical methods adequate for ordered categorical variables. Findings revealed strong evidence for a 2-factor model, similar to the original factor structure of the instrument. Only 3 items presented negligible differential functioning for gender. We address the implications of these results, and stress the need for expanding research on the measurement and structural invariance of the LSRP scale by means of cross-cultural investigations.     

Five-item Francis scale of attitude toward Christianity: construct and nomological validity and internal consistency among Colombian college students

The Spanish version of the five-item Francis scale of attitude toward Christianity is a refinement of the short version of the Francis scale of attitude toward Christianity. The scale is a good measurement for intrinsic religiosity. It has been applied previously among Colombian adolescent students. The internal consistency and construct and nomological validity were tested among a sample of 1349 Colombian college students from Santa Marta, Colombia. Participants were aged between 18- and 30-years-old; 51% were men; and 68% were social science students. Exploratory analysis factor, Cronbach alpha and omega McDonald were computed. The scale showed high internal consistency (both alpha and omega = .96) and excellent construct and nomological validity (one factor which explained for 88% of variance; women scored higher than men; and Protestants scored higher than Catholics and students with other religion filiations). The five-item Francis scale can be used further researches in Hispano-America among college students.     

Methodological challenges in union commitment studies

Methodological problems in studies of union commitment were identified and illustrated with data from 4,641 members and 479 stewards in 297 local teachers' unions. Using a 20-item union commitment scale, results confirmed the existence of 3 substantive factors and 1 method factor at the individual level of analysis: loyalty to the union, responsibility to the union, willingness to work for the union, and a factor of negatively worded items. Tests of measurement invariance showed that the scale captured commitment for rank-and-file members but not for union stewards. The authors also found partial measurement invariance between long-time and newer members and full measurement invariance between men and women. Finally, the authors found that violation of the statistical assumption of independence reduced model fit when individual commitment scores were analyzed without attention to the hierarchical nature of the data.     

Goal commitment and the goal-setting process: conceptual clarification and empirical synthesis

Goals are central to current treatments of work motivation, and goal commitment is a critical construct in understanding the relationship between goals and task performance. Despite this importance, there is confusion about the role of goal commitment and only recently has this key construct received the empirical attention it warrants. This meta-analysis, based on 83 independent samples, updates the goal commitment literature by summarizing the accumulated evidence on the antecedents and consequences of goal commitment. Using this aggregate empirical evidence, the role of goal commitment in the goal-setting process is clarified and key areas for future research are identified.     

Dimensions of Identity Development Scale (DIDS): A test of longitudinal measurement invariance in Greek adolescents

Identity is one core developmental task of adolescence. Although Marcia’s model, comprising of the dimensions of exploration and commitment, has dominated identity research for decades new models have recently been proposed. Luyckx and colleagues’ model poses that identity is a process consisting of five aspects: Exploration in Breadth, Commitment Making, Ruminative Exploration, Exploration in Depth and Identification with Commitments. The Dimensions of Identity Development Scale (DIDS) is a 25-item instrument developed to assess those five aspects. The goal of this study is: (a) to test the applicability of DIDS in a sample of Greek adolescents, and (b) to investigate the longitudinal measurement invariance of the scale. The results support the use of DIDS in Greek context and show that strong measurement invariance holds longitudinally in the course of 12 months. Echoing recent studies, the six-factor model showed significantly better fit, with Exploration in Depth splitting to Exploration in Depth and Reconsideration of Commitment. The scale is suitable for studies of longitudinal change in identity development.     

A comprehensive model and measure of compensation satisfaction

We describe the results of two studies designed to develop a comprehensive theoretical model and measure of compensation satisfaction. Our typology of compensation satisfaction consists of seven dimensions: four for pay (level, structure, raises, and variable pay procedures satisfaction) and three dimensions for benefits (level, determination, and administration satisfaction). We used new and existing items to develop the Comprehensive Compensation Satisfaction Questionnaire. In Study 1, we report the results of exploratory factor analysis that supports a seven‐factor structure. In Study 2, confirmatory factor analysis supported the same seven‐factor structure in a different sample. We examined relationships between the compensation satisfaction dimensions and their antecedents and consequences. Seven hypotheses regarding differential antecedents of compensation satisfaction were supported. Satisfaction with aspects of compensation procedures were related to perceived organizational support, and perceived organizational support mediated the relationships between these compensation satisfaction procedures and affective commitment and turnover intentions. Our final analysis yielded a 29‐item scale (including eight new items) which we recommend for use in future compensation satisfaction research.     

Factorial structure and age-related psychometrics of the MIDUS personality adjective items across the life span

The present study addresses issues of measurement invariance and comparability of factor parameters of Big Five personality adjective items across age. Data from the Midlife in the United States (MIDUS) survey were used to investigate age-related developmental psychometrics of the MIDUS personality adjective items in 2 large cross-sectional samples (exploratory sample: N = 862; analysis sample: N = 3,000). After having established and replicated a comprehensive 5-factor structure of the measure, increasing levels of measurement invariance were tested across 10 age groups. Results indicate that the measure demonstrates strict measurement invariance in terms of number of factors and factor loadings. Also, we found that factor variances and covariances were equal across age groups. By contrast, a number of age-related factor mean differences emerged. The practical implications of these results are discussed, and future research is suggested.     

The Clergy Occupational Distress Index (CODI): Background and Findings from Two Samples of Clergy

This study demonstrates the reliability and validity of the Clergy Occupational Distress Index (CODI). The five-item index allows researchers to measure the frequency that clergy, who traditionally have not been the subject of occupational health studies, experience occupational distress. We assess the reliability and validity of the index using two samples of clergy: a nationally representative sample of clergy and a sample of clergy from nine Protestant denominations. Exploratory factor analysis and Cronbach’s scores are generated. Construct validity is measured by examining the association between CODI scores and depressive symptoms while controlling for demographic, ministerial, and health variables. In both samples, the five items of the CODI load onto a single factor and the Cronbach’s alpha scores are robust. The regression model indicates that a high score on the CODI (i.e., more frequent occupational distress) is positively associated with having depressive symptoms within the last 4 weeks. The CODI can be used to identify clergy who frequently experience occupational distress and to understand how occupational distress affects clergy’s health, ministerial career, and the functioning of their congregation.     

Exploring Nonlinear Models in Personality Assessment: Development and Preliminary Validation of a Negative Emotionality Scale

ABSTRACT In this article we discuss the applicability of several new measurement models to the construction of personality scales, and we contrast these models with more traditional approaches in common usage, such as the principal factor analysis model. Our goal is to illustrate how nonlinear item-response models can be profitably used in personality research. We describe the development of a 30-item Negative Emotionality scale that was constructed using nonlinear factor analysis and item-response theory. We also show how traditional (linear) factor analysis can produce misleading results when it is applied to personality items with dichotomous response formats (e.g., true/false, agree/disagree). No formal training in modern measurement theory is assumed of the reader as we describe the nonlinear models that are used in this study in nontechnical language with a minimum of mathematics.     

Evaluating a Brief Scale Measuring Psychological Climate for Sexual Harassment

We evaluated the measurement properties of the psychological climate for sexual harassment (PCSH) questionnaire with data from women officers (n?=?311) in the Swedish Armed Forces. Confirmatory factor analyses indicated that a two-factor solution assessing risks and seriousness/actions associated with sexual harassment episodes described the underlying pattern of correlations among items. Correlational and regression analyses showed that ratings of perceived intolerance for sexual harassment were associated with high ratings of job satisfaction, organizational commitment, and (positive) mental health; and decreased ratings of psychological distress. We discuss the theoretical, methodological, and practical implications of our findings for future research.     

A validation study of goal orientations and self-efficacy scales

The aim of the current study was to investigate the validity and reliability of goal orientation and self-efficacy scales. The scales were administered to 264 university students (154 from engineering departments, 110 from business administration). Two samples were used. In the first sample, the original factor model was tested with confirmatory factor analysis. In the second sample, the Turkish versions of the scales were factor analyzed. Principal components analysis resulted in three components for the Goal Orientation scale: Learning goal orientation, Performance-prove goal orientation, and Performance-avoid goal orientation. The Self-efficacy scale had one factor as expected. Cronbach's alpha coefficients were satisfactory. The results did not fully support the use of current Turkish versions of the scales. Results of the studies are discussed along with the strengths and limitations of the study and suggestions for further development of the scales.     

Item grouping and item randomization in personality measurement

This paper describes a study examining the impact of item order in personality measurement on reliability, measurement equivalence and scale-level correlations. A large sample of university students completed one of three forms of the International Personality Item Pool version of the Big Five personality inventory: items sorted at random, items sorted by factor, and items cycled through factors. Results showed that the underlying measurement model and the internal consistency of the IPIP-Big Five scale was unaffected by differences in item order. Also, most of the scale-level correlations among factors were not significantly different across forms. Implications for the administration of tests and interpretation of test scores are discussed, and future research directions are offered.     

Development of a prototype‐based measure of relational boredom

The goal of this research was to create a self‐report measure of relational boredom using a prototype approach. In the first study, 2 samples (participants in dating relationships and in marital relationships) generated features of the concept of relational boredom. In Study 2, these features were rated for prototypicality by 2 samples (dating and married). A Relational Boredom Scale was constructed by selecting those features (items) that were rated as most central to the construct. In Study 3, the reliability and validity of the scale were assessed, again with participants in dating and marital relationships. There was evidence that the Relational Boredom Scale is a psychometrically sound measurement instrument.     

Extending self‐leadership research to the East: Measurement equivalence of the Chinese and English versions of the MSLQ

In response to calls regarding the applicability of self‐leadership measurement in Eastern (collectivistic) and Western (individualistic) cultures, this study examined the psychometric properties and measurement invariance of the modified self‐leadership questionnaire (MSLQ). The sample consisted of 395 Chinese students and 241 Australian students. Results revealed that the modified self‐leadership questionnaire exhibited a satisfactory condition of psychometric properties across cultures. A series of multi‐sample confirmatory factor analyses demonstrated the cross‐cultural similarity of an 11‐factor model across the Chinese and Australian samples. The modified self‐leadership questionnaire was also found to possess measurement invariance, suggesting that it is appropriate for cross‐cultural research assessing differences of self‐leadership behaviour across Chinese and Western cultures. Implications for future research are also discussed.     

青少年心理韧性量表的编制和效度验证

心理韧性（resilience）是积极心理学的热点课题。虽然国外已有很多测量工具,但在中国群体中的适用性未得到支持。基于心理韧性的过程模型,通过访谈法开发适合我国青少年群体的心理韧性测量工具。通过访谈25名经历过较大负性生活事件而又适应良好的中学生,编制出100个题目,在283名青少年中初测,通过项目鉴别度分析和探索性因素分析,保留了27个题目,包含目标专注、情绪控制、积极认知、家庭支持和人际协助五个因子,α均大于0.7。复测样本包含420名青少年,验证性因素分析支持了量表的结构效度,二阶因素分析发现前3个因子属于个人力,后2个因子属于支持力。以其他心理韧性量表（RS）和中学生生存质量为关联效标,皮尔逊相关分别为0.53和0.49,支持了量表的外部效度。文章最后讨论了我国青少年心理韧性结构的文化意义及量表的应用范围