Cross‐cultural Generalizability of the Alternative Five‐factor Model Using the Zuckerman–Kuhlman–Aluja Personality Questionnaire

Several personality models are known for being replicable across cultures, such as the Five‐Factor Model (FFM) or Eysenck's Psychoticism–Extraversion–Neuroticism (PEN) model, and are for this reason considered universal. The aim of the current study was to evaluate the cross‐cultural replicability of the recently revised Alternative FFM (AFFM). A total of 15 048 participants from 23 cultures completed the Zuckerman–Kuhlman–Aluja Personality Questionnaire (ZKA‐PQ) aimed at assessing personality according to this revised AFFM. Internal consistencies, gender differences and correlations with age were similar across cultures for all five factors and facet scales. The AFFM structure was very similar across samples and can be considered as highly replicable with total congruence coefficients ranging from .94 to .99. Measurement invariance across cultures was assessed using multi‐group confirmatory factor analyses, and each higher‐order personality factor did reach configural and metric invariance. Scalar invariance was never reached, which implies that culture‐specific norms should be considered. The underlying structure of the ZKA‐PQ replicates well across cultures, suggesting that this questionnaire can be used in a large diversity of cultures and that the AFFM might be as universal as the FFM or the PEN model. This suggests that more research is needed to identify and define an integrative framework underlying these personality models. Copyright © 2016 European Association of Personality Psychology     

Comparing OECD PISA Reading in English to Other Languages: Identifying Potential Sources of Non-Invariance

The use of the Programme for International Student Assessment (PISA) across nations, cultures, and languages has been criticized. The key criticisms point to the linguistic and cultural biases potentially underlying the design of reading comprehension tests, raising doubts about the legitimacy of comparisons across economies. Our research focused on the type and magnitude of invariance or non-invariance in the PISA Reading Comprehension test by language, culture, and economic development relative to performance of the Australian English-speaking reference group used to develop the tests. Multi-Group Confirmatory Factor Analysis based on means and covariance structure (MACS) modeling was used to establish a d_MACS effect size index for each economy for the degree of non-invariance. Only three wealthy, English-speaking countries had scalar invariance with Australia. Moderate or large effects were observed in just 31% of the comparisons. PISA index of economic, social and cultural status had a moderate inverse correlation with dMACS suggesting that socioeconomic resourcing of education played a significant role in measurement invariance, while educational practice and language factors seemed to play a further small role in non-invariance. Alternative approaches to reporting PISA results consistent with non-invariance are suggested.     

Construct validity and construct equivalence of work values across boys and girls

This study investigated the structural validity and construct comparability, across boys and girls, of a newly developed measure of work values. The total sample was split into two equal parts, and based on an item-level factor analysis of the first sub-sample, fit statistics provided support for a six-factor first-order structural model with the following constructs: Power, Money, Tidy environment, Teamwork, Work–Family Balance and Ability Utilization. This structure was confirmed in the second sub-sample, and strict measurement invariance for the measurement model was obtained in this sample. Additionally, the factor variances/covariances were invariant. Five non-invariant latent means were found, with girls scoring higher on the Balance and Personal Challenge values, and boys scoring higher on the Power, Money and Teamwork values.     

词素的结构对称效应:结构对称汉语成语认知特点的进一步研究

运用词素启动作业,进一步考察了结构对称性汉语成语的识别过程.结果发现(1)无论是用成语的前二个字还是后二个字启动,在成语识别过程中都存在明显的词素结构对称效应,即结构对称成语中的词素启动效应明显大于非对称成语中的词素启动效应.(2)成语的结构对称性、熟悉度和启动词素位置之间存在显著的三阶相互作用.简单效应的分析表明无论成语前二个字还是后二个字启动,词素的结构对称效应均只在低熟悉度成语的识别过程中显著;在前二个字启动时,非对称成语的识别还存在熟悉度效应.     

A multitrait-multimethod model with minimal assumptions

A new model of confirmatory factor analysis (CFA) for multitrait-multimethod (MTMM) data sets is presented. It is shown that this model can be defined by only three assumptions in the framework of classical psychometric test theory (CTT). All other properties of the model, particularly the uncorrelated-ness of the trait with the method factors are logical consequences of the definition of the model. In the model proposed there are as many trait factors as different traits considered, but the number of method factors is one fewer than the number of methods included in an MTMM study. The covariance structure implied by this model is derived, and it is shown that this model is identified even under conditions under which other CFA-MTMM models are not. The model is illustrated by two empirical applications. Furthermore, its advantages and limitations are discussed with respect to previously developed CFA models for MTMM data.     

Robust mean and covariance structure analysis through iteratively reweighted least squares

Robust schemes in regression are adapted to mean and covariance structure analysis, providing an iteratively reweighted least squares approach to robust structural equation modeling. Each case is properly weighted according to its distance, based on first and second order moments, from the structural model. A simple weighting function is adopted because of its flexibility with changing dimensions. The weight matrix is obtained from an adaptive way of using residuals. Test statistic and standard error estimators are given, based on iteratively reweighted least squares. The method reduces to a standard distribution-free methodology if all cases are equally weighted. Examples demonstrate the value of the robust procedure.The authors acknowledge the constructive comments of three referees and the Editor that lead to an improved version of the paper. This work was supported by National Institute on Drug Abuse Grants DA01070 and DA00017 and by the University of North Texas Faculty Research Grant Program.     

无均值结构的潜变量交互效应模型的标准化估计

潜变量交互效应建模研究近年来有两项重要进展, 一是提出了潜变量交互效应模型的标准化估计及其计算公式; 二是发现无均值结构模型可以取代传统的有均值结构模型, 建模大为简化。但标准化估计是在传统的有均值结构模型中建立的, 在简化的模型中同样适用吗？本文在无均值结构模型的框架内, 给出了潜变量交互效应模型的标准化形式、计算公式和建模步骤, 并通过模拟研究比较了极大似然和广义最小二乘两种估计方法、配对乘积指标和全部乘积指标两种指标类型, 结果表明, 在计算交互效应的标准化估计时, 应当使用配对乘积指标建模, 并且首选极大似然估计。     

Consequences of Ignoring Guessing Effects on Measurement Invariance Analysis

Pseudo-guessing parameters are present in item response theory applications for many educational assessments. When sample size is not sufficiently large, the guessing parameters may be ignored from the analysis. This study examines the impact of ignoring pseudo-guessing parameters on measurement invariance analysis, specifically, on item difficulty, item discrimination, and mean and variance of ability distribution. Results show that when non-zero guessing parameters are ignored from the measurement invariance analysis, item discrimination estimates tend to decrease particularly for more difficult items, and item difficulty estimates decrease unless the items are highly discriminating and difficult. As the guessing parameter increases, the size of the decrease in item discrimination and difficulty tends to increase, and the estimated mean and variance of ability distribution tend to be inaccurate. When two groups have heterogeneous ability distributions, ignoring the guessing parameter affects the reference group and the focal group differently. Implications of result findings are discussed.     

Analysing multisource feedback with multilevel structural equation models: Pitfalls and recommendations from a simulation study

When multisource feedback instruments, for example, 360-degree feedback tools, are validated, multilevel structural equation models are the method of choice to quantify the amount of reliability as well as convergent and discriminant validity. A non-standard multilevel structural equation model that incorporates self-ratings (level-2 variables) and others’ ratings from different additional perspectives (level-1 variables), for example, peers and subordinates, has recently been presented. In a Monte Carlo simulation study, we determine the minimal required sample sizes for this model. Model parameters are accurately estimated even with the smallest simulated sample size of 100 self-ratings and two ratings of peers and of subordinates. The precise estimation of standard errors necessitates sample sizes of 400 self-ratings or at least four ratings of peers and subordinates. However, if sample sizes are smaller, mainly standard errors concerning common method factors are biased. Interestingly, there are trade-off effects between the sample sizes of self-ratings and others’ ratings in their effect on estimation bias. The degree of convergent and discriminant validity has no effect on the accuracy of model estimates. The χ² test statistic does not follow the expected distribution. Therefore, we suggest using a corrected level-specific standardized root mean square residual to analyse model fit and conclude with further recommendations for applied organizational research.     

Measurement invariance of the Belief in a Zero‐Sum Game scale across 36 countries

In this paper, we examined the psychometric properties of cross‐cultural validation and replicability (i.e. measurement invariance) of the Belief in a Zero‐Sum Game (BZSG) scale, measuring antagonistic belief about interpersonal relations over scarce resources. The factorial structure of the BZSG scale was investigated in student samples from 36 countries (N = 9907), using separate confirmatory factor analyses (CFAs) for each country. The cross‐cultural validation of the scale was based on multigroup confirmatory factor analyses (MGCFA). The results confirmed that the scale had a one‐factor structure in all countries, in which configural and metric invariance between countries was confirmed. As a zero‐sum belief about social relations perceived as antagonistic, BZSG is an important factor related to, for example, social and international relations, attitudes toward immigrants, or well‐being. The paper proposes different uses of the BZSG scale for cross‐cultural studies in different fields of psychology: social, political, or economic.