Fixed- and random-effects meta-analytic structural equation modeling: Examples and analyses in R

Meta-analytic structural equation modeling (MASEM) combines the ideas of meta-analysis and structural equation modeling for the purpose of synthesizing correlation or covariance matrices and fitting structural equation models on the pooled correlation or covariance matrix. Cheung and Chan (Psychological Methods 10:40–64, 2005b, Structural Equation Modeling 16:28–53, 2009) proposed a two-stage structural equation modeling (TSSEM) approach to conducting MASEM that was based on a fixed-effects model by assuming that all studies have the same population correlation or covariance matrices. The main objective of this article is to extend the TSSEM approach to a random-effects model by the inclusion of study-specific random effects. Another objective is to demonstrate the procedures with two examples using the metaSEM package implemented in the R statistical environment. Issues related to and future directions for MASEM are discussed.     

Thought-action fusion: a comprehensive analysis using structural equation modeling

Thought-action fusion (TAF), the phenomenon whereby one has difficulty separating cognitions from corresponding behaviors, has implications in a wide variety of disturbances, including eating disorders, obsessive-compulsive disorder, generalized anxiety disorder, and panic disorder. Numerous constructs believed to contribute to the etiology or maintenance of TAF have been identified in the literature, but to date, no study has empirically integrated these findings into a comprehensive model. In this study, we examined simultaneously an array of variables thought to be related to TAF, and subsequently developed a model that elucidates the role of those variables that seem most involved in this phenomenon using a structural equation modeling approach. Results indicated that religiosity, as predicted by ethnic identity, was a significant predictor of TAF. Additionally, the relation between ethnic identity and TAF was partially mediated by an inflated sense of responsibility. Both TAF and obsessive-compulsive symptoms were found to be significant predictors of engagement in neutralization activities. Clinical and theoretical implications are discussed.     

Processing speed, intelligence, creativity, and school performance: Testing of causal hypotheses using structural equation models

According to mental speed theory of intelligence, the speed of information processing constitutes an important basis for cognitive abilities. However, the question, how mental speed relates to real world criteria, like school, academic, or job performance, is still unanswered. The aim of the study is to test an indirect speed-factor model in comparison to rivaling models explaining the relationships between different mental abilities and performance. In this speed-factor model, basic cognitive processing is assumed to influence higher mental abilities (IQ and creativity). Intelligence and creativity themselves should be valid predictors of school performance. We computed bivariate correlations and structural equation models to test this hypothesis, using indicators of processing speed [Zahlen-Verbindungs-Test (ZVT) and Coding Test], psychometric intelligence [Kognitiver Fähigkeits-Test (KFT) and Raven's Advanced Progressive Matrices (APM)], creativity [Verbaler Kreativitäts-Test (VKT) and Verwendungs-Test (VWT)] and school performance (grades). In a sample of 271 students from German gymnasiums (Class Levels 9 to 11) the speed-factor model can reproduce at best the empirical relationships between processing speed, intelligence, creativity, and school performance: It assumes that processing speed influences higher mental abilities (intelligence and creativity), which, in the sequel, influence school performance. Therefore, processing speed seems to have no direct effect on school performance; the effect is indirect as it operates via mediation through higher cognitive abilities.     

Testing parameters in structural equation modeling: every "one" matters

A problem with standard errors estimated by many structural equation modeling programs is described. In such programs, a parameter's standard error is sensitive to how the model is identified (i.e., how scale is set). Alternative but equivalent ways to identify a model may yield different standard errors, and hence different Z tests for a parameter, even though the identifications produce the same overall model fit. This lack of invariance due to model identification creates the possibility that different analysts may reach different conclusions about a parameter's significance level even though they test equivalent models on the same data. The authors suggest that parameters be tested for statistical significance through the likelihood ratio test, which is invariant to the identification choice.     

Self-reported emotional intelligence and life satisfaction: Testing incremental predictive validity hypotheses via structural equation modeling (SEM) in a small sample

In a previous investigation, Palmer, Donaldson, and Stough (2002) examined the incremental predictive validity of the subscales from the TMMS and TAS-20 in predicting life satisfaction. To this effect, Palmer et al. (2002) used multiple regression and reported that only the Clarity (β = .20) subscale from the TMMS was uniquely related to SWLS. In this investigation, structural equation modeling was used for the purposes of modeling a general EI factor as a potential incrementally predictive predictor of life satisfaction. The results demonstrated that a general EI factor was associated with SWLS at β = .61 and that this effect was only partially mediated by PA and NA, such that the validity coefficient was reduced to β = .49. The results are discussed in light of the advantages of using structural equation modeling, even in cases where the sample size may not be considered particularly large (i.e., N = 100).     

Asymptotic biases in exploratory factor analysis and structural equation modeling

Formulas for the asymptotic biases of the parameter estimates in structural equation models are provided in the case of the Wishart maximum likelihood estimation for normally and nonnormally distributed variables. When multivariate normality is satisfied, considerable simplification is obtained for the models of unstandardized variables. Formulas for the models of standardized variables are also provided. Numerical examples with Monte Carlo simulations in factor analysis show the accuracy of the formulas and suggest the asymptotic robustness of the asymptotic biases with normality assumption against nonnormal data. Some relationships between the asymptotic biases and other asymptotic values are discussed.The author is indebted to the editor and anonymous reviewers for their comments, corrections, and suggestions on this paper, and to Yutaka Kano for discussion on biases.     

结构方程模型统计检验力分析：原理与方法

结构方程模型是心理学、管理学、社会学等学科中重要的统计工具之一。然而, 大量使用结构方程模型的研究忽视了对该方法的统计检验力进行必要的分析和报告, 在一定程度上降低了这些研究的结果的证明效力。结构方程模型的统计检验力分析方法主要有Satorra-Saris法、MacCallum法与Monte Carlo法三类。其中Satorra-Saris法适用于备择模型清晰、检验对象相对简单、检验方法基于χ²分布的情形; MacCallum法适用于基于χ²分布的模型拟合检验且备择模型不明的情形; Monte Carlo法适用于检验对象相对复杂、采用模拟或重抽样方法进行检验的情形。在实际应用中, 研究者应当首先判断检验的目的、方法以及是否有明确的备择模型, 并根据这些信息选择具体的分析方法。     

Standard errors of fit indices using residuals in structural equation modeling

The asymptotic standard errors of the correlation residuals and Bentler's standardized residuals in covariance structures are derived based on the asymptotic covariance matrix of raw covariance residuals. Using these results, approximations of the asymptotic standard errors of the root mean square residuals for unstandardized or standardized residuals are derived by the delta method. Further, in mean structures, approximations of the asymptotic standard errors of residuals, standardized residuals and their summary statistics are derived in a similar manner. Simulations are carried out, which show that the asymptotic standard errors of the various types of residuals and the root mean square residuals in covariance, correlation and mean structures are close to actual ones.The author is indebted to the reviewers for their comments and suggestions which have led to an improvement of this work.     

Generalized multilevel structural equation modeling

A unifying framework for generalized multilevel structural equation modeling is introduced. The models in the framework, called generalized linear latent and mixed models (GLLAMM), combine features of generalized linear mixed models (GLMM) and structural equation models (SEM) and consist of a response model and a structural model for the latent variables. The response model generalizes GLMMs to incorporate factor structures in addition to random intercepts and coefficients. As in GLMMs, the data can have an arbitrary number of levels and can be highly unbalanced with different numbers of lower-level units in the higher-level units and missing data. A wide range of response processes can be modeled including ordered and unordered categorical responses, counts, and responses of mixed types. The structural model is similar to the structural part of a SEM except that it may include latent and observed variables varying at different levels. For example, unit-level latent variables (factors or random coefficients) can be regressed on cluster-level latent variables. Special cases of this framework are explored and data from the British Social Attitudes Survey are used for illustration. Maximum likelihood estimation and empirical Bayes latent score prediction within the GLLAMM framework can be performed using adaptive quadrature in gllamm, a freely available program running in Stata.gllamm can be downloaded from http://www.gllamm.org. The paper was written while Sophia Rabe-Hesketh was employed at and Anders Skrondal was visiting the Department of Biostatistics and Computing, Institute of Psychiatry, King's College London.     

Constrained versus unconstrained estimation in structural equation modeling

Recently, R. D. Stoel, F. G. Garre, C. Dolan, and G. van den Wittenboer (2006) reviewed approaches for obtaining reference mixture distributions for difference tests when a parameter is on the boundary. The authors of the present study argue that this methodology is incomplete without a discussion of when the mixtures are needed and show that they only become relevant when constrained difference tests are conducted. Because constrained difference tests can hide important model misspecification, a reliable way to assess global model fit under constrained estimation would be needed. Examination of the options for assessing model fit under constrained estimation reveals that no perfect solutions exist, although the conditional approach of releasing a degree of freedom for each active constraint appears to be the most methodologically sound one. The authors discuss pros and cons of constrained and unconstrained estimation and their implementation in 5 popular structural equation modeling packages and argue that unconstrained estimation is a simpler method that is also more informative about sources of misfit. In practice, researchers will have trouble conducting constrained difference tests appropriately, as this requires a commitment to ignore Heywood cases. Consequently, mixture distributions for difference tests are rarely appropriate.     

Missing data techniques for structural equation modeling

As with other statistical methods, missing data often create major problems for the estimation of structural equation models (SEMs). Conventional methods such as listwise or pairwise deletion generally do a poor job of using all the available information. However, structural equation modelers are fortunate that many programs for estimating SEMs now have maximum likelihood methods for handling missing data in an optimal fashion. In addition to maximum likelihood, this article also discusses multiple imputation. This method has statistical properties that are almost as good as those for maximum likelihood and can be applied to a much wider array of models and estimation methods.     

Testing hypotheses involving Cronbach's alpha using marginal models

We discuss the statistical testing of three relevant hypotheses involving Cronbach's alpha: one where alpha equals a particular criterion; a second testing the equality of two alpha coefficients for independent samples; and a third testing the equality of two alpha coefficients for dependent samples. For each of these hypotheses, various statistical tests have been proposed. Over the years, these tests have depended on progressively fewer assumptions. We propose a new approach to testing the three hypotheses that relies on even fewer assumptions, is especially suited for discrete item scores, and can be applied easily to tests containing large numbers of items. The new approach uses marginal modelling. We compared the Type I error rate and the power of the marginal modelling approach to several of the available tests in a simulation study using realistic conditions. We found that the marginal modelling approach had the most accurate Type I error rates, whereas the power was similar across the statistical tests.     

Testing mediational models with longitudinal data: questions and tips in the use of structural equation modeling

R. M. Baron and D. A. Kenny (1986; see record 1987-13085-001) provided clarion conceptual and methodological guidelines for testing mediational models with cross-sectional data. Graduating from cross-sectional to longitudinal designs enables researchers to make more rigorous inferences about the causal relations implied by such models. In this transition, misconceptions and erroneous assumptions are the norm. First, we describe some of the questions that arise (and misconceptions that sometimes emerge) in longitudinal tests of mediational models. We also provide a collection of tips for structural equation modeling (SEM) of mediational processes. Finally, we suggest a series of 5 steps when using SEM to test mediational processes in longitudinal designs: testing the measurement model, testing for added components, testing for omitted paths, testing the stationarity assumption, and estimating the mediational effects.     

接纳承诺疗法的作用机制——基于元分析结构方程模型

接纳承诺疗法(Acceptance and Commitment Therapy, ACT)被认为是行为治疗“第三浪潮”的重要代表。本研究使用元分析结构方程模型, 考察ACT的作用机制。通过数据库检索与筛选, 最终纳入文献50篇。结果发现: ACT所假设的心理灵活性、接纳、此时此刻、价值的中介作用都达到统计显著, 认知解离这一中介变量并不显著; 中介机制在网络化干预中仍然得到检验; 相较之传统CBT, ACT在所假设的机制上有其区别于CBT的优势。后续临床研究应更全面地测量6大核心机制, 关注对美好生活提升的影响, 采用多点瞬时评价法, 并尽可能使用更高级、更先进的统计方法检验其作用机制。     

Hopes and cautions in implementing Bayesian structural equation modeling

Muthén and Asparouhov (2012) have proposed and demonstrated an approach to model specification and estimation in structural equation modeling (SEM) using Bayesian methods. Their contribution builds on previous work in this area by (a) focusing on the translation of conventional SEM models into a Bayesian framework wherein parameters fixed at zero in a conventional model can be respecified using small-variance priors and (b) implementing their approach in software that is widely accessible. We recognize potential benefits for applied researchers as discussed by Muthén and Asparouhov, and we also see a tradeoff in that effective use of the proposed approach introduces increased demands in terms of expertise of users to navigate new complexities in model specification, parameter estimation, and evaluation of results. We also raise cautions regarding the issues of model modification and model fit. Although we see significant potential value in the use of Bayesian SEM, we also believe that effective use will require an awareness of these complexities. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

Dimensional analysis of sense of coherence using structural equation modelling

The sense of coherence (SOC) concept has been criticized on conceptual and psychometric grounds. The aim of this study was to develop the concept using structural equation modelling. The short 13‐item version of the SOC questionnaire was used and data were collected from two different samples. Each sample consisted of about 2000 individuals, selected to be representative of the Swedish population. A model with a general factor and two subordinate specific factors yielded a satisfactory solution in both samples. The two factors were labelled Social Comprehension and Commitment and Unpleasant Emotions and Inner Tension respectively. It was concluded that the 13‐item SOC scale could to a certain degree be regarded as a measure of negative affectivity and that the suggested model makes the SOC concept more theoretically coherent. Copyright © 1999 John Wiley & Sons, Ltd.     

Meta-analytic structural equation modeling: a two-stage approach

To synthesize studies that use structural equation modeling (SEM), researchers usually use Pearson correlations (univariate r), Fisher z scores (univariate z), or generalized least squares (GLS) to combine the correlation matrices. The pooled correlation matrix is then analyzed by the use of SEM. Questionable inferences may occur for these ad hoc procedures. A 2-stage structural equation modeling (TSSEM) method is proposed to incorporate meta-analytic techniques and SEM into a unified framework. Simulation results reveal that the univariate-r, univariate-z, and TSSEM methods perform well in testing the homogeneity of correlation matrices and estimating the pooled correlation matrix. When fitting SEM, only TSSEM works well. The GLS method performed poorly in small to medium samples.