Model comparison of nonlinear structural equation models with fixed covariates

Recently, it has been recognized that the commonly used linear structural equation model is inadequate to deal with some complicated substantive theory. A new nonlinear structural equation model with fixed covariates is proposed in this article. A procedure, which utilizes the powerful path sampling for computing the Bayes factor, is developed for model comparison. In the implementation, the required random observations are simulated via a hybrid algorithm that combines the Gibbs sampler and the Metropolis-Hastings algorithm. It is shown that the proposed procedure is efficient and flexible; and it produces Bayesian estimates of the parameters, latent variables, and their highest posterior density intervals as by-products. Empirical performances of the proposed procedure such as sensitivity to prior inputs are illustrated by a simulation study and a real example.This research is fully supported by a grant from the Research Grant Council of the Hong Kong Special Administrative Region, China (Project No. CUHK 4346/01H). The authors are thankful to the Editor, the Associate Editor, and anonymous reviewers for valuable comments which improve the paper significantly, and grateful to ICPSR and the relevant funding agency for allowing use of the data in the example. The assistance of Michael K.H. Leung and Esther L.S. Tam is gratefully acknowledged.     

Analysis of structural equation model with ignorable missing continuous and polytomous data

The main purpose of this article is to develop a Bayesian approach for structural equation models with ignorable missing continuous and polytomous data. Joint Bayesian estimates of thresholds, structural parameters and latent factor scores are obtained simultaneously. The idea of data augmentation is used to solve the computational difficulties involved. In the posterior analysis, in addition to the real missing data, latent variables and latent continuous measurements underlying the polytomous data are treated as hypothetical missing data. An algorithm that embeds the Metropolis-Hastings algorithm within the Gibbs sampler is implemented to produce the Bayesian estimates. A goodness-of-fit statistic for testing the posited model is presented. It is shown that the proposed approach is not sensitive to prior distributions and can handle situations with a large number of missing patterns whose underlying sample sizes may be small. Computational efficiency of the proposed procedure is illustrated by simulation studies and a real example.The work described in this paper was fully supported by a grant from the Research Grants Council of the HKSAR (Project No. CUHK 4088/99H). The authors are greatly indebted to the Editor and anonymous reviewers for valuable comments in improving the paper; and also to D. E. Morisky and J.A. Stein for the use of their AIDS data set.     

Bayesian estimation and testing of structural equation models

The Gibbs sampler can be used to obtain samples of arbitrary size from the posterior distribution over the parameters of a structural equation model (SEM) given covariance data and a prior distribution over the parameters. Point estimates, standard deviations and interval estimates for the parameters can be computed from these samples. If the prior distribution over the parameters is uninformative, the posterior is proportional to the likelihood, and asymptotically the inferences based on the Gibbs sample are the same as those based on the maximum likelihood solution, for example, output from LISREL or EQS. In small samples, however, the likelihood surface is not Gaussian and in some cases contains local maxima. Nevertheless, the Gibbs sample comes from the correct posterior distribution over the parameters regardless of the sample size and the shape of the likelihood surface. With an informative prior distribution over the parameters, the posterior can be used to make inferences about the parameters underidentified models, as we illustrate on a simple errors-in-variables model.We thank David Spiegelhalter for suggesting applying the Gibbs sampler to structural equation models to the first author at a 1994 workshop in Wiesbaden. We thank Ulf Böckenholt, Chris Meek, Marijtje van Duijn, Clark Glymour, Ivo Molenaar, Steve Klepper, Thomas Richardson, Teddy Seidenfeld, and Tom Snijders for helpful discussions, mathematical advice, and critiques of earlier drafts of this paper.     

Local influence analysis of nonlinear structural equation models

By regarding the latent random vectors as hypothetical missing data and based on the conditional expectation of the complete-data log-likelihood function in the EM algorithm, we investigate assessment of local influence of various perturbation schemes in a nonlinear structural equation model. The basic building blocks of local influence analysis are computed via observations of the latent variables generated by the Metropolis-Hastings algorithm, while the diagnostic measures are obtained via the conformal normal curvature. Seven perturbation schemes, including some perturbation schemes on latent vectors, are investigated. The proposed procedure is illustrated by a simulation study and a real example. Acknowledgment: This research is fully supported by a grant (CUHK 4243/02H) from the Research Grant Council of the Hong Kong Special Administration Region. The authors are indebted to ICPSR and the relevant funding agency for allowing use of their data, and to the Editor and reviewers for their valuable comments for improving the paper.     

Maximum likelihood estimation of latent interaction effects with the LMS method

In the context of structural equation modeling, a general interaction model with multiple latent interaction effects is introduced. A stochastic analysis represents the nonnormal distribution of the joint indicator vector as a finite mixture of normal distributions. The Latent Moderated Structural Equations (LMS) approach is a new method developed for the analysis of the general interaction model that utilizes the mixture distribution and provides a ML estimation of model parameters by adapting the EM algorithm. The finite sample properties and the robustness of LMS are discussed. Finally, the applicability of the new method is illustrated by an empirical example. This research has been supported by a grant from the Deutsche Forschungsgemeinschaft, Germany, No. Mo 474/1 and Mo 474/2. The data for the empirical example have been provided by Andreas Thiele of the University of Frankfurt, Germany. The authors are indebted to an associate editor and to three anonymous reviewers ofPsychometrika whose comments and suggestions have been very helpful.     

An EM algorithm for fitting two-level structural equation models

Maximum likelihood is an important approach to analysis of two-level structural equation models. Different algorithms for this purpose have been available in the literature. In this paper, we present a new formulation of two-level structural equation models and develop an EM algorithm for fitting this formulation. This new formulation covers a variety of two-level structural equation models. As a result, the proposed EM algorithm is widely applicable in practice. A practical example illustrates the performance of the EM algorithm and the maximum likelihood statistic.We are thankful to the reviewers for their constructive comments that have led to significant improvement on the first version of this paper. Special thanks are due to the reviewer who suggested a comparison with the LISREL program in the saturated means model, and provided its setup and output. This work was supported by National Institute on Drug Abuse grants DA01070, DA00017, and a UNH 2002 Summer Faculty Fellowship.     

Maximum likelihood estimation of the joint covariance matrix for sections of tests given to distinct samples with application to test equating

Consider an old testX consisting ofs sections and two new testsY andZ similar toX consisting ofp andq sections respectively. All subjects are given testX plus two variable sections from either testY orZ. Different pairings of variable sections are given to each subsample of subjects. We present a method of estimating the covariance matrix of the combined test (X ₁, ...,X _s ,Y ₁, ...,Y _p ,Z ₁, ...,Z _q ) and describe an application of these estimation techniques to linear, observed-score, test equating.The author is indebted to Paul W. Holland and Donald B. Rubin for their encouragement and many helpful comments and suggestions that contributed significantly to the development of this paper.This research was supported by the Program Statistics Research Project of the ETS Research Statistics Group.     

Effect analysis and causation in linear structural equation models

This paper considers total and direct effects in linear structural equation models. Adopting a causal perspective that is implicit in much of the literature on the subject, the paper concludes that in many instances the effects do not admit the interpretations imparted in the literature. Drawing a distinction between concomitants and factors, the paper concludes that a concomitant has neither total nor direct effects on other variables. When a variable is a factor and one or more intervening variables are concomitants, the notion of a direct effect is not causally meaningful. Even when the notion of a direct effect is meaningful, the usual estimate of this quantity may be inappropriate. The total effect is usually interpreted as an equilibrium multiplier. In the case where there are simultaneity relations among the dependent variables in tghe model, the results in the literature for the total effects of dependent variables on other dependent variables are not equilibrium multipliers, and thus, the usual interpretation is incorrect. To remedy some of these deficiencies, a new effect, the total effect of a factorX on an outcomeY, holding a set of variablesF constant, is defined. When defined, the total and direct effects are a special case of this new effect, and the total effect of a dependent variable on a dependent variable is an equilibrium multiplier.For helpful comments, I am grateful to G. Arminger, K. Bollen, W. Faris, R. m. Hauser, T. Petersen, three anonymous Psychometrikas reviewers, and the Editor. For computational assistance, I am grateful to B. D. Kim.     

The analysis of structural equation models by means of derivative free nonlinear least squares

It is shown that the PAR Derivative-Free Nonlinear Regression program in BMDP can be used to fit structural equation models, producing generalized least squares estimates, standard errors, and goodness-of-fit test statistics. Covariance structure models more general than LISREL can be analyzed. The approach is particularly useful for dealing with new non-standard models and experimenting with alternate methods of estimation. The research of the second author was supported by the NSF grant MCS 83-01587. We wish to thank our referees for some very valuable suggestions.     

Limited information estimation and testing of discretized multivariate normal structural models

Discretized multivariate normal structural models are often estimated using multistage estimation procedures. The asymptotic properties of parameter estimates, standard errors, and tests of structural restrictions on thresholds and polychoric correlations are well known. It was not clear how to assess the overall discrepancy between the contingency table and the model for these estimators. It is shown that the overall discrepancy can be decomposed into a distributional discrepancy and a structural discrepancy. A test of the overall model specification is proposed, as well as a test of the distributional specification (i.e., discretized multivariate normality). Also, the small sample performance of overall, distributional, and structural tests, as well as of parameter estimates and standard errors is investigated under conditions of correct model specification and also under mild structural and/or distributional misspecification. It is found that relatively small samples are needed for parameter estimates, standard errors, and structural tests. Larger samples are needed for the distributional and overall tests. Furthermore, parameter estimates, standard errors, and structural tests are surprisingly robust to distributional misspecification. This research was supported by the Department of Universities, Research and Information Society (DURSI) of the Catalan Government, and by grants BSO2000-0661 and BSO2003-08507 of the Spanish Ministry of Science and Technology.     

Constrained maximum likelihood estimation of two-level covariance structure model via EM type algorithms

In this paper, the constrained maximum likelihood estimation of a two-level covariance structure model with unbalanced designs is considered. The two-level model is reformulated as a single-level model by treating the group level latent random vectors as hypothetical missing-data. Then, the popular EM algorithm is extended to obtain the constrained maximum likelihood estimates. For general nonlinear constraints, the multiplier method is used at theM-step to find the constrained minimum of the conditional expectation. An accelerated EM gradient procedure is derived to handle linear constraints. The empirical performance of the proposed EM type algorithms is illustrated by some artifical and real examples.This research was supported by a Hong Kong UCG Earmarked Grant, CUHK 4026/97H. We are greatly indebted to D.E. Morisky and J.A. Stein for the use of their AIDS data in our example. We also thank the Editor, two anonymous reviewers, W.Y. Poon and H.T. Zhu for constructive suggestions and comments in improving the paper. The assistance of Michael K.H. Leung and Esther L.S. Tam is gratefully acknowledged.     

Maximum likelihood estimation of polyserial correlations

This paper considers a multivariate normal model with one of the component variables observable only in polytomous form. The maximum likelihood approach is used for estimation of the parameters in the model. The Newton-Raphson algorithm is implemented to obtain the solution of the problem. Examples based on real and simulated data are reported.The research of the first author was supported in part by a research grant (DA01070) from the US Public Health Service. We are indebted to the referees and the editor for some very valuable comments and suggestions.     

Maximum likelihood estimation of the polychoric correlation coefficient

The polychoric correlation is discussed as a generalization of the tetrachoric correlation coefficient to more than two classes. Two estimation methods are discussed: Maximum likelihood estimation, and what may be called two-step maximum likelihood estimation. For the latter method, the thresholds are estimated in the first step. For both methods, asymptotic covariance matrices for estimates are derived, and the methods are illustrated and compared with artificial and real data.This paper was read at the 1978 European Meeting on Psychometrics and Mathematical Psychology in Uppsala, Sweden, June 1978.Research reported in this paper has been supported by the Bank of Sweden Tercentenary Foundation under project Structural Equation Models in the Social Sciences, project director Karl G. Jöreskog.     

Estimation for structural equation models with missing data

A direct method in handling incomplete data in general covariance structural models is investigated. Asymptotic statistical properties of the generalized least squares method are developed. It is shown that this approach has very close relationships with the maximum likelihood approach. Iterative procedures for obtaining the generalized least squares estimates, the maximum likelihood estimates, as well as their standard error estimates are derived. Computer programs for the confirmatory factor analysis model are implemented. A longitudinal type data set is used as an example to illustrate the results.This research was supported in part by Research Grant DAD1070 from the U.S. Public Health Service. The author is indebted to anonymous reviewers for some very valuable suggestions. Computer funding is provided by the Computer Services Centre, The Chinese University of Hong Kong.     

On structural models for analyzing change

The recommendation to base the analysis of multi-wave data upon explicit models for change is advocated. Several univariate and multivariate models are described, which emerge from an interaction between the classical test theory and the structural equation modeling approach. The resulting structural models for analyzing change reflect in some of their parameters substantively interesting aspects of intra- and interindividual change in follow-up studies. The models are viewed as an alternative to an ANOVA-based analysis of longitudinal data, and are illustrated on data from a cognitive intervention study of old adults (Bakes et al , 1986). The approach presents a useful means of analyzing change over time, and is applicable for purposes of (latent) growth curve analysis when analysis of variance assumptions are violated (e.g., Schaie & Hertzog, 1982; Morrison, 1976).     

缺失数据的结构方程建模:全息极大似然估计时辅助变量的作用

本研究通过蒙特卡洛模拟考查了采用全息极大似然估计进行缺失数据建模时辅助变量的作用。具体考查了辅助变量与研究变量的共缺机制、共缺率、相关程度、辅助变量数目与样本量等因素对参数估计结果精确性的影响。结果表明,当辅助与研究变量共缺时:(1)对于完全随机缺失的辅助变量,结果更容易出现偏差;(2)对于MAR-MAR组合机制,纳入单个辅助变量是有益的;对于MAR-MCAR或MAR-MNAR组合机制,纳入多于一个辅助变量的效果更好;(3)纳入与研究变量低相关的辅助变量对结果也是有益的。     

Generalized multilevel structural equation modeling

A unifying framework for generalized multilevel structural equation modeling is introduced. The models in the framework, called generalized linear latent and mixed models (GLLAMM), combine features of generalized linear mixed models (GLMM) and structural equation models (SEM) and consist of a response model and a structural model for the latent variables. The response model generalizes GLMMs to incorporate factor structures in addition to random intercepts and coefficients. As in GLMMs, the data can have an arbitrary number of levels and can be highly unbalanced with different numbers of lower-level units in the higher-level units and missing data. A wide range of response processes can be modeled including ordered and unordered categorical responses, counts, and responses of mixed types. The structural model is similar to the structural part of a SEM except that it may include latent and observed variables varying at different levels. For example, unit-level latent variables (factors or random coefficients) can be regressed on cluster-level latent variables. Special cases of this framework are explored and data from the British Social Attitudes Survey are used for illustration. Maximum likelihood estimation and empirical Bayes latent score prediction within the GLLAMM framework can be performed using adaptive quadrature in gllamm, a freely available program running in Stata.gllamm can be downloaded from http://www.gllamm.org. The paper was written while Sophia Rabe-Hesketh was employed at and Anders Skrondal was visiting the Department of Biostatistics and Computing, Institute of Psychiatry, King's College London.     

Information matrix estimation procedures for cognitive diagnostic models

Two new methods to estimate the asymptotic covariance matrix for marginal maximum likelihood estimation of cognitive diagnosis models (CDMs), the inverse of the observed information matrix and the sandwich-type estimator, are introduced. Unlike several previous covariance matrix estimators, the new methods take into account both the item and structural parameters. The relationships between the observed information matrix, the empirical cross-product information matrix, the sandwich-type covariance matrix and the two approaches proposed by de la Torre (2009, J. Educ. Behav. Stat., 34, 115) are discussed. Simulation results show that, for a correctly specified CDM and Q-matrix or with a slightly misspecified probability model, the observed information matrix and the sandwich-type covariance matrix exhibit good performance with respect to providing consistent standard errors of item parameter estimates. However, with substantial model misspecification only the sandwich-type covariance matrix exhibits robust performance.     

Standard errors of fit indices using residuals in structural equation modeling

The asymptotic standard errors of the correlation residuals and Bentler's standardized residuals in covariance structures are derived based on the asymptotic covariance matrix of raw covariance residuals. Using these results, approximations of the asymptotic standard errors of the root mean square residuals for unstandardized or standardized residuals are derived by the delta method. Further, in mean structures, approximations of the asymptotic standard errors of residuals, standardized residuals and their summary statistics are derived in a similar manner. Simulations are carried out, which show that the asymptotic standard errors of the various types of residuals and the root mean square residuals in covariance, correlation and mean structures are close to actual ones.The author is indebted to the reviewers for their comments and suggestions which have led to an improvement of this work.     

Exploratory structural equation modeling,bifactor models,and standard confirmatory factor analysis models: Application to the BASC-2 Behavioral and Emotional Screening System Teacher Form

Several psychological assessment instruments are based on the assumption of a general construct that is composed of multiple interrelated domains. Standard confirmatory factor analysis is often not well suited for examining the factor structure of such scales. This study used data from 1885 elementary school students (mean age = 8.77 years, SD = 1.47 years) to examine the factor structure of the Behavioral Assessment System for Children, Second Edition (BASC-2) Behavioral and Emotional Screening System (BESS) Teacher Form that was designed to assess general risk for emotional/behavioral difficulty among children. The modeling sequence included the relatively new exploratory structural equation modeling (ESEM) approach and bifactor models in addition to more standard techniques. Findings revealed that the factor structure of the BASC-2 BESS Teacher Form is multidimensional. Both ESEM and bifactor models showed good fit to the data. Bifactor models were preferred on conceptual grounds. Findings illuminate the hypothesis-generating power of ESEM and suggest that it might not be optimal for instruments designed to assess a predominant general factor underlying the data.