Bayesian analysis of two‐level nonlinear structural equation models with continuous and polytomous data

Two‐level structural equation models with mixed continuous and polytomous data and nonlinear structural equations at both the between‐groups and within‐groups levels are important but difficult to deal with. A Bayesian approach is developed for analysing this kind of model. A Markov chain Monte Carlo procedure based on the Gibbs sampler and the Metropolis‐Hasting algorithm is proposed for producing joint Bayesian estimates of the thresholds, structural parameters and latent variables at both levels. Standard errors and highest posterior density intervals are also computed. A procedure for computing Bayes factor, based on the key idea of path sampling, is established for model comparison.     

Assessment of generalised Bayesian structural equation models for continuous and binary data

The paper proposes a novel model assessment paradigm aiming to address shortcoming of posterior predictive $p$-values, which provide the default metric of fit for Bayesian structural equation modelling (BSEM). The model framework presented in the paper focuses on the approximate zero approach (Psychological Methods, 17 , 2012, 313), which involves formulating certain parameters (such as factor loadings) to be approximately zero through the use of informative priors, instead of explicitly setting them to zero. The introduced model assessment procedure monitors the out-of-sample predictive performance of the fitted model, and together with a list of guidelines we provide, one can investigate whether the hypothesised model is supported by the data. We incorporate scoring rules and cross-validation to supplement existing model assessment metrics for BSEM. The proposed tools can be applied to models for both continuous and binary data. The modelling of categorical and non-normally distributed continuous data is facilitated with the introduction of an item-individual random effect. We study the performance of the proposed methodology via simulation experiments as well as real data on the ‘Big-5’ personality scale and the Fagerstrom test for nicotine dependence.     

Bayesian model comparison of nonlinear structural equation models with missing continuous and ordinal categorical data

Missing data are very common in behavioural and psychological research. In this paper, we develop a Bayesian approach in the context of a general nonlinear structural equation model with missing continuous and ordinal categorical data. In the development, the missing data are treated as latent quantities, and provision for the incompleteness of the data is made by a hybrid algorithm that combines the Gibbs sampler and the Metropolis‐Hastings algorithm. We show by means of a simulation study that the Bayesian estimates are accurate. A Bayesian model comparison procedure based on the Bayes factor and path sampling is proposed. The required observations from the posterior distribution for computing the Bayes factor are simulated by the hybrid algorithm in Bayesian estimation. Our simulation results indicate that the correct model is selected more frequently when the incomplete records are used in the analysis than when they are ignored. The methodology is further illustrated with a real data set from a study concerned with an AIDS preventative intervention for Filipina sex workers.     

Bayesian analysis of mixtures in structural equation models with non‐ignorable missing data

Structural equation models (SEMs) have become widely used to determine the interrelationships between latent and observed variables in social, psychological, and behavioural sciences. As heterogeneous data are very common in practical research in these fields, the analysis of mixture models has received a lot of attention in the literature. An important issue in the analysis of mixture SEMs is the presence of missing data, in particular of data missing with a non‐ignorable mechanism. However, only a limited amount of work has been done in analysing mixture SEMs with non‐ignorable missing data. The main objective of this paper is to develop a Bayesian approach for analysing mixture SEMs with an unknown number of components and non‐ignorable missing data. A simulation study shows that Bayesian estimates obtained by the proposed Markov chain Monte Carlo methods are accurate and the Bayes factor computed via a path sampling procedure is useful for identifying the correct number of components, selecting an appropriate missingness mechanism, and investigating various effects of latent variables in the mixture SEMs. A real data set on a study of job satisfaction is used to demonstrate the methodology.     

Estimation for structural equation models with missing data

A direct method in handling incomplete data in general covariance structural models is investigated. Asymptotic statistical properties of the generalized least squares method are developed. It is shown that this approach has very close relationships with the maximum likelihood approach. Iterative procedures for obtaining the generalized least squares estimates, the maximum likelihood estimates, as well as their standard error estimates are derived. Computer programs for the confirmatory factor analysis model are implemented. A longitudinal type data set is used as an example to illustrate the results.This research was supported in part by Research Grant DAD1070 from the U.S. Public Health Service. The author is indebted to anonymous reviewers for some very valuable suggestions. Computer funding is provided by the Computer Services Centre, The Chinese University of Hong Kong.     

Effect analysis and causation in linear structural equation models

This paper considers total and direct effects in linear structural equation models. Adopting a causal perspective that is implicit in much of the literature on the subject, the paper concludes that in many instances the effects do not admit the interpretations imparted in the literature. Drawing a distinction between concomitants and factors, the paper concludes that a concomitant has neither total nor direct effects on other variables. When a variable is a factor and one or more intervening variables are concomitants, the notion of a direct effect is not causally meaningful. Even when the notion of a direct effect is meaningful, the usual estimate of this quantity may be inappropriate. The total effect is usually interpreted as an equilibrium multiplier. In the case where there are simultaneity relations among the dependent variables in tghe model, the results in the literature for the total effects of dependent variables on other dependent variables are not equilibrium multipliers, and thus, the usual interpretation is incorrect. To remedy some of these deficiencies, a new effect, the total effect of a factorX on an outcomeY, holding a set of variablesF constant, is defined. When defined, the total and direct effects are a special case of this new effect, and the total effect of a dependent variable on a dependent variable is an equilibrium multiplier.For helpful comments, I am grateful to G. Arminger, K. Bollen, W. Faris, R. m. Hauser, T. Petersen, three anonymous Psychometrikas reviewers, and the Editor. For computational assistance, I am grateful to B. D. Kim.     

The use of item parcels in structural equation modelling: Non‐normal data and small sample sizes

Maximum likelihood estimation in confirmatory factor analysis requires large sample sizes, normally distributed item responses, and reliable indicators of each latent construct, but these ideals are rarely met. We examine alternative strategies for dealing with non‐normal data, particularly when the sample size is small. In two simulation studies, we systematically varied: the degree of non‐normality; the sample size from 50 to 1000; the way of indicator formation, comparing items versus parcels; the parcelling strategy, evaluating uniformly positively skews and kurtosis parcels versus those with counterbalancing skews and kurtosis; and the estimation procedure, contrasting maximum likelihood and asymptotically distribution‐free methods. We evaluated the convergence behaviour of solutions, as well as the systematic bias and variability of parameter estimates, and goodness of fit.     

Ridge structural equation modelling with correlation matrices for ordinal and continuous data

This paper develops a ridge procedure for structural equation modelling (SEM) with ordinal and continuous data by modelling the polychoric/polyserial/product‐moment correlation matrix R . Rather than directly fitting R , the procedure fits a structural model to R _a= R +a I by minimizing the normal distribution‐based discrepancy function, where a > 0. Statistical properties of the parameter estimates are obtained. Four statistics for overall model evaluation are proposed. Empirical results indicate that the ridge procedure for SEM with ordinal data has better convergence rate, smaller bias, smaller mean square error, and better overall model evaluation than the widely used maximum likelihood procedure.     

Analysis of structural equation model with ignorable missing continuous and polytomous data

The main purpose of this article is to develop a Bayesian approach for structural equation models with ignorable missing continuous and polytomous data. Joint Bayesian estimates of thresholds, structural parameters and latent factor scores are obtained simultaneously. The idea of data augmentation is used to solve the computational difficulties involved. In the posterior analysis, in addition to the real missing data, latent variables and latent continuous measurements underlying the polytomous data are treated as hypothetical missing data. An algorithm that embeds the Metropolis-Hastings algorithm within the Gibbs sampler is implemented to produce the Bayesian estimates. A goodness-of-fit statistic for testing the posited model is presented. It is shown that the proposed approach is not sensitive to prior distributions and can handle situations with a large number of missing patterns whose underlying sample sizes may be small. Computational efficiency of the proposed procedure is illustrated by simulation studies and a real example.The work described in this paper was fully supported by a grant from the Research Grants Council of the HKSAR (Project No. CUHK 4088/99H). The authors are greatly indebted to the Editor and anonymous reviewers for valuable comments in improving the paper; and also to D. E. Morisky and J.A. Stein for the use of their AIDS data set.     

Local influence analysis of structural equation models with continuous and ordinal categorical variables

This paper proposes a method to assess the local influence of minor perturbations for a structural equation model with continuous and ordinal categorical variables. The key idea is to treat the latent variables as hypothetical missing data and then apply Cook's approach to the conditional expectation of the complete‐data log‐likelihood function in the corresponding EM algorithm for deriving the normal curvature and the conformal normal curvature. Building blocks for achieving the diagnostic measures are computed via observations generated by the Gibbs sampler. It is shown that the proposed methodology is relatively simple to implement, computationally efficient, and feasible for a wide variety of perturbation schemes. Two illustrative real examples are presented.     

IQ heritability estimation: analyzing genetically-informative data with structural equation models

When analyzing genetic data, Structural Equations Modeling (SEM) provides a straightforward methodology to decompose phenotypic variance using a model-based approach. Furthermore, several models can be easily implemented, tested, and compared using SEM, allowing the researcher to obtain valuable information about the sources of variability. This methodology is briefly described and applied to re-analyze a Spanish set of IQ data using the biometric ACE model. In summary, we report heritability estimates that are consistent with those of previous studies and support substantial genetic contribution to phenotypic IQ; around 40% of the variance can be attributable to it. With regard to the environmental contribution, shared environment accounts for 50% of the variance, and non-shared environment accounts for the remaining 10%. These results are discussed in the text.     

Structural equation models with continuous and polytomous variables

A two-stage procedure is developed for analyzing structural equation models with continuous and polytomous variables. At the first stage, the maximum likelihood estimates of the thresholds, polychoric covariances and variances, and polyserial covariances are simultaneously obtained with the help of an appropriate transformation that significantly simplifies the computation. An asymptotic covariance matrix of the estiates is also computed. At the second stage, the parameters in the structural covariance model are obtained via the generalized least squares approach. Basic statistical properties of the estimates are derived and some illustrative examples and a small simulation study are reported.This research was supported in part by a research grant DA01070 from the U. S. Public Health Service. We are indebted to several referees and the editor for very valuable comments and suggestions for improvement of this paper. The computing assistance of King-Hong Leung and Man-Lai Tang is also gratefully acknowledged.     

Bayesian analysis of structural equation models with mixed exponential family and ordered categorical data

Structural equation models are very popular for studying relationships among observed and latent variables. However, the existing theory and computer packages are developed mainly under the assumption of normality, and hence cannot be satisfactorily applied to non‐normal and ordered categorical data that are common in behavioural, social and psychological research. In this paper, we develop a Bayesian approach to the analysis of structural equation models in which the manifest variables are ordered categorical and/or from an exponential family. In this framework, models with a mixture of binomial, ordered categorical and normal variables can be analysed. Bayesian estimates of the unknown parameters are obtained by a computational procedure that combines the Gibbs sampler and the Metropolis–Hastings algorithm. Some goodness‐of‐fit statistics are proposed to evaluate the fit of the posited model. The methodology is illustrated by results obtained from a simulation study and analysis of a real data set about non‐adherence of hypertension patients in a medical treatment scheme.     

Generalized linear models with ordinally‐observed covariates

An ordinally‐observed variable is a variable that is only partially observed through an ordinal surrogate. Although statistical models for ordinally‐observed response variables are well known, relatively little attention has been given to the problem of ordinally‐observed regressors. In this paper I show that if surrogates to ordinally‐observed covariates are used as regressors in a generalized linear model then the resulting measurement error in the covariates can compromise the consistency of point estimators and standard errors for the effects of fully‐observed regressors. To properly account for this measurement error when making inferences concerning the fully‐observed regressors, I propose a general modelling framework for generalized linear models with ordinally‐observed covariates. I discuss issues of model specification, identification, and estimation, and illustrate these with examples.     

Generalized latent variable models with non‐linear effects

Until recently, item response models such as the factor analysis model for metric responses, the two‐parameter logistic model for binary responses and the multinomial model for nominal responses considered only the main effects of latent variables without allowing for interaction or polynomial latent variable effects. However, non‐linear relationships among the latent variables might be necessary in real applications. Methods for fitting models with non‐linear latent terms have been developed mainly under the structural equation modelling approach. In this paper, we consider a latent variable model framework for mixed responses (metric and categorical) that allows inclusion of both non‐linear latent and covariate effects. The model parameters are estimated using full maximum likelihood based on a hybrid integration–maximization algorithm. Finally, a method for obtaining factor scores based on multiple imputation is proposed here for the non‐linear model.     

Sensitivity analysis of structural equation models

The main purpose of this paper is to investigate the sensitivity analysis of structural equation model when minor perturbation is introduced. Some influence measure that based on the general case weight perturbation is derived for the generalized least squares estimation. An influence measure that related to the Cook's distance is also developed for the special case deletion perturbation scheme. Using the proposed methodology, the influential observation in a data set can be detected. Moreover, the general theory can be applied to detect the influential parameters in a model. Finally, some illustrative artificial and real examples are presented. The research of the first author was supported by a Hong Kong UPGC grant. The authors are greatly indebted to two reviewers for some very valuable comments for improvement of the paper.     

Testing mediational models with longitudinal data: questions and tips in the use of structural equation modeling

R. M. Baron and D. A. Kenny (1986; see record 1987-13085-001) provided clarion conceptual and methodological guidelines for testing mediational models with cross-sectional data. Graduating from cross-sectional to longitudinal designs enables researchers to make more rigorous inferences about the causal relations implied by such models. In this transition, misconceptions and erroneous assumptions are the norm. First, we describe some of the questions that arise (and misconceptions that sometimes emerge) in longitudinal tests of mediational models. We also provide a collection of tips for structural equation modeling (SEM) of mediational processes. Finally, we suggest a series of 5 steps when using SEM to test mediational processes in longitudinal designs: testing the measurement model, testing for added components, testing for omitted paths, testing the stationarity assumption, and estimating the mediational effects.     

Influence analysis of structural equation models with polytomous variables

The estimation of model parameters in structural equation models with polytomous variables can be handled by several computationally efficient procedures. However, sensitivity or influence analysis of the model is not well studied. We demonstrate that the existing influence analysis methods for contingency tables or for normal theory structural equation models cannot be applied directly to structural equation models with polytomous variables; and we develop appropriate procedures based on the local influence approach of Cook (1986). The proposed procedures are computationally efficient, the necessary bits of the proposed diagnostic measures are readily available following an usual fit of the model. We consider the influence of an individual cell frequency with respect to three cases: when all parameters in an unstructured model are of interest, when the unstructured polychoric correlations are of interest, and when the structural parameters are of interest. We also consider the sensitivity of the parameters estimates. Two examples based on real data are presented for illustration.The work described in this paper was partially supported by a Chinese University of Hong Kong Postdoctoral Fellows Scheme and a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (RGC Ref. No. CUHK4186/98P). We are indebted to P.M. Bentler and M.D. Newcomb for providing the data set, Michael Leung for his assistance, and the Editor and the referees for some very valuable comments.     

缺失数据的结构方程建模:全息极大似然估计时辅助变量的作用

本研究通过蒙特卡洛模拟考查了采用全息极大似然估计进行缺失数据建模时辅助变量的作用。具体考查了辅助变量与研究变量的共缺机制、共缺率、相关程度、辅助变量数目与样本量等因素对参数估计结果精确性的影响。结果表明,当辅助与研究变量共缺时:(1)对于完全随机缺失的辅助变量,结果更容易出现偏差;(2)对于MAR-MAR组合机制,纳入单个辅助变量是有益的;对于MAR-MCAR或MAR-MNAR组合机制,纳入多于一个辅助变量的效果更好;(3)纳入与研究变量低相关的辅助变量对结果也是有益的。     

Bayesian estimation and testing of structural equation models

The Gibbs sampler can be used to obtain samples of arbitrary size from the posterior distribution over the parameters of a structural equation model (SEM) given covariance data and a prior distribution over the parameters. Point estimates, standard deviations and interval estimates for the parameters can be computed from these samples. If the prior distribution over the parameters is uninformative, the posterior is proportional to the likelihood, and asymptotically the inferences based on the Gibbs sample are the same as those based on the maximum likelihood solution, for example, output from LISREL or EQS. In small samples, however, the likelihood surface is not Gaussian and in some cases contains local maxima. Nevertheless, the Gibbs sample comes from the correct posterior distribution over the parameters regardless of the sample size and the shape of the likelihood surface. With an informative prior distribution over the parameters, the posterior can be used to make inferences about the parameters underidentified models, as we illustrate on a simple errors-in-variables model.We thank David Spiegelhalter for suggesting applying the Gibbs sampler to structural equation models to the first author at a 1994 workshop in Wiesbaden. We thank Ulf Böckenholt, Chris Meek, Marijtje van Duijn, Clark Glymour, Ivo Molenaar, Steve Klepper, Thomas Richardson, Teddy Seidenfeld, and Tom Snijders for helpful discussions, mathematical advice, and critiques of earlier drafts of this paper.