A Sandwich-Type Standard Error Estimator of SEM Models with Multivariate Time Series

Structural equation models are increasingly used as a modeling tool for multivariate time series data in the social and behavioral sciences. Standard error estimators of SEM models, originally developed for independent data, require modifications to accommodate the fact that time series data are inherently dependent. In this article, we extend a sandwich-type standard error estimator of independent data to multivariate time series data. One required element of this estimator is the asymptotic covariance matrix of concurrent and lagged correlations among manifest variables, whose closed-form expression has not been presented in the literature. The performance of the adapted sandwich-type standard error estimator is evaluated using a simulation study and further illustrated using an empirical example.     

Dealing with Multiple Solutions in Structural Vector Autoregressive Models

Structural vector autoregressive models (VARs) hold great potential for psychological science, particularly for time series data analysis. They capture the magnitude, direction of influence, and temporal (lagged and contemporaneous) nature of relations among variables. Unified structural equation modeling (uSEM) is an optimal structural VAR instantiation, according to large-scale simulation studies, and it is implemented within an SEM framework. However, little is known about the uniqueness of uSEM results. Thus, the goal of this study was to investigate whether multiple solutions result from uSEM analysis and, if so, to demonstrate ways to select an optimal solution. This was accomplished with two simulated data sets, an empirical data set concerning children's dyadic play, and modifications to the group iterative multiple model estimation (GIMME) program, which implements uSEMs with group- and individual-level relations in a data-driven manner. Results revealed multiple solutions when there were large contemporaneous relations among variables. Results also verified several ways to select the correct solution when the complete solution set was generated, such as the use of cross-validation, maximum standardized residuals, and information criteria. This work has immediate and direct implications for the analysis of time series data and for the inferences drawn from those data concerning human behavior.     

The common fate model for dyadic data: variations of a theoretically important but underutilized model

Studying dyads, very often there is a theoretical construct that has an effect on both members, such as relationship harmony or shared environment. To model such influences, the common fate model (CFM) is often the most appropriate approach. In this article, we address conceptual and statistical issues in the use of the standard CFM and present a series of variations, all of which are estimated by structural equation modeling (SEM). For indistinguishable dyad members (e.g., gay couples), we describe the use of a multilevel SEM method. Throughout the paper, we draw connections to the actor-partner interdependence model (APIM). We also discuss the analysis of hybrid models that combines both the CFM and the APIM. The models are illustrated using data from heterosexual couples.     

Structural Equation Modeling of Social Networks: Specification,Estimation, and Application

Psychologists are interested in whether friends and couples share similar personalities or not. However, no statistical models are readily available to test the association between personalities and social relations in the literature. In this study, we develop a statistical model for analyzing social network data with the latent personality traits as covariates. Because the model contains a measurement model for the latent traits and a structural model for the relationship between the network and latent traits, we discuss it under the general framework of structural equation modeling (SEM). In our model, the structural relation between the latent variable(s) and the outcome variable is no longer linear or generalized linear. To obtain model parameter estimates, we propose to use a two-stage maximum likelihood (ML) procedure. This modeling framework is evaluated through a simulation study under representative conditions that would be found in social network data. Its usefulness is then demonstrated through an empirical application to a college friendship network.     

Consistent Differential Discrimination Model Estimation

A novel factor-analytic model—the differential discrimination model—for assessing individual differences in scale use has been recently introduced, together with a three-stage estimation approach for model fitting. Unfortunately, the second-stage estimator and, as a consequence, the third-stage estimator of this procedure are not consistent. In this article we show that (a) the differential discrimination model can be expressed in a structural equation model framework, and (b) consistent and simultaneous estimation of all model parameters can be achieved using standard SEM software.     

Generalized multilevel structural equation modeling

A unifying framework for generalized multilevel structural equation modeling is introduced. The models in the framework, called generalized linear latent and mixed models (GLLAMM), combine features of generalized linear mixed models (GLMM) and structural equation models (SEM) and consist of a response model and a structural model for the latent variables. The response model generalizes GLMMs to incorporate factor structures in addition to random intercepts and coefficients. As in GLMMs, the data can have an arbitrary number of levels and can be highly unbalanced with different numbers of lower-level units in the higher-level units and missing data. A wide range of response processes can be modeled including ordered and unordered categorical responses, counts, and responses of mixed types. The structural model is similar to the structural part of a SEM except that it may include latent and observed variables varying at different levels. For example, unit-level latent variables (factors or random coefficients) can be regressed on cluster-level latent variables. Special cases of this framework are explored and data from the British Social Attitudes Survey are used for illustration. Maximum likelihood estimation and empirical Bayes latent score prediction within the GLLAMM framework can be performed using adaptive quadrature in gllamm, a freely available program running in Stata.gllamm can be downloaded from http://www.gllamm.org. The paper was written while Sophia Rabe-Hesketh was employed at and Anders Skrondal was visiting the Department of Biostatistics and Computing, Institute of Psychiatry, King's College London.     

Model Implied Instrumental Variables (MIIVs): An Alternative Orientation to Structural Equation Modeling

Few dispute that our models are approximations to reality. Yet when it comes to structural equation models (SEMs), we use estimators that assume true models (e.g. maximum likelihood) and that can create biased estimates when the model is inexact. This article presents an overview of the Model Implied Instrumental Variable (MIIV) approach to SEMs from Bollen (1996). The MIIV estimator using Two Stage Least Squares (2SLS), MIIV-2SLS, has greater robustness to structural misspecifications than system wide estimators. In addition, the MIIV-2SLS estimator is asymptotically distribution free. Furthermore, MIIV-2SLS has equation-based overidentification tests that can help pinpoint misspecifications. Beyond these features, the MIIV approach has other desirable qualities. MIIV methods apply to higher order factor analyses, categorical measures, growth curve models, dynamic factor analysis, and nonlinear latent variables. Finally, MIIV-2SLS permits researchers to estimate and test only the latent variable model or any other subset of equations. In addition, other MIIV estimators beyond 2SLS are available. Despite these promising features, research is needed to better understand its performance under a variety of conditions that represent empirical applications. Empirical and simulation examples in the article illustrate the MIIV orientation to SEMs and highlight an R package MIIVsem that implements MIIV-2SLS.     

Out-of-bag Prediction Error: A Cross Validation Index for Generalized Structured Component Analysis

Cross validation is a useful way of comparing predictive generalizability of theoretically plausible a priori models in structural equation modeling (SEM). A number of overall or local cross validation indices have been proposed for existing factor-based and component-based approaches to SEM, including covariance structure analysis and partial least squares path modeling. However, there is no such cross validation index available for generalized structured component analysis (GSCA) which is another component-based approach. We thus propose a cross validation index for GSCA, called Out-of-bag Prediction Error (OPE), which estimates the expected prediction error of a model over replications of so-called in-bag and out-of-bag samples constructed through the implementation of the bootstrap method. The calculation of this index is well-suited to the estimation procedure of GSCA, which uses the bootstrap method to obtain the standard errors or confidence intervals of parameter estimates. We empirically evaluate the performance of the proposed index through the analyses of both simulated and real data.     

Four simultaneous component models for the analysis of multivariate time series from more than one subject to model intraindividual and interindividual differences

A class of four simultaneous component models for the exploratory analysis of multivariate time series collected from more than one subject simultaneously is discussed. In each of the models, the multivariate time series of each subject is decomposed into a few series of component scores and a loading matrix. The component scores series reveal the latent data structure in the course of time. The interpretation of the components is based on the loading matrix. The simultaneous component models model not only intraindividual variability, but interindividual variability as well. The four models can be ordered hierarchically from weakly to severely constrained, thus allowing for big to small interindividual differences in the model. The use of the models is illustrated by an empirical example.This research has been made possible by funding from the Netherlands Organization of Scientific Research (NWO) to the first author. The authors are obliged to Tom A.B. Snijders, Jos M.F. ten Berge and three anonymous reviewers for comments on an earlier version of this paper, and to Kim Shifren for providing us with her data set, which was collected at Syracuse University.     

On structural models for analyzing change

The recommendation to base the analysis of multi-wave data upon explicit models for change is advocated. Several univariate and multivariate models are described, which emerge from an interaction between the classical test theory and the structural equation modeling approach. The resulting structural models for analyzing change reflect in some of their parameters substantively interesting aspects of intra- and interindividual change in follow-up studies. The models are viewed as an alternative to an ANOVA-based analysis of longitudinal data, and are illustrated on data from a cognitive intervention study of old adults (Bakes et al , 1986). The approach presents a useful means of analyzing change over time, and is applicable for purposes of (latent) growth curve analysis when analysis of variance assumptions are violated (e.g., Schaie & Hertzog, 1982; Morrison, 1976).     

A Polychoric Instrumental Variable (PIV) Estimator for Structural Equation Models with Categorical Variables

This paper presents a new polychoric instrumental variable (PIV) estimator to use in structural equation models (SEMs) with categorical observed variables. The PIV estimator is a generalization of Bollen’s (Psychometrika 61:109–121, 1996) 2SLS/IV estimator for continuous variables to categorical endogenous variables. We derive the PIV estimator and its asymptotic standard errors for the regression coefficients in the latent variable and measurement models. We also provide an estimator of the variance and covariance parameters of the model, asymptotic standard errors for these, and test statistics of overall model fit. We examine this estimator via an empirical study and also via a small simulation study. Our results illustrate the greater robustness of the PIV estimator to structural misspecifications than the system-wide estimators that are commonly applied in SEMs. Kenneth Bollen gratefully acknowledges support from NSF SES 0617276, NIDA 1-RO1-DA13148-01, and DA013148-05A2. Albert Maydeu-Olivares was supported by the Department of Universities, Research and Information Society (DURSI) of the Catalan Government, and by grant BSO2003-08507 from the Spanish Ministry of Science and Technology. We thank Sharon Christ, John Hipp, and Shawn Bauldry for research assistance. The comments of the members of the Carolina Structural Equation Modeling (CSEM) group are greatly appreciated. An earlier version of this paper under a different title was presented by K. Bollen at the Psychometric Society Meetings, June, 2002, Chapel Hill, North Carolina.     

An alternative two stage least squares (2SLS) estimator for latent variable equations

The Maximum-likelihood estimator dominates the estimation of general structural equation models. Noniterative, equation-by-equation estimators for factor analysis have received some attention, but little has been done on such estimators for latent variable equations. I propose an alternative 2SLS estimator of the parameters in LISREL type models and contrast it with the existing ones. The new 2SLS estimator allows observed and latent variables to originate from nonnormal distributions, is consistent, has a known asymptotic covariance matrix, and is estimable with standard statistical software. Diagnostics for evaluating instrumental variables are described. An empirical example illustrates the estimator. I gratefully acknowledge support for this research from the Sociology Program of the National Science Foundation (SES-9121564) and the Center for Advanced Study in the Behavioral Sciences, Stanford, California. This paper was presented at the Interdisciplinary Consortium for Statistical Applications at Indiana University at Bloomington (March 2, 1994) and at the RMD Conference on Causal Modeling at Purdue University, West Lafayette, Indiana (March 3-5, 1994).     

新世纪20年国内心理统计方法研究回顾

新世纪头20年, 国内心理学11本专业期刊一共发表了213篇统计方法研究论文。研究范围主要包括以下10类(按论文篇数排序)：结构方程模型、测验信度、中介效应、效应量与检验力、纵向研究、调节效应、探索性因子分析、潜在类别模型、共同方法偏差和多层线性模型。对各类做了简单的回顾与梳理。结果发现, 国内心理统计方法研究的广度和深度都不断增加, 研究热点在相互融合中共同发展; 但综述类论文比例较大, 原创性研究论文比例有待提高, 研究力量也有待加强。     

结构方程建模中的题目打包策略

结构方程建模中题目打包法的优缺点包括：指标数据质量变好、模型拟合程度提高; 估计偏差不大, 可校正; 估计稳定, 但降低了敏感性与可证伪性。打包法的前提条件是单维、同质, 适合结构模型分析, 不适合测量模型分析。对于单维测验, 给出了一个打包流程。对于通常的多个子量表(多维结构)测验, 推荐在子量表内打包, 每个子量表打包成1个指标或者3个指标, 用于结构方程建模。     

Structural equation modeling of paired-comparison and ranking data

L. L. Thurstone's (1927) model provides a powerful framework for modeling individual differences in choice behavior. An overview of Thurstonian models for comparative data is provided, including the classical Case V and Case III models as well as more general choice models with unrestricted and factor-analytic covariance structures. A flow chart summarizes the model selection process. The authors show how to embed these models within a more familiar structural equation modeling (SEM) framework. The different special cases of Thurstone's model can be estimated with a popular SEM statistical package, including factor analysis models for paired comparisons and rankings. Only minor modifications are needed to accommodate both types of data. As a result, complex models for comparative judgments can be both estimated and tested efficiently.     

Confirmatory Factor Analysis (CFA), Exploratory Structural Equation Modeling (ESEM), and Set-ESEM: Optimal Balance Between Goodness of Fit and Parsimony

Abstract

CFAs of multidimensional constructs often fail to meet standards of good measurement (e.g., goodness-of-fit, measurement invariance, and well-differentiated factors). Exploratory structural equation modeling (ESEM) represents a compromise between exploratory factor analysis’ (EFA) flexibility, and CFA/SEM’s rigor and parsimony, but lacks parsimony (particularly in large models) and might confound constructs that need to be kept separate. In Set-ESEM, two or more a priori sets of constructs are modeled within a single model such that cross-loadings are permissible within the same set of factors (as in Full-ESEM) but are constrained to be zero for factors in different sets (as in CFA). The different sets can reflect the same set of constructs on multiple occasions, and/or different constructs measured within the same wave. Hence, Set-ESEM that represents a middle-ground between the flexibility of traditional-ESEM (hereafter referred to as Full-ESEM) and the rigor and parsimony of CFA/SEM. Thus, the purposes of this article are to provide an overview tutorial on Set-ESEM, juxtapose it with Full-ESEM, and to illustrate its application with simulated data and diverse “real” data applications with accessible, heuristic explanations of best practice.     

Examining Spirituality Over Time: Latent Growth Curve and Individual Growth Curve Analyses

SUMMARY

Research on spirituality and religiousness has gained growing attention in recent years; however, most studies have used cross-sectional designs. As research on this topic evolves, there has been increasing recognition of the need to examine these constructs and their effects through the use of longitudinal designs. Beyond repeated-measures ANOVA and OLS regression models, what tools are available to examine these constructs over time? The purpose of this paper is to provide an overview of two cutting-edge statistical techniques that will facilitate longitudinal investigations of spirituality and religiousness: latent growth curve analysis using structural equation modeling (SEM) and individual growth curve models. The SEM growth curve approach examines change at the group level, with change over time expressed as a single latent growth factor. In contrast, individual growth curve models consider longitudinal change at the level of the person. While similar results may be obtained using either method, researchers may opt for one over the other due to the strengths and weaknesses associated with these methods. Examples of applications of both approaches to longitudinal studies of spirituality and religiousness are presented and discussed, along with design and data considerations when employing these modeling techniques.     

A Latent Gaussian process model for analysing intensive longitudinal data

Intensive longitudinal studies are becoming progressively more prevalent across many social science areas, and especially in psychology. New technologies such as smart-phones, fitness trackers, and the Internet of Things make it much easier than in the past to collect data for intensive longitudinal studies, providing an opportunity to look deep into the underlying characteristics of individuals under a high temporal resolution. In this paper we introduce a new modelling framework for latent curve analysis that is more suitable for the analysis of intensive longitudinal data than existing latent curve models. Specifically, through the modelling of an individual-specific continuous-time latent process, some unique features of intensive longitudinal data are better captured, including intensive measurements in time and unequally spaced time points of observations. Technically, the continuous-time latent process is modelled by a Gaussian process model. This model can be regarded as a semi-parametric extension of the classical latent curve models and falls under the framework of structural equation modelling. Procedures for parameter estimation and statistical inference are provided under an empirical Bayes framework and evaluated by simulation studies. We illustrate the use of the proposed model though the analysis of an ecological momentary assessment data set.     

多维测验项目参数的估计：基于SEM与MIRT方法的比较

作者简要回顾了SEM框架下分类数据因素分析(CCFA)模型和MIRT框架下测验题目和潜在能力的关系模型, 对两种框架下的主要参数估计方法进行了总结。通过模拟研究, 比较了SEM框架下WLSc和WLSMV估计方法与MIRT框架下MLR和MCMC估计方法的差异。研究结果表明：(1) WLSc得到参数估计的偏差最大, 且存在参数收敛的问题; (2)随着样本量增大, 各种项目参数估计的精度均提高, WLSMV方法与MLR方法得到的参数估计精度差异很小, 大多数情况下不比MCMC方法差; (3)除WLSc方法外, 随着每个维度测验题目的增多参数估计的精度逐渐增高; (4)测验维度对区分度参数和难度参数的影响较大, 而测验维度对项目因素载荷和阈值的影响相对较小; (5)项目参数的估计精度受项目测量维度数的影响, 只测量一个维度的项目参数估计精度较高。另外文章还对两种方法在实际应用中应该注意的问题提供了一些建议。