Dynamic GSCA (Generalized Structured Component Analysis) with Applications to the Analysis of Effective Connectivity in Functional Neuroimaging Data

We propose a new method of structural equation modeling (SEM) for longitudinal and time series data, named Dynamic GSCA (Generalized Structured Component Analysis). The proposed method extends the original GSCA by incorporating a multivariate autoregressive model to account for the dynamic nature of data taken over time. Dynamic GSCA also incorporates direct and modulating effects of input variables on specific latent variables and on connections between latent variables, respectively. An alternating least square (ALS) algorithm is developed for parameter estimation. An improved bootstrap method called a modified moving block bootstrap method is used to assess reliability of parameter estimates, which deals with time dependence between consecutive observations effectively. We analyze synthetic and real data to illustrate the feasibility of the proposed method.     

Regularized Generalized Structured Component Analysis

Generalized structured component analysis (GSCA) has been proposed as a component-based approach to structural equation modeling. In practice, GSCA may suffer from multi-collinearity, i.e., high correlations among exogenous variables. GSCA has yet no remedy for this problem. Thus, a regularized extension of GSCA is proposed that integrates a ridge type of regularization into GSCA in a unified framework, thereby enabling to handle multi-collinearity problems effectively. An alternating regularized least squares algorithm is developed for parameter estimation. A Monte Carlo simulation study is conducted to investigate the performance of the proposed method as compared to its non-regularized counterpart. An application is also presented to demonstrate the empirical usefulness of the proposed method.     

Multilevel Dynamic Generalized Structured Component Analysis for Brain Connectivity Analysis in Functional Neuroimaging Data

We extend dynamic generalized structured component analysis (GSCA) to enhance its data-analytic capability in structural equation modeling of multi-subject time series data. Time series data of multiple subjects are typically hierarchically structured, where time points are nested within subjects who are in turn nested within a group. The proposed approach, named multilevel dynamic GSCA, accommodates the nested structure in time series data. Explicitly taking the nested structure into account, the proposed method allows investigating subject-wise variability of the loadings and path coefficients by looking at the variance estimates of the corresponding random effects, as well as fixed loadings between observed and latent variables and fixed path coefficients between latent variables. We demonstrate the effectiveness of the proposed approach by applying the method to the multi-subject functional neuroimaging data for brain connectivity analysis, where time series data-level measurements are nested within subjects.     

Bayesian generalized structured component analysis

Generalized structured component analysis (GSCA) is a component-based approach to structural equation modelling, which adopts components of observed variables as proxies for latent variables and examines directional relationships among latent and observed variables. GSCA has been extended to deal with a wider range of data types, including discrete, multilevel or intensive longitudinal data, as well as to accommodate a greater variety of complex analyses such as latent moderation analysis, the capturing of cluster-level heterogeneity, and regularized analysis. To date, however, there has been no attempt to generalize the scope of GSCA into the Bayesian framework. In this paper, a novel extension of GSCA, called BGSCA, is proposed that estimates parameters within the Bayesian framework. BGSCA can be more attractive than the original GSCA for various reasons. For example, it can infer the probability distributions of random parameters, account for error variances in the measurement model, provide additional fit measures for model assessment and comparison from the Bayesian perspectives, and incorporate external information on parameters, which may be obtainable from past research, expert opinions, subjective beliefs or knowledge on the parameters. We utilize a Markov chain Monte Carlo method, the Gibbs sampler, to update the posterior distributions for the parameters of BGSCA. We conduct a simulation study to evaluate the performance of BGSCA. We also apply BGSCA to real data to demonstrate its empirical usefulness.     

Functional Generalized Structured Component Analysis

An extension of Generalized Structured Component Analysis (GSCA), called Functional GSCA, is proposed to analyze functional data that are considered to arise from an underlying smooth curve varying over time or other continua. GSCA has been geared for the analysis of multivariate data. Accordingly, it cannot deal with functional data that often involve different measurement occasions across participants and a large number of measurement occasions that exceed the number of participants. Functional GSCA addresses these issues by integrating GSCA with spline basis function expansions that represent infinite-dimensional curves onto a finite-dimensional space. For parameter estimation, functional GSCA minimizes a penalized least squares criterion by using an alternating penalized least squares estimation algorithm. The usefulness of functional GSCA is illustrated with gait data.     

Generalized latent variable models with non‐linear effects

Until recently, item response models such as the factor analysis model for metric responses, the two‐parameter logistic model for binary responses and the multinomial model for nominal responses considered only the main effects of latent variables without allowing for interaction or polynomial latent variable effects. However, non‐linear relationships among the latent variables might be necessary in real applications. Methods for fitting models with non‐linear latent terms have been developed mainly under the structural equation modelling approach. In this paper, we consider a latent variable model framework for mixed responses (metric and categorical) that allows inclusion of both non‐linear latent and covariate effects. The model parameters are estimated using full maximum likelihood based on a hybrid integration–maximization algorithm. Finally, a method for obtaining factor scores based on multiple imputation is proposed here for the non‐linear model.     

Out-of-bag Prediction Error: A Cross Validation Index for Generalized Structured Component Analysis

Cross validation is a useful way of comparing predictive generalizability of theoretically plausible a priori models in structural equation modeling (SEM). A number of overall or local cross validation indices have been proposed for existing factor-based and component-based approaches to SEM, including covariance structure analysis and partial least squares path modeling. However, there is no such cross validation index available for generalized structured component analysis (GSCA) which is another component-based approach. We thus propose a cross validation index for GSCA, called Out-of-bag Prediction Error (OPE), which estimates the expected prediction error of a model over replications of so-called in-bag and out-of-bag samples constructed through the implementation of the bootstrap method. The calculation of this index is well-suited to the estimation procedure of GSCA, which uses the bootstrap method to obtain the standard errors or confidence intervals of parameter estimates. We empirically evaluate the performance of the proposed index through the analyses of both simulated and real data.     

Abstract: Comparing Semiparametric and Parametric Methods for Modeling Interactions Among Latent Variables

Many approaches have been proposed to estimate interactions among latent variables. These methods often assume a specific functional form for the interaction, such as a bilinear interaction. Theory is seldom specific enough to provide a functional form for an interaction, however, so a more exploratory, diagnostic approach may often be required. Bauer (2005) proposed a semiparametric approach that allows for the estimation of interaction effects of unknown functional form among latent variables. A structural equation mixture model (SEMM) is first fit to the data. Then an approximation of the interaction is obtained by aggregating over the mixing components. A simulation study is used to examine the performance of this semiparametric approach to two parametric approaches: the latent moderated structures approach (Klein & Moosbrugger, 2000) and the unconstrained product-indicator approach (Marsh, Wen, & Hau, 2004). Data were generated from four functional forms: main effects only, quadratic trend, bilinear interaction, and exponential interaction. Estimates of bias and root mean squared error of approximation were calculated by comparing the surface used to generate the data and the model-implied surface constructed from each approach. As expected, the parametric approaches were more efficient than the SEMM. For the main effects model, bias was similar for both the SEMM and parametric approaches. For the bilinear interaction, the parametric approaches provided nearly identical results, although the SEMM approach was slightly more biased. When the parametric approaches assumed a bilinear interaction and the data were generated from a quadratic trend or an exponential interaction, the parametric approaches generated biased estimates of the true surface. The SEMM approach approximated the true data generation surface with a similarly low level of bias for all the nonlinear surfaces. For example, Figure 1 shows the true surface for the bilinear interaction along with the SEMM estimated average surface. The results suggest that the SEMM approach can provide a relatively unbiased approximation to variety of nonlinear relationships among latent variables.     

A Bayesian Model For The Estimation Of Latent Interaction And Quadratic Effects When Latent Variables Are Non-Normally Distributed

Structural equation models with interaction and quadratic effects have become a standard tool for testing nonlinear hypotheses in the social sciences. Most of the current approaches assume normally distributed latent predictor variables. In this article, we present a Bayesian model for the estimation of latent nonlinear effects when the latent predictor variables are nonnormally distributed. The nonnormal predictor distribution is approximated by a finite mixture distribution. We conduct a simulation study that demonstrates the advantages of the proposed Bayesian model over contemporary approaches (Latent Moderated Structural Equations [LMS], Quasi-Maximum-Likelihood [QML], and the extended unconstrained approach) when the latent predictor variables follow a nonnormal distribution. The conventional approaches show biased estimates of the nonlinear effects; the proposed Bayesian model provides unbiased estimates. We present an empirical example from work and stress research and provide syntax for substantive researchers. Advantages and limitations of the new model are discussed.     

无均值结构的潜变量交互效应模型的标准化估计

潜变量交互效应建模研究近年来有两项重要进展, 一是提出了潜变量交互效应模型的标准化估计及其计算公式; 二是发现无均值结构模型可以取代传统的有均值结构模型, 建模大为简化。但标准化估计是在传统的有均值结构模型中建立的, 在简化的模型中同样适用吗？本文在无均值结构模型的框架内, 给出了潜变量交互效应模型的标准化形式、计算公式和建模步骤, 并通过模拟研究比较了极大似然和广义最小二乘两种估计方法、配对乘积指标和全部乘积指标两种指标类型, 结果表明, 在计算交互效应的标准化估计时, 应当使用配对乘积指标建模, 并且首选极大似然估计。     

纳入式分类分析法在潜在剖面模型的后续多元回归中的应用

纳入式分类分析法能克服传统的分类分析法对后续一元回归模型参数的低估,发挥潜在类别模型的后续分析简化变量间交互作用的功能。本文进一步将纳入式分类分析法拓展至潜在剖面模型后续的多元统计分析中。通过蒙特卡洛模拟实验,比较各种纳入变量的方法思路与后续分析模型在四种常见的多元回归模型中参数估计的表现。结果发现,纳入式分类分析法所需纳入的变量取决于后续分析中与因变量、潜类别变量的关系,且后续分析使用含交互作用的模型更为稳健。     

基于结构方程模型的有调节的中介效应分析

有调节的中介模型是中介过程受到调节变量影响的模型。指出了目前有调节的中介效应分析普遍存在的问题：当前有调节的中介效应检验大多使用多元线性回归分析,忽略了测量误差;而基于结构方程模型(SEM)的有调节的中介效应分析需要产生乘积指标,又会面临乘积指标生成和乘积项非正态分布的问题。在简介潜调节结构方程(LMS)方法后,建议使用LMS方法得到偏差校正的bootstrap置信区间来进行基于SEM的有调节的中介效应分析。总结出一个有调节的中介SEM分析流程,并有示例和相应的Mplus程序。文末展望了LMS和有调节的中介模型的发展方向。     

Modeling Interactions Between Latent Variables in Research on Type D Personality: A Monte Carlo Simulation and Clinical Study of Depression and Anxiety

Several approaches exist to model interactions between latent variables. However, it is unclear how these perform when item scores are skewed and ordinal. Research on Type D personality serves as a good case study for that matter. In Study 1, we fitted a multivariate interaction model to predict depression and anxiety with Type D personality, operationalized as an interaction between its two subcomponents negative affectivity (NA) and social inhibition (SI). We constructed this interaction according to four approaches: (1) sum score product; (2) single product indicator; (3) matched product indicators; and (4) latent moderated structural equations (LMS). In Study 2, we compared these interaction models in a simulation study by assessing for each method the bias and precision of the estimated interaction effect under varying conditions. In Study 1, all methods showed a significant Type D effect on both depression and anxiety, although this effect diminished after including the NA and SI quadratic effects. Study 2 showed that the LMS approach performed best with respect to minimizing bias and maximizing power, even when item scores were ordinal and skewed. However, when latent traits were skewed LMS resulted in more false-positive conclusions, while the Matched PI approach adequately controlled the false-positive rate.     

潜变量交互效应标准化估计：方法比较与选用策略

标准化估计对模型的解释和效应大小的比较有重要作用。虽然潜变量交互效应的恰当标准化估计公式已经面世超过10年, 国内外都在使用和引用, 但至今未见到关于不同估计方法得到的恰当标准化估计的系统比较。通过模拟实验, 比较了乘积指标法、潜调节结构方程(LMS)、无先验信息和有先验信息的贝叶斯法的潜变量交互效应标准化估计在不同条件下的表现。结果发现, 在正态条件下, LMS和有信息贝叶斯法表现较好; 而在非正态条件下, 乘积指标法比较稳健, 但需要较大的样本(不小于500), 小样本且外生潜变量之间相关很低时可使用无信息贝叶斯法。     

结构方程模型中调节效应的标准化估计

回归分析和结构方程分析中,标准化估计对解释模型和比较效应大小有重要作用。对于调节效应模型（或交互效应模型）,通常的标准化估计没有意义。虽然显变量的调节效应模型标准化估计问题已经解决,但潜变量的调节效应模型标准化估计问题复杂得多。本文先介绍回归分析中显变量调节效应模型的标准化估计,然后提出了一种通过参数的原始估计和通常标准化估计来计算潜变量调节效应模型的“标准化”估计的方法,得到的“标准化”估计是尺度不变的,说明可以用“标准化”估计来解释和比较主效应和调节效应     

潜变量交互效应建模: 告别均值结构

潜变量交互效应建模研究近年来有了长足的发展, 但模型中被认为不可缺少的均值结构往往让实际应用工作者却步。本文首先分析了潜变量交互效应模型中均值结构产生的根源; 然后讨论了指标变换与均值结构的关系; 接着提出了一个均值为零的潜变量交互结构, 所建立的模型不需要均值结构, 却不会改变主效应和交互效应等参数; 最后用模拟例子对无均值结构和有均值结构的两种模型的参数估计进行了比较, 结果符合理论预期, 困扰人们多年的均值结构问题从此可以终结。     

An exploratory analysis of the latent structure of process data via action sequence autoencoders

Computer simulations have become a popular tool for assessing complex skills such as problem-solving. Log files of computer-based items record the human–computer interactive processes for each respondent in full. The response processes are very diverse, noisy, and of non-standard formats. Few generic methods have been developed to exploit the information contained in process data. In this paper we propose a method to extract latent variables from process data. The method utilizes a sequence-to-sequence autoencoder to compress response processes into standard numerical vectors. It does not require prior knowledge of the specific items and human–computer interaction patterns. The proposed method is applied to both simulated and real process data to demonstrate that the resulting latent variables extract useful information from the response processes.     

有调节的多层中介效应分析

多层中介和多层调节效应分析在社科领域已常有应用,但如果将多层中介和调节整合在一起,可以产生2（多层中介类型）×2（调节变量的层次）×3（调节的中介路径）共12种有调节的多层中介模型。面对有调节的多层中介效应分析,研究者往往束手无策。详述了基于多层线性模型的12种有调节的多层中介的分析方法和基于多层结构方程模型的4类有调节的多层中介分析方法,包括正交分割法,随机系数预测法,潜调节结构方程法和贝叶斯合理值法。这四类方法的核心议题在于如何处理潜调节项。当样本量足够大时,建议选择潜调节结构方程法;当样本量不足时,建议选择贝叶斯合理值法。随后用一个实际例子演示如何进行有调节的多层中介效应分析并有相应的Mplus程序。最后展望了有调节的多层中介效应分析研究的拓展方向。     

Full Information Maximum Likelihood Estimation for Latent Variable Interactions With Incomplete Indicators

Researchers have developed missing data handling techniques for estimating interaction effects in multiple regression. Extending to latent variable interactions, we investigated full information maximum likelihood (FIML) estimation to handle incompletely observed indicators for product indicator (PI) and latent moderated structural equations (LMS) methods. Drawing on the analytic work on missing data handling techniques in multiple regression with interaction effects, we compared the performance of FIML for PI and LMS analytically. We performed a simulation study to compare FIML for PI and LMS. We recommend using FIML for LMS when the indicators are missing completely at random (MCAR) or missing at random (MAR) and when they are normally distributed. FIML for LMS produces unbiased parameter estimates with small variances, correct Type I error rates, and high statistical power of interaction effects. We illustrated the use of these methods by analyzing the interaction effect between advanced cancer patients’ depression and change of inner peace well-being on future hopelessness levels.