Quadratic prediction of factor scores

Factor scores are naturally predicted by means of their conditional expectation given the indicatorsy. Under normality this expectation is linear iny but in general it is an unknown function ofy. It is discussed that under nonnormality factor scores can be more precisely predicted by a quadratic function ofy.The authors would like to thank Edith Nijenhuis, the anonymous referees, and the associate editor for their helpful comments and suggestions.     

The effect of additional variables on factor indeterminacy in models with a single common factor

Determinate solutions for the indeterminate common factor ofp variables satisfying the single common factor model are not unique. Therefore an infinite sequence of additional variables that conform jointly with the originalp variables to the original single common factor model does not determine a unique solution for the indeterminate factor of thep variables (although the solution is unique for the factor of the infinite sequence). Other infinite sequences may be found to determine different solutions for the factor of the originalp variables. The paper discusses a number of theorems about the effects of additional variables on factor indeterminacy in a model with a single common factor and draws conclusions from them for factor theory in general.     

An alternative two stage least squares (2SLS) estimator for latent variable equations

The Maximum-likelihood estimator dominates the estimation of general structural equation models. Noniterative, equation-by-equation estimators for factor analysis have received some attention, but little has been done on such estimators for latent variable equations. I propose an alternative 2SLS estimator of the parameters in LISREL type models and contrast it with the existing ones. The new 2SLS estimator allows observed and latent variables to originate from nonnormal distributions, is consistent, has a known asymptotic covariance matrix, and is estimable with standard statistical software. Diagnostics for evaluating instrumental variables are described. An empirical example illustrates the estimator. I gratefully acknowledge support for this research from the Sociology Program of the National Science Foundation (SES-9121564) and the Center for Advanced Study in the Behavioral Sciences, Stanford, California. This paper was presented at the Interdisciplinary Consortium for Statistical Applications at Indiana University at Bloomington (March 2, 1994) and at the RMD Conference on Causal Modeling at Purdue University, West Lafayette, Indiana (March 3-5, 1994).     

Latent variables should remain as such: Evidence from a Monte Carlo study

Use of subject scores as manifest variables to assess the relationship between latent variables produces attenuated estimates. This has been demonstrated for raw scores from classical test theory (CTT) and factor scores derived from factor analysis. Conclusions on scores have not been sufficiently extended to item response theory (IRT) theta estimates, which are still recommended for estimation of relationships between latent variables. This is because IRT estimates appear to have preferable properties compared to CTT, while structural equation modeling (SEM) is often advised as an alternative to scores for estimation of the relationship between latent variables. The present research evaluates the consequences of using subject scores as manifest variables in regression models to test the relationship between latent variables. Raw scores and three methods for obtaining theta estimates were used and compared to latent variable SEM modeling. A Monte Carlo study was designed by manipulating sample size, number of items, type of test, and magnitude of the correlation between latent variables. Results show that, despite the advantage of IRT models in other areas, estimates of the relationship between latent variables are always more accurate when SEM models are used. Recommendations are offered for applied researchers.     

Linear structural equations with latent variables

An interdependent multivariate linear relations model based on manifest, measured variables as well as unmeasured and unmeasurable latent variables is developed. The latent variables include primary or residual common factors of any order as well as unique factors. The model has a simpler parametric structure than previous models, but it is designed to accommodate a wider range of applications via its structural equations, mean structure, covariance structure, and constraints on parameters. The parameters of the model may be estimated by gradient and quasi-Newton methods, or a Gauss-Newton algorithm that obtains least-squares, generalized least-squares, or maximum likelihood estimates. Large sample standard errors and goodness of fit tests are provided. The approach is illustrated by a test theory model and a longitudinal study of intelligence.This investigation was supported in part by a Research Scientist Development Award (KO2-DA00017) and a research grant (DA01070) from the U. S. Public Health Service.     

Premature conclusions about the signal-to-noise ratio in structural equation modeling research: A commentary on Yuan and Fang (2023)

In a recent article published in this journal, Yuan and Fang (British Journal of Mathematical and Statistical Psychology, 2023) suggest comparing structural equation modeling (SEM), also known as covariance-based SEM (CB-SEM), estimated by normal-distribution-based maximum likelihood (NML), to regression analysis with (weighted) composites estimated by least squares (LS) in terms of their signal-to-noise ratio (SNR). They summarize their findings in the statement that “[c]ontrary to the common belief that CB-SEM is the preferred method for the analysis of observational data, this article shows that regression analysis via weighted composites yields parameter estimates with much smaller standard errors, and thus corresponds to greater values of the [SNR].” In our commentary, we show that Yuan and Fang have made several incorrect assumptions and claims. Consequently, we recommend that empirical researchers not base their methodological choice regarding CB-SEM and regression analysis with composites on the findings of Yuan and Fang as these findings are premature and require further research.     

Regression estimation and post-stratification in factor analysis

Regression estimation and poststratification are methods used in survey sampling to estimate a population mean, when additional information is available for some auxiliary variables. The extension of these methods to factor analysis is considered. These methods may be used either to improve the efficiency of estimation or to adjust for the effects of nonrandom selection. The estimation procedure may be formulated in a LISREL framework.The author is grateful to the referees for their comments.     

Generalized multilevel structural equation modeling

A unifying framework for generalized multilevel structural equation modeling is introduced. The models in the framework, called generalized linear latent and mixed models (GLLAMM), combine features of generalized linear mixed models (GLMM) and structural equation models (SEM) and consist of a response model and a structural model for the latent variables. The response model generalizes GLMMs to incorporate factor structures in addition to random intercepts and coefficients. As in GLMMs, the data can have an arbitrary number of levels and can be highly unbalanced with different numbers of lower-level units in the higher-level units and missing data. A wide range of response processes can be modeled including ordered and unordered categorical responses, counts, and responses of mixed types. The structural model is similar to the structural part of a SEM except that it may include latent and observed variables varying at different levels. For example, unit-level latent variables (factors or random coefficients) can be regressed on cluster-level latent variables. Special cases of this framework are explored and data from the British Social Attitudes Survey are used for illustration. Maximum likelihood estimation and empirical Bayes latent score prediction within the GLLAMM framework can be performed using adaptive quadrature in gllamm, a freely available program running in Stata.gllamm can be downloaded from http://www.gllamm.org. The paper was written while Sophia Rabe-Hesketh was employed at and Anders Skrondal was visiting the Department of Biostatistics and Computing, Institute of Psychiatry, King's College London.     

The rank of reduced dispersion matrices

Psychometricians working in factor analysis and econometricians working in regression with measurement error in all variables are both interested in the rank of dispersion matrices under variation of the diagonal elements. Psychometricians concentrate on cases in which low rank can be attained, preferably rank one, the Spearman case. Econometricians cocentrate on cases in which the rank cannot be reduced below the number of variables minus one, the Frisch case. In this paper we give an extensive historial discussion of both fields, we prove the two key results in a more satisfactory and uniform way, we point out various small errors and misunderstandings, and we present a methodological comparison of factor analysis and regression on the basis of our results.Financial support by the Netherlands Organization for the Advancement of Pure Research (ZWO) is gratefully acknowledged.     

Model modification

An analysis of empirical data often leads to a rejection of a hypothesized model, even if the researcher has spent considerable efforts in including all available information in the formulation of the model. Thus, the researcher must reformulate the model in some way, but in most instances there is, at least theoretically, an overwhelming number of possible actions that could be taken. In this paper a modification index will be discussed which should serve as a guide in the search for a better model. In statistical terms, the index measures how much we will be able to reduce the discrepancy between model and data, as defined by a general fit function, when one parameter is added or freed or when one equality constraint is relaxed. The modification index discussed in this paper is an improvement of the one incorporated in the LISREL V computer program in that it takes into account changes in all the parameters of the model when one particular parameter is freed.The research reported in this paper has been supported by The Swedish Council for Research in the Humanities and Social Sciences under Research Program Multivariate Statistical Analysis, Project Director Karl G Jöreskog.     

A Method of Correcting Estimation Failure in Latent Differential Equations with Comparisons to Kalman Filtering

Abstract

Studies have used the latent differential equation (LDE) model to estimate the parameters of damped oscillation in various phenomena, but it has been shown that correct, non-zero parameter estimates are only obtained when the latent series exhibits little or no process noise. Consequently, LDEs are limited to modeling deterministic processes with measurement error rather than those with random behavior in the true latent state. The reasons for these limitations are considered, and a piecewise deterministic approximation (PDA) algorithm is proposed to treat process noise outliers as functional discontinuities and obtain correct estimates of the damping parameter. Comprehensive, random-effects simulations were used to compare results with those obtained using a state-space model (SSM) based on the Kalman filter. The LDE with the PDA algorithm (LDEPDA) successfully recovered the simulated damping parameter under a variety of conditions when process noise was present in the latent state. The LDEPDA had greater precision and accuracy than the SSM when estimating parameters from data with sparse jump discontinuities, but worse performance for diffusion processes overall. All three methods were applied to a sample of postural sway data. The basic LDE estimated zero damping, while the LDEPDA and SSM estimated moderate to high damping. The SSM estimated the smallest standard errors for both frequency and damping parameter estimates.     

A Latent Transition Model With Logistic Regression

Latent transition models increasingly include covariates that predict prevalence of latent classes at a given time or transition rates among classes over time. In many situations, the covariate of interest may be latent. This paper describes an approach for handling both manifest and latent covariates in a latent transition model. A Bayesian approach via Markov chain Monte Carlo (MCMC) is employed in order to achieve more robust estimates. A case example illustrating the model is provided using data on academic beliefs and achievement in a low-income sample of adolescents in the United States. This research was partially supported by the National Institute on Drug Abuse Grant 1-R03-DA021639. This research was partially supported by the National Institute on Drug Abuse Grant 1-P50-DA10075, The Methodology Center, The Pennsylvania State University. This research was partially supported by the National Institute of Mental Health funds as part of the Studying Diverse Lives research support program at the Henry A. Murray Research Archive, Institute for Quantitative Science, Harvard University.     

Extending the Debate Between Spearman and Wilson 1929: When do Single Variables Optimally Reproduce the Common Part of the Observed Covariances?

The covariances of observed variables reproduced from conventional factor score predictors are generally not the same as the covariances reproduced from the common factors. We sought to find a factor score predictor that optimally reproduces the common part of the observed covariances. It was found algebraically that—under some conditions—the single observed variable with highest loading on a factor reproduces the non-diagonal elements of the observed covariance matrix more exactly than the conventional factor score predictors. This finding is linked to Spearman's and Wilson's 1929 debate on the use of single variables as factor score predictors. A population-based and a sample-based simulation study confirmed the algebraic result that taking a single variable can outperform conventional factor score predictors in reproducing the non-diagonal covariances when the nonzero loading size and the number of nonzero loadings per factor are small. The results indicated that a weighted aggregation of variables does not necessarily lead to an improvement of the score over the variable with the highest loading.     

潜变量交互效应分析方法

简要回顾了分析显变量交互效应的常用方法。详细讨论了目前分析潜变量交互效应的主要方法,包括用潜变量的因子得分做回归分析、分组线性结构方程模型分析、加入乘积项的结构方程模型分析和两步最小二乘回归分析,并比较和评价了这些方法的优缺点。最后归纳了潜变量交互效应分析方法的研究趋势,并介绍了新近进展(包括LMS方法和GAPI方法)。     

Best univocal estimates of orthogonal common factors

A general formulation is presented for obtaining conditionally unbiased, univocal common-factor score estimates that have maximum validity for the true orthogonal factor scores. We note that although this expression is formally different from both Bartlett's formulation and Heermann's approximate expression, all three, while developed from very different rationales, yield identical results given that the common-factor model holds for the data. Although the true factor score validities can be raised by a different non-orthogonal transformation of orthogonalized regression estimates—as described by Mulaik—the resulting estimates lose their univocality.     

Exploratory structural equation modeling,bifactor models,and standard confirmatory factor analysis models: Application to the BASC-2 Behavioral and Emotional Screening System Teacher Form

Several psychological assessment instruments are based on the assumption of a general construct that is composed of multiple interrelated domains. Standard confirmatory factor analysis is often not well suited for examining the factor structure of such scales. This study used data from 1885 elementary school students (mean age = 8.77 years, SD = 1.47 years) to examine the factor structure of the Behavioral Assessment System for Children, Second Edition (BASC-2) Behavioral and Emotional Screening System (BESS) Teacher Form that was designed to assess general risk for emotional/behavioral difficulty among children. The modeling sequence included the relatively new exploratory structural equation modeling (ESEM) approach and bifactor models in addition to more standard techniques. Findings revealed that the factor structure of the BASC-2 BESS Teacher Form is multidimensional. Both ESEM and bifactor models showed good fit to the data. Bifactor models were preferred on conceptual grounds. Findings illuminate the hypothesis-generating power of ESEM and suggest that it might not be optimal for instruments designed to assess a predominant general factor underlying the data.     

Cross-Sectional Analysis of Longitudinal Mediation Processes

Statistical mediation analysis can help to identify and explain the mechanisms behind psychological processes. Examining a set of variables for mediation effects is a ubiquitous process in the social sciences literature; however, despite evidence suggesting that cross-sectional data can misrepresent the mediation of longitudinal processes, cross-sectional analyses continue to be used in this manner. Alternative longitudinal mediation models, including those rooted in a structural equation modeling framework (cross-lagged panel, latent growth curve, and latent difference score models) are currently available and may provide a better representation of mediation processes for longitudinal data. The purpose of this paper is twofold: first, we provide a comparison of cross-sectional and longitudinal mediation models; second, we advocate using models to evaluate mediation effects that capture the temporal sequence of the process under study. Two separate empirical examples are presented to illustrate differences in the conclusions drawn from cross-sectional and longitudinal mediation analyses. Findings from these examples yielded substantial differences in interpretations between the cross-sectional and longitudinal mediation models considered here. Based on these observations, researchers should use caution when attempting to use cross-sectional data in place of longitudinal data for mediation analyses.     

An incomplete data approach to the analysis of covariance structures

In this paper, linear structural equation models with latent variables are considered. It is shown how many common models arise from incomplete observation of a relatively simple system. Subclasses of models with conditional independence interpretations are also discussed. Using an incomplete data point of view, the relationships between the incomplete and complete data likelihoods, assuming normality, are highlighted. For computing maximum likelihood estimates, the EM algorithm and alternatives are surveyed. For the alternative algorithms, simplified expressions for computing function values and derivatives are given. Likelihood ratio tests based on complete and incomplete data are related, and an example on using their relationship to improve the fit of a model is given.This research forms part of the author's doctoral thesis and was supported by a Commonwealth Postgraduate Research Award. The author also wishes to acknowledge the support of CSIRO during the preparation of this paper and the referees' comments which led to substantial improvements.     

Stability of aggression among adolescents over time: A south African study

In a study spanning 5 years, data were collected on the aggressiveness of over 1,700 male and female subjects. Subjects who were the more aggressive grade 8 (standard 6) pupils at the beginning of the study were discovered to be the more aggressive grade 12 (standard 10) pupils. It is concluded that, whatever its causes, aggression can be viewed as a persistent trait that may be influenced by situational variables but reveals substantial consistency over time. The findings of studies by Huesmann and Eron in the United States as well as Olweus in Scandinavia were thus supported in this South African investigation.