Using SAS PROC CALIS to fit Level-1 error covariance structures of latent growth models

In the present article, we demonstrates the use of SAS PROC CALIS to fit various types of Level-1 error covariance structures of latent growth models (LGM). Advantages of the SEM approach, on which PROC CALIS is based, include the capabilities of modeling the change over time for latent constructs, measured by multiple indicators; embedding LGM into a larger latent variable model; incorporating measurement models for latent predictors; and better assessing model fit and the flexibility in specifying error covariance structures. The strength of PROC CALIS is always accompanied with technical coding work, which needs to be specifically addressed. We provide a tutorial on the SAS syntax for modeling the growth of a manifest variable and the growth of a latent construct, focusing the documentation on the specification of Level-1 error covariance structures. Illustrations are conducted with the data generated from two given latent growth models. The coding provided is helpful when the growth model has been well determined and the Level-1 error covariance structure is to be identified.     

Reciprocal influences in children's and families' adaptation to early childhood wheezing.

OBJECTIVE: The objective of the present study was to demonstrate the reciprocal relationships between family adaptation to illness and children's medication use over time among children who presented with wheezing illness in infancy but have varying illness outcomes by age 4. DESIGN: A longitudinal design and latent growth curve models (LGM) were used to predict change in family and caregiver adaptation to illness and children's medication use over three years among 140 infants with wheezing, among families from low socioeconomic, multi-ethnic backgrounds. MAIN OUTCOME MEASURES: One LGM predicted level and change (slope) of family adaptation to illness from children's baseline medication use. The second LGM predicted level and change (slope) of children's medication use from baseline family adjustment to illness. In both models, illness severity, caregivers' psychological resources, and emergency department use were covaried with the independent variable. RESULTS: Two latent growth models were found to adequately fit the data and demonstrate full reciprocal relations between family adaptation to illness and children's medication use while accounting for baseline variables. Baseline measures of caregiver psychological functioning and illness severity were also significant predictors of family adaptation and children's medication use over time. The two models were not statistically different for children with and without active asthma at 4 years of age. CONCLUSION: Findings support the reciprocal effects model of child and family influences on pediatric illness and underscore the importance of early indicators of individual and family functioning.     

Growth modeling with nonignorable dropout: alternative analyses of the STAR*D antidepressant trial

This article uses a general latent variable framework to study a series of models for nonignorable missingness due to dropout. Nonignorable missing data modeling acknowledges that missingness may depend not only on covariates and observed outcomes at previous time points as with the standard missing at random assumption, but also on latent variables such as values that would have been observed (missing outcomes), developmental trends (growth factors), and qualitatively different types of development (latent trajectory classes). These alternative predictors of missing data can be explored in a general latent variable framework with the Mplus program. A flexible new model uses an extended pattern-mixture approach where missingness is a function of latent dropout classes in combination with growth mixture modeling. A new selection model not only allows an influence of the outcomes on missingness but allows this influence to vary across classes. Model selection is discussed. The missing data models are applied to longitudinal data from the Sequenced Treatment Alternatives to Relieve Depression (STAR*D) study, the largest antidepressant clinical trial in the United States to date. Despite the importance of this trial, STAR*D growth model analyses using nonignorable missing data techniques have not been explored until now. The STAR*D data are shown to feature distinct trajectory classes, including a low class corresponding to substantial improvement in depression, a minority class with a U-shaped curve corresponding to transient improvement, and a high class corresponding to no improvement. The analyses provide a new way to assess drug efficiency in the presence of dropout.     

Qualitative and Quantitative Shifts in Adolescent Problem Behavior Development: A Cohort-Sequential Multivariate Latent Growth Modeling Approach

The aim of this study was to examine the nature of problem behavior development from late childhood through adolescence, to assess the quantitative development of problem behavior (alcohol use, marijuana use, deviance, academic failure) as well as potential qualitative shifts in problem behavior over time. Multivariate latent growth curve modeling (LGM) analyses and a cohort-sequential design were employed. Data were from the National Youth Survey and included 770 youth from four cohorts (11, 12, 13, 14 years old), assessed annually for 5 years. Results showed significant growth in problem behavior from ages 11 to 18. Alcohol use and marijuana use contributed most, and academic failure contributed least to the problem behavior latent construct. Results of the variant model revealed that the contribution of all four behaviors to the overall problem behavior construct increased similarly as children aged.     

The EffectLiteR Approach for Analyzing Average and Conditional Effects

We present a framework for estimating average and conditional effects of a discrete treatment variable on a continuous outcome variable, conditioning on categorical and continuous covariates. Using the new approach, termed the EffectLiteR approach, researchers can consider conditional treatment effects given values of all covariates in the analysis and various aggregates of these conditional treatment effects such as average effects, effects on the treated, or aggregated conditional effects given values of a subset of covariates. Building on structural equation modeling, key advantages of the new approach are (1) It allows for latent covariates and outcome variables; (2) it permits (higher order) interactions between the treatment variable and categorical and (latent) continuous covariates; and (3) covariates can be treated as stochastic or fixed. The approach is illustrated by an example, and open source software EffectLiteR is provided, which makes a detailed analysis of effects conveniently accessible for applied researchers.     

Virtual Levels and Role Models: N-Level Structural Equations Model of Reciprocal Ratings Data

A general latent variable modeling framework called n-Level Structural Equations Modeling (NL-SEM) for dependent data-structures is introduced. NL-SEM is applicable to a wide range of complex multilevel data-structures (e.g., cross-classified, switching membership, etc.). Reciprocal dyadic ratings obtained in round-robin design involve complex set of dependencies that cannot be modeled within Multilevel Modeling (MLM) or Structural Equations Modeling (SEM) frameworks. The Social Relations Model (SRM) for round robin data is used as an example to illustrate key aspects of the NL-SEM framework. NL-SEM introduces novel constructs such as ‘virtual levels’ that allows a natural specification of latent variable SRMs. An empirical application of an explanatory SRM for personality using xxM, a software package implementing NL-SEM is presented. Results show that person perceptions are an integral aspect of personality. Methodological implications of NL-SEM for the analyses of an emerging class of contextual- and relational-SEMs are discussed.     

A similarity-based smoothing approach to nondimensional item analysis

The probability that an examinee chooses a particular option within an item is estimated by averaging over the responses to that item of examinees with similar response patterns for the whole test. The approach does not presume any latent variable structure or any dimensionality. But simulated and actual data analyses are presented to show that when the responses are determined by a latent ability variable, this similarity-based smoothing procedure can reveal the dimensionality of ability very satisfactorily.The author wishes to acknowledge the support of the Natural Sciences and Engineering Research Council of Canada through grant A320, and to thank Educational Testing Service for making the data on the Advanced Placement Chemistry Exam available.     

Information-theoretic latent distribution modeling: distinguishing discrete and continuous latent variable models

Distinguishing between discrete and continuous latent variable distributions has become increasingly important in numerous domains of behavioral science. Here, the authors explore an information-theoretic approach to latent distribution modeling, in which the ability of latent distribution models to represent statistical information in observed data is emphasized. The authors conclude that loss of statistical information with a decrease in the number of latent values provides an attractive basis for comparing discrete and continuous latent variable models. Theoretical considerations as well as the results of 2 Monte Carlo simulations indicate that information theory provides a sound basis for modeling latent distributions and distinguishing between discrete and continuous latent variable models in particular.     

Generalized latent variable models with non‐linear effects

Until recently, item response models such as the factor analysis model for metric responses, the two‐parameter logistic model for binary responses and the multinomial model for nominal responses considered only the main effects of latent variables without allowing for interaction or polynomial latent variable effects. However, non‐linear relationships among the latent variables might be necessary in real applications. Methods for fitting models with non‐linear latent terms have been developed mainly under the structural equation modelling approach. In this paper, we consider a latent variable model framework for mixed responses (metric and categorical) that allows inclusion of both non‐linear latent and covariate effects. The model parameters are estimated using full maximum likelihood based on a hybrid integration–maximization algorithm. Finally, a method for obtaining factor scores based on multiple imputation is proposed here for the non‐linear model.     

A Bayesian Approach to More Stable Estimates of Group-Level Effects in Contextual Studies

Multilevel analyses are often used to estimate the effects of group-level constructs. However, when using aggregated individual data (e.g., student ratings) to assess a group-level construct (e.g., classroom climate), the observed group mean might not provide a reliable measure of the unobserved latent group mean. In the present article, we propose a Bayesian approach that can be used to estimate a multilevel latent covariate model, which corrects for the unreliable assessment of the latent group mean when estimating the group-level effect. A simulation study was conducted to evaluate the choice of different priors for the group-level variance of the predictor variable and to compare the Bayesian approach with the maximum likelihood approach implemented in the software Mplus. Results showed that, under problematic conditions (i.e., small number of groups, predictor variable with a small ICC), the Bayesian approach produced more accurate estimates of the group-level effect than the maximum likelihood approach did.     

Assessing Growth in a Diagnostic Classification Model Framework

A common assessment research design is the single-group pre-test/post-test design in which examinees are administered an assessment before instruction and then another assessment after instruction. In this type of study, the primary objective is to measure growth in examinees, individually and collectively. In an item response theory (IRT) framework, longitudinal IRT models can be used to assess growth in examinee ability over time. In a diagnostic classification model (DCM) framework, assessing growth translates to measuring changes in attribute mastery status over time, thereby providing a categorical, criterion-referenced interpretation of growth. This study introduces the Transition Diagnostic Classification Model (TDCM), which combines latent transition analysis with the log-linear cognitive diagnosis model to provide methodology for analyzing growth in a general DCM framework. Simulation study results indicate that the proposed model is flexible, provides accurate and reliable classifications, and is quite robust to violations to measurement invariance over time. The TDCM is used to analyze pre-test/post-test data from a diagnostic mathematics assessment.     

Testing multivariate mean collinearity via latent variable modelling

A procedure for testing mean collinearity in multidimensional spaces is outlined, which is applicable in settings with missing data and can be used when examining group mean differences. The approach is based on non‐linear parameter restrictions and is developed within the framework of latent variable modelling. The method provides useful information about the constellation of multiple response centroids in the populations studied, and is illustrated with an example.     

Four Research Designs and a Comprehensive Analysis Strategy for Investigating Common Method Variance with Self-Report Measures Using Latent Variables

Common method variance (CMV) is an ongoing topic of debate and concern in the organizational literature. We present four latent variable confirmatory factor analysis model designs for assessing and controlling for CMV—those for unmeasured latent method constructs, Marker Variables, Measured Cause Variables, as well as a new hybrid design wherein these three types of method latent variables are used concurrently. We then describe a comprehensive analysis strategy that can be used with these four designs and provide a demonstration using the new design, the Hybrid Method Variables Model. In our discussion, we comment on different issues related to implementing these designs and analyses, provide supporting practical guidance, and, finally, advocate for the use of the Hybrid Method Variables Model. Through these means, we hope to promote a more comprehensive and consistent approach to the assessment of CMV in the organizational literature and more extensive use of hybrid models that include multiple types of latent method variables to assess CMV.     

The trade-off between accuracy and precision in latent variable models of mediation processes

Social psychologists place high importance on understanding mechanisms and frequently employ mediation analyses to shed light on the process underlying an effect. Such analyses can be conducted with observed variables (e.g., a typical regression approach) or latent variables (e.g., a structural equation modeling approach), and choosing between these methods can be a more complex and consequential decision than researchers often realize. The present article adds to the literature on mediation by examining the relative trade-off between accuracy and precision in latent versus observed variable modeling. Whereas past work has shown that latent variable models tend to produce more accurate estimates, we demonstrate that this increase in accuracy comes at the cost of increased standard errors and reduced power, and examine this relative trade-off both theoretically and empirically in a typical 3-variable mediation model across varying levels of effect size and reliability. We discuss implications for social psychologists seeking to uncover mediating variables and provide 3 practical recommendations for maximizing both accuracy and precision in mediation analyses.     

A meta-analytic approach to growth curve analysis

A meta-analytic approach to growth curve analysis is described and illustrated by applying it to the evaluation of the Arizona Pilot Project, an experimental project for financing the treatment of the severely mentally ill. In this approach to longitudinal data analysis, each individual subject for which repeated measures are obtained is initially treated as a separate case study for analysis. This approach has at least two distinct advantages. First, it does not assume a balanced design (equal numbers of repeated observations) across all subjects; to accommodate a variable number of observations for each subject, individual growth curve parameters are differentially weighted by the number of repeated measures on which they are based. Second, it does not assume homogeneity of treatment effects (equal slopes) across all subjects. Individual differences in growth curve parameters representing potentially unequal developmental rates through time are explicitly modeled. A meta-analytic approach to growth curve analysis may be the optimal analytical strategy for longitudinal studies where either (1) a balanced design is not feasible or (2) an assumption of homogeneity of treatment effects across all individuals is theoretically indefensible. In our evaluation of the Arizona Pilot Project, individual growth curve parameters were obtained for each of the 13 rationally derived subscales of the New York Functional Assessment Survey, over time, by linear regression analysis. The slopes, intercepts, and residuals obtained for each individual were then subjected to meta-analytic causal modeling. Using factor analytic models and then general linear models for the latent constructs, the growth curve parameters of all individuals were systematically related to each other via common factors and predicted based on hypothesized exogenous causal factors. The same two highly correlated common factors were found for all three growth curve parameters analyzed, a general psychological factor and a general functional factor. The factor patterns were found to be nearly identical across the separate analyses of individual intercepts, slopes, and residuals. Direct effects on the unique factors of each subscale of the New York Functional Assessment Survey were tested for each growth curve parameter by including the common factors as hierarchically prior predictors in the structural model for each of the indicator variables, thus statistically controlling for any indirect effect produced on the indicator through the common factors. The exogenous predictors modeled were theoretically specified orthogonal contrasts for Method of Payment (comparing Arizona Pilot Project treatment or "capitation" to traditional or "fee-for-service" care as a control), Treatment Administration Site (comparing various locations within treatment or control groups), Pretreatment Assessment (comparing general functional level at intake as assigned by an Outside Assessment Team), and various interactions among these main effects. The intercepts, representing the initial status of individual subjects on both the two common factors and the 13 unique factors of the subscales of the New York Functional Assessment Survey, were found to vary significantly across many of the various different treatment conditions, treatment administration sites, and pretreatment functional levels. This indicated a severe threat to the validity of the originally intended design of the Arizona Pilot Project as a randomized experiment. When the systematic variations were statistically controlled by including intercepts as hierarchically prior predictors in the structural models for slopes, recasting the experiment as a nonequivalent groups design, the effects of the intercepts on the slopes were found to be both statistically significant and substantial in magnitude. (ABSTRACT TRUNCATED)     

A comparison of methods for estimating quadratic effects in nonlinear structural equation models

Two Monte Carlo simulations were performed to compare methods for estimating and testing hypotheses of quadratic effects in latent variable regression models. The methods considered in the current study were (a) a 2-stage moderated regression approach using latent variable scores, (b) an unconstrained product indicator approach, (c) a latent moderated structural equation method, (d) a fully Bayesian approach, and (e) marginal maximum likelihood estimation. Of the 5 estimation methods, it was found that overall the methods based on maximum likelihood estimation and the Bayesian approach performed best in terms of bias, root-mean-square error, standard error ratios, power, and Type I error control, although key differences were observed. Similarities as well as disparities among methods are highlight and general recommendations articulated. As a point of comparison, all 5 approaches were fit to a reparameterized version of the latent quadratic model to educational reading data.     

The design and analysis of state-trace experiments

State-trace analysis (Bamber, 1979) addresses a question of interest in many areas of psychological research: Does 1 or more than 1 latent (i.e., not directly observed) variable mediate an interaction between 2 experimental manipulations? There is little guidance available on how to design an experiment suited to state-trace analysis, despite its increasing use, and existing statistical methods for state-trace analysis are problematic. We provide a framework for designing and refining a state-trace experiment and statistical procedures for the analysis of accuracy data using Klugkist, Kato, and Hoijtink's (2005) method of estimating Bayes factors. The statistical procedures provide estimates of the evidence favoring 1 versus more than 1 latent variable, as well as evidence that can be used to refine experimental methodology.     

Testing Manifest Monotonicity Using Order-Constrained Statistical Inference

Most dichotomous item response models share the assumption of latent monotonicity, which states that the probability of a positive response to an item is a nondecreasing function of a latent variable intended to be measured. Latent monotonicity cannot be evaluated directly, but it implies manifest monotonicity across a variety of observed scores, such as the restscore, a single item score, and in some cases the total score. In this study, we show that manifest monotonicity can be tested by means of the order-constrained statistical inference framework. We propose a procedure that uses this framework to determine whether manifest monotonicity should be rejected for specific items. This approach provides a likelihood ratio test for which the p-value can be approximated through simulation. A simulation study is presented that evaluates the Type I error rate and power of the test, and the procedure is applied to empirical data.     

Multilevel and Latent Variable Modeling with Composite Links and Exploded Likelihoods

Composite links and exploded likelihoods are powerful yet simple tools for specifying a wide range of latent variable models. Applications considered include survival or duration models, models for rankings, small area estimation with census information, models for ordinal responses, item response models with guessing, randomized response models, unfolding models, latent class models with random effects, multilevel latent class models, models with log-normal latent variables, and zero-inflated Poisson models with random effects. Some of the ideas are illustrated by estimating an unfolding model for attitudes to female work participation. We wish to thank The Research Council of Norway for a grant supporting our collaboration.     

Treatment effects on count outcomes with non-normal covariates

The effects of a treatment or an intervention on a count outcome are often of interest in applied research. When controlling for additional covariates, a negative binomial regression model is usually applied to estimate conditional expectations of the count outcome. The difference in conditional expectations under treatment and under control is then defined as the (conditional) treatment effect. While traditionally aggregates of these conditional treatment effects (e.g., average treatment effects) are computed by averaging over the empirical distribution, a recently proposed moment-based approach allows for computing aggregate effects as a function of distribution parameters. The moment-based approach makes it possible to control for (latent) multivariate normally distributed covariates and provides more reliable inferences under certain conditions. In this paper we propose three different ways to account for non-normally distributed continuous covariates in this approach: an alternative, known non-normal distribution; a plausible factorization of the joint distribution; and an approximation using finite Gaussian mixtures. A saturated model is used for categorical covariates, making a distributional assumption obsolete. We further extend the moment-based approach to allow for multiple treatment conditions and the computation of conditional effects for categorical covariates. An illustrative example highlighting the key features of our extension is provided.