A taxonomy of latent structure assumptions for probability matrix decomposition models

A taxonomy of latent structure assumptions (LSAs) for probability matrix decomposition (PMD) models is proposed which includes the original PMD model (Maris, De Boeck, & Van Mechelen, 1996) as well as a three-way extension of the multiple classification latent class model (Maris, 1999). It is shown that PMD models involving different LSAs are actually restricted latent class models with latent variables that depend on some external variables. For parameter estimation a combined approach is proposed that uses both a mode-finding algorithm (EM) and a sampling-based approach (Gibbs sampling). A simulation study is conducted to investigate the extent to which information criteria, specific model checks, and checks for global goodness of fit may help to specify the basic assumptions of the different PMD models. Finally, an application is described with models involving different latent structure assumptions for data on hostile behavior in frustrating situations.Note: The research reported in this paper was partially supported by the Fund for Scientific Research-Flanders (Belgium) (project G.0207.97 awarded to Paul De Boeck and Iven Van Mechelen), and the Research Fund of K.U. Leuven (F/96/6 fellowship to Andrew Gelman, OT/96/10 project awarded to Iven Van Mechelen and GOA/2000/02 awarded to Paul De Boeck and Iven Van Mechelen). We thank Marcel Croon and Kristof Vansteelandt for commenting on an earlier draft of this paper.     

The use of latent trajectory models in psychopathology research

Despite the recent surge in the development of powerful modeling strategies to test questions about individual differences in stability and change over time, these methods are not currently widely used in psychopathology research. In an attempt to further the dissemination of these new methods, the authors present a pedagogical introduction to the structural equation modeling based latent trajectory model, or LTM. They review several different types of LTMs, discuss matching an optimal LTM to a given question of interest, and highlight several issues that might be particularly salient for research in psychopathology. The authors augment each section with a review of published applications of these methods in psychopathology-related research to demonstrate the implementation and interpretation of LTMs in practice.     

A person-fit index for polytomous rasch models,latent class models,and their mixture generalizations

A normally distributed person-fit index is proposed for detecting aberrant response patterns in latent class models and mixture distribution IRT models for dichotomous and polytomous data.This article extends previous work on the null distribution of person-fit indices for the dichotomous Rasch model to a number of models for categorical data. A comparison of two different approaches to handle the skewness of the person-fit index distribution is included.Major parts of this paper were written while the first author worked at the Institute for Science Education, Kiel, Germany. Any opinions expressed in this paper are those of the authors and not necessarily of Educational Testing Service. The results presented in this paper were improved by valuable comments from J. Rost, K. Yamamoto, N.D. Verhelst, E. Bedrick and two anonymous reviewers.     

On growth curves and mixture models

The multilevel model of change and the latent growth model are flexible means to describe all sorts of population heterogeneity with respect to growth and development, including the presence of sub‐populations. The growth mixture model is a natural extension of these models. It comes at hand when information about sub‐populations is missing and researchers nevertheless want to retrieve developmental trajectories from sub‐populations. We argue that researchers have to make rather strong assumptions about the sub‐populations or latent trajectory classes in order to retrieve existing population differences. A simulated example is discussed, showing that a sample of repeated measures drawn from two sub‐populations easily leads to the mistaken inference of three sub‐populations, when assumptions are not met. The merits of methodological advises on this issue are discussed. It is concluded that growth mixture models should be used with understanding, and offer no free way to growth patterns in unknown sub‐populations. Copyright © 2006 John Wiley & Sons, Ltd.     

Missing not at random models for latent growth curve analyses

The past decade has seen a noticeable shift in missing data handling techniques that assume a missing at random (MAR) mechanism, where the propensity for missing data on an outcome is related to other analysis variables. Although MAR is often reasonable, there are situations where this assumption is unlikely to hold, leading to biased parameter estimates. One such example is a longitudinal study of substance use where participants with the highest frequency of use also have the highest likelihood of attrition, even after controlling for other correlates of missingness. There is a large body of literature on missing not at random (MNAR) analysis models for longitudinal data, particularly in the field of biostatistics. Because these methods allow for a relationship between the outcome variable and the propensity for missing data, they require a weaker assumption about the missing data mechanism. This article describes 2 classic MNAR modeling approaches for longitudinal data: the selection model and the pattern mixture model. To date, these models have been slow to migrate to the social sciences, in part because they required complicated custom computer programs. These models are now quite easy to estimate in popular structural equation modeling programs, particularly Mplus. The purpose of this article is to describe these MNAR modeling frameworks and to illustrate their application on a real data set. Despite their potential advantages, MNAR-based analyses are not without problems and also rely on untestable assumptions. This article offers practical advice for implementing and choosing among different longitudinal models.     

Statistical power of latent growth curve models to detect quadratic growth

Latent curve models (LCMs) have been used extensively to analyze longitudinal data. However, little is known about the power of LCMs to detect nonlinear trends when they are present in the data. For this study, we utilized simulated data to investigate the power of LCMs to detect the mean of the quadratic slope, Type I error rates, and rates of nonconvergence during the estimation of quadratic LCMs. Five factors were examined: the number of time points, growth magnitude, interindividual variability, sample size, and the R ²s of the measured variables. The results showed that the empirical Type I error rates were close to the nominal value of 5 %. The empirical power to detect the mean of the quadratic slope was affected by the simulation factors. Finally, a substantial proportion of samples failed to converge under conditions of no to small variation in the quadratic factor, small sample sizes, and small R ² of the repeated measures. In general, we recommended that quadratic LCMs be based on samples of (a) at least 250 but ideally 400, when four measurement points are available; (b) at least 100 but ideally 150, when six measurement points are available; (c) at least 50 but ideally 100, when ten measurement points are available.     

Identifying trajectories of adolescent smoking: an application of latent growth mixture modeling.

The goal of the current study was to identify discrete longitudinal patterns of change in adolescent smoking using latent growth mixture modeling. Five distinct longitudinal patterns were identified. A group of early rapid escalators was characterized by early escalation (at age 13) that rapidly increased to heavy smoking. A pattern characterized by occasional puffing up until age 15, at which time smoking escalated to moderate levels was also identified (late moderate escalators). Another group included adolescents who, after age 15, began to escalate slowly in their smoking to light (0.5 cigarettes per month) levels (late slow escalators). Finally, a group of stable light smokers (those who smoked 1-2 cigarettes per month) and a group of stable puffers (those who smoked only a few puffs per month) were also identified. The stable puffer group was the largest group and represented 25% of smokers.     

多阶段混合增长模型的方法及研究现状

多阶段混合增长模型(PGMM)可对发展过程中的阶段性及群体异质性特征进行分析,在能力发展、行为发展及干预、临床心理等研究领域应用广泛。PGMM可在结构方程模型和随机系数模型框架下定义,通常使用基于EM算法的极大似然估计和基于马尔科夫链蒙特卡洛模拟的贝叶斯推断两种方法进行参数估计。样本量、测量时间点数、潜在类别距离等因素对模型及参数估计有显著影响。未来应加强PGMM与其它增长模型的比较研究;在相同或不同的模型框架下研究数据特征、类别属性等对参数估计方法的影响。     

Local solutions in the estimation of growth mixture models

Finite mixture models are well known to have poorly behaved likelihood functions featuring singularities and multiple optima. Growth mixture models may suffer from fewer of these problems, potentially benefiting from the structure imposed on the estimated class means and covariances by the specified growth model. As demonstrated here, however, local solutions may still be problematic. Results from an empirical case study and a small Monte Carlo simulation show that failure to thoroughly consider the possible presence of local optima in the estimation of a growth mixture model can sometimes have serious consequences, possibly leading to adoption of an inferior solution that differs in substantively important ways from the actual maximum likelihood solution. Often, the defaults of current software need to be overridden to thoroughly evaluate the parameter space and obtain confidence that the maximum likelihood solution has in fact been obtained.     

Two classes of models for magnitude estimation

One class of models assumes that presentation of a signal results in an internal representation as a random variable. Depending on whether the signal is close to or far from the preceding signal, the variance of the representation is smaller or larger. Responses are determined largely by this random variable; however, when the signal is close to the preceding one, the response is generated by modifying the representation multiplicatively by some function of the ratio of the previous response to its representation. Power and linear functions are explored. The form of the random variable is assumed to be that arising from either the timing or the counting model operating on a Poisson process. Detailed analyses are carried out successfully only for the timing model with neural sample sizes independent of intensity; however, the data require the sample to increase with intensity. The linear response function coupled with the constant sample size counting model appears somewhat viable, but detailed calculations are very difficult to carry out. The second class of models postulates a power function relation between magnitude estimates and signals intensity for which the exponent is a Gaussian distributed random variable and the unit is the product of two log normal random variables. Again we assume an attention band such that succesive stimuli that are widely separated in intensity lead to independent samples of the random variables while a variety of assumptions is explored for successive stimuli that are near each other in intensity. Although they each give rise to the qualitative features of the data, estimates of parameters are sufficiently inconsistent that we are led to reject all of the submodels studied.     

First-grade predictors of mathematical learning disability: A latent class trajectory analysis

Kindergarten to third grade mathematics achievement scores from a prospective study of mathematical development (n = 306) were subjected to latent growth trajectory analyses. The four corresponding classes included children with mathematical learning disability (MLD, 6% of sample), and low (LA, 50%), typically (TA, 39%) and high (HA, 5%) achieving children. The groups were administered a battery of intelligence (IQ), working memory, and mathematical-cognition measures in first grade. The children with MLD had general deficits in working memory and IQ and potentially more specific deficits on measures of number sense. The LA children did not have working memory or IQ deficits but showed moderate deficits on these number sense measures and for addition fact retrieval. The distinguishing features of the HA children were a strong visuospatial working memory, a strong number sense, and frequent use of memory-based processes to solve addition problems. Implications for the early identification of children at risk for poor mathematics achievement are considered.     

Higher-order latent trait models for cognitive diagnosis

Higher-order latent traits are proposed for specifying the joint distribution of binary attributes in models for cognitive diagnosis. This approach results in a parsimonious model for the joint distribution of a high-dimensional attribute vector that is natural in many situations when specific cognitive information is sought but a less informative item response model would be a reasonable alternative. This approach stems from viewing the attributes as the specific knowledge required for examination performance, and modeling these attributes as arising from a broadly-defined latent trait resembling theϑ of item response models. In this way a relatively simple model for the joint distribution of the attributes results, which is based on a plausible model for the relationship between general aptitude and specific knowledge. Markov chain Monte Carlo algorithms for parameter estimation are given for selected response distributions, and simulation results are presented to examine the performance of the algorithm as well as the sensitivity of classification to model misspecification. An analysis of fraction subtraction data is provided as an example. This research was funded by National Institute of Health grant R01 CA81068. We would like to thank William Stout and Sarah Hartz for many useful discussions, three anonymous reviewers for helpful comments and suggestions, and Kikumi Tatsuoka and Curtis Tatsuoka for generously sharing data.     

Multicomponent latent trait models for ability tests

A major research direction for ability measurement has been to identify the information-processes that are involved in solving test items through mathematical modeling of item difficulty. However, this research has had limited impact on ability measurement, since person parameters are not included in the process models. The current paper presents some multicomponent latent trait models for reproducing test performance from both item and person parameters on processing components. Components are identified from item subtasks, in which performance is a logistic function (i.e., Rasch model) of person and item parameters, and then are combined according to a mathematical model of processing on the composite item.The author would like to thank David Thissen for his invaluable insights concerning this model and an anonymous reviewer for his suggestion about the sample space for the model.This research was partially supported by National Institute of Education grant number NIE-6-7-0156 to Susan E. Whitely, principal investigator. However the opinions expressed herein do not necessarily reflect the position or policy of the National Institute of Education, and no official endorsement by the National Institute of Education should be referred. Part of this paper was presented at the annual meeting of thePsychometric Society, Monterey, California: June, 1979.     

Forgetting curves: implications for connectionist models

Forgetting in long-term memory, as measured in a recall or a recognition test, is faster for items encoded more recently than for items encoded earlier. Data on forgetting curves fit a power function well. In contrast, many connectionist models predict either exponential decay or completely flat forgetting curves. This paper suggests a connectionist model to account for power-function forgetting curves by using bounded weights and by generating the learning rates from a monotonically decreasing function. The bounded weights introduce exponential forgetting in each weight and a power-function forgetting results when weights with different learning rates are averaged. It is argued that these assumptions are biologically reasonable. Therefore power-function forgetting curves are a property that may be expected from biological networks. The model has an analytic solution, which is a good approximation of a power function displaced one lag in time. This function fits better than any of the 105 suggested two-parameter forgetting-curve functions when tested on the most precise recognition memory data set collected by. Unlike the power-function normally used, the suggested function is defined at lag zero. Several functions for generating learning rates with a finite integral yield power-function forgetting curves; however, the type of function influences the rate of forgetting. It is shown that power-function forgetting curves cannot be accounted for by variability in performance between subjects because it requires a distribution of performance that is not found in empirical data. An extension of the model accounts for intersecting forgetting curves found in massed and spaced repetitions. The model can also be extended to account for a faster forgetting rate in item recognition (IR) compared to associative recognition in short but not long retention intervals.     

Information-theoretic latent distribution modeling: distinguishing discrete and continuous latent variable models

Distinguishing between discrete and continuous latent variable distributions has become increasingly important in numerous domains of behavioral science. Here, the authors explore an information-theoretic approach to latent distribution modeling, in which the ability of latent distribution models to represent statistical information in observed data is emphasized. The authors conclude that loss of statistical information with a decrease in the number of latent values provides an attractive basis for comparing discrete and continuous latent variable models. Theoretical considerations as well as the results of 2 Monte Carlo simulations indicate that information theory provides a sound basis for modeling latent distributions and distinguishing between discrete and continuous latent variable models in particular.     

Quantitative genetic analysis of latent growth curve models of cognitive abilities in adulthood

Though many cognitive abilities exhibit marked decline over the adult years, individual differences in rates of change have been observed. In the current study, biometrical latent growth models were used to examine sources of variability for ability level (intercept) and change (linear and quadratic effects) for verbal, fluid, memory, and perceptual speed abilities in the Swedish Adoption/Twin Study of Aging. Genetic influences were more important for ability level at age 65 and quadratic change than for linear slope at age 65. Expected variance components indicated decreasing genetic and increasing nonshared environmental variation over age. Exceptions included one verbal and two memory measures that showed increasing genetic and nonshared environmental variance. The present findings provide support for theories of the increasing influence of the environment with age on cognitive abilities.     

Job resources and flow at work: Modelling the relationship via latent growth curve and mixture model methodology

The aim of the present three‐wave follow‐up study (n = 335) among employees of an employment agency was to investigate the association between job resources and work‐related flow utilizing both variable‐ and person‐oriented approaches. In addition, emotional exhaustion was studied as a moderator of the job resources–flow relationship, and as a predictor of the development of job resources and flow. The variable‐oriented approach, based on latent growth curve analyses, revealed that the levels of job resources and flow at work, as well as changes in these variables, were positively associated with each other. The person‐oriented inspection with the growth mixture modelling identified four trajectories based on the mean levels of job resources and flow and on the changes of these mean levels over time: (a) moderate work‐related resources (n = 166), (b) declining work‐related resources (n = 87), (c) high work‐related resources (n = 46), and (d) low work‐related resources (n = 36). Exhaustion was found to be an important predictor of job resources and flow, but it did not moderate their mutual association. Specifically, a low level of exhaustion was found to predict high levels of job resources and flow. Overall, these results suggest the importance of a person‐oriented view of motivational processes at work. In addition, in order to fully understand positive motivational processes it seems important to investigate the role of negative well‐being states as well.     

A MCMC-method for models with continuous latent responses

This paper introduces a new technique for estimating the parameters of models with continuous latent data. Using the Rasch model as an example, it is shown that existing Bayesian techniques for parameter estimation, such as the Gibbs sampler, are not always easy to implement. Then, a new sampling-based Bayesian technique, called the DA-T-Gibbs sampler, is introduced. The DA-T-Gibbs sampler relies on the particular latent data structure of latent response models to simplify the computations involved in parameter estimation. This research was supported by the Dutch National Research Council (NWO) (grant number 575-30-001).     

On the power of multivariate latent growth curve models to detect correlated change

We evaluated the statistical power of single-indicator latent growth curve models (LGCMs) to detect correlated change between two variables (covariance of slopes) as a function of sample size, number of longitudinal measurement occasions, and reliability (measurement error variance). Power approximations following the method of Satorra and Saris (1985) were used to evaluate the power to detect slope covariances. Even with large samples (N = 500) and several longitudinal occasions (4 or 5), statistical power to detect covariance of slopes was moderate to low unless growth curve reliability at study onset was above .90. Studies using LGCMs may fail to detect slope correlations because of low power rather than a lack of relationship of change between variables. The present findings allow researchers to make more informed design decisions when planning a longitudinal study and aid in interpreting LGCM results regarding correlated interindividual differences in rates of development.