Extending General Processing Tree Models to Analyze Reaction Time Experiments

General processing tree (GPT) models are usually used to analyze categorical data collected in psychological experiments. Such models assume functional relations between probabilities of the observed behavior categories and the unobservable choice probabilities involved in a cognitive task. This paper extends GPT models for categorical data to the analysis of continuous data in a class of response time (RT) experiments in cognitive psychology. Suppose that a cognitive task involves several discrete processing stages and both accuracy (categorical) and latency (continuous) measures are obtained for each of the response categories. Furthermore, suppose that the task can be modeled by a GPT model that assumes serialization among the stages. The observed latencies of the response categories are functions of the choice probabilities and processing times (PT) at each of the processing stages. The functional relations are determined by the processing structure of the task. A general framework is presented and it is applied to a set of data obtained from a source monitoring experiment. Copyright 2001 Academic Press.     

Temporal properties of human information processing: Tests of discrete versus continuous models

Cognitive psychologists have characterized the temporal properties of human information processing in terms of discrete and continuous models. Discrete models postulate that component mental processes transmit a finite number of intermittent outputs (quanta) of information over time, whereas continuous models postulate that information is transmitted in a gradual fashion. These postulates may be tested by using an adaptive response-priming procedure and analysis of reaction-time mixture distributions. Three experiments based on this procedure and analysis are reported. The experiments involved varying the temporal interval between the onsets of a prime stimulus and a subsequent test stimulus to which a response had to be made. Reaction time was measured as a function of the duration of the priming interval and the type of prime stimulus. Discrete models predict that manipulations of the priming interval should yield a family of reaction-time mixture distributions formed from a finite number of underlying basis distributions, corresponding to distinct preparatory states. Continuous models make a different prediction. Goodness-of-fit tests between these predictions and the data supported either the discrete or the continuous models, depending on the nature of the stimuli and responses being used. When there were only two alternative responses and the stimulus-response mapping was a compatible one, discrete models with two or three states of preparation fit the results best. For larger response sets with an incompatible stimulus-response mapping, a continuous model fit some of the data better. These results are relevant to the interpretation of reaction-time data in a variety of contexts and to the analysis of speed-accuracy trade-offs in mental processes.     

A novel method for assessing rival models of recognition memory

A general comparison is made between the multinomial processing tree (MPT) approach and a strength-based approach for modeling recognition memory measurement. Strength models include the signal-detection model and the dual-process model. Existing MPT models for recognition memory and a new generic MPT model, called the Multistate (MS) model, are contrasted with the strength models. Although the ROC curves for the MS model and strength model are similar, there is a critical difference between existing strength models and MPT models that goes beyond the assessment of the ROC. This difference concerns the question of stochastic mixtures for foil test trials. The hazard function and the reverse hazard function are powerful methods for detecting the presence of a probabilistic mixture. Several new theorems establish a novel method for obtaining information about the hazard function and reverse hazard function for the latent continuous distributions that are assumed in the strength approach to recognition memory. Evidence is provided that foil test trials involve a stochastic mixture. This finding occurred for both short-term memory procedures, such as the Brown–Peterson task, and long-term list-learning procedures, such as the paired-associate task. The effect of mixtures on foil trials is problematic for existing strength models but can be readily handled by MPT models such as the MS model. Other phenomena, such as the mirror effect and the effect of target-foil similarity, are also predicted accurately by the MPT modeling framework.     

Ordinal state-trait regression for intensive longitudinal data

In many psychological studies, in particular those conducted by experience sampling, mental states are measured repeatedly for each participant. Such a design allows for regression models that separate between- from within-person, or trait-like from state-like, components of association between two variables. But these models are typically designed for continuous variables, whereas mental state variables are most often measured on an ordinal scale. In this paper we develop a model for disaggregating between- from within-person effects of one ordinal variable on another. As in standard ordinal regression, our model posits a continuous latent response whose value determines the observed response. We allow the latent response to depend nonlinearly on the trait and state variables, but impose a novel penalty that shrinks the fit towards a linear model on the latent scale. A simulation study shows that this penalization approach is effective at finding a middle ground between an overly restrictive linear model and an overfitted nonlinear model. The proposed method is illustrated with an application to data from the experience sampling study of Baumeister et al. (2020, Personality and Social Psychology Bulletin, 46, 1631).     

Rasch-representable reaction time distributions

This article investigates properties of a representation based on the Rasch test model for reaction times (RT) that was proposed by Micko. Necessary and sufficient conditions for a set of RT distributions to be Rasch-representable are derived. It is shown that independent serial and independent parallel processing models cannot be reconciled with the representation. However, random extreme models compatible with the Reasch-representation exist that assume RT is determined by the longest or he shortest processing time of a random number of independent paraloel channels. Nonparametric properties of Rasch-representable distributions are derived that can be used for testing the model and for estimating its parameters. Conditions are presented for Rasch-representable distributions to form a scale family. Finally, Rasch-represent-able distributions are characterized interms of their hazard functions.For helpful discussions, we are grateful to Hans Irtel, Christoph Micko, Hartmann Scheiblechner, and Hans-Henning Schultz.     

Response style analysis with threshold and multi‐process IRT models: A review and tutorial

Two different item response theory model frameworks have been proposed for the assessment and control of response styles in rating data. According to one framework, response styles can be assessed by analysing threshold parameters in Rasch models for ordinal data and in mixture‐distribution extensions of such models. A different framework is provided by multi‐process item response tree models, which can be used to disentangle response processes that are related to the substantive traits and response tendencies elicited by the response scale. In this tutorial, the two approaches are reviewed, illustrated with an empirical data set of the two‐dimensional ‘Personal Need for Structure’ construct, and compared in terms of multiple criteria. Mplus is used as a software framework for (mixed) polytomous Rasch models and item response tree models as well as for demonstrating how parsimonious model variants can be specified to test assumptions on the structure of response styles and attitude strength. Although both frameworks are shown to account for response styles, they differ on the quantitative criteria of model selection, practical aspects of model estimation, and conceptual issues of representing response styles as continuous and multidimensional sources of individual differences in psychological assessment.     

The role of orthographic and phonological codes in the word and the pseudoword superiority effect: an analysis by means of multinomial processing tree models

Central to the current accounts of the word and the pseudoword superiority effect (WSE and PWSE, respectively) is the concept of a unitized code that is less susceptible to masking than single-letter codes. Current explanations of the WSE and PWSE assume that this unitized code is orthographic, explaining these phenomena by the assumption of dual read-out from unitized and single-letter codes. In this article, orthographic dual read-out models are compared with a phonological dual read-out model (which is based on the assumption that the 1st unitized code is phonological). From this phonological code, an orthographic code is derived, through either lexical access or assembly. Comparison of the orthographic and phonological dual read-out models was performed by formulating both models as multinomial processing tree models. From an application of these models to the data of 2 letter identification experiments, it was clear that the orthographic dual read-out models are insufficient as an explanation of the PWSE, whereas the phonological dual read-out model is sufficient.     

Applying processing trees in social psychology

Processing tree models offer a powerful research framework by which the contributions of cognitive processes to a task can be separated and quantified. The present article reviews a number of applications of processing tree models in the domain of social psychology in order to illustrate the steps to be taken in developing and validating a given model and applying it to the measurement and comparison of processes across experimental and quasi-experimental conditions. Process dissociation models are discussed as special cases of processing tree models. Crucial assumptions of processing tree models are considered and methods to overcome violations of such assumptions are reviewed. In addition to the application of processing tree models for the analysis of social and cognitive processes, their value is also discussed for the elicitation of truthful responses to socially sensitive questions.     

A Computational Evaluation of Sentence Processing Deficits in Aphasia

Individuals with agrammatic Broca's aphasia experience difficulty when processing reversible non‐canonical sentences. Different accounts have been proposed to explain this phenomenon. The Trace Deletion account (Grodzinsky, 1995, 2000, 2006) attributes this deficit to an impairment in syntactic representations, whereas others (e.g., Caplan, Waters, Dede, Michaud, & Reddy, 2007; Haarmann, Just, & Carpenter, 1997) propose that the underlying structural representations are unimpaired, but sentence comprehension is affected by processing deficits, such as slow lexical activation, reduction in memory resources, slowed processing and/or intermittent deficiency, among others. We test the claims of two processing accounts, slowed processing and intermittent deficiency, and two versions of the Trace Deletion Hypothesis (TDH), in a computational framework for sentence processing (Lewis & Vasishth, 2005) implemented in ACT‐R (Anderson, Byrne, Douglass, Lebiere, & Qin, 2004). The assumption of slowed processing is operationalized as slow procedural memory, so that each processing action is performed slower than normal, and intermittent deficiency as extra noise in the procedural memory, so that the parsing steps are more noisy than normal. We operationalize the TDH as an absence of trace information in the parse tree. To test the predictions of the models implementing these theories, we use the data from a German sentence—picture matching study reported in Hanne, Sekerina, Vasishth, Burchert, and De Bleser (2011). The data consist of offline (sentence‐picture matching accuracies and response times) and online (eye fixation proportions) measures. From among the models considered, the model assuming that both slowed processing and intermittent deficiency are present emerges as the best model of sentence processing difficulty in aphasia. The modeling of individual differences suggests that, if we assume that patients have both slowed processing and intermittent deficiency, they have them in differing degrees.     

Factor copula models for mixed data

We develop factor copula models to analyse the dependence among mixed continuous and discrete responses. Factor copula models are canonical vine copulas that involve both observed and latent variables, hence they allow tail, asymmetric and nonlinear dependence. They can be explained as conditional independence models with latent variables that do not necessarily have an additive latent structure. We focus on important issues of interest to the social data analyst, such as model selection and goodness of fit. Our general methodology is demonstrated with an extensive simulation study and illustrated by reanalysing three mixed response data sets. Our studies suggest that there can be a substantial improvement over the standard factor model for mixed data and make the argument for moving to factor copula models.     

使用验证性补偿多维IRT模型进行认知诊断评估

随着人们对测验反馈结果精细化的需求逐渐提高, 具有认知诊断功能的测量方法逐渐受到人们的关注。在认知诊断模型(CDMs)闪耀着光芒的同时, 另一类能够在连续量尺上提供精细反馈的多维IRT模型(MIRTMs)似乎受到些许冷落。为探究MIRTMs潜在的认知诊断功能, 本文以补偿模型为视角, 聚焦于分别属于MIRTMs的多维两参数logistic模型(M2PLM)和属于CDMs的线性logistic模型(LLM); 之后为使两者具有可比性, 可对补偿M2PLM引入验证性矩阵(Q矩阵)来界定题目与维度之间的关系, 进而得到验证性的补偿M2PLM (CC-M2PLM), 并通过把潜在特质按切点划分为跨界属性, 以期使CC-M2PLM展现出其本应具有的认知诊断功能; 预研究表明logistic量尺上的0点可作为相对合理的切点; 然后, 通过模拟研究对比探究CC-M2PLM和LLM的认知诊断功能, 结果表明CC-M2PLM可用于分析诊断测验数据, 且认知诊断功能与直接使用LLM的效果相当; 最后, 以两则实证数据为例来说明CC-M2PLM在实际诊断测验分析中的可行性。     

Intrusion patterns in rapid serial visual presentation tasks with two response dimensions.

A rapid serial visual presentation (RSVP) paradigm using both one and two response dimensions was used to test parallel processing models of stimulus dimensions. Fifty subjects were asked to report the identity and/or color of a target uppercase word inserted in a series of lowercase words. The results produced a predominance of posttarget intrusions for color responses and a predominance of pretarget intrusions for identity responses. The requirement of a response to a second dimension impaired hit rates but did not change the pattern of intrusions. An examination of the distributions of intrusions in each response dimension as a function of the response given to the other dimension showed an unexpectedly high percentage of simultaneous hits, a moderate covariation between both responses, and the same patterns of intrusions when compared with the general distributions. While these results seem to be compatible with parallel models of processing for stimulus dimensions, two modifications to this model are suggested. First, the processing of response dimension(s) needs some attentional resources. Second, provision for a mixed model is indicated, which would include trials where no illusory conjunctions are formed.     

A phase transition model for the speed-accuracy trade-off in response time experiments

Most models of response time (RT) in elementary cognitive tasks implicitly assume that the speed-accuracy trade-off is continuous: When payoffs or instructions gradually increase the level of speed stress, people are assumed to gradually sacrifice response accuracy in exchange for gradual increases in response speed. This trade-off presumably operates over the entire range from accurate but slow responding to fast but chance-level responding (i.e., guessing). In this article, we challenge the assumption of continuity and propose a phase transition model for RTs and accuracy. Analogous to the fast guess model (Ollman, 1966), our model postulates two modes of processing: a guess mode and a stimulus-controlled mode. From catastrophe theory, we derive two important predictions that allow us to test our model against the fast guess model and against the popular class of sequential sampling models. The first prediction--hysteresis in the transitions between guessing and stimulus-controlled behavior--was confirmed in an experiment that gradually changed the reward for speed versus accuracy. The second prediction--bimodal RT distributions--was confirmed in an experiment that required participants to respond in a way that is intermediate between guessing and accurate responding.     

Intrusion patterns in rapid serial visual presentation tasks with two response dimensions

A rapid serial visual presentation (RSVP) paradigm using both one and two response dimensions was used to test parallel processing models of stimulus dimensions. Fifty subjects were asked to report the identity and/or color of a target uppercase word inserted in a series of lowercase words. The results produced a predominance of posttarget intrusions for color responses and a predominance of pretarget intrusions for identity responses. The requirement of a response to a second dimension impaired hit rates but did not change the pattern of intrusions. An examination of the distributions of intrusions in each response dimension as a function of the response given to the other dimension showed an unexpectedly high percentage of simultaneous hits, a moderate covariation between both responses, and the same patterns of intrusions when compared with the general distributions. While these results seem to be compatible with parallel models of processing for stimulus dimensions, two modifications to this model are suggested. First, the processing of response dimension(s) needs some attentional resources. Second, provision for a mixed model is indicated, which would include trials where no illusory conjunctions are formed.     

Appletree: A multinomial processing tree modeling program for macintosh computers

Multinomial processing tree (MPT) models are statistical models that allow for the prediction of categorical frequency data by sets of unobservable (cognitive) states. In MPT models, the probability that an event belongs to a certain category is a sum of products of state probabilities. AppleTree is a computer program for Macintosh for testing user-defined MPT models. It can fit model parameters to empirical frequency data, provide confidence intervals for the parameters, generate tree graphs for the models, and perform identifiability checks. In this article, the algorithms used by AppleTree and the handling of the program are described.     

Bayesian Semiparametric Structural Equation Models with Latent Variables

Structural equation models (SEMs) with latent variables are widely useful for sparse covariance structure modeling and for inferring relationships among latent variables. Bayesian SEMs are appealing in allowing for the incorporation of prior information and in providing exact posterior distributions of unknowns, including the latent variables. In this article, we propose a broad class of semiparametric Bayesian SEMs, which allow mixed categorical and continuous manifest variables while also allowing the latent variables to have unknown distributions. In order to include typical identifiability restrictions on the latent variable distributions, we rely on centered Dirichlet process (CDP) and CDP mixture (CDPM) models. The CDP will induce a latent class model with an unknown number of classes, while the CDPM will induce a latent trait model with unknown densities for the latent traits. A simple and efficient Markov chain Monte Carlo algorithm is developed for posterior computation, and the methods are illustrated using simulated examples, and several applications.     

The Latent Structure of Substance Use Among American Indian Adolescents: An Example Using Categorical Variables

Researchers frequently have only categorical data to analyze and cannot, for theoretical or methodological reasons, assume that the observed variables are discrete representations of an underlying continuous variable. We present latent class analysis as an alternative method of measuring latent variables in these circumstances. Latent class analysis does not require the assumptions of factor analyses about the nature of manifest and latent variables, but does allow the use of more precise model selection than techniques such as cluster analysis. We modeled the lifetime substance use of American Indian youth. The latent class model of American Indian teenagers' substance use had four classes: Abstaining, Predominantly Alcohol, Predominantly Alcohol and Marijuana, and Plural Substance. We then demonstrated the usefulness of this latent variable by using it to differentiate levels of several variables in a manner consistent with Social Cognitive Theory.     

The resurrection of Tweedledum and Tweedledee: Bimodality cannot distinguish serial and parallel processes

Simultaneously presented signals may be processed in serial or in parallel. One potentially valuable indicator of a system’s characteristics may be the appearance of multimodality in the response time (RT) distributions. It is known that standard serial models can predict multimodal RT distributions, but it is unknown whether multimodality is diagnostic of serial systems, or whether alternative architectures, such as parallel ones, can also make such predictions. We demonstrate via simulations that a multimodal RT distribution is not sufficient by itself to rule out parallel self-terminating processing, even with limited trial numbers. These predictions are discussed within the context of recent data indicating the existence of multimodal distributions in visual search.     

Dynamic analysis of multivariate panel data with non-linear transformations

Many models for multivariate data analysis can be seen as special cases of the linear dynamic or state space model. Contrary to the classical approach to linear dynamic systems analysis, in which high-dimensional exact solutions are sought, the model presented here is developed from a social science framework where low-dimensional approximate solutions are preferred. Borrowing concepts from the theory on mixture distributions, the linear dynamic model can be viewed as a multi-layered regression model, in which the output variables are imprecise manifestations of an unobserved continuous process. An additional layer of mixing makes it possible to incorporate non-normal as well as ordinal variables.Using the EM-algorithm, we find estimates of the unknown model parameters, simultaneously providing stability estimates. The model is very general and cannot be well estimated by other estimation methods. We illustrate the applicability of the obtained procedure through an example with generated data.