Using response times to detect aberrant responses in computerized adaptive testing

A lognormal model for response times is used to check response times for aberrances in examinee behavior on computerized adaptive tests. Both classical procedures and Bayesian posterior predictive checks are presented. For a fixed examinee, responses and response times are independent; checks based on response times offer thus information independent of the results of checks on response patterns. Empirical examples of the use of classical and Bayesian checks for detecting two different types of aberrances in response times are presented. The detection rates for the Bayesian checks outperformed those for the classical checks, but at the cost of higher false-alarm rates. A guideline for the choice between the two types of checks is offered.This study received funding from the Law School Admission Council (LSAC). The opinions and conclusions contained in this paper are those of the authors and do not necessarily reflect the policy and position of LSAC. The authors are most indebted to Wim M. M. Tielen for his computational assistance and to the US Defense Manpower Data Center for the permission to use the ASVAB data set in the empirical examples.     

A factor simplicity index

We propose an index for assessing the degree of factor simplicity in the context of principal components and exploratory factor analysis. The new index, which is called Loading Simplicity, is based on the idea that the communality of each variable should be related to few components, or factors, so that the loadings in each variable are either zero or as far from zero as possible. This index does not depend on the scale of the factors, and its maximum and minimum are only related to the degree of simplicity in the loading matrix. The aim of the index is to enable the degree of simplicity in loading matrices to be compared.The author would like to thank the review team for their insights and recommendations. This work was supported by a grant SEC2001-3821-C05-C02 from the Spanish Ministry of Science and Technology.     

Orthomax rotation and perfect simple structure

A loading matrix has perfect simple structure if each row has at most one nonzero element. It is shown that if there is an orthogonal rotation of an initial loading matrix that has perfect simple structure, then orthomax rotation with 0 1 of the initial loading matrix will produce the perfect simple structure. In particular, varimax and quartimax will produce rotations with perfect simple structure whenever they exist.     

A person-fit index for polytomous rasch models,latent class models,and their mixture generalizations

A normally distributed person-fit index is proposed for detecting aberrant response patterns in latent class models and mixture distribution IRT models for dichotomous and polytomous data.This article extends previous work on the null distribution of person-fit indices for the dichotomous Rasch model to a number of models for categorical data. A comparison of two different approaches to handle the skewness of the person-fit index distribution is included.Major parts of this paper were written while the first author worked at the Institute for Science Education, Kiel, Germany. Any opinions expressed in this paper are those of the authors and not necessarily of Educational Testing Service. The results presented in this paper were improved by valuable comments from J. Rost, K. Yamamoto, N.D. Verhelst, E. Bedrick and two anonymous reviewers.     

Tucker3 hierarchical classes analysis

This paper presents a new model for binary three-way three-mode data, called Tucker3 hierarchical classes model (Tucker3-HICLAS). This new model generalizes Leenen, Van Mechelen, De Boeck, and Rosenberg's (1999) individual differences hierarchical classes model (INDCLAS). Like the INDCLAS model, the Tucker3-HICLAS model includes a hierarchical classification of the elements of each mode, and a linking structure among the three hierarchies. Unlike INDCLAS, Tucker3-HICLAS (a) does not restrict the hierarchical classifications of the three modes to have the same rank, and (b) allows for more complex linking structures among the three hierarchies. An algorithm to fit the Tucker3-HICLAS model is described and evaluated in an extensive simulation study. An application of the model to hostility data is discussed.The first author is a Research Assistant of the Fund for Scientific Research-Flanders (Belgium). The research reported in this paper was partially supported by the Research Council of K.U. Leuven (GOA/2000/02). We are grateful to Kristof Vansteelandt for providing us with an interesting data set.     

Subfactors of DSM-IV Conduct Disorder: Evidence and Connections with Syndromes from the Child Behavior Checklist

Is conduct disorder (CD) as defined in the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV; American Psychiatric Association, 1994) a unitary entity, or do variants of CD exist? We addressed this question, using data collected from the parents of 1,669 Australian boys, aged 6–17. Parents were interviewed to assess DSM-IV Conduct Disorder (DSM-IV CD) criteria. Results revealed 2 subfactors of DSM-IV CD symptoms, made up of overt behaviors (e.g., initiating physical fights) and covert behaviors (e.g., stealing without confrontation). Ordinary least squares regressions showed the 2 CD subfactors to be significantly and uniquely predicted by Child Behavior Checklist (CBCL; T. M. Achenbach, 1991a, 1991b) syndromes labeled Aggressive Behavior and Delinquent Behavior, respectively. The results are discussed in terms of the utility of differentiating these 2 variants of CD in future editions of the DSM.     

Dynamic analyses of mother-child interactions in functional and dysfunctional dyads: a synergetic approach

Describes the application of a new analytical approach (derived from synergetics, a complex dynamic systems theory) to home observational data of mother–child interactions in average dyads and dyads with children referred for disruptive behavior problems at home and school (n = 11 in each group). Results show that (1) the two groups differed in their daily interactions in predictable ways, and (2) the most frequent patterns of interactions observed in the two groups brought them back repeatedly to behave in similar ways toward each other. The findings are in keeping with a body of literature on mother–child interactions. However, they add to it by providing multivariate, graphical representations of these interactions and by offering a conceptual framework within which to move from an observational to an inferential level of analysis. At that level, the transactional processes that are characteristic of functional and dysfunctional relationships may become apparent.     

Living with Contradictions: The Taken-for-Granted in Israeli Political Discourse

Two apparently contradictory ideas are closely linked in Israeli political discourse: Israel is powerful and independent and Israel is vulnerable and dependent. This study used content analysis and focus groups, as well as existing survey data analyzed by others, to explore how this paradox has been reflected in newspapers and conversations during six different time periods from 1948 to 1996. The goal was not to explain the paradox but to examine its consequences for Israeli perceptions of U.S. policy in the Middle East—and, in the process, to explore Israeli self-images. The nature of U.S. strategic interests was originally treated as problematic and in need of political discussion, but in the past 25 years these interests have become taken for granted. Surprisingly, even after the end of the Cold War, a critical discourse moment in which a reexamination of U.S. interests in the Middle East would seem inevitable, the U.S. role remains taken for granted and largely unexamined. The strong/vulnerable paradox explains this absence of discussion: Examining U.S. interests too closely upsets the delicate balance that keeps the sense of vulnerability in check.