Using response times to detect aberrant responses in computerized adaptive testing

A lognormal model for response times is used to check response times for aberrances in examinee behavior on computerized adaptive tests. Both classical procedures and Bayesian posterior predictive checks are presented. For a fixed examinee, responses and response times are independent; checks based on response times offer thus information independent of the results of checks on response patterns. Empirical examples of the use of classical and Bayesian checks for detecting two different types of aberrances in response times are presented. The detection rates for the Bayesian checks outperformed those for the classical checks, but at the cost of higher false-alarm rates. A guideline for the choice between the two types of checks is offered.This study received funding from the Law School Admission Council (LSAC). The opinions and conclusions contained in this paper are those of the authors and do not necessarily reflect the policy and position of LSAC. The authors are most indebted to Wim M. M. Tielen for his computational assistance and to the US Defense Manpower Data Center for the permission to use the ASVAB data set in the empirical examples.     

Orthomax rotation and perfect simple structure

A loading matrix has perfect simple structure if each row has at most one nonzero element. It is shown that if there is an orthogonal rotation of an initial loading matrix that has perfect simple structure, then orthomax rotation with 0 1 of the initial loading matrix will produce the perfect simple structure. In particular, varimax and quartimax will produce rotations with perfect simple structure whenever they exist.     

A person-fit index for polytomous rasch models,latent class models,and their mixture generalizations

A normally distributed person-fit index is proposed for detecting aberrant response patterns in latent class models and mixture distribution IRT models for dichotomous and polytomous data.This article extends previous work on the null distribution of person-fit indices for the dichotomous Rasch model to a number of models for categorical data. A comparison of two different approaches to handle the skewness of the person-fit index distribution is included.Major parts of this paper were written while the first author worked at the Institute for Science Education, Kiel, Germany. Any opinions expressed in this paper are those of the authors and not necessarily of Educational Testing Service. The results presented in this paper were improved by valuable comments from J. Rost, K. Yamamoto, N.D. Verhelst, E. Bedrick and two anonymous reviewers.     

Subfactors of DSM-IV Conduct Disorder: Evidence and Connections with Syndromes from the Child Behavior Checklist

Is conduct disorder (CD) as defined in the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV; American Psychiatric Association, 1994) a unitary entity, or do variants of CD exist? We addressed this question, using data collected from the parents of 1,669 Australian boys, aged 6–17. Parents were interviewed to assess DSM-IV Conduct Disorder (DSM-IV CD) criteria. Results revealed 2 subfactors of DSM-IV CD symptoms, made up of overt behaviors (e.g., initiating physical fights) and covert behaviors (e.g., stealing without confrontation). Ordinary least squares regressions showed the 2 CD subfactors to be significantly and uniquely predicted by Child Behavior Checklist (CBCL; T. M. Achenbach, 1991a, 1991b) syndromes labeled Aggressive Behavior and Delinquent Behavior, respectively. The results are discussed in terms of the utility of differentiating these 2 variants of CD in future editions of the DSM.     

Dynamic analyses of mother-child interactions in functional and dysfunctional dyads: a synergetic approach

Describes the application of a new analytical approach (derived from synergetics, a complex dynamic systems theory) to home observational data of mother–child interactions in average dyads and dyads with children referred for disruptive behavior problems at home and school (n = 11 in each group). Results show that (1) the two groups differed in their daily interactions in predictable ways, and (2) the most frequent patterns of interactions observed in the two groups brought them back repeatedly to behave in similar ways toward each other. The findings are in keeping with a body of literature on mother–child interactions. However, they add to it by providing multivariate, graphical representations of these interactions and by offering a conceptual framework within which to move from an observational to an inferential level of analysis. At that level, the transactional processes that are characteristic of functional and dysfunctional relationships may become apparent.     

Self-Effacing and Self-Defeating Leadership: Adlai E. Stevenson

Using neo-Freudian analysis, this essay argues that as a child Adlai Stevenson experienced shame, anxiety, and ambivalence about the value and consequences of his initiative and autonomy. He responded with an imaginative coping mechanism, creating an idealized image in which ambition and autonomy were subordinated to duty and service. After a sequence of searing events during the Eriksonian period of identity versus role confusion, he resolved his identity crisis by becoming, in his mind, his idealized image. This conception of Stevenson's character provides a rich explanation of his behavior in the presidential nomination contests of 1952 and 1960.     

Discovering the Alphabetic Principle: A Lost Opportunity for Educational Reform

We review the recently published report by the Committee on the Prevention of Reading Difficulties in Young Children from a behavior analytic perspective. The authors prescribe what children should learn to be successful readers based on the correlates of reading and the developmental progression of reading errors. The report offers no discussion of theoretical models that can be used by teachers and parents to reform reading instruction or specific procedures that have been shown to be effective at promoting various reading skills. We discuss these omissions in terms of the level of research included in the review, the authors' structural approach to synthesizing this research, and the constructivist orientation common to many early childhood educators. The paper concludes by identifying models and strategies from the behavior analysis literature that can be used to guide instruction and offers a modest suggestion for future reviews of reading research.     

A Uniform Approach for Characterizing the Provably Total Number-Theoretic Functions of KPM and (Some of) its Subsystems

In this article we show how to extract with the use of the Buchholz-Cichon-Weiermann approach to subrecursive hierarchies from Rathjen's 1991 ordinal analysis of KPM a characterization of the provably total number-theoretic functions of KPM and some of its (most prominent) subsystems in a uniform and direct way.     

Effects of session duration on functional analysis outcomes.

We examined the extent to which variations in session duration affected the outcomes of functional analyses. Forty-six individuals, all diagnosed with mental retardation and referred for assessment and treatment of self-injurious or aggressive behavior, participated in functional analyses, consisting of repeated exposure to multiple test conditions during 15-min sessions. For each set of assessment data, new data sets based on session durations of 10 and 5 min were prepared by deleting data from the last 5 and 10 min, respectively, of each session. Each graph (N = 138) was then reviewed individually by graduate students who had previous experience conducting and interpreting functional analyses, but who were blind to both participant identity and session duration. Interpretations of behavioral function based on the 10- and 5-min data sets were then compared with those based on the 15-min data sets. All of the 10-min data sets yielded interpretations identical to those based on 15-min data sets. Interpretations based on the 5-min and 15-min data sets yielded three discrepancies, all of which were the result of increased response rates toward the latter parts of sessions. These results suggest that the efficiency of assessment might be improved with little or no loss in clarity by simply reducing the duration of assessment sessions.     

A case study of behavioral assessment and treatment of insect phobia

We assessed the academic performance of a 14-year-old boy with insect phobia in the context of feared stimuli. The dependent measure was math calculation rate across three conditions that varied therapist statements about the presence of crickets and the actual presence of live crickets. Subsequent treatment consisted of graduated exposure and contingent rewards for math problem completion. Assessment results indicated that the boy's performance was consistently low in the presence of live crickets but not when he was spuriously informed that crickets were present (the primary referral concern). Treatment results indicated no effect from exposure alone and a dramatic effect when exposure was combined with contingent rewards.