Constructing the exact significance level for a person fit statistic

This paper uses an extension of the network algorithm originally introduced by Mehta and Patel to construct exact tail probabilities for testing the general hypothesis that item responses are distributed according to the Rasch model. By assuming that item difficulties are known, the algorithm is applicable to the statistical tests either given the maximum likelihood ability estimate or conditioned on the total score. A simulation study indicates that the network algorithm is an efficient tool for computing the significance level of a person fit statistic based on test lengths of 30 items or less.     

The many null distributions of person fit indices

This paper deals with the situation of an investigator who has collected the scores ofn persons to a set ofk dichotomous items, and wants to investigate whether the answers of all respondents are compatible with the one parameter logistic test model of Rasch. Contrary to the standard analysis of the Rasch model, where all persons are kept in the analysis and badly fittingitems may be removed, this paper studies the alternative model in which a small minority ofpersons has an answer strategy not described by the Rasch model. Such persons are called anomalous or aberrant. From the response vectors consisting ofk symbols each equal to 0 or 1, it is desired to classify each respondent as either anomalous or as conforming to the model. As this model is probabilistic, such a classification will possibly involve false positives and false negatives. Both for the Rasch model and for other item response models, the literature contains several proposals for a person fit index, which expresses for each individual the plausibility that his/her behavior follows the model. The present paper argues that such indices can only provide a satisfactory solution to the classification problem if their statistical distribution is known under the null hypothesis that all persons answer according to the model. This distribution, however, turns out to be rather different for different values of the person's latent trait value. This value will be called ability parameter, although our results are equally valid for Rasch scales measuring other attributes.As the true ability parameter is unknown, one can only use its estimate in order to obtain an estimated person fit value and an estimated null hypothesis distribution. The paper describes three specifications for the latter: assuming that the true ability equals its estimate, integrating across the ability distribution assumed for the population, and conditioning on the total score, which is in the Rasch model the sufficient statistic for the ability parameter.Classification rules for aberrance will be worked out for each of the three specifications. Depending on test length, item parameters and desired accuracy, they are based on the exact distribution, its Monte Carlo estimate and a new and promising approximation based on the moments of the person fit statistic. Results for the likelihood person fit statistic are given in detail, the methods could also be applied to other fit statistics. A comparison of the three specifications results in the recommendation to condition on the total score, as this avoids some problems of interpretation that affect the other two specifications.The authors express their gratitude to the reviewers and to many colleagues for comments on an earlier version.     

Personality disorder correspondence between the million behavioral health inventory (MBHI) and the minnesota multiphasic personality inventory (MMPI)

The MBHI and MMPI personality disorder scales were analyzed for convergent and discriminant validity. Correlational data demonstrated that six of the eight scales were significantly related, while the remaining two scales approached significance. Further analyses of these data, however, demonstrated that none of the scales correlated significantly better with its convergent scale compared to nonconvergent scales. The MBHI classified significantly more of the sample as personality disordered (93%) compared to the MMPI personality disorder scales (17%). Furthermore, the MBHI tended to describe the sample as falling within the Anxious cluster of personality disorders, whereas the MMPI described them within the Dramatic cluster. Single scale codetype correspondence was found to be 15%, while two-point concordance was 12.5%, indicating very low congruence between personality style codetypes. These two measures do not appear to be measuring the same personality style constructs.     

Parent-infant resemblance for general and specific cognitive abilities in the Colorado adoption project

Previous publications emanating from the Colorado Adoption Project have reported significant relationships between parental general cognitive ability (g) and infant Bayley MDI scores. The present study compared infant Bayley factor scores representing separable dimensions of infant cognition with parental general and specific cognitive abilities for 182 adoptive families and 164 nonadoptive families. Parent/offspring correlations between 12-month Bayley factors and parental cognitive abilities suggest only minimal relationships for both parental g and specific abilities. At 24 months, more parent/offspring resemblance was present; moreover, Bayley factors that were related to parental cognition tended to be related to parental g, not to specific abilities. The finding of significant parent/offspring relationships at 24 months between biological parents and their adopted-away infants, as well as between nonadoptive parents and their infants, suggests some genetic continuity from infancy to adulthood.     

Attitude polarization as a function of thought and reality constraints

It was suggested that thought changes cognitions to be more consistent with one's initial attitude direction and, therefore, results in attitude polarization. Specifically, it was predicted that polarization would be highest under thought with reality constraints absent, followed by thought with reality constraints present, followed by distration. During the first period of each of two trials, some of the 144 subjects were distracted from thinking about a preselected painting, others thought about the painting while viewing it, and others thought about it in its absence. Subjects were redistributed across the same three conditions for a second period. They then indicated their feelings about the painting. In the original study as well as a partial replication, females behaved as predicted: Thought with reality constraints absent produced the most polarization, followed by thought with reality constraints present, followed by distraction. In both the original study and the replication there was no systematic trend for the males. The theoretical implications of the female results and the sex differences were discussed.     

Bayesian parameter estimation in the Expectancy Valence model of the Iowa gambling task

The purpose of the popular Iowa gambling task is to study decision making deficits in clinical populations by mimicking real-life decision making in an experimental context. Busemeyer and Stout [Busemeyer, J. R., & Stout, J. C. (2002). A contribution of cognitive decision models to clinical assessment: Decomposing performance on the Bechara gambling task. Psychological Assessment, 14, 253-262] proposed an “Expectancy Valence” reinforcement learning model that estimates three latent components which are assumed to jointly determine choice behavior in the Iowa gambling task: weighing of wins versus losses, memory for past payoffs, and response consistency. In this article we explore the statistical properties of the Expectancy Valence model. We first demonstrate the difficulty of applying the model on the level of a single participant, we then propose and implement a Bayesian hierarchical estimation procedure to coherently combine information from different participants, and we finally apply the Bayesian estimation procedure to data from an experiment designed to provide a test of specific influence.     

Applying memories of reinforcement outcomes mainly to Pavlovian conditioning

A theory devised initially on the basis of instrumental reward schedule data, such as the PREE, was extended to deal with various Pavlovian findings. These Pavlovian findings include blocking, unblocking, relative validity, positive and negative patterning, renewal, reinstatement, reacquisition, and inhibition. In addition, the sequential model was discussed in relation to the rule-learning view of Hulse and Dorsky (1977) employing data from a report by Bloom and Capaldi (1961).     

Examining the Relationships Between the Justice Facets and Turnover Intent: The Mediating Roles of Overall Justice and Psychological Strain

We examined how interpersonal justice from coworkers, the traditional justice facets (i.e., distributive, procedural, interpersonal, informational), and overall justice perceptions relate to employee psychological strain and turnover intentions in Canadian Armed Forces personnel. Specifically, we hypothesized that overall justice would mediate the relationships between the justice facets (including coworker justice) and strain, and strain would mediate the relationship between overall justice and turnover intent. We used a cross-sectional correlational design with personnel from 2 military units (total N = 218) as our sample. A 2-step structural equation modeling technique was used to evaluate our hypotheses. Support for our hypotheses was obtained with 1 exception: informational justice did not predict overall justice judgments. Our results suggest that employees’ reactions to individual justice events and different sources of justice exert their effects on strain and turnover intent indirectly through their impact on a global evaluation of justice in their work environment.     

The response dynamics of preferential choice

The ubiquity of psychological process models requires an increased degree of sophistication in the methods and metrics that we use to evaluate them. We contribute to this venture by capitalizing on recent work in cognitive science analyzing response dynamics, which shows that the bearing information processing dynamics have on intended action is also revealed in the motor system. This decidedly “embodied” view suggests that researchers are missing out on potential dependent variables with which to evaluate their models—those associated with the motor response that produces a choice. The current work develops a method for collecting and analyzing such data in the domain of decision making. We first validate this method using widely normed stimuli from the International Affective Picture System (Experiment 1), and demonstrate that curvature in response trajectories provides a metric of the competition between choice options. We next extend the method to risky decision making (Experiment 2) and develop predictions for three popular classes of process model. The data provided by response dynamics demonstrate that choices contrary to the maxim of risk seeking in losses and risk aversion in gains may be the product of at least one “online” preference reversal, and can thus begin to discriminate amongst the candidate models. Finally, we incorporate attentional data collected via eye-tracking (Experiment 3) to develop a formal computational model of joint information sampling and preference accumulation. In sum, we validate response dynamics for use in preferential choice tasks and demonstrate the unique conclusions afforded by response dynamics over and above traditional methods.