Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

Influential observations in principal factor analysis

We propose a method for detecting influential observations in iterative principal factor analysis. For this purpose we derive the influence functionsI(x; LL ^T ) andI(x; ) for the common variance matrixT =LL ^T and the unique variance matrix , respectively, in the common factor decomposition =LL ^T + . A numerical example is given for illustration.The authors are grateful to Tomoyuki Tarumi and Atsuhiro Hayashi for their kind permission to use their software Seto/B for drawing Figures 1 and 2 and to anonymous reviewers for comments on the paper.     

On the limits of the matching concept in monkeys (Cebus apella).

Two cebus monkeys, with many years of experience matching a variety of static visual stimuli (forms and colors) within a standard matching-to-sample paradigm, were trained to press a left lever when a pair of displayed static stimuli were the same and to press a right lever when they were different. After learning the same/different task, the monkeys were tested for transfer to dynamic visual stimuli (flashing versus steady green disks), with which they had no previous experience. Both failed to transfer to the dynamic stimuli. A third monkey, also with massive past experience matching static visual stimuli, was tested for transfer to the dynamic stimuli within our standard matching paradigm, and it, too, failed. All 3 subjects were unable to reach a moderate acquisition criterion despite as many as 52 sessions of training with the dynamic stimuli. These results provide further evidence that, in monkeys, the matching (or identity) concept has a very limited reach; they consequently do not support the view held by some theorists that an abstract matching concept based on physical similarity is a general endowment of animals.     

How serious a fallacy is inconsistency?

Consistency is often pictured as an indispensable requisite for rationality. The paper argues that this is overly rigoristic. Inconsistency can be treated as a matter of isolable singularities rather than an all-destructive disaster. The paper, supports and illustrates a perspective on which consistency can be seen as a desideratum rather than a totaly non-negotiable demand. The argumentation of the paper casts consistency in the role of a cognitive ideal rather than a sine qua non condition of rational process.     

Multifactor measurement of bodily feelings: Conceptual development,scale construction,and empirical validation

A series of studies is described demonstrating a coherent exploratory and confirmatory factor-analytic approach to the scaling of self-reported bodily feelings. This approach attempts to optimize the orthogonality, parsimony, and meaningfulness of a multifactor inventory. Psychometric properties of the resulting 35-item Bodily Feeling Scale (BFS) are presented and its comparability with other inventories is discussed. A validity study using item-content-based scales of the Minnesota Multiphasic Personality Inventory showed both concurrent and discriminative validity of the BFS. Implications for clinical and research utility are discussed.Portions of this research were conducted while the first author was supported by a University Graduate Fellowship awarded by the Graduate School of Arts and Sciences at Vanderbilt University.Professor Nunnally passed away in August 1982. His major contributions to the several stages of this research program are recognized through coauthorship.     

A nonparametric approach for assessing latent trait unidimensionality

Assuming a nonparametric family of item response theory models, a theory-based procedure for testing the hypothesis of unidimensionality of the latent space is proposed. The asymptotic distribution of the test statistic is derived assuming unidimensionality, thereby establishing an asymptotically valid statistical test of the unidimensionality of the latent trait. Based upon a new notion of dimensionality, the test is shown to have asymptotic power 1. A 6300 trial Monte Carlo study using published item parameter estimates of widely used standardized tests indicates conservative adherence to the nominal level of significance and statistical power averaging 81 out of 100 rejections for examinee sample sizes and psychological test lengths often incurred in practice.The referees' comments were remarkably detailed and greatly enhanced the writeup and sensitized the author to certain pertinent issues. Discussions with Fritz Drasgow, Lloyd Humphreys, Dennis Jennings, Brian Junker, Robert Linn, Ratna Nandakumar, and Robin Shealy were also very useful.This research was supported by the Office of Naval Research under grant N00014-84-K-0186; NR 150-533, and by the National Science Foundation under grant DMS 85-03321.     

A taxonomy of item response models

A number of models for categorical item response data have been proposed in recent years. The models appear to be quite different. However, they may usefully be organized as members of only three distinct classes, within which the models are distinguished only by assumptions and constraints on their parameters. “Difference models” are appropriate for ordered responses, “divide-by-total” models may be used for either ordered or nominal responses, and “left-side added” models are used for multiple-choice responses with guessing. The details of the taxonomy and the models are described in this paper. The present study was supported in part by two postdoctoral fellowships awarded to Lynne Steinberg: an Educational Testing Service Postdoctoral Fellowship at ETS, Princeton, NJ and an NIMH Individual National Research Service Award at Stanford University, Stanford, CA. Helpful comments by the editor and three anonymous reviewers are gratefully acknowledged.     

Assertiveness and cognitive processing in interpersonal situations

This study examined social skills components that precede the delivery of a skilled overt interpersonal response. Using a cognitive-behavioral systems approach to assertiveness, a task analysis of how women receive and process information in interpersonal situations requiring an assertive response to men was performed. Forty women were assigned to high- or low-assertive groups based on their Rathus Assertiveness Schedule scores. In small group sessions, each woman viewed four videotaped problem situations requiring an assertive response to both pleasant and angry males. After viewing each scene, each woman completed three questionnaires: (a) receiving information, (b) processing-generation of alternatives and decision making, and (c) processing-generation of consequences. High- and low-assertive participants were found to differ in their evaluation of consequences, for response options, particularly how a male would likely to behave to them. High-assertive participants were judged to evaluate more correctly than low-assertive participants the likely behavior of males if response options were implemented. All participants generated more complex alternatives and more assertive responses to situations involving an angry male as compared to a pleasant male. No differences were found between groups in their ability to receive information accurately. Correlational results were supportive of a cognitive-behavioral systems approach of assertion, that is, the emission of a skilled response depends on a chain of preceding responses.Thanks are due to Vida Dyson and Lenard Jason for their comments on an early draft of this paper.     

Expertise reversal effect in a pen-tablet-based learning environment: The role of learningcentered emotions in the interplay between learner expertise and task complexity

The study investigated interactions between learner expertise and task complexity evaluated from both cognitive and affective perspectives. One hundred and seventy-three students, both novices and advanced learners, were asked to learn Japanese writing in a pen-tablet-based digital learning environment with varying task complexity levels. Cognitive load and learning-centred emotions were measured at intervals during learning, while writing performance was monitored by runtime tracking. Results indicated that while advanced learners performed better than novices across the range of task complexity, the moderate task complexity was shown to be superior in enhancing performance for both levels of expertise. Results for learning-centred emotions showed that advanced learners reported lower enjoyment and higher frustration when completing the low complexity task, whereas the moderately complex task was reported to be the most enjoyable and less frustrating for these learners. No significant difference in emotions was found across levels of task complexity for novices. Finally, a constructed composite indicator of cognitive-affective efficiency of instructional conditions showed a significant interaction between levels of learner expertise and task complexity primarily caused by affective factors.