Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

Influential observations in principal factor analysis

We propose a method for detecting influential observations in iterative principal factor analysis. For this purpose we derive the influence functionsI(x; LL ^T ) andI(x; ) for the common variance matrixT =LL ^T and the unique variance matrix , respectively, in the common factor decomposition =LL ^T + . A numerical example is given for illustration.The authors are grateful to Tomoyuki Tarumi and Atsuhiro Hayashi for their kind permission to use their software Seto/B for drawing Figures 1 and 2 and to anonymous reviewers for comments on the paper.     

Using item-specific instructional information in achievement modeling

The problem of detecting instructional sensitivity (item basis) in test items is considered. An illustration is given which shows that for tests with many biased items, traditional item bias detection schemes give a very poor assessment of bias. A new method is proposed instead. This method extends item response theory (IRT) by including item-specific auxiliary measurement information related to opportunity-to-learn. Item-specific variation in measurement relations across students with varying opportunity-to-learn is allowed for.This paper was presented at the 1987 AERA meeting in Washington, DC. This research was supported by grant OERI-G-86-003 from the Office of Educational Research and Improvement, Department of Education. The author thanks Michael Hollis and Chih-fen Kao for valuable research assistance, and appreciates valuable comments made by an anonymous reviewer.     

Children's social behavior: Reliability and concurrent validity of two self-report measures

In this study the psychometric qualities of Deluty's Children's Action Tendency Scale (CATS) and Michelson and Wood's Children's Assertive Behavior Scale (CABS) were assessed with 157 Dutch children. Both instruments are designed to assess children's self-reported responses to interpersonal situations, whereby aggressive, assertive, and submissive scores are obtained. In general acceptable psychometric properties were obtained for both the CATS and the CABS, except for the assertive scale of the CATS. Furthermore, it was found that the ability of both the CATS and the CABS to discriminate between submissiveness and assertiveness was low. Important gender differences that were found regarding the relations with measures of perceived competence and social desirability are offered as a possible explanation for the relative failure of the CABS and the CATS to unbind submissive from assertive behavior. The parent version of the CABS is offered as a possible alternative or additional source of information for the assessment of children's submissiveness. Recommendations for future applications and research are presented.This research was supported by Grant 2843 from the NFGV to the second author.     

On the limits of the matching concept in monkeys (Cebus apella).

Two cebus monkeys, with many years of experience matching a variety of static visual stimuli (forms and colors) within a standard matching-to-sample paradigm, were trained to press a left lever when a pair of displayed static stimuli were the same and to press a right lever when they were different. After learning the same/different task, the monkeys were tested for transfer to dynamic visual stimuli (flashing versus steady green disks), with which they had no previous experience. Both failed to transfer to the dynamic stimuli. A third monkey, also with massive past experience matching static visual stimuli, was tested for transfer to the dynamic stimuli within our standard matching paradigm, and it, too, failed. All 3 subjects were unable to reach a moderate acquisition criterion despite as many as 52 sessions of training with the dynamic stimuli. These results provide further evidence that, in monkeys, the matching (or identity) concept has a very limited reach; they consequently do not support the view held by some theorists that an abstract matching concept based on physical similarity is a general endowment of animals.     

The effects of social motives on behavior in social dilemmas in two cultures

Subjects in Santa Barbara, California, and Groningen, The Netherlands, participated in a seven-person social dilemma game, presented in terms of a conservation of resources problem. Prior to their decision making in the social dilemma game, subject's social motive (altruistic, cooperative, individualistic, competitive) was assessed by means of two different classification procedures. On the basis of previous research findings American subjects were expected to display relatively more competitive social motives, and Dutch subjects relatively more cooperative ones. However, no indications of crosscultural differences were found neither with regard to the distribution of social motives nor with regard to the amount of resources taken for self in the social dilemma game. In both locations, competitive subjects took most resources for self, individualistic subjects took next most, cooperative subjects took less than individualists, and altruistic subjects took the least. In addition to predictive validity, indices of the convergent validity of two social motive assessment procedures were described.     

The pathological left-handedness syndrome

A clinical syndrome of pathological left-handedness (PLH) is proposed to identify the pattern of correlative changes in lateral development associated with early brain injury in some manifest left-handers. This syndrome is believed to be caused by a hemispheric lesion that is predominantly left-sided (or bilateral asymmetric), which onsets before Age 6, and which encroaches upon the critical speech zones of the frontotemporal/frontoparietal cortex. The pattern of changes may include any or all of the following features: shifts in manual dominance, trophic changes in the extremities, transfer of hemispheric speech, and/or intrahemispheric reorganization of visuospatial cognitive functions. Although some of these correlates of PLH have long been known, they have not been recognized as an interrelated pattern of traits that constitute a clinical syndrome. Identification of these individuals, all manifest left-handers, will be shown to have implications for diagnosis/remediation and for models of recovery of function.     

Optic aphasia, optic apraxia, and loss of dreaming

A 47-year-old man with a left temporo-occipital infarct in the area of the posterior cerebral artery is presented. The neuropsychological examination did not reveal aphasia or gross mental deficits. The patient presented with alexia without agraphia, color agnosia, but few visual perceptual deficits. The main impairment was in confrontation naming; he was incapable of naming objects and pictures, not from lack of recognition (excluding visual agnosia) but from lack of access to the appropriate word (optic aphasia). The patient also exhibited a deficit in the evocation of gesture from the visual presentation of an object (optic apraxia) and a difficulty in "conjuring up" visual images of objects (impaired visual imagery) and loss of dreams. The fundamental deficit of this patient is tentatively explained in terms of visuoverbal and visuogestural disconnection and a deficit of mental imagery.