Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

Influential observations in principal factor analysis

We propose a method for detecting influential observations in iterative principal factor analysis. For this purpose we derive the influence functionsI(x; LL ^T ) andI(x; ) for the common variance matrixT =LL ^T and the unique variance matrix , respectively, in the common factor decomposition =LL ^T + . A numerical example is given for illustration.The authors are grateful to Tomoyuki Tarumi and Atsuhiro Hayashi for their kind permission to use their software Seto/B for drawing Figures 1 and 2 and to anonymous reviewers for comments on the paper.     

Using item-specific instructional information in achievement modeling

The problem of detecting instructional sensitivity (item basis) in test items is considered. An illustration is given which shows that for tests with many biased items, traditional item bias detection schemes give a very poor assessment of bias. A new method is proposed instead. This method extends item response theory (IRT) by including item-specific auxiliary measurement information related to opportunity-to-learn. Item-specific variation in measurement relations across students with varying opportunity-to-learn is allowed for.This paper was presented at the 1987 AERA meeting in Washington, DC. This research was supported by grant OERI-G-86-003 from the Office of Educational Research and Improvement, Department of Education. The author thanks Michael Hollis and Chih-fen Kao for valuable research assistance, and appreciates valuable comments made by an anonymous reviewer.     

The social phobia and anxiety inventory: Construct validity

The Social Phobia and Anxiety Inventory (SPAI) is a new instrument composed of social phobia and agoraphobia subscales. The latter scale is used to detect social anxiety that may result from agoraphobia. The SPAI's construct validity was assessed through several procedures. First, confirmatory factor analyses were conducted to validate the existence of the two subscales. Second, exploratory factor analyses examined the underlying structure of the social phobia subscale. Third, a Q factor procedure determined if different anxiety diagnostic groups could be differentiated by their SPAI response pattern. The results confirmed the utility of the two SPAI subscales and identified a number of dimensions contained within the social phobia subscale which differed depending upon the specific subject sample. In addition, the complaints of social phobies appeared more homogeneous than those of an agoraphobic comparison group. The results are discussed in terms of construct validity and the sensitivity of the SPAI to various dimensions of social phobia fears.This study was supported in part by NIMH Grants 41852, 30915, 18269, and 16884.     

HUMANITY IN THE WORLD OF LIFE

Abstract. The position and role of humanity in the world of life is examined in the light of the ontological structure of life itself. This problem is approached by considering the possible units of life representing various modes of life phenomena. I argue that the only meaningful unit of life without interposing some special external conditions is "global life" framed in a star-planet system. Any other possible unit of life exhibited by various kinds of individuals is conditional in the sense that it would leave out an essential part as "co-life." The relationship between human being and the global life should be understood in this general scheme of individual and global life. It is emphasized, however, that human being occupies a unique position in global life in the sense that humanity can promote either a cancerous situation or a healthy higher-order enhancement of the global life.     

TOWARD A NEW RELATION BETWEEN HUMANITY AND NATURE: RECONSTRUCTING T'IEN-JEN-HO-I

Abstract. The traditional Chinese idea of t'ien-jen-ho-i (Heaven and humanity in union) implies that humanity has to live in harmony with nature. As science and technology progress, however, the idea appears increasingly outmoded, and it becomes fashionable to talk about overcoming nature. Ironically, though, the further science reaches the more clearly are its limitations exposed. The exploitation of nature not only endangers many life forms on earth but threatens the very existence of the human species. I propose that a reconstruction of the traditional Chinese idea of T'ien-jen-ho-i will help us envisage a new and salutary relation between humanity and nature.     

HUMANITY IN NATURE: CONSERVING YET CREATING

Abstract. Developing a scientifically grounded philosophy of cosmic evolution, and using the moral norm of completeness as dynamic harmony, this paper argues that humans are a part of nature in both its conserving and emergent aspects. Humans are both material and cultural, instinctual-emotional and rational, creatures and creators, and carriers of stability and change. To ignore any of the multifaceted aspects of humanity in relation to the rest of nature is to commit one of a number of fallacies that are grounded in a dualistic-conquest mentality. Examples of some new developments in philosophy and theology, metaphorical images, and ritual show how to overcome dualism in favor of a dynamic harmony of humanity within nature.     

Complex decision making: A longitudinal study of process and performance

Two studies using a computer-simulated, strategy-formulation game and business students were conducted using simultaneous verbal protocols. It was found that a number of information-processing and information-evaluation thought processes were significantly related to game performance. Consistent with what is known about individual decision making, the present results suggest that, for the task used in this study, individuals who engage in causal analysis perform better than those who do not. But those who focus on negative emotions, blindly repeat previously successful decisions, and engage in illogical through processes perform more poorly than those who do not. Causal replication using real managers within organizational settings, however, is needed before firm conclusions can be drawn from this research.