Rivals without a cause? Relative performance feedback creates destructive competition despite aligned incentives

Whether people compete or cooperate with each other has consequences for their own performance and that of organizations. To explain why people compete or cooperate, previous research has focused on two main factors: situational outcome structures and personality types. Here, we propose that—above and beyond these two factors—situational cues, such as the format in which people receive feedback, strongly affect whether they act competitively, cooperatively, or individualistically. Results of a laboratory experiment support our theorizing: After receiving ranking feedback, both students and experienced managers treated group situations with cooperative outcome structures as competitive and were in consequence willing to forgo guaranteed financial gains to pursue a—financially irrelevant—better rank. Conversely, in dilemma situations, feedback based on the joint group outcome led to more cooperation than ranking feedback. Our study contributes to research on competition, cooperation, interdependence theory, forced ranking, and the design of information environments.     

Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

Criterion-related construct validity

Established results on latent variable models are applied to the study of the validity of a psychological test. When the test predicts a criterion by measuring a unidimensional latent construct, not only must the total score predict the criterion, but the joint distribution of criterion scores and item responses must exhibit a certain pattern. The presence of this population pattern may be tested with sample data using the stratified Wilcoxon rank sum test. Often, criterion information is available only for selected examinees, for instance, those who are admitted or hired. Three cases are discussed: (i) selection at random, (ii) selection based on the current test, and (iii) selection based on other measures of the latent construct. Discriminant validity is also discussed.This work was supported in part by Grant SES-87-01890 from the Measurement Methods and Data Improvement Program of the U.S. National Science Foundation.     

A nonparametric approach for assessing latent trait unidimensionality

Assuming a nonparametric family of item response theory models, a theory-based procedure for testing the hypothesis of unidimensionality of the latent space is proposed. The asymptotic distribution of the test statistic is derived assuming unidimensionality, thereby establishing an asymptotically valid statistical test of the unidimensionality of the latent trait. Based upon a new notion of dimensionality, the test is shown to have asymptotic power 1. A 6300 trial Monte Carlo study using published item parameter estimates of widely used standardized tests indicates conservative adherence to the nominal level of significance and statistical power averaging 81 out of 100 rejections for examinee sample sizes and psychological test lengths often incurred in practice.The referees' comments were remarkably detailed and greatly enhanced the writeup and sensitized the author to certain pertinent issues. Discussions with Fritz Drasgow, Lloyd Humphreys, Dennis Jennings, Brian Junker, Robert Linn, Ratna Nandakumar, and Robin Shealy were also very useful.This research was supported by the Office of Naval Research under grant N00014-84-K-0186; NR 150-533, and by the National Science Foundation under grant DMS 85-03321.     

Separability of item and person parameters in response time models

This paper discusses two forms of separability of item and person parameters in the context of response time (RT) models. The first is separate sufficiency: the existence of sufficient statistics for the item (person) parameters that do not depend on the person (item) parameters. The second is ranking independence: the likelihood of the item (person) ranking with respect to RTs does not depend on the person (item) parameters. For each form a theorem stating sufficient conditions, is proved. The two forms of separability are shown to include several (special cases of) models from psychometric and biometric literature. Ranking independence imposes no restrictions on the general distribution form, but on its parametrization. An estimation procedure based upon ranks and pseudolikelihood theory is discussed, as well as the relation of ranking independence to the concept of double monotonicity.I am indebted to Wim van der Linden for bringing Thissen's (1983) paper to my notice, and to Martijn Berger, Frans Tan, and the anonymous reviewers for their constructive comments on earlier drafts of this paper.     

A marginalization model for the multidimensional unfolding analysis of ranking data

A marginalization model for the multidimensional unfolding analysis of ranking data is presented. A subject samples one of a number of random points that are multivariate normally distributed. The subject perceives the distances from the point to all the stimulus points fixed in the same multidimensional space. The distances are error perturbed in this perception process. He/she produces a ranking dependent on these error-perturbed distances. The marginal probability of a ranking is obtained according to this ranking model and by integrating out the subject (ideal point) parameters, assuming the above distribution. One advantage of the model is that the individual differences are captured using the posterior probabilities of subject points. Three sets of ranking data are analyzed by the model.     

Isotonic ordinal probabilistic models (ISOP)

The concept of an ordinal instrumental probabilistic comparison is introduced. It relies on an ordinal scale given a priori and on the concept of stochastic dominance. It is used to define a weakly independently ordered system, or isotonic ordinal probabilistic (ISOP) model, which allows the construction of separate sample-free ordinal scales on a set of subjects and a set of items. The ISOP-model is a common nonparametric theoretical structure for unidimensional models for quantitative, ordinal and dichotomous variables.Fundamental theorems on dichotomous and polytomous weakly independently ordered systems are derived. It is shown that the raw score system has the same formal properties as the latent system, and therefore the latter can be tested at the observed empirical level.I wish to thank 3 reviewers and 2 editors who contributed a lot to the readability and precision of the article.     

The percentage bend correlation coefficient

A well-known result is that the usual correlation coefficient,, is highly nonrobust: very slight changes in only one of the marginal distributions can alter by a substantial amount. There are a variety of methods for correcting this problem. This paper identifies one particular method which is useful in psychometrics and provides a simple test for independence. It is not recommended that the new test replace the usual test ofH ₀: = 0, but the new test has important advantages over the usual test in terms of both Type I errors and power.     

Essential independence and likelihood-based ability estimation for polytomous items

A definition ofessential independence is proposed for sequences of polytomous items. For items satisfying the reasonable assumption that the expected amount of credit awarded increases with examinee ability, we develop a theory ofessential unidimensionality which closely parallels that of Stout. Essentially unidimensional item sequences can be shown to have a unique (up to change-of-scale) dominant underlying trait, which can be consistently estimated by a monotone transformation of the sum of the item scores. In more general polytomous-response latent trait models (with or without ordered responses), anM-estimator based upon maximum likelihood may be shown to be consistent for under essentially unidimensional violations of local independence and a variety of monotonicity/identifiability conditions. A rigorous proof of this fact is given, and the standard error of the estimator is explored. These results suggest that ability estimation methods that rely on the summation form of the log likelihood under local independence should generally be robust under essential independence, but standard errors may vary greatly from what is usually expected, depending on the degree of departure from local independence. An index of departure from local independence is also proposed.This work was supported in part by Office of Naval Research Grant N00014-87-K-0277 and National Science Foundation Grant NSF-DMS-88-02556. The author is grateful to William F. Stout for many helpful comments, and to an anonymous reviewer for raising the questions addressed in section 2. A preliminary version of section 6 appeared in the author's Ph.D. thesis.     

Community,liberty and the practice of teaching

Does the cultivation of liberty undermine communities of practice? The answer depends significantly on what is meant by the cultivation of liberty and on what is meant by a community of practice. On the question of community, the work of Rawls and Sandel serves as a starting point. I examine three conceptions — the instrumental, the sentimental and the constitutive — and attempt to illustrate them with examples of communities of practice. I argue that Sandel's criterion for distinguishing between the sentimental and constitutive conceptions of community does not do the work required of it. On the question of liberty undermining community, I argue that if liberty is taken as license then it is a threat both to communities and to practices, whereas if it is taken as independence then it threatens neither. Two conceptions of independence can be distinguished. One, which is central to liberal political theory, does not presuppose an account of the good; the other, which I argue is central to the flourishing of a community of practice, does. It presupposes that account of the good which is implicit in the end or telos of the practice concerned.