The psychometricians' fallacy: Too clever by half?

The psychometricians' fallacy concludes that an attribute is quantitative from the premise that it is ordinal. This fallacy occupies a central place in the paradigm of psychometrics. Most of the founders of the discipline committed it and it makes sense of otherwise anomalous developments within the discipline, such as the permissible statistics controversy and the dominant form taken by item response theories. The fallacy is displayed by showing (1) that an attribute's quantitative structure reduces to a weak order upon differences between degrees that satisfies the double cancellation, solvability, and Archimedean conditions of conjoint measurement theory and (2) the fact that any order on the degrees themselves does not entail sufficient structure on this weak order to guarantee satisfaction of these conditions. Thus, it is possible that an ordered attribute is non‐quantitative. Also, each pair of differences between degrees of an ordinal attribute falls into one of two disjoint classes: (1) those where the order relation between the pair follows from an order on the attribute and (2) those where it is independent of that order and possibly diagnostic of quantitative structure and this fact means that the distinction between order and quantity is an empirical one.     

When a Psychometric Advance Falls in the Forest

Borsboom (2006) attacks psychologists for failing to incorporate psychometric advances in their work, discusses factors that contribute to this regrettable situation, and offers suggestions for ameliorating it. This commentary applauds Borsboom for calling the field to task on this issue and notes additional problems in the field regarding measurement that he could add to his critique. It also chastises Borsboom for occasionally being unnecessarily perjorative in his critique, noting that negative rhetoric is unlikely to make converts of offenders. Finally, it exhorts psychometricians to make their work more accessible and points to Borsboom, Mellenbergh, and Van Heerden (2003) as an excellent example of how this can be done. I wish to thank Frank Schmidt for his help in preparing this paper. Requests for reprints should be sent to la-clark@uiowa.edu.     

Looking Philosophical: Stuff,Stereotypes, and Self‐Presentation

Self‐presentation is a complex phenomenon through which individuals present themselves in performance of social roles. The success of such performances rests not just on how well a performer fulfills expectations regarding the role she would play, but on whether observers find her convincing. I focus on how self‐presentation entails making use of material environment and objects: One may “dress for the part” and employ props that suit a desired role. However, regardless of dress or props, one can nonetheless fail to “look the part” owing to expectations informed by biases patterned along commonplace social stereotypes. Using the social role of philosopher as my example, I analyze how the stereotype attached to this role carries implications for how demographically under‐represented philosophers may self‐present, specifically with regard to dress and decoration. I look, in particular, to the alienation from one's material environment that may follow on the frustration of self‐presentation through bias. One pernicious effect of bias, I argue, is the power it has to deform and distort its target's relation to her physical setting and objects. Where comfort and ease in one's material environment can be a significant ethico‐aesthetic good, bias can inhibit access to, and enjoyment of, this good.     

Future of Psychometrics: Ask What Psychometrics Can Do for Psychology

I address two issues that were inspired by my work on the Dutch Committee on Tests and Testing (COTAN). The first issue is the understanding of problems test constructors and researchers using tests have of psychometric knowledge. I argue that this understanding is important for a field, like psychometrics, for which the dissemination of psychometric knowledge among test constructors and researchers in general is highly important. The second issue concerns the identification of psychometric research topics that are relevant for test constructors and test users but in my view do not receive enough attention in psychometrics. I discuss the influence of test length on decision quality in personnel selection and quality of difference scores in therapy assessment, and theory development in test construction and validity research. I also briefly mention the issue of whether particular attributes are continuous or discrete.     

Measurements in the future: beyond the 20th century

This article presents a brief history of psychometrics and the development in the USA shortly after the end of World War II of university graduate programs to educate and train psychometricians. Three decades later these programs in North America were on a steady decline. But, at the same time there was a surge in universities abroad in producing well-trained psychometricians, particularly in Western European countries, especially The Netherlands. Broad implications of the effect of this movement on psychological testing are suggested.     

What if there were no psychometrics?: constructs, complexity, and measurement

McGrath (2005/this issue) has published a very significant article; it is significant because it examines the substantive issue of construct validity in a simple and informative way, noting the confusions apparent in how constructs and their variables are defined, used, and interpreted within the domain of personality and individual differences. This is a careful, thoughtful, article that quietly proceeds to outline the problems with current thinking and approaches to defining and using constructs in psychology. McGrath also suggests how some of these problems might be addressed. I note that McGrath appears to miss what might be considered an obvious rejoinder to some of his arguments, that is, the use of latent variable and item response theory. Some consideration is given to these arguments. However, a cursory examination shows that although these new methodologies offer many opportunities for new stochastic questionnaire data modeling and the construction of "instant" latent variables, the same problems caused by lack of attention to measurement and meaning remain. I find I am in agreement with many of the author's views and arguments, but I also find myself wondering whether modern psychometrics and individual differences research methods is now so dominated by psychological statisticians that any thought of substantive scientific innovation in this area that deals more properly with measurement and meaning is long gone. I think the answers to the question "What if there was no psychometrics?" would be most illuminating.     

PROGRESS IN PSYCHOMETRICS: CAN INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY CATCH UP?

Murphy and DeShon (2000) show that interrater correlations do not provide reasonable estimates of the reliability of job performance ratings, and suggest that better estimates can be obtained by applying the methods of generalizability theory. Schmidt, Viswesvaran, and Ones (2000) criticize our suggestions as radical, and argue that: (a) the reliability of ratings should be evaluated using the parallel test model rather than the more general and more realistic generalizability model, (b) reliability and validity are distinct concepts that should not be confused, and (c) measurement models have little to do with substantive models of the processes that generate scores on a test or measure. All three of these ideas were once part of the psychometric mainstream, but progress in psychometrics over the last 3 decades has moved the field well beyond these assumptions and approaches. Modern psychometric theory calls for close linkages between measurement models and substantive models of the phenomena being measured.     

Building Simple Mechanical MindsUsing LEGO® Robots for Research and Teaching in Philosophy

In this essay I discuss how I built a cognitive-robotics lab using inexpensive LEGO® MINDSTORMS™ robot kits. The lab has provided pedagogical and research opportunities for a number of philosophy courses, and I briefly describe the results of those efforts. I also describe how one might build a similar lab. Philosophers need to be more directly involved in the field of robotics. There is much work to do in tidying up the philosophical debris left by the last wave of robotics research, which the researchers have been unwilling or unable to do themselves. The major barriers to participation have been hardware costs and a lack of technical expertise among most philosophers. In recent years, though, these barriers have become less of a problem. At the end, I present some ideas about the kinds of experiments that such kits make possible and how to expand beyond the limitations of the basic LEGO® hardware.     

The Narrative Arc of TATs: Introduction to the JPA Special Section on Thematic Apperceptive Techniques

The past decade has seen important developments in thematic apperceptive techniques (TATs), with the creation of new card sets having alternate pictures representing different cultures, new scoring systems becoming available, and increasing international communication of these achievements. However, continuing impediments to the development of a validational literature include lingering mistaken assumptions about the nature of story data, ongoing debates about appropriate psychometric evaluation, and continuing questions about how stimuli and scoring systems should be conceptualized and interpreted. Negotiating the publication system can impede some potential authors. Excellent work on TATs with children is not well known in the adult-focused journals. The labor burden of meeting increasingly sophisticated publication standards might be a barrier to assessors focused on clinical practice. Accumulating a focused evidence base is challenging given the diversity of criterion variables for which TATs have been used. Research on TATs by clinicians can span the science–practice gap, but the narrative arc can be a dramatic one. The articles in this special section on TATs represent important conceptual, methodological, and substantive innovations.     

How the intentions of the draftsman shape perception of a drawing

The interaction between the recovery of the artist’s intentions and the perception of an artwork is a classic topic for philosophy and history of art. It also frequently, albeit sometimes implicitly, comes up in everyday thought and conversation about art and artworks. Since recent work in cognitive science can help us understand how we perceive and understand the intentions of others, this discipline could fruitfully participate in a multidisciplinary investigation of the role of intention recovery in art perception. The method I propose is to look for cases where recovery of the artist’s intentions interacts with perception of a work of art, and this cannot be explain by a simple top-down influence of conscious propositional knowledge on perception. I will focus on drawing and show that recovery of the draftsman’s intentional actions is handled by a psychological process shaped by the motor system of the observer.     

Why Colours Do Look Like Dispositions

In recent years philosophers such as Paul Boghossian, David Velleman and Colin McGinn have argued against the view that colours are dispositional properties, on the grounds that they do not look like dispositional properties, and in particular that they are not represented in visual experience as dispositions to present certain kinds of appearances. Rather colours are represented as being these appearances, i.e., simple, non-dispositional properties. I argue that a proper understanding of how visual experiences represent physical objects as being coloured shows that colours do look like dispositions. In particular, I argue that if visual experiences are to represent properties as properties of physical objects, they must distinguish between these properties and their appearances, and thus cannot represent such properties as colours as being identical with their corresponding appearances.     

The Economic Sphere

Herman Dooyeweerd (1985) argued that among the modalities making up the fabric of reality a specifically economic one is to be found. The aim of the present paper is to discuss the texture of such a modality and how it both differentiates and intertwines with others. For an updated brief, albeit cogent and analytically lucid presentation of the Law Framework ontology, see Clouser (2009). Dooyeweerd’s view entails that the proper object of economics is irreducible to that of other disciplines, but a non-reductionist view of the object of economics presupposes that the nuclear meaning of that discipline has been clearly delimited: this is required in order to determine its nature and separate identity as a scientific discipline. By ‘the nuclear meaning of a discipline’ I understand a pre-theoretical delimitation of its field of research, such as that of the field of physics, characterized by the laws governing force and energy. Within one and the same field there may be many theories, theories competing to explain the same phenomena, or dealing with phenomena so different that it is nearly impossible to trace conceptual connections among them. This last situation calls for a unified-field theory. In the second section of this paper I will attempt to defend a rather commonly accepted definition of the field of economics that sees this discipline as a science of choice. In the third I will show how the analytical conception it involves can be naturally complemented with a classificatory one. According to a classificatory conception, the aggregated social-level phenomena, patterns and regularities economic theories usually deal with, are economic in that sense, even though they are not prima facie cases of individual behavior, or are unintended consequences of aggregated individual choices. In the fourth I will discuss the meaning of the most general, supra-arbitrary economic laws—the modal laws of economics. In the final section I will offer a non-reductionist view of economics that nevertheless takes into account its intertwining with other spheres.     

Being Religious: Working at Self-Maintenance and Self-Transformation

We see religion in the things people treat as crucial to what they are and to what they aspire to become, things that make the biggest difference in how people feel about themselves. They may be social aspects or personal (behavioral or characterological) aspects of the self. The things people are militant about, the practices in regard to which they are most scrupulous, and the things about themselves that distress them are indicators of where their religious concerns lie, whatever the subject matter. People work to maintain themselves as they want to see themselves and as they want others to see them; they seek ways to repair damage to their selves. They seek also to transform themselves so as to escape present unhappy definitions of self and to achieve ideal states of being. What needs to be changed may be perceived as aspects of personal self, as attitudes other people have toward otherwise unchangeable aspects of self, or as the entire socio-political system in which people feel trapped. The process by which people manage successfully to transform themselves includes social cooperation, including the formation of groups to provide mutual reinforcement.     

Departure from normal assumptions: A promise for future psychometrics with substantive mathematical modeling

Normal assumptions have been used in many psychometric methods, to the extent that most researchers do not even question their adequacy. With the rapid advancement of computer technologies in recent years, psychometrics has extended its territory to include intensive cognitive diagnosis, etcetera, and substantive mathematical modeling ha become essential. As a natural consequence, it is time to consider departure from normal assumptions seriously. As examples of models which are not based on normality or its approximation, the logistic positive exponent family of models is discussed. These models include the item task complexity as the third parameter, which determines the single principle of ordering individuals on the ability scale.     

ON AGGRESSION TURNED AGAINST THE SELF

Deliberate self‐harm is a common presenting problem suffered by young people. Several patients referred to the NHS outpatient clinic where I work have been able to stop harming themselves during intensive psychoanalytic psychotherapy. In this paper, I shall discuss a variety of motives for persistent cutting by one adolescent girl. I am most interested to show how the healthier part of her personality overcame her motives for harming herself, and eventually allowed her to make use of my understanding of a sadomasochistic internal object that worked against us.     

Emulation vs. indigenization in the reception of western psychology in Republican China: An analysis of the content of Chinese psychology journals (1922–1937)

The present study examines the practice of empirical psychology in China during the Republican period using a content analysis of its journals. By seeking answers to questions of what kinds of psychology from the West first attracted the Chinese; whether they found a way of developing a psychology more in tune to their own cultural assumptions of selfhood; and to what uses they felt the new discipline could be put, it shows the extent to which its journal content adopted a Western or an indigenous orientation. It thus contributes to the recent debate about indigenization of psychology globally and situates the origins of these issues in China much earlier than has been envisaged by contemporary Chinese indigenous psychologists. Throughout this period, indigenous concerns informed the research agenda, the dominant practice being psychometrics. But because of a lack of social support, they remained largely confined to the pages of psychology journals. © 2009 Wiley Periodicals, Inc.     

Thurstonian-Based Analyses: Past, Present, and Future Utilities

Current psychometric models of choice behavior are strongly influenced by Thurstone’s (1927, 1931) experimental and statistical work on measuring and scaling preferences. Aided by advances in computational techniques, choice models can now accommodate a wide range of different data types and sources of preference variability among respondents induced by such diverse factors as person-specific choice sets or different functional forms for the underlying utility representations. At the same time, these models are increasingly challenged by behavioral work demonstrating the prevalence of choice behavior that is not consistent with the underlying assumptions of these models. I discuss new modeling avenues that can account for such seemingly inconsistent choice behavior and conclude by emphasizing the interdisciplinary frontiers in the study of choice behavior and the resulting challenges for psychometricians. The author would like to thank R. Darrell Bock whose work inspired many of the ideas presented here. The paper benefitted from helpful comments by Albert Maydeu-Olivares and Rung-Ching Tsai. The reported research was supported in parts by the Social Sciences and Humanities Research Council of Canada.     

Synchronicity as A Basis of Analytic Attitude

My aim is to describe Jung's approach to the experience of the chaotic, which could equally be termed the irrational, the non-ego, the unordered or prima materia , and to extract from this a clinical approach to the analytic patient which, in Jung's own writings, is often more implicit than explicit. My interest in this enquiry arises from the clinical experience of the unconscious in the form of transference/ countertransference, involving relentless pressure on both analyst and analysand to attempt to impute meaning and order. I examine Jung's work 'Synchronicity: an acausal connecting principle' and extrapolate from it what I think to be its unique contribution to hermeneutics - the ontologically-based concept of a psychoid understanding of meaning and pattern. In the second part of the paper, I discuss the application to analytic work of Jung's hermeneutic approach. I look at how analysts relate to meaning in terms of their relationship to theory. I illustrate this by comparing two short psychoanalytic papers on aggression, an instinct which is often seen as engendering splitting and which tends therefore to promote the dissociations which Jung was trying to address in 'Synchronicity'. I then illustrate with clinical material how Jungian analysts might relate to meaning in their approach to the patient. Together, these form the basis of what is commonly called 'analytic attitude', which I see as the basis for a distinctively Jungian identity for analytic practice.