On the sampling theory roundations of item response theory models

Item response theory (IT) models are now in common use for the analysis of dichotomous item responses. This paper examines the sampling theory foundations for statistical inference in these models. The discussion includes: some history on the stochastic subject versus the random sampling interpretations of the probability in IRT models; the relationship between three versions of maximum likelihood estimation for IRT models; estimating versus estimating -predictors; IRT models and loglinear models; the identifiability of IRT models; and the role of robustness and Bayesian statistics from the sampling theory perspective.A presidential address can serve many different functions. This one is a report of investigations I started at least ten years ago to understand what IRT was all about. It is a decidedly one-sided view, but I hope it stimulates controversy and further research. I have profited from discussions of this material with many people including: Brian Junker, Charles Lewis, Nicholas Longford, Robert Mislevy, Ivo Molenaar, Donald Rock, Donald Rubin, Lynne Steinberg, Martha Stocking, William Stout, Dorothy Thayer, David Thissen, Wim van der Linden, Howard Wainer, and Marilyn Wingersky. Of course, none of them is responsible for any errors or misstatements in this paper. The research was supported in part by the Cognitive Science Program, Office of Naval Research under Contract No. Nooo14-87-K-0730 and by the Program Statistics Research Project of Educational Testing Service.     

Awakening from Descartes' nightmare: On the love of ambiguity in phenomenological approaches to education

This paper is an exploration of the Cartesian paradigms of clarity and univocity and how these inform contemporary educational theory and practice. Phenomenology is discussed as a way of disrupting Descartes' visions of clarity and distinctness as paradigms of knowledge and as a return of inquiry to life as it is actually lived. Analogical discourse is examined as a way of giving a voice to this sort of inquiry. Heidegger's notions of inquiry as obedience and thanksgiving are discussed.     

Grading the ‘cultural literacy’ project

The essay examines the argument advanced by E.D. Hirsch, Jr., for instituting ‘cultural literacy’ as a fundamental priority of schools. A number of confusions and equivocations in Hirsch's reasoning are identified, and the propensity of his project to indoctrinate is exposed. Among the features of Hirsch's argument shown to be troubling are his shifting construal of ‘language’, his inconsistency about the requirements of cultural literacy, and his uncritical relation to traditional images of the American past and present. The upshot is to raise the question why Hirsch's project has elicited wide support and praise.     

Concepts and conceptual change

This paper argues that questions concerning the nature of concepts that are central in cognitive psychology are also important to epistemology and that there is more to conceptual change than mere belief revision. Understanding of epistemic change requires appreciation of the complex ways in which concepts are structured and organized and of how this organization can affect belief revision. Following a brief summary of the psychological functions of concepts and a discussion of some recent accounts of what concepts are, I propose a view of concepts as complex computational structures. This account suggests that conceptual change can come in varying degrees, with the most extreme consisting of fundamental conceptual reorganizations. These degrees of conceptual change are illustrated by the development of the concept of an acid.I am grateful to Michael Ranney and Gilbert Harman for comments on an earlier version of this paper.     

Converging operations on a basic level in event taxonomies

Research on object concepts has identified one level of abstraction as "basic" in cognition and communication. We investigated whether concepts for routine social events have a basic level by replicating the converging operations used to investigate object concepts. In Experiment 1, subjects were presented with event names from a taxonomy and were asked to list the actions comprising the event. Many more actions were listed at the middle than at the highest taxonomic level, without a further increase at the most specific level, paralleling the pattern of superordinate-, basic-, and subordinate-level object concepts. From these action lists, brief stories were composed for each event. In Experiment 2, subjects made pairwise similarity judgments on the stories. The mean similarity of events increased with specificity, as expected. But differentiation of categories (within-category similarity compared to between-category similarity) was highest for super-ordinates, contrary to results with object categories. In Experiment 3, subjects were fastest in recognizing actions as belonging to events named at the basic level. In Experiment 4, subjects predominantly chose basic-level terms to name stories. We conclude that event taxonomies do show basic-level structure, albeit a less sharply defined and less stable structure than in object taxonomies. The benefits and hazards of extending models of object concepts to other entities, such as social events, are discussed.     

Why Boys will be boys and girls will be girls: Understanding colloquial tautologies

What do tautological phrases such asBoys will be boys, A promise is a promise, or War is war mean and how are they understood? These phrases literally appear to be uninformative, yet speakers frequently use such expressions in conversation and listeners have little difficulty comprehending them. Understanding nominal tautologies requires that listeners/readers infer the speaker's attitude toward the noun phrase (e.g.,boys) mentioned in the sentence. The purpose of the present studies was to investigate the role of context, syntactic form, and lexical content in the interpretation of nominal tuatologies. Two studies are reported in which subjects rated the acceptability of different tautological constructions either alone (Experiment 1) or with supporting contextual information (Experiment 2). The results of these studies provide evidence that colloquial tautologies can be interpreted differently in different contexts, but that there are important regularities in the syntactic form and lexical content of these phrases which influence how they are understood. Our findings highlight the importance of speakers/listeners' stereotypical understanding of people, activities, and concrete objects in the use and understanding of different tautological expressions. The implications of this research for psycholinguistic theories of conversational inference and indirect language use are discussed.     

An on-line assessment of causal reasoning during comprehension

Fletcher and Bloom (1988) have argued that as readers read narratives, clause by clause, they repeatedly focus their attention on the last preceding clause that contains antecedents but no consequences in the text. This strategy allows them to discover a causal path linking the text's opening to its final outcome while minimizing the number of times long-term memory must be searched for missing antecedents or consequences. In order to test this hypothesis, we examined the reading times of 25 subjects for each clause of eight simple narrative texts. The results show that: (1) causal links between clauses that co-occur in short-term memory (as predicted by the strategy) increase the time required to read the second clause; (2) potential causal links between clauses that never co-occur in short-term memory (again as predicted by the strategy) have no effect on reading time; and (3) reinstatement searches are initiated at the end of sentences that are causally unrelated to the contents of short-term memory or that contain clauses that satisfy goals no longer in short-term memory. These results support the claim that subjects engage in a form of causal reasoning when they read simple narrative texts.     

Bilingual language processing after a lesion in the left thalamic and temporal regions. A case report with early childhood onset.

This case study concerns an 18-year-old bilingual girl who suffered a radiation lesion in the left (dominant) thalamic and temporal region when she was 4 years old. Language and memory assessment revealed deficits in auditory short-term memory, auditory word comprehension, nonword repetition, syntactic processing, word fluency, and confrontation naming tasks. Both languages (English and Dutch) were found to be affected in a similar manner, despite the fact that one language (English) was acquired before and the other (Dutch) after the period of lesion onset. Most of the deficits appear to be related to verbal (short-term) memory dysfunction. Several hypotheses of subcortical involvement in memory processes are discussed with reference to existing theories in this area.