Ordinal consistency and ordinal true scores

This paper argues that test data are ordinal, that latent trait scores are only determined ordinally, and that test data are used largely for ordinal purposes. Therefore it is desirable to develop a test theory based only on ordinal assumptions. A set of ordinal assumptions is presented, including an ordinal version of local independence. From these assumptions it is first shown that the gamma-correlation between two tests is the product of their gamma-correlations with the true latent order. The theory is generalized to allow for heterogeneous tests by defining a weighted average local independence. The tau-correlations between total score and the latent order can be found in both homogeneous and heterogeneous cases, and a system of differential item weighting to maximize the tau-correlation between weighted items and the latent order is provided. Thus a purely ordinal test theory seems possible.Part of this work was done while the author was a Visiting Fellow at Macquarrie University. The paper has benefitted from discussions with Professors Thomas J. Reynolds and Roderick P. McDonald and from the comments of several anonymous reviewers.     

Recall by expert medical practitioners and novices as a record of processing attention

Using recall of clinical protocols as a measure of expertise in medicine has yielded disappointingly small effects. Experiments using recall of clinical laboratory data are presented to provide an explanation. In one experiment, subjects either deliberately memorized or first diagnosed and then were incidentally asked for memory. With incidental instructions, experts recalled over twice as much data as did students, but with memorization instructions, student performance approximated that of experts. Experts also showed a large advantage over students in incidental recall of data that were not relevant to the problem solution. These results suggest that expert processing in this "discrete, independent inputs" domain requires effortful analysis with minimal reliance on default values, rather than relatively effortless pattern perception reported in highly visual areas of expertise. For this area, intentional memory is a misleading measure of expertise. However, incidental memory is a valuable measure of processing during diagnosis.     

Molecular maximizing characterizes choice on Vaughan's (1981) procedure

Pigeons keypecked on a two-key procedure in which their choice ratios during one time period determined the reinforcement rates assigned to each key during the next period (Vaughan, 1981). During each of four phases, which differed in the reinforcement rates they provided for different choice ratios, the duration of these periods was four minutes, duplicating one condition from Vaughan's study. During the other four phases, these periods lasted six seconds. When these periods were long, the results were similar to Vaughan's and appeared compatible with melioration theory. But when these periods were short, the data were consistent with molecular maximizing (see Silberberg & Ziriax, 1982) and were incompatible with melioration, molar maximizing, and matching. In a simulation, stat birds following a molecular-maximizing algorithm responded on the short- and long-period conditions of this experiment. When the time periods lasted four minutes, the results were similar to Vaughan's and to the results of the four-minute conditions of this study; when the time periods lasted six seconds, the choice data were similar to the data from real subjects for the six-second conditions. Thus, a molecular-maximizing response rule generated choice data comparable to those from the short- and long-period conditions of this experiment. These data show that, among extant accounts, choice on the Vaughan procedure is most compatible with molecular maximizing.     

Cross-task validation of functional measurement

Ss judged average heaviness of two unseen lifted weights on a 20-step rating scale. They also rated heaviness of a single visible object of variable size and weight. The data for each task obeyed the parallelism prediction of the linear integration model. This within-task consistency validates jointly the model and the response scale. Functional measurement procedure yielded independent scales of subjective heaviness from each task. These were linearly related, a criterion of external consistency. The plot of subjective heaviness against objective weight was slightly negatively accelerated. These results disagree with those that have been obtained with magnitude estimation. Since the rating data satisfy both internal and external consistency, they constitute the true measure of sensation. Magnitude estimation, in contrast, must be biased and invalid.     

COMMONALITY OF WORD LISTING,PREDICTABILITY, ORIGINALITY AND CHUNKING

Les AA. analysent les données de deux épreuves verbales (liste de mots, créativité) auxquelles ont été soumis des adolescents hindous (N = 144) et américains (N = 96). Ils constatent que : (1) les sujets hindous montrent plus de variabilité dans la tendance à donner des mots identiques (commonality) dans une liste et se caractérisent par un nombre plus élevé de “ groupes ” de mots, liés entre eux dans une même chaîne de pensée; (2) les filies donnent plus de mots identiques que les garçons, mais seulement dans le groupe américain; (3) il existe une relation faible, mais de sens contraire, entre la prédictibilité et le groupement des mots dans les deux groupes linguistiques. La discussion est centrée sur la pertinence des ressemblances plutôt que des différences en matière de comparaisons interculturelles; les similitudes verbales pourraient refléter chez les sujets américains L'orientation vers le groupe des pairs et il est possible de donner d'autres explications à L'absence de Jiaison entre les similitudes verbales, la prédictibilité, I'originalité et la tendance à répondre par groupes de mots.