Reliability of multiple classifications

Cohen's kappa index is reformulated for multiple classifications based on exchangeable random variables. It is found that kappa is between 0 and 1 inclusive. Two characterizations for kappa are stated in terms of the relationship between such random variables. Within the normal test score model, kappa increases with test reliability and test length. Furthermore, when based on binary classifications, kappa is an inverse U-shaped function of the cutoff score. These trends also hold for the beta-binomial test score model.Paper read at the Spring meeting of the Psychometric Society, Bell Laboratories (Murray Hill, New Jersey), March 1976.The editorial assistance and helpful comments of Leonard S. Feldt, Sarah P. Seaman-Huynh, and the three referees are gratefully acknowledged.     

On knowing how well one is remembering: The persistence of strategy use during transfer

A potential cause for children's failure to transfer learning strategies was explored in the present study. A self-monitoring process was suggested to be essential for evaluating one's own level of performance and the effectiveness of various mnemonic strategies. Matched on free recall scores in this study's first sort-and-recall phase, first, third, and fifth graders (ages 7, 9, and 11 years, respectively) were assigned to one of three treatment groups or a control group. During Phase II, the treatment groups received instruction in sorting pictures according to semantic similarities in preparation for future recall. In addition, Groups 3 and 4 later received feedback indicating their Phase II improvement in performance. A cause-and-effect relationship between strategy use and enhanced recall was further suggested to Group 4. Among third graders, only those provided with feedback and strategy instruction continued to rely upon the input organization strategy when faced with transfer tasks in Phase III. Both enhanced recall and improved sorting styles were observed for these subjects in Phase III. Some first graders also showed improved sorting styles and improved recall following feedback, while fifth graders showed enhanced recall even without experimenter-provided feedback. Subject's responses to a metamemory interview provided additional support for the hypothesis that the self-monitoring of memory performance is more likely to be part of fifth graders' (than first graders') memory abilities.     

On the discriminability of stimulus duration.

The performance of pigeons trained to detect differences in the duration of stimuli was analysed using a matching model of signal detection. Two white stimuli, S1 and S2, differing in duration, were arranged with equal probability on the center key of a three-key chamber. S1 was systematically varied from 5 seconds to 25 seconds while S2 remained constant at 30 seconds. On completion of the center-key stimulus, a peck on the center key turned on the two red side keys. A left-key response was "correct" when S1 had been in effect on the center key and a right-key response was "correct" on S2 trials. A correct response produced a 3-second magazine light accompanied intermittently by food. Incorrect responses produced 3-second blackouts. Detection performance was measured under two procedures. In the first, the obtained reinforcement ratio was uncontrolled by allowing the number of food reinforcements obtained for correct left- and right-key responses to vary as the stimuli were changed. In the second procedure, the presentation of food reinforcement was controlled by holding the obtained reinforcement ratio constant. Discriminability changed as a function of stimulus differences under both procedures. No such trend was found in response bias.     

Developmental auditory agnosia in the severely retarded: A further investigation

The hypotheses were investigated that (a) ability to recognize the auditory perceptual stimuli for familiar events is a developmental correlate to language acquisition and (b) the low functioning mentally handicapped suffer from auditory agnosia and are impaired in this ability. The subjects were 42 nonretarded children of ages 3 through 6 and 53 severely and moderately retarded, noninstitutionalized students. The retarded subjects were matched by mental age to the chronological age of the nonretarded children. The stimuli were 49 environmental sounds; the task consisted of sound-and-picture matching-to-sample. Group membership and developmental age were the factors in an analysis of variance design. The results revealed a strong effect of developmental age (p <. 0001). The effect of group was not significant, indicating that auditory agnosia may not be common among the lower functioning retarded. The assumption that agnosia may be a major factor underlying the language disability of the severely retarded was reexamined. It was suggested that the severely retarded achieve the requisite perceptual-semantic knowledge base for language too late, after the critical age for spontaneous and efficient language learning has passed.     

The effects of modifying consummatory behavior on the topography of the autoshaped pecking response in pigeons

The autoshaped responses of two debeaked pigeons that had developed modified eating behavior were compared to the autoshaped responses of three control subjects that ate grain normally. The control subjects exhibited keylight responding that was judged normal by two independent raters. The debeaked subjects pecked the key and ate grain with both normal and modified responses. The results of this study demostrate that an autoshaping procedure using grain as an appetitive stimulus may be used to establish a response that is not biologically preorganized.     

The interaction between stimulus and reinforcer control on remembering.

In a symbolic matching-to-sample task, 6 pigeons obtained food by pecking a red side key when the brighter of two white lights had been presented on the center key and by pecking a green side key when the dimmer of two white lights had been presented on the center key. Across Part 1 and Parts 6 to 10, the delay between sample-stimulus presentation and the availability of the choice keys was varied between 0 s and 25 s. Across Parts 1 to 5, the delay between the emission of a correct choice and the delivery of a reinforcer was varied between 0 s and 30 s. Although increasing both types of delay decreased stimulus discriminability, lengthening the stimulus-choice delay produced a greater decrement in choice accuracy than did lengthening the choice-reinforcer delay. Additionally, the relative reinforcer rate for correct choice was varied across both types of delay. The sensitivity of behavior to the distribution of reinforcers decreased as discriminability decreased under both procedures. These data are consistent with the view, based on the generalized matching law, that sample stimuli and reinforcers interact in their control over remembering.     

Essential independence and likelihood-based ability estimation for polytomous items

A definition ofessential independence is proposed for sequences of polytomous items. For items satisfying the reasonable assumption that the expected amount of credit awarded increases with examinee ability, we develop a theory ofessential unidimensionality which closely parallels that of Stout. Essentially unidimensional item sequences can be shown to have a unique (up to change-of-scale) dominant underlying trait, which can be consistently estimated by a monotone transformation of the sum of the item scores. In more general polytomous-response latent trait models (with or without ordered responses), anM-estimator based upon maximum likelihood may be shown to be consistent for under essentially unidimensional violations of local independence and a variety of monotonicity/identifiability conditions. A rigorous proof of this fact is given, and the standard error of the estimator is explored. These results suggest that ability estimation methods that rely on the summation form of the log likelihood under local independence should generally be robust under essential independence, but standard errors may vary greatly from what is usually expected, depending on the degree of departure from local independence. An index of departure from local independence is also proposed.This work was supported in part by Office of Naval Research Grant N00014-87-K-0277 and National Science Foundation Grant NSF-DMS-88-02556. The author is grateful to William F. Stout for many helpful comments, and to an anonymous reviewer for raising the questions addressed in section 2. A preliminary version of section 6 appeared in the author's Ph.D. thesis.     

Humanizing education: Subjective and objective aspects

I propose that there are four standards to be met if a given educational enterprise is to be considered humane: (1) the practice to be mastered must be socially justified; (2) the disciplines pursued to master the practice must be appropriate to the practice; (3) the practice must be owned by the learner; and (4) this ownership must itself meet certain ethical requirements. The paper emphasizes the problem of ownership. It argues for a view of ownership that is communitarian. This view sees ownership as a function of identification or membership. People become committed to certain educational ends in virtue of the fact that they see themselves as members of a group and the ends as the ends of the group. It is central to this view that ownership of ends does not require full understanding or rational appraisal of such ends. I argue that a rational appraisal of ends is difficult when a novice seeks to appraise the ends of some practice both because the ends of the practice are internal to it in a way that makes grasping such ends difficult prior to mastery of the practice and because initiation into the practice will change the individual's standards of appraisal.     

What is educational theory and how to make it?

An analysis is provided detailing the conditions for the appropriate theoretical study of the object of educational science: pedagogy.     

HOW DID MORALITY EVOLVE?

Abstract. This paper presents and criticizes. Alexander's evolutionary theory of morality (1987). Earlier research, on which Alexander's theory is based, is also reviewed. The propensity to create moral systems evolved because it allowed ancestral humans to limit conflict within cooperating groups and thus form larger groups, which were advantageous because of intense between-group competition. Alexander sees moral codes as contractual, and the primary criticism of his theory is that moral codes are not completely contractual but also coercive. Ways of evaluating Alexander's theory as well as modified versions of it are discussed.