Reliability of multiple classifications

Cohen's kappa index is reformulated for multiple classifications based on exchangeable random variables. It is found that kappa is between 0 and 1 inclusive. Two characterizations for kappa are stated in terms of the relationship between such random variables. Within the normal test score model, kappa increases with test reliability and test length. Furthermore, when based on binary classifications, kappa is an inverse U-shaped function of the cutoff score. These trends also hold for the beta-binomial test score model.Paper read at the Spring meeting of the Psychometric Society, Bell Laboratories (Murray Hill, New Jersey), March 1976.The editorial assistance and helpful comments of Leonard S. Feldt, Sarah P. Seaman-Huynh, and the three referees are gratefully acknowledged.     

APPLICATION OF A SOCIAL SKILLS TRAINING PROGRAM IN THE MODIFICATION OF INTERPERSONAL DEFICITS AMONG RETARDED ADULTS: A CLINICAL REPLICATION

Six mentally retarded adults, equally divided into two treatment groups, were provided with individualized social skills training programs. Treatment, evaluated via a multiple-baseline design strategy, was sequentially and cumulatively applied across target behaviors over a four-week intervention period. Behavioral observation probes and social validation measures served as the primary dependent variables. Results indicated that (a) treatment was effective for virtually all behaviors across all subjects, (b) improvements occurred for both training and generalization scenes, and (c) behavioral performance was maintained one month following the termination of treatment.     

THE EFFECTIVENESS OF INTERPERSONAL SKILLS TRAINING ON THE SOCIAL SKILL ACQUISITION OF MODERATELY AND MILDLY RETARDED ADULTS

Sixteen moderately and mildly retarded adults were selected from a group residential facility and randomly assigned to experimental and control groups. The experimental group received a 12-session interpersonal skills training program consisting of instruction in the following areas: (1) Introductions and Small Talk, (2) Asking for Help, (3) Differing with Others, and (4) Handling Criticism. The social skills instructional package included verbal instruction, modeling, role playing, feedback, contingent incentives, and homework. As a result of this training program, moderately and mildly retarded adults acquired new social skills as evidenced by performance on a situation role play assessment. These gains generalized to untrained role play situations but did not result in significant group differences when assessed in a more natural setting (i.e., local grocery store).     

ACCEPTABILITY OF ALTERNATIVE TREATMENTS FOR DEVIANT CHILD BEHAVIOR

The acceptability of alternative treatments for deviant child behavior was evaluated in two experiments. In each experiment, clinical cases were described to undergraduate students along with four different treatments in a Replicated Latin Square Design. The treatments included reinforcement of incompatible behavior, time out from reinforcement, drug therapy, and electric shock and the treatments were described as they were applied to children with problem behaviors. Experiment 1 developed an assessment device to evaluate treatment acceptability and examined whether treatments were rated as differentially acceptable. Experiment 2 replicated the first experiment and examined whether the severity of the presenting clinical problem influenced ratings of acceptability. The results indicated that treatments were sharply distinguished in overall acceptability. Reinforcement of incompatible behavior was more acceptable than other treatments which followed, in order, time out from reinforcement, drug therapy, and electric shock. Case severity influenced acceptability of alternative treatments with all treatments being rated as more acceptable with more severe cases. However, the strength of case severity was relatively small in relation to the different treatment conditions themselves which accounted for large portions of variance.     

Effects of stress and retesting on role play tests of social skill

The purpose of this study was to examine the role of stress in performance on role play tests of social skill. Chronic psychiatric patients were tested in a formal videotape studio or in an informal consulting room setting. Motoric and physiological measures were secured. In addition, one-half of the subjects were retested one week later. In contrast to previous studies, results indicated that the assessment was not stressful. The two groups were not different on any measure, and the mean heart rates ranged from only 80 to 84 b.p.m. The effects of retesting were difficult to interpret. There were reductions in motoric indices of anxiety (speech disruptions) but not on physiological indices. Overall, testretest reliability was quite high. The results raise several questions which affect interpretation of many social skills studies in the literature.     

On the discriminability of stimulus duration.

The performance of pigeons trained to detect differences in the duration of stimuli was analysed using a matching model of signal detection. Two white stimuli, S1 and S2, differing in duration, were arranged with equal probability on the center key of a three-key chamber. S1 was systematically varied from 5 seconds to 25 seconds while S2 remained constant at 30 seconds. On completion of the center-key stimulus, a peck on the center key turned on the two red side keys. A left-key response was "correct" when S1 had been in effect on the center key and a right-key response was "correct" on S2 trials. A correct response produced a 3-second magazine light accompanied intermittently by food. Incorrect responses produced 3-second blackouts. Detection performance was measured under two procedures. In the first, the obtained reinforcement ratio was uncontrolled by allowing the number of food reinforcements obtained for correct left- and right-key responses to vary as the stimuli were changed. In the second procedure, the presentation of food reinforcement was controlled by holding the obtained reinforcement ratio constant. Discriminability changed as a function of stimulus differences under both procedures. No such trend was found in response bias.     

Naturalistic observations of pathological behavior in hospitalized psychiatric patients

Naturalistic observations were conducted on 19 acutely ill psychiatric patients in the hospital ward milieu. The study was designed to determine relationships between selected social and environment variables and overt atypical behavior. Patients were observed on an individual basis with time-sampling techniques. In total, 16 pathological behaviors were coded and the most frequent (postural deviance, pace, agitation, hyperactivity, withdrawal, foot shake/body sway, leg swing) were selected in order to determine variation in frequency of these behaviors as a function of the following variables: area within hospital, week of hospitalization, distance between the focal subject and his/her nearest neighbor, number of people in an area, and time of day. Results showed differential changes in pathological behavior as a function of week of hospitalization, number of people in a given area, and distance from the focal subject's nearest neighbor. There was no significant change in the frequency of pathological behaviors as a function of area within hospital or time of day. In addition, most pathological behaviors decreased significantly when patients were engaged in the sending or receiving of verbal behavior. Cluster analyses revealed varying degrees of dissociation between pathological behaviors and social-interaction behaviors. These results support (a) a nonunitary concept of the general category pathological and (b) the view that there are inhibitory effects of social interaction on the enactment of atypical behaviors. Clinical implications of these findings are discussed.R.H.P. completed this research during his tenure as a postdoctocal fellow in the Department of Psychiatry, Human Ethology Laboratory, UCLA (NIMH Fellowship 1 F32MHO7627-01). Support for this research also came from the Veterans Administration.     

The effects of modifying consummatory behavior on the topography of the autoshaped pecking response in pigeons

The autoshaped responses of two debeaked pigeons that had developed modified eating behavior were compared to the autoshaped responses of three control subjects that ate grain normally. The control subjects exhibited keylight responding that was judged normal by two independent raters. The debeaked subjects pecked the key and ate grain with both normal and modified responses. The results of this study demostrate that an autoshaping procedure using grain as an appetitive stimulus may be used to establish a response that is not biologically preorganized.     

EFFECTS OF CONTEXTUAL COMPETENCE ON SOCIAL INITIATIONS

The frequency of social initiations and satisfaction with interactions in three dyads, each consisting of 1 student with disabilities and 1 nondisabled peer, were assessed under two alternating conditions: Condition 1 assessed the interactions around a set of four trained computer games, and Condition 2 assessed interactions when students were playing a set of four untrained computer games. Training was conducted with a multiple baseline design across participants and was followed by social interaction probes using an alternating treatments design. The results indicated greater frequencies of social initiations by 5 of 6 participants, higher degrees of game satisfaction by all participants, and equal or higher degrees of peer satisfaction by 5 of 6 participants when playing trained games in comparison to untrained games.