A critical review of theS/L reliability index

The meaning and properties of a commonly used index of reliability, S/L,were examined critically. It was found that the index does not reflect any conventional concept of reliability. When used for an identical behavioral observation session, it is not statistically correlated with other reliability indices. Within an observation session, the standardizing measure of Lis beyond the control of the investigator. Furthermore, the reason for the choice of Las the standard is unclear. The role of chance agreement in S/Lis not known. The exact interpretation of the index depends on which observer reports L.Overall the conceptual and mathematical meaning of S/Lis dubious. It is suggested that the S/Lindex should not be used until its nature is shown to be a measure of reliability. Other approaches such as the intraclass correlations and generalizability coefficients should be used instead.The authors are indebted to Johnny Matson for his critique of an earlier version of this paper.     

AN INDEX FOR ASSESSING WEIGHT CHANGE IN CHILDREN: WEIGHT/HEIGHT RATIOS1

Weight and height data from two studies were recomputed, and original data were computed using a Weight Index formula that accounts for the interaction of actual weight/height changes in growing children and compares this ratio with that of normed weight/height ratios for equal-aged children. Recomputing the data of one study showed that the Weight Index is a more sensitive procedure for assessing long-term behavioral treatment of obesity for girls than weight alone. Recomputing the data of a second study showed that the Weight Index formula is consistent for boys and girls and is a more sensitive procedure for assessing long-term effects of a variety of medical treatments for obesity than the Ponderal Index or weight alone. Computation of the data for 17 “normal” children in a preschool class showed a zero Weight Index score before and after a six-month interval elapsed without treatment. The procedure may be useful in assessing ponderosity or anorexia over intervals of six months or more with growing children or difference between actual and normed weight over shorter intervals.     

Stability criteria

Three approaches to the determination of behavioral stability were examined. In the first, a learning curve was fit to acquisition data (from Cumming and Schoenfeld, 1960), and the “experiment” stopped when the data approached sufficiently close to the theoretical asymptote. In the second, the data were analyzed for variability and linear and quadratic trend. In the third, the experiment was stopped when the magnitude of the daily changes in the data fell below a criterion. Accuracy was measured as deviation between the average value of the dependent variable when the experiment was stopped, and the average value over the last 100 sessions. The first approach was most accurate, but at the cost of requiring the most sessions and being the most difficult to apply. Both the second and third approaches provided acceptable criteria with a reasonable cost-accuracy tradeoff. The second approach permits a continuous adjustment of the criteria to accommodate the variability intrinsic in the experimental paradigm. The third, nomothetic, approach also takes into account the decreasing marginal utility of extended training sessions.     

Reliability of multiple classifications

Cohen's kappa index is reformulated for multiple classifications based on exchangeable random variables. It is found that kappa is between 0 and 1 inclusive. Two characterizations for kappa are stated in terms of the relationship between such random variables. Within the normal test score model, kappa increases with test reliability and test length. Furthermore, when based on binary classifications, kappa is an inverse U-shaped function of the cutoff score. These trends also hold for the beta-binomial test score model.Paper read at the Spring meeting of the Psychometric Society, Bell Laboratories (Murray Hill, New Jersey), March 1976.The editorial assistance and helpful comments of Leonard S. Feldt, Sarah P. Seaman-Huynh, and the three referees are gratefully acknowledged.     

Quantifiers and question answering in young children

Two hypotheses were tested about how young children answer questions with the quantifiers all and some: (a) that children use syntactic cues in determining which noun phrase is quantified, and (b) that children evaluate a some-statement as part of evaluating an all-statement. To test these hypotheses, the same group of 60 4- to 7-year-olds were asked four contrasting types of quantitative questions. The results indicated that children can use syntactic cues under some presentation conditions. However, there was no evidence for an asymmetry between the all-and some-questions. A model of how young children might answer quantitative questions was then considered.     

Central deafness and subcortical motor aphasia

Clinical and autopsy studies were made on a right-handed man who had central deafness and subcortical motor aphasia, and the literature on central deafness and on subcortical motor aphasia was analyzed. Central deafness is due to bilateral destruction of the primary auditory cortex. It is sometimes difficult to distinguish from word deafness and from auditory agnosia, which are due to pathology in other parts of the temporal lobes. There is almost always some preserved hearing in central deafness, possibly from some auditory pathway other than the classical pathway. In this patient the subcortical motor aphasia was due to bilateral destruction of the motor cortex for the mouth and throat. In some other cases subcortical motor aphasia was due to the same pathology that usually causes Broca's aphasia; in these cases the unexpected preservation of writing was perhaps related to some difference in how language functions were organized in the brain.     

Central auditory processing : III. The “cocktail party” effect and anterior temporal lobectomy

The capacity to selectively attend to only one of multiple, spatially separated, simultaneous sound sources—the “cocktail party” effect—was evaluated in normal subjects and in those with anterior temporal lobectomy using common environmental sounds. A significant deficit in this capacity was observed for those stimuli located on the side of space contralateral to the lobectomy, a finding consistent with the hypothesis that within each anterior temporal lobe is a mechanism that is normally capable of enhancing the perceptual salience of one acoustic stimulus on the opposite side of space, when other sound sources are present on that side. Damage to this mechanism also appears to be associated with a deficit of spatial localization for sounds contralateral to the lesion.