A critical review of theS/L reliability index

The meaning and properties of a commonly used index of reliability, S/L,were examined critically. It was found that the index does not reflect any conventional concept of reliability. When used for an identical behavioral observation session, it is not statistically correlated with other reliability indices. Within an observation session, the standardizing measure of Lis beyond the control of the investigator. Furthermore, the reason for the choice of Las the standard is unclear. The role of chance agreement in S/Lis not known. The exact interpretation of the index depends on which observer reports L.Overall the conceptual and mathematical meaning of S/Lis dubious. It is suggested that the S/Lindex should not be used until its nature is shown to be a measure of reliability. Other approaches such as the intraclass correlations and generalizability coefficients should be used instead.The authors are indebted to Johnny Matson for his critique of an earlier version of this paper.     

AN INDEX FOR ASSESSING WEIGHT CHANGE IN CHILDREN: WEIGHT/HEIGHT RATIOS1

Weight and height data from two studies were recomputed, and original data were computed using a Weight Index formula that accounts for the interaction of actual weight/height changes in growing children and compares this ratio with that of normed weight/height ratios for equal-aged children. Recomputing the data of one study showed that the Weight Index is a more sensitive procedure for assessing long-term behavioral treatment of obesity for girls than weight alone. Recomputing the data of a second study showed that the Weight Index formula is consistent for boys and girls and is a more sensitive procedure for assessing long-term effects of a variety of medical treatments for obesity than the Ponderal Index or weight alone. Computation of the data for 17 “normal” children in a preschool class showed a zero Weight Index score before and after a six-month interval elapsed without treatment. The procedure may be useful in assessing ponderosity or anorexia over intervals of six months or more with growing children or difference between actual and normed weight over shorter intervals.     

Effects of training students to identify the semantic base of prose materials

Feedback and feedback plus points toward a course grade were applied to the attentional behaviors (defined as the ability to identify the semantic base of text passages) of 30 undergraduate students participating in a reading comprehension development program. Correct underlining was increased, extraneous underlining was decreased, and postreading comprehension test scores improved as a result of the procedures. Scores on a standardized test of reading comprehension also increased significantly.     

Quantifiers and question answering in young children

Two hypotheses were tested about how young children answer questions with the quantifiers all and some: (a) that children use syntactic cues in determining which noun phrase is quantified, and (b) that children evaluate a some-statement as part of evaluating an all-statement. To test these hypotheses, the same group of 60 4- to 7-year-olds were asked four contrasting types of quantitative questions. The results indicated that children can use syntactic cues under some presentation conditions. However, there was no evidence for an asymmetry between the all-and some-questions. A model of how young children might answer quantitative questions was then considered.     

Central deafness and subcortical motor aphasia

Clinical and autopsy studies were made on a right-handed man who had central deafness and subcortical motor aphasia, and the literature on central deafness and on subcortical motor aphasia was analyzed. Central deafness is due to bilateral destruction of the primary auditory cortex. It is sometimes difficult to distinguish from word deafness and from auditory agnosia, which are due to pathology in other parts of the temporal lobes. There is almost always some preserved hearing in central deafness, possibly from some auditory pathway other than the classical pathway. In this patient the subcortical motor aphasia was due to bilateral destruction of the motor cortex for the mouth and throat. In some other cases subcortical motor aphasia was due to the same pathology that usually causes Broca's aphasia; in these cases the unexpected preservation of writing was perhaps related to some difference in how language functions were organized in the brain.     

Central auditory processing : III. The “cocktail party” effect and anterior temporal lobectomy

The capacity to selectively attend to only one of multiple, spatially separated, simultaneous sound sources—the “cocktail party” effect—was evaluated in normal subjects and in those with anterior temporal lobectomy using common environmental sounds. A significant deficit in this capacity was observed for those stimuli located on the side of space contralateral to the lobectomy, a finding consistent with the hypothesis that within each anterior temporal lobe is a mechanism that is normally capable of enhancing the perceptual salience of one acoustic stimulus on the opposite side of space, when other sound sources are present on that side. Damage to this mechanism also appears to be associated with a deficit of spatial localization for sounds contralateral to the lesion.     

Do medical decision analyses' largest gains grow from the smallest trees?

Some decision analysts recommend reserving their models for careful, complete study of complex problems. Others believe simple problem analyses provide the greatest gains. To clarify these issues, I tested: (1) whether simple published analyses compared to complex ones, produced results as non-intuitive; and (2) whether non-intuitiveness represented analytic gain (or equivalently, intuitive loss). Very limited data also examined (3) the gain from adding model intricacy for a given problem vs. selecting more complex problems for analysis. To assess two non-intuitiveness measures, 75 subjects (33 physicians and 42) non-physicians stated their intuitive preferences in 40 (22 published and 18 unpublished) medical dilemmas. For both physicians and non-physicians, simpler models (those with lees than 30 terminal branches in the decision tree) had about one third the non-intuitiveness of more complex ones. Three tests also supported the premise that analyses outperform intuition, therefore that on average the formers' non-intuitiveness reflects less analytic gain. In addition, for different models of the same problem, tree complexity did not correlate with gain. Thus, simpler trees may not generally gain less because they inadequately describe problems. Instead, simpler analyses may represent simpler problems, with more similar intuitive and formal solutions. If so, these findings may help us avoid some costly but unnecessary simple analyses.     

Performance of humans in concurrent avoidance/positive-reinforcement schedules

Performance maintained under concurrent schedules consisting of a variable-interval avoidance component and a variable-interval positive-reinforcement component was studied in three human subjects using points exchangeable for money as the reinforcer. The rate of responding in the avoidance component increased, and the rate of responding in the positive-reinforcement component declined, as a function of the frequency of point-losses avoided in the avoidance component. The performance of all three subjects conformed to equations proposed by Herrnstein to describe behavior in concurrent schedules. The logarithms of the ratios of the response rates in the two components, and the logarithms of the ratios of the times spent in the two components, were linearly related to the logarithms of the ratios of the frequency of loss avoidance in the avoidance component to the frequency of reinforcement in the positive-reinforcement component. When a changeover delay of 5.0 sec was imposed, the slopes of the linear functions were close to 1.0 in the case of two subjects, whereas the third subject exhibited significant undermatching. For two subjects the changeover delay was then reduced to 2.0 sec; in both cases the slopes of the linear functions were lower than under the 5.0-sec condition. One subject participated in a third phase, in which no changeover delay was imposed; there was a further reduction in the slopes of the linear functions.