Strategic and tactical limits of comparison studies

A comparison study is an experiment whose primary purpose is to compare directly (regardless of experimental design) at least two different procedures for changing behavior or two or more components of such a procedure. This paper argues that, in spite of their popularity, such studies typically lead to inappropriate inferences with poor generality based on improper evidence gathered in support of the wrong question, thus wasting the limited experimental resources. The discussion considers problems concerning the functions of comparison studies, the nature of the comparisons that are attempted, the generality of their findings, and the limited role that they can play in technological research.     

Reliability of parental reports using the Katz Adjustment Scales: before and after hospital admission for schizophrenia

We examined the interrater and test-retest reliability of the KATZ Adjustment Scale (Relative rated or R form) longitudinally in a sample of schizophrenic patients, assessing their function before hospital admission, as well as at 1 and 9 mo. after discharge. Changes in mean scores over those assessments suggested sensitivity to change while mothers and fathers both completed the measure with moderate consistency over time. Interrater reliability was moderate at best and quite poor at initial testing, when the subjects were most disturbed clinically, suggesting that the scales may be acceptable when the individual is stable but that ratings may be unreliable when there is an exacerbation in clinical state.     

Is dependence on phonological information in children's reading a product of instructional approach?

Eight-year-old British children were found to be less accurate at rejecting pseudohomophones than ordinary nonwords in a lexical decision task, but 8-year-old New Zealand children did not show this effect. A subsequent homophone decision task showed that this difference was not due to the New Zealand children being unable to distinguish pseudohomophones from other nonwords. The New Zealand children, however, were less accurate than the British children in pronouncing the pseudohomophones they had identified. It was argued that the British children tended to sound out the items before making a choice in the lexical decision task, which gave salience to phonological rather than visual information, resulting in increased errors to the pseudohomophones. It was concluded that where the British children showed this dependency on use of phonological information it was a product of the teaching approach they had experienced.     

Levels of selection and capacity limits

Subjects performed a visual target-detection task in eight experiments. We examined the effects of word relevancy (word in relevant or irrelevant location) and display load (1-4 words) on physical, semantic, and controlled processing of nontargets. Interwoven with the detection task was a test-word identification task that was used to measure priming potency of nontargets. Physical and semantic levels of processing were measured in terms of identity and semantic priming, respectively. Nontarget primes were repeated as test words in identity priming. Nontarget primes were semantic associates of test words in semantic priming. Controlled processing of nontargets was measured in terms of recognition memory on a subsequent test. All measures increased with word relevancy and decreased with display load. The priming effects remained intact even when word presentation was speeded up and controlled processing was sharply curtailed. The data indicate that all levels of processing are selective and capacity limited.     

Menstruation and crime: A critical review of the literature from the clinical criminology perspective

The authors review the literature on the relationship between menstruation and crime, focusing upon the methodological limitations of these studies in the broader context of criminological and menstruation research. Based on this review, they conclude: the present state of scientific knowledge is such that it is unknown whether there is an association between any phases of the menstrual cycle and crime; there is no evidence linking fluctuations in reproductive hormones to criminal behavior; and, this lack of scientific knowledge is so glaring that evidence regarding menstruation and crime should not be admissible in criminal trials.