Back to basics: Percentage agreement measures are adequate, but there are easier ways

Percentage agreement measures of interobserver agreement or "reliability" have traditionally been used to summarize observer agreement from studies using interval recording, time-sampling, and trial-scoring data collection procedures. Recent articles disagree on whether to continue using these percentage agreement measures, and on which ones to use, and what to do about chance agreements if their use is continued. Much of the disagreement derives from the need to be reasonably certain we do not accept as evidence of true interobserver agreement those agreement levels which are substantially probable as a result of chance observer agreement. The various percentage agreement measures are shown to be adequate to this task, but easier ways are discussed. Tables are given to permit checking to see if obtained disagreements are unlikely due to chance. Particularly important is the discovery of a simple rule that, when met, makes the tables unnecessary. If reliability checks using 50 or more observation occasions produce 10% or fewer disagreements, for behavior rates from 10% through 90%, the agreement achieved is quite improbably the result of chance agreement.     

The dispositional shift in attribution over time

Two experiments examined the effect of time on causal attributions. In Experiment I, subjects who described themselves into a tape recorder assumed more personal responsibility for their behavior after 3 weeks' time than others who explained their behavior immediately after its occurrence. In Experiment II, actor-subjects took part in a getting acquainted conversation and explained their behavior more dispositionally and less situationally after 3 weeks' time than they had initially, while observer-subjects experienced no change over time. Results were interpreted in terms of an altered self-perspective in memory and the diminished salience of situational details over time.     

Children at risk for delinquency: A follow-up comparison of aggressive children and children who steal

This study compared the follow-up incidence of court-recorded nonstatus offenses for three groups of adolescent children. These children had been seen 2 to 9 years earlier for problems with aggression in the home (N = 21), for stealing problems (N = 25), or for normative comparisons (N = 14). The results showed that 77% of the children with stealing problems had court-recorded offenses. This was significantly higher than the aggressive children, whose rate did not differ from the normative sample. These findings suggested that young aggressive children were not at risk for adolescent court contact. Instead, it was the young child with identified stealing problems who was highly likely to become an official delinquent. It also appeared that parental reports of stealing events constituted a predictive measure of later criminal acts.     

Apparatus for collecting voice chronography data

The conversion of speech into on-off pulse patteras representing talk spurts and pauses is a major tool used by psychologists in analyzing interactive communications behavior. We describe a conversion method and a means for interfacing its output with a computer, which allows the collection of large amounts of speech data from one or more sources. The major improvement over prior art is the ability to reject cross talk between neighbor speakers while permitting the detection of simultaneous speech. In the evaluation of the performance of the apparatus, no errors were detected for single-party speaking. Infrequent small errors occurred in the detection and duration of talk spurts and pauses during two- and three-party speaking, but these would probably be acceptable in most applications.     

Tune recognition with reduced pitch and interval information

Twenty subjects were tested on their ability to recognize simple tunes from which rhythm information had been removed. Only the first phrase of each tune was presented. The purpose of the experiment was (a) to determine whether stimuli containing only high harmonics can evoke a sense of musical pitch, and (b) to provide a set of data in normal subjects with which the performance of deaf subjects whose auditory nerve is stimulated electrically can be compared. Each subject was tested on five sets of stimuli presented in a counterbalanced order. These stimuli were (I) pulse trains high-pass filtered at 2 kHz, with repetition rates in the range of 100-200 p.p.s.; (2) as in (I) but high-pass filtered at 4 kHz; (3) sinusoids with musical intervals compressed, so that the “octave” was a ratio of I:I·3; (4) sinusoids with the musical intervals expanded, so that the “octave” was a ratio of I:4; (5) sinusoids of a constant frequency in which the normal frequency changes were translated into intensity changes, each semitone being represented by a 3 dB change in level. The results indicate that a pattern of intensity changes does not support tune recognition, and that, although the pitch contour alone allows reasonable performance, subjects do use musical interval information in recognizing tunes. Stimuli containing only high harmonics can provide such interval information, and thus can evoke a sense of musical pitch. Preliminary results from a deaf subject stimulated electrically with an electrode on the surface of the cochlea indicate that such stimulation can also evoke a sense of musical pitch. It is concluded that musical pitch information can be carried in the time-pattern of nerve impulses in the auditory nerve.     

Reflection-impulsivity in normal and behavior-disordered children

The primary index of reflection- impulsivity is Kagan's Matching Familiar Figures Test (MFF), which yields both a latency and an error score. To evaluate further the construct validity of these measures, both the latency and error scores of 9- and 15-year-old normal and acting-out behavior-disordered children were compared. Young behavior-disordered children were found to be more impulsive than the other groups on the MFF error measure. No differences occurred on the MFF latency measure. This result is consistent with previous findings with normal children in supporting the construct validity of the MFF error score and raising questions about the construct validity of the MFF latency score. Findings were inconsistent with Kagan's assertion that normal children become more reflective with age. The older behavior-disordered children were more reflective on the error measure than the younger behavior-disordered children and had equivalent error scores to both age groups of normals. This finding suggested a lag in the development of reflection in behavior-disordered children.The authors wish to thank Dr. Kenneth C. Molkner for his valuable assistance in obtaining subjects and for his kind support.     

Startbox-goalbox confinement durations as determinants of self-punitive behavior

Two levels of confinement duration (5 or 60 sec) in either startbox or goalbox were factorially combined with presence or absence of shock during extinction of a runway escape response in a self-punitive paradigm under a spaced-trials procedure. All groups were equated for amount and temporal spacing of handling before and after each trial. Shocked rats were more resistant to extinction than nonshocked rats only when startbox confinement was short. When startbox confinement was long, shock facilitated extinction. Long goalbox confinement enhanced running speed for shocked rats, but only in the presence of shock. It was suggested that duration of startbox confinement affects strength of conditioned fear, with long confinement leading to its extinction.     

Wilhelm Dilthey: Forerunner of humanist social thought

Humanist social thought is as a meadow in the forest of positivist science. Much of this space was cleared by Wilhelm Dilthey, not only through his attack on the fundamental assumptions of positivism, but also through his formulation of a critical method by which the works of free human consciousness could be understood. The first tenet of positivism is that the world is made up of ‘out there’ objectively knowable ‘facts’. Dilthey undercut this notion by asserting that the subject matter of the human studies was not mere facts of nature, but rather objectified expressions of the human mind. The second central assumption of positivism is that these facts are explainable or determined by general causal laws. In contrast, Dilthey asserted that, while we can explain the natural world, human action must be understood through an interpretive rather than a causal logic. In demonstrating and specifically describing such an interpretive procedure, Dilthey provided an epistemological and methodological grounding fur a humanistic science of the person and of the social world. His ideas illuminate the works even of his critics and his influence, though largely unacknowledged, continues to be widespread in all the human studies.