Considerations in the choice of interobserver reliability estimates

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.     

Semantic and surface codes in the memory of deaf children

In three experiments, deaf children in the age range of 6 years, 10 months to 15 years, 5 months were presented with continuous lists of items, and for each item they had to indicate whether it had appeared before on the list. Later items were related to preceding items either in surface form or in meaning or were unrelated. False-recognition errors (i.e., “yes” responses to new items) served as an index of memorial coding. In one experiment, the items presented to the subjects were printed words. The results of this experiment showed a false-recognition effect (i.e., more errors to related words than to unrelated words) for both semantically related words and orthographically similar words. In the other two experiments, the subjects viewed a series of manual signs on videotape. In these experiments, there was a false-recognition effect for signs related semantically and for signs related cherologically (i.e., similar in terms of their manual production). These results establish orthography and cherology as effective memorial codes for deaf children. The finding of a consistently strong semantic effect for young deaf children stands in contrast to findings of weak semantic effects in false-recognition studies with young hearing children. The ascendancy of semantic codes for deaf children was attributed to the absence of competition from the speech code which dominates the linguistic memory of hearing children.