THE BEHAVIOR OBSERVATION INSTRUMENT: A METHOD OF DIRECT OBSERVATION FOR PROGRAM EVALUATION1

The background and development of a multicategory direct observation system, the Behavior Observation Instrument (BOI), is described. This time-sampling procedure for recording the behavior of persons is demonstrated in several treatment settings and the results applied to issues of program evaluation. Elements that have prevented direct observation from being widely adopted, such as costs, manpower, and training requirements, are systematically analyzed. A basic psychometric analysis of the instrument is used to determine optimum frequency and duration of observation intervals as well as observer agreement. The results imply that direct observation methods, once assumed by some to belong to the special province of the single-subject design, can be used to assess the effects of programs on groups of psychiatric clients in an efficient and economic manner.     

Involuntary memory and the development of retrieval skills in young children

An incidental memory paradigm was used to study involuntary encoding processes and voluntary retrieval strategies in children's memory. Preschool (mean age: 4 years, 4 months) and kindergarten (mean age: 5 years, 10 months) children sorted pictures according to their color or category membership, and then received either a recall test (Experiment 1) or a recognition test (Experiment 2). Better retention of category- than color-sorted items was observed for kindergarten children in free recall, preschool and kindergarten children in cued recall, and neither group in recognition. These results were interpreted in terms of the retrieval strategies used by children in each of the memory tasks. The importance of distinguishing between voluntary and involuntary memory processes, and between acquisition and retrieval, in studies of depth-of-processing was emphasized. Developmental differences in performance appear to derive primarily from the role of voluntary search strategies in retrieval, rather than from age differences in involuntary encoding processes.     

NATURALISTIC OBSERVATIONS OF INSTITUTIONALIZED RETARDED PERSONS: A COMPARISON OF LICENSURE DECISIONS AND BEHAVIORAL OBSERVATIONS

In the last several years, various organizations have produced strikingly similar documents by which institutions for retarded persons are judged for licensure. The purpose of the present study was to determine whether residential units that were licensed differed from residential units that were not licensed in terms of the active programming behaviors of their staff and residents. Data were collected through a time-sampling procedure that yielded about 160,000 observations on eight staff and six resident behaviors. Results showed that the licensed units were just as derelict as unlicensed units in providing habilitative programming for their retarded residents. Maladaptive responding by residents occurred at least as much as task-related behaviors: residents spent as much time self-stimulating as they did in programming; they also engaged in self-abusive behavior about as much time as they engaged in on-task responding. Results were discussed in terms of the failure of governmental regulations that are not based on observation to adequately assess habilitative programming.     

Effects of neutral and positive stimuli on stuttering: “Calling attention to stuttering” revisited

This study investigated the effects of presumably positive and neutral response-contingent stimuli on the occurence of stuttering. Eight adult stutterers spoke spontaneously during a 60-min experimental session, which was divided into three 20-min periods. During Condition I no stimuli were delivered. During Condition II a digital counter and a pair of yellow lights were activated each time the subject stuttered. During Condition III these same response-contingent stimuli were delivered, but with the additional factor that the subject would earn 5¢ each time the counter moved forward and the lights were illuminated. Conditions II and III were counterbalanced across subjects. The experimenter was unaware of which of the two contingencies were operative during Conditions II and III. Results showed no significant changes in occurence of stuttering due to either response-contingent stimulus. A discussion of theoretical and experimental implications is given.     

Are there constraints on childhood disfluency?

Analysis of the spontaneous speech of eight stuttering and eight normally fluent children reveals that (a) the location of both stuttering and normal disfluent moments is constrained by sentential constituent structure, and (b) stuttering children experience fluency breakdown with a particular type of constituent (verb phrase) not usually disfluently produced by normals. A view of early stuttering as a sentence planning and integration disorder is present.     

Stuttering and fluency: Exclusive events or points on a continuum?

In recent years, several studies have been conducted in which the fluency of stutterers was compared with that of normal speakers. These investigations have been of two basic types, some involving objective measures of physiologic, aerodynamic, or acoustic features of the subjects' fluent speech signal, and others involving experiments performed in which listeners attempted to distinguish the fluency produced by stutterers from that generated by normal speakers. The body of literature pertaining to each of these two types of investigations is reviewed and interpreted. The interpretations offered are then developed in an effort to shed further light on both fluency and stuttering. Implications for further research, as well as for the evaluation, treatment, and post-therapy assessment of stutterers are drawn.     

Concurrent validity of the WISC-R factor scores

This study investigated the efficacy of predicting academic achievement as measured by the Wide Range Achievement Test using the factor scores of the Wechsler Intelligence Scale for Children-Revised as potential predictors. Both instruments were administered to 200 school children referred for psychological evaluations. Factor scores for the WISC-R were computed according to equations provided by Gutkin (1978). These factor scores then were regressed in a stepwise manner on the Reading, Spelling, and Arithmetic standard scores from the Wide Range Achievement Test. Stepwise regressions also were performed using the traditional Verbal and Performance IQs as the potential predictors. A comparison was made between the results obtained by use of the factors or the more common scores. The results indicated that the Freedom From Distractibility factor score significantly aided in the prediction of Reading and Spelling achievement and was of primary importance in predicting Arithmetic achievement. When the stepwise results using the different scores were contrasted, the factor scores accounted for appreaciably more variance in Arithmetic than did the traditional Verbal and Performance IQs. Derived regression equations are reported along with a discussion of the interpretability of the Freedom From Distractibility factor.     

An observational case study of failure in social problem-solving

An observationally based assessment of social problem-solving skill was contrasted with more traditional testing methods. A preschool child with low social success was chosen for a demonstration profile analysis. The relative frequencies of the social goals, strategies, and targets shown by this child during free play were plotted in relation to that of his same-sex peer group. Parallel profiles of his relative success with specific goals, strategies, and targets were also constructed and compared to relevant group means and standard deviations. Specific social problem-solving strengths and weaknesses were identified from these profiles, using both intra- and interindividual analyses. The benefits and limitations of this approach for measurement and treatment of social problem-solving deficits were discussed.     

Do medical decision analyses' largest gains grow from the smallest trees?

Some decision analysts recommend reserving their models for careful, complete study of complex problems. Others believe simple problem analyses provide the greatest gains. To clarify these issues, I tested: (1) whether simple published analyses compared to complex ones, produced results as non-intuitive; and (2) whether non-intuitiveness represented analytic gain (or equivalently, intuitive loss). Very limited data also examined (3) the gain from adding model intricacy for a given problem vs. selecting more complex problems for analysis. To assess two non-intuitiveness measures, 75 subjects (33 physicians and 42) non-physicians stated their intuitive preferences in 40 (22 published and 18 unpublished) medical dilemmas. For both physicians and non-physicians, simpler models (those with lees than 30 terminal branches in the decision tree) had about one third the non-intuitiveness of more complex ones. Three tests also supported the premise that analyses outperform intuition, therefore that on average the formers' non-intuitiveness reflects less analytic gain. In addition, for different models of the same problem, tree complexity did not correlate with gain. Thus, simpler trees may not generally gain less because they inadequately describe problems. Instead, simpler analyses may represent simpler problems, with more similar intuitive and formal solutions. If so, these findings may help us avoid some costly but unnecessary simple analyses.