Curriculum-Based Measurement

Abstract

Curriculum-based measurement (CBM) has evolved as a reliable and valid method for measuring and monitoring student performance in basic academic skills. While the efficacy of CBM for assessing reading skills is not in question, issues remain regarding whether or not a difference exists between CBM probes derived directly from the instructional curriculum and generic probes. The current study extends previous research comparing the utility of two types of CBM reading probe materials. Both types of probes were administered to 13 second grade students twice weekly for 5 weeks. No significant differences were found between the two probe types' measurement of performance or progress over time, which suggests that school psychologists and educational professionals can use generic or curriculum-dependent probes in curriculum-based measurement.     

REMEDIATION OF MUTUALLY AVERSIVE INTERACTIONS BETWEEN A PROBLEM STUDENT AND FOUR TEACHERS BY TRAINING THE STUDENT IN REINFORCEMENT TECHNIQUES

This study tested the effect of a social reinforcement training procedure for a problem student on the verbal and nonverbal approval and disapproval of four of the student's teachers. A design incorporating aspects of a multiple baseline within an extended reversal design (ABABA) was employed. Data were taken on the four teachers' approval and disapproval of a student regarded as a major discipline problem and the target student's approval and disapproval of the four teachers during baseline 1, experimental condition 1, baseline 2, experimental condition 2, and a postcheck or baseline 3 condition six weeks after experimental condition 2. Results showed that increased student approval and decreased disapproval were attributable to training procedures. The increased student approval increased three of the four teachers' approval and decreased the disapproval of all four teachers. Six weeks after experimental condition 2, both approval and disapproval by three of the four teachers and the student and disapproval by all four teachers and the student remained changed over baseline conditions. Student and teacher approval and disapproval were highly correlated at statistically significant levels.     

ACQUISITION OF ADJECTIVES AND ADVERBS IN SENTENCES WRITTEN BY HEARING IMPAIRED AND APHASIC CHILDREN

The effect of an instructional package, which included modeling, reinforcement, and remedial feedback on the rate, accuracy, and topography of sentences composed by four hearing impaired and aphasic children, was examined. In a specially designed classroom, students wrote sentences describing a stimulus picture on acetate sheets placed on the stage of an overhead projector which was built into each student's desk. This arrangement provided the teacher and other students immediate and continuous visual access to each student's sentences. In a multiple baseline design across behaviors, model sentences were projected and token reinforcment and remedial feedback were made contingent upon writing correct sentences containing prenominal adjectives only, then adverbs only, then prenomial adjectives plus adverbs. During baseline all students displayed poor written language skills and seldom wrote sentences containing modifiers. When the instructional package was implemented, all students demonstrated significant increases in response rate, accuracy, and percentage of correct sentences including prenominal adjectives and adverbs.     

USE OF SOUNDING OUT TO IMPROVE SPELLING IN YOUNG CHILDREN

We examined the effects of teaching 5 typically developing elementary students to sound out their spelling words while writing them using the cover‐copy‐compare (CCC) method to practice spelling. Each student's posttest performance following practice with sounding out was compared to that student's posttest performance following practice with no sounding out. For every student, posttest accuracy was higher following practice with sounding out, indicating that it is an effective and easily implemented strategy to improve spelling instruction.     

Evaluating the impact of feedback on elementary aged students' fluency growth in written expression: A randomized controlled trial

The purpose of this randomized controlled trial was to evaluate elementary-aged students' writing fluency growth in response to (a) instructional practices, (b) sex differences, and (c) student's initial level of writing fluency. Third-grade students (n = 133) in three urban elementary schools were randomly assigned to either an individualized performance feedback condition (n = 46), a practice-only condition (i.e., weekly writing practice; n = 39), or an instructional control condition (n = 48) for 8 weeks. Findings included support for use of performance feedback as an instructional component in general education classrooms (Hedges' g = 0.66), whereas simple practice with curriculum-based measurement in written expression did not produce growth significantly greater than standard instructional practices. The hypothesis that girls write significantly more than boys was supported. However, girls and boys did not differ in their rate of growth. Finally, students' initial risk status in writing fluency did not differentially predict growth in writing fluency over the course of the study. Implications for incorporating feedback as a basic component of intervention in writing are discussed.     

A BEHAVIORAL-EDUCATIONAL ALTERNATIVE TO DRUG CONTROL OF HYPERACTIVE CHILDREN

A behavioral procedure for controlling hyperactivity without inhibiting academic performance is described. Using a time-sample observational method, the hyperactivity displayed by three school children was recorded during math and reading classes. Concurrently, math and reading performances were measured. The study consisted of two baselines, one while the children were on medication and the second while they were off medication. A multiple-baseline design across the two academic subject matters was used to assess the behavioral intervention, which consisted of token reinforcement for correct academic responses in math and subsequently math and reading. Discontinuation of medication resulted in a gross increase in hyperactivity from 20% to about 80%, and a slight increase in math and reading performance. Introduction of a behavioral program for academic performance, during no medication, controlled the children's hyperactivity at a level comparable to that when they were on drugs (about 20%). At the same time, math and reading performance for the group jumped from about 12% during baseline to a level of over 85% correct. Each child performed behaviorally and academically in an optimal manner without medication. Contingency management techniques provided a feasible alternative to medication for controlling hyperactivity in the classroom while enabling the children to grow academically.     

FUNCTIONAL CONSIDERATIONS IN THE USE OF PROCEDURAL TIMEOUT AND AN EFFECTIVE ALTERNATIVE1

Two single-subject experiments were conducted with students in special preschool classes. In Experiment I, the subject's disruptive, appropriate, and inappropriate play behaviors were measured as a function of three independent variables: reinforcement, a typical timeout procedure, and regularly paced teacher instructions. In an ABA reversal within a multiple baseline across two teachers, all three independent variables comprised the A conditions and procedural timeout was omitted in B. Experiment II examined a second subject's appropriate and inappropriate eating as a function of the same three variables. Two teachers conducted baseline and paced instruction-plus-reinforcement conditions in multiple baseline across teachers. Subsequently, one teacher performed a series of reversals and replications with various combinations of a typical timeout procedure and reinforcement mixed with paced instructions. The results of both experiments suggest that timeout did not produce response decrement in a punishment paradigm, but rather produced response increment in a negative reinforcement paradigm. These results prevailed, even though a reinforcer was operating in the environment before introducing timeout. Paced instructions (delivering instructions to the child at a set pace regardless of the child's behavior) appears to be an alternative when timeout is not effective and, in conjunction with reinforcement, was demonstrated to reduce inappropriate behavior to near zero.     

THE GOOD TOOTHBRUSHING GAME: A SCHOOL-BASED DENTAL HYGIENE PROGRAM FOR INCREASING THE TOOTHBRUSHING EFFECTIVENESS OF CHILDREN

There has been a serious lack of experimentally verified, effective dental hygiene programs in the schools. In and of themselves, the instruction-alone programs which comprise children's dental education do not produce proper toothbrushing skills. In the present study, a school-based contingency dental hygiene program designed to increase the effectiveness of children's toothbrushing skills at home was implemented with grade one and two classes. Each class was divided into teams and participated in the “Good Toothbrushing Game.” Each day four children from each team had the cleanliness of their teeth assessed according to the Simplified Oral Hygiene Index (Greene & Vermillion, 1964). The team with the lowest mean oral hygiene score was declared the daily winner. Winning teams received stickers and had their names posted. A multiple baseline across classrooms single-subject group design (Hersen & Barlow, 1976, pp. 228–229) established that the good toothbrushing game greatly increased the effectiveness of children's oral hygiene skills. The treatment terminal level for the grade one scores was 2.0 as compared to a baseline terminal level of 5.0, and for the grade two's was 2.3 compared to 5.7 at the end of baseline. A 9-mo follow-up indicated that these results were maintained. The data strongly suggest that proper implementation of behavioral principles is essential to the success of oral hygiene programs.     

AN ANALYSIS OF SOME VARIABLES INFLUENCING THE EFFECTIVENESS OF REPRIMANDS

Although several studies have shown that social reprimands can function as punishers, no study reported to date has isolated any of the factors influencing reprimand efficacy. Three experiments were conducted to investigate several factors. Experiment 1 used an alternating treatments design and was conducted on two elementary school boys, one of whom was in a special education class. Results showed that verbal reprimands delivered with eye contact and firm grasp of the student's shoulders reduced disruptive behavior to a greater extent than did verbal reprimands delivered without eye contact and grasp. Both types of reprimand were more effective than a baseline condition during which disruptive behavior was ignored. Experiment 2 also used an alternating treatments design and was conducted on one elementary school boy. Results demonstrated that reprimands delivered from one meter away were considerably more effective than reprimands delivered from seven meters away. Experiment 3 used a reversal design and was conducted on two pairs of elementary school children, one a pair of boys and the other a pair of girls. Results demonstrated that reprimands delivered to just one member of the pair reduced the disruptive behavior of both members of the pair. Thus, the effects of reprimands “spilled” over to nonreprimanded students.     

Patterns of Family Conflict and Their Relation to College Student Adjustment

The current study explored whether college students' reported participation in one of four theoretically distinct family alignments was differentially related to their scores on a multidimensional measure of college adjustment. Students were classified into one of four family alignment groups (noncoalition, mother-coalition, father-coalition, and triangulation) on the basis of their comparative levels of conflictual independence from each parent. Results suggest that students' academic and personal adjustment are differentially affected by the nature of the parent-student conflictual alignment. Results also support the consideration of a family perspective when evaluating the student's adaptation to the college environment.     

White Noise to Decrease Problem Behaviors in the Classroom for a Child With Attention Deficit Hyperactivity Disorder (ADHD)

Continuous white noise played through headphones was used as a classroom intervention to reduce off-task behavior and increase assignment production and accuracy for a child with Attention Deficit Hyperactivity Disorder (ADHD). When listening to white noise the student's off-task behavior decreased from 89% during baseline to 62%. Subsequently, he began taking a stimulant medication for his ADHD. Pharmacotherapy alone (65% off task) was approximately equivalent to white noise alone. When medication was combined with white noise his off-task behavior decreased to 45%. Assignment production was also enhanced while listening to white noise, whereas accuracy remained high throughout.     

ASSESSING THE ROLE OF EFFORT REDUCTION IN THE REINFORCING EFFICACY OF TIMEOUT FROM AVOIDANCE

Rats responded on concurrent schedules of shock‐postponement or deletion (avoidance) and timeout from avoidance. In Experiment 1, 3 rats' responses on one lever postponed shocks for 20 s and responses on a second lever produced a 1‐min timeout according to a variable‐interval 45‐s schedule. Across conditions, a warning signal (white noise) was presented 19.5 s, 16 s, 12 s, 8 s, or 4 s before an impending shock. Raising the duration of the warning signal increased both avoidance and timeout response rates. Timeout responding, although positively correlated with avoidance responding, was not correlated with the prevailing shock rate. In Experiment 2, 3 rats' responses on one lever deleted scheduled shocks according to a variable‐cycle 30‐s schedule and responses on a second lever produced a 2‐min timeout as described above. After this baseline condition, the avoidance lever was removed and noncontingent shocks were delivered at intervals yoked to the receipt of shocks in the baseline sessions. Timeout responding decreased when the avoidance lever was removed, even though the shock‐frequency reduction afforded by the timeout remained constant. These results suggest that a key factor in the reinforcing efficacy of timeout is suspension of the requirement to work to avoid shock, rather than the reduction in shock frequency associated with timeout.     

EVALUATION OF TACTILE PROMPTS WITH A STUDENT WHO IS DEAF,BLIND, AND MENTALLY RETARDED

We provided tactile cues to a student who was deaf, blind, and mentally retarded to guide her performance on a variety of packaging tasks. The student had previously received extensive training on multiple packaging and sequencing tasks through her vocational education program. Although she was able to complete these tasks, each change in materials necessitated that similar levels of retraining be conducted in order for her to perform revised tasks. Tactile cues were introduced and evaluated through a multiple baseline with sequential withdrawal design for two envelope-stuffing tasks and one bagging task. Results indicated that the tactile prompts were effective in guiding her performance on the training task and in promoting generalization to novel tasks and cues. Continued use of the cues was necessary to maintain the student's performance. Our findings suggest that tactile prompts function similarly to picture prompts and may be an effective alternative external prompting system for persons for whom picture prompts would not be appropriate.     

THE EFFECT OF PRINT ACCESS ON READING FREQUENCY

Studies on reading motivation have found that access to reading materials has an important influence on the amount students choose to read. There are few studies, however, that have examined print access in a comprehensive way to include home, school, and community resources. In this study, surveys and reading tests were administered to a class of eleventh-grade students (N = 24). Consistent with previous research, convenient access to reading material, regardless of a student's reading ability, was associated with more frequent reading. In addition, more voluntary or "free" reading was associated with higher levels of reading proficiency. Implications for providing students with easier access to reading materials are discussed.     

Teaching complex verbal operants to children with autism and establishing generalization using the peak curriculum

The present study evaluated the feasibility of the PEAK Relational Training System's Generalization Module (Dixon, 2014b) to teach and establish generalization of autoclitic mands, distorted tacts, and creative path finding in three children diagnosed with autism spectrum disorder. Using a multiple‐baseline design across behaviors, each participant was provided with differential reinforcement and a least‐to‐most prompting hierarchy for correct responses to a subset of stimuli, and responses to other similar stimulus sets were probed for emergent generalization. Following training, each participant successfully acquired the directly trained behaviors and demonstrated generalization to the nonreinforced test exemplars. These data support the utility of Skinner's (1957) analysis to teach complex forms of verbal operants, and suggest that a manualized curriculum such as PEAK may have utility for promoting skill development and generalization for front line staff and caregivers of children with autism.     

EFFECTS OF SETTING EVENTS ON THE PROBLEM BEHAVIOR OF STUDENTS WITH SEVERE DISABILITIES

Two studies analyzed the effects of preceding setting events on the problem behavior of students with severe disabilities. Using ABAB withdrawal designs, the occurrence versus nonoccurrence of preceding setting events was analyzed in relation to the frequency of problem behavior. Data were collected throughout a student's school day, with interventions focusing upon the elimination of setting events that occurred before school. The results indicate that (a) the occurrence of preceding setting events was related to higher frequencies of problem behavior and (b) interventions designed to eliminate preceding setting events were consistently associated with low frequencies of problem behavior.     

TREATMENT OF SOCIAL BEHAVIOR IN AUTISM THROUGH THE MODIFICATION OF PIVOTAL SOCIAL SKILLS

We examined acquisition of individual social communicative behaviors and generalization across other social behaviors in 2 children with autism. The results of a multiple baseline design showed that the children's treated social behaviors improved rapidly and that there were generalized changes in untreated social behaviors. These improvements were accompanied by increases in subjective ratings of the overall appropriateness of the children's social interactions. The results suggest the possibility of identifying pivotal response classes of social communicative behavior that may facilitate the understanding of social behavior in autism as well as improve peer interactions, social integration, and social development.     

Learning to Graph Linear Functions: A Case Study of Conceptual Change

This case study shows how a student's strategies and associated conceptions emerged and changed over the course of a 6-session tutoring curriculum designed to develop conceptual knowledge of linear functions. Using microgenetic and sequential analyses, we identify the student's strategies and conceptions and describe how these changed. We show how the student did not erase his original conception or replace it with a conception supported by instruction, but instead refined his initial strategies and conceptions.     

THE INSULAR MOTHER: HER PROBLEMS IN PARENT-CHILD TREATMENT

Eighteen mother-child dyads were referred for psychological help because of the children's oppositional behaviors and the mothers' aversive reactions to the children. All dyads were from low income families in which the mothers reported themselves to be relatively isolated from social contact in their communities. Following a baseline phase, the mothers were trained to modify their children's oppositional behaviors through time out and a point system. Fourteen of the dyads were observed in three phases of the study: baseline, parent training or treatment, and a 1-year follow-up period. In Phases one and two, child opposition and mother aversive reactions to the children were measured twice weekly by professional observers in the home settings. During Phase three (follow-up), these observations occurred twice per month. In addition, the mothers' self-reported contacts with people in their communities were obtained immediately after each observation. Results showed significant improvement in the mother-child problems during the parent training or treatment phase. However, the problems returned to baseline levels of occurrence during the follow-up phase. The self-report findings indicated that number of mother contacts with friends was an inverse predictor of these problems. On days marked by high proportions of friend contacts, mother-child problems were lower in frequency than on days marked by low proportions of friend contacts. These correlational findings were taken to suggest that a mother's extra-family social contacts may influence her child interaction patterns at home. This possibility was discussed as a factor in the long-term success of parent training as a treatment strategy.     

Promoting Favorable Attitudes Toward Personnel Surveys: The Role of Follow-Up

Periodic command climate assessments and other such surveys are typical in most military organizations. In today's era of dwindling response rates, empirical guidance is needed for leaders and practitioners attempting to understand the factors that affect personnel's attitudes toward surveys and their intentions to complete recurrent questionnaires. The present study addressed this problem by assessing 236 military and civilian workers' reactions to a recurring command climate survey. As hypothesized, personnel who witnessed data feedback, problem identification, and survey-based action after the administration of the survey were particularly inclined to deem the survey useful. Moreover, personnel considered action more important than feedback when evaluating the survey's utility. By shaping perceptions of survey usefulness, awareness of follow-up actions impacted intentions to complete future questionnaires. Overall, the results of this study document the importance of visible, post-survey actions and highlight the repercussions of failing to adequately communicate survey-based change initiatives to the workforce.