Assessing long‐term maintenance of staff performance following behavior skills training in a home‐based setting

We used a multiple baseline across participant design to evaluate the effects of behavior skills training on teaching three behavior therapists to implement discrete trial teaching (DTT) and evaluate the long‐term maintenance of skills acquired through behavioral skills training. For participants whose skills did not maintain, the authors evaluated an independent self‐evaluation procedure on their performance. Following DTT implementation training, maintenance probes were assessed at 2‐, 4‐, 6‐, and 8‐week follow‐ups. The results demonstrated that one participant maintained 100% procedural integrity (PI) through all follow‐ups, one participant decreased below mastery criterion at the 2‐week follow‐up, and one participant dropped below mastery criterion at the 4‐week follow‐up. Those participants that demonstrated decreased accuracy of implementation of DTT programs and were taught to implement a self‐evaluation procedure. Following self‐evaluation, PI maintained for up to 7 weeks for one participant. Our results suggest that if PI does not maintain, self‐evaluation may be a supplementary intervention to increase and maintain PI of new employees.     

THE EFFECTS OF BEHAVIORAL SKILLS TRAINING ON IMPLEMENTATION OF THE PICTURE EXCHANGE COMMUNICATION SYSTEM

The effectiveness of a behavioral skills training (BST) package to teach the implementation of the first three phases of the picture exchange communication system (PECS) was evaluated with 3 adults who had no history teaching any functional communication system. A multiple baseline design across participants was used to evaluate the effectiveness of the training package, which consisted of a video, written and verbal instructions, modeling, rehearsal, and feedback. Results showed significant improvements relative to baseline in a short amount of training time and that skills generalized to a learner with a severe developmental disability. Skills were maintained at 1 month follow‐up for 1 participant.     

Effects of video modeling on treatment integrity of behavioral interventions

We examined the effects of individualized video modeling on the accurate implementation of behavioral interventions using a multiple baseline design across 3 teachers. During video modeling, treatment integrity improved above baseline levels; however, teacher performance remained variable. The addition of verbal performance feedback increased treatment integrity to 100% for all participants, and performance was maintained 1 week later. Teachers found video modeling to be more socially acceptable with performance feedback than alone, but rated both positively.     

UTILIZATION OF VIDEO MODELING COMBINED WITH SELF‐MONITORING TO INCREASE RATES OF ON‐TASK BEHAVIOR

The study investigated the effectiveness of an intervention package consisting of self‐monitoring and video modeling to increase on‐task behavior during independent seatwork time in math. Four students in either the second or third grade, identified as displaying high rates of off‐task behavior by their classroom teacher, were included in the study. Results showed immediate, large, and durable changes in on‐task behavior for each of the four participants. At baseline, on‐task behavior of the participants while working on independent math assignments was displayed in 47% of the intervals observed. During the intervention, the participants' average rate of on‐task behavior increased to 85% of the intervals observed. Mean Busk and Serlin (1994) effect size for all four participants was 5.60, with a percentage of non‐overlapping data points effect size of 100%. Observations of the participants 3 weeks following the termination of the study showed that the gains in on‐task behavior were maintained. Both teacher and participant feedbacks concerning the use and effectiveness of the intervention package were positive. Results of the investigation suggest that the intervention package may be an effective and socially valid method for addressing off‐task behaviors of students within the classroom. Copyright © 2014 John Wiley & Sons, Ltd.     

A component analysis of job interview training for young adults with autism spectrum disorder

The job interview is a vital component to acquire employment. Individuals with autism spectrum disorder may experience difficulties with job interviews due to notable deficits in social and communication skills. We evaluated the relative impact of several components of a job interview training package on six participants' responses to commonly asked interview questions. We used a multiple baseline design across participants to present the following components: written instructions, rehearsal and video self‐feedback with a commercially available training program, and verbal feedback delivered by the experimenter. Results demonstrated that all participants required an additional behavioral skills training session to meet our mastery criterion. However, once training was complete, all participants showed generalized performance when the interview questions were presented in a varied format and by a novel interviewer outside of the training environment. In addition, their performance was maintained at follow‐up.     

A comparison of performance feedback procedures on teachers' treatment implementation integrity and students' inappropriate behavior in special education classrooms

This study examined the extent to which treatment integrity of 4 special education teachers was affected by goal setting, performance feedback regarding student or teacher performance, and a meeting cancellation contingency. Teachers were trained to implement function-based treatment packages to address student problem behavior. In one condition, teachers set a goal for student behavior and received daily written feedback about student performance. In a second condition, teachers received daily written feedback about student performance as well as their own accuracy in implementing the intervention and would be able to avoid meeting with a consultant to practice missed steps by implementing the intervention with 100% integrity. This latter package increased treatment integrity the most above baseline levels. Higher levels of treatment integrity were significantly correlated with lower levels of student problem behavior for 3 of the 4 teacher-student dyads. Three of the 4 teachers also rated both feedback procedures as highly acceptable. Implications for increasing and maintaining treatment integrity by teachers via a consultation model are discussed.     

Reducing stereotypic behavior through discrimination training,differential reinforcement of other behavior,and self‐monitoring

The effect of a treatment package designed to reduce stereotypic body rocking was examined in a child diagnosed with autism. After baseline, the participant was taught to discriminate between inappropriate (e.g. sitting in a chair and rocking) and appropriate (e.g. sitting in a chair without rocking) behavior. During intervention, both a therapist and the participant himself monitored the occurrence of rocking behavior. A non‐resetting 5 min differential reinforcement of other behavior (DRO) schedule was also introduced. A multiple baseline across behaviors (sitting and standing) design was used to evaluate the effects of the intervention package. The results indicated that the intervention was effective in eliminating body rocking. In addition, the DRO schedule was successfully increased to 20 min for sitting and 17 min for standing and the treatment was successfully introduced at the child's school. Copyright © 2001 John Wiley & Sons, Ltd.     

The use of behavioral skills training to improve staff performance of discrete trial training

Well‐trained staff are a prerequisite for successful implementation of treatment plans when working in human service contexts. The high rate of turnover makes the use of efficient and effective staff training all the more important. Previous research has used behavioral skills training to train teachers in correct implementation of discrete trial training of children with autism. They showed that a brief 10‐min procedure could effectively train staff and result in improved performance. The current study elaborated on previous work by using participants without prior exposure to the method, including treatment integrity data and testing for maintenance 1 month after training ended. The mean percentage of correct teaching responses for the three participants increased from 70%, 58%, and 66% during baseline to 97%, 96%, and 99%, respectively, following training. Results indicated that the training package was effective and the results were maintained 30 days later.     

Training parents to implement pediatric feeding protocols

Four different multicomponent training packages were evaluated to increase the treatment integrity of parents implementing pediatric feeding protocols. In Study 1 we exposed 3 parents to a training package that consisted of written protocols (baseline), verbal instructions, therapist modeling, and rehearsal training. Results suggested that the package was successful in increasing treatment integrity of the feeding protocols to high levels. Study 2 investigated three different parent-training packages comprised of components used in Study 1. Two parents were exposed to written protocols, verbal instructions, and modeling; 2 parents were exposed to written protocols, verbal instructions, and rehearsal; and 2 parents were exposed to written protocols and verbal instructions. Results of Study 2 showed that each parent-training package produced very high treatment integrity. Follow-up data in the clinic and home for 5 participants suggested that the results were durable for up to 3 months. These results demonstrate a first step in the transfer and application of research findings into routine clinical practice because we evaluated several methods for training parents to implement behavioral feeding protocols, and we demonstrated that these methods resulted in high levels of treatment integrity in a controlled clinical setting.     

Pyramidal parent training using behavioral skills training: Training caregivers in the use of a differential reinforcement procedure

Six caregivers participated in a research study in which behavioral skills training (BST) was used within a pyramidal training model to train a differential reinforcement of an alternative behavior (DRA) procedure. Physical prompting was utilized to obtain correct responses across the identified alternative behavior. The caregivers were split into two tiers, comprised of three caregivers each. The experimenter trained tier‐one caregivers, who then trained tier‐two caregivers after meeting a predetermined mastery criterion. A multiple baseline design across participants research design was used to evaluate the effectiveness of correct implementation of the DRA procedure, demonstrating experimental control across participants. During baseline, caregivers did not implement DRA correctly. Following training, tier‐one and tier‐two caregivers demonstrated correct implementation of the DRA and prompting procedure. Intervention score was (M = 96%), from a baseline score of (M = 34.6%), for tier‐one participants. Intervention score was (M = 96.6%), from a baseline score of (M = 33%), for tier‐two participants. A follow‐up maintenance probe demonstrated correct implementation of the DRA procedure with prompting across both tiers of trained caregivers.     

Promoting social initiation in children with autism using video modeling

A large number of studies have shown that children and youths with autism can improve their social skills when provided with appropriate and well planned treatment strategies. Here, a video modeling procedure was implemented with seven developmentally delayed children, using a multiple‐treatment design. Each child watched a videotape showing a model and the experimenter engaged in a simple social interactive play in an adapted play setting. Afterwards each child's behavior was assessed in this setting, while the experimenter's behavior remained the same as that shown in the videotape. The video modeling training enhanced the social initiation skills of four children. It also facilitated appropriate play engagement, which generalized across settings, peers, and toys. These changes maintained after a 1‐ and 2‐month follow‐up period. The intervention was evaluated as a time‐efficient teaching tool as well as a means of enhancing appropriate play skills. Copyright © 2003 John Wiley & Sons, Ltd.     

Promoting parent use of empirically supported reading interventions: two experimental investigations of child outcomes

Two experimental investigations of the effects of parent delivered reading interventions were conducted. Tutoring packages consisting of empirically supported intervention components were delivered by parents for at least several weeks after initial parent training. Both experiments used single‐case experimental designs and measured participants' oral reading fluency in passages. Experiment 1 used a multiple‐probe design across tasks (passages) to evaluate tutoring effects for two students with learning disabilities. Results indicate that both students increased their reading fluency and maintained those increases over time. Experiment 2 used a brief experimental analysis that included both experimenter and parent delivered instructional trials to validate the treatment package. Next, the treatment package was evaluated using an alternating treatments design. Results were uniformly positive. An interesting but not surprising correlation was also found between treatment integrity and student outcomes. Results are discussed in terms of the framework and skills that behavior analysts have for working with parents and schools to improve their children's academic responding. Copyright © 2006 John Wiley & Sons, Ltd.     

The effects of self-monitoring on the procedural integrity of a behavioral intervention for young children with developmental disabilities

The effects of self-monitoring on the procedural integrity of token economy implementation by 3 staff in a special education classroom were evaluated. The subsequent changes in academic readiness behaviors of 2 students with low-incidence disabilities were measured. Multiple baselines across staff and students showed that procedural integrity increased when staff used monitoring checklists, and students' academic readiness behavior also increased. Results are discussed with respect to the use of self-monitoring and the importance of procedural integrity in public school settings.     

PREVENTING BACK INJURIES IN HOSPITAL SETTINGS: THE EFFECTS OF VIDEO MODELING ON SAFE PATIENT LIFTING BY NURSES

This study evaluated video scoring and feedback about scoring as a safety intervention among 6 nursing staff. The dependent variable was safety behavior on one‐person transfers. Following baseline, 5 nursing staff participated in an information phase. A video scoring phase was then introduced for all 6. A feedback phase was added for 2 participants. All participants experienced treatment withdrawal. Information resulted in improvements for all 5 participants who received it. Further improvements were observed during video scoring for the 5 participants who improved following information. No improvements were observed for the participant who received only video scoring. Safety feedback further improved safety for the 2 participants who received it. However, participants' behavior returned to video scoring levels during withdrawal.     

IMPROVING INTERVENTION INTEGRITY OF DIRECT‐SERVICE PRACTITIONERS THROUGH PERFORMANCE FEEDBACK AND PROBLEM SOLVING CONSULTATION

The purpose of this study was to improve intervention integrity of behavior support plan implementation by teachers at a specialized school. During the first phase of a multiple baseline design, performance feedback was given to the teachers during (correction) and immediately following (praise) classroom observations. In a second phase, the teachers received problem solving consultation that addressed behavior support plan misapplication and respective procedural modifications. Only one of the three teachers demonstrated improved intervention integrity with performance feedback, whereas problem solving consultation produced uniform improvement. We discuss these findings and implications for intervention integrity assessment and research. Copyright © 2014 John Wiley & Sons, Ltd.     

Evaluating the Effectiveness of a Teaching Package Utilizing Behavioral Skills Training and In Situ Training to Teach Gun Safety Skills in a Preschool Classroom

There are a number of different safety threats that children face in their lives. One infrequent, but highly dangerous situation a child can face is finding a firearm. Hundreds of children are injured or killed by firearms each year. Fortunately, behavioral skills training (BST) and in situ training (IST) are effective approaches for teaching a number of different skills, including safety skills. The purpose of this study was to evaluate a teaching package for preschool teachers to learn to conduct BST to teach safety skills. Following teacher-implemented BST, the experimenter completed in situ training and supplemental instructions. A multiple baseline across subjects design was used to evaluate the effectiveness of this teaching package implemented by the teacher and experimenter with five preschoolers. Five children demonstrated the skills following IST and additional reinforcement or time out. The use of additional reinforcement, as well as treatment fidelity are discussed.     

Increasing physical activity through self‐monitoring,goal setting,and feedback

Excess body weight, especially obesity, is a problem of increasing social significance, and weight gain is often correlated with age. Because physical activity can both decrease current body weight and prevent weight gain, it is an especially suitable target for behavioral intervention. A package intervention consisting of self‐monitoring, goal setting, and feedback was used to increase the physical activity of healthy adults. A combined multiple‐baseline and reversal design was arranged to evaluate the effects of the intervention on the number of steps taken each day by participants, as recorded by a pedometer. The intervention increased the number of steps taken across participants, but there were no changes in participant body weight during the intervention. The results suggest that a relatively simple and low‐cost intervention can be used to increase the physical activity of some adults. Copyright © 2008 John Wiley & Sons, Ltd.