Evaluation of the accuracy,reliability, efficiency,and acceptability of fast forwarding to score problem behavior

Technological advances have allowed professionals to obtain extended recordings of caregiver–client interactions in natural settings, but scoring recorded video at normal speed to identify instances of low‐rate problem behavior is impractical in terms of scoring time. Fast forwarding is a continuous measurement system in which all seconds of an observation are viewed at a speed faster than normal. In Study 1, we evaluated whether three groups of five observers could discriminate problem behavior at three fast‐forwarding speeds across 10‐min observations. We analyzed the efficiency of using fast forwarding compared to continuous scoring, and interobserver agreement across the fast‐forwarding speeds. In Study 2, we compared the accuracy, efficiency, and social acceptability of fast forwarding (3.5x) and momentary time sampling (3.5 s) across 90‐min observations. Results support the use of 3.5x fast forwarding as a viable measurement system of improving the practicality of scoring problem behavior from video.     

VIDEO MODELING TO TRAIN STAFF TO IMPLEMENT DISCRETE‐TRIAL INSTRUCTION

Three new direct‐service staff participated in a program that used a video model to train target skills needed to conduct a discrete‐trial session. Percentage accuracy in completing a discrete‐trial teaching session was evaluated using a multiple baseline design across participants. During baseline, performances ranged from a mean of 12% to 63% accuracy. During video modeling, there was an immediate increase in accuracy to a mean of 98%, 85%, and 94% for each participant. Performance during maintenance and generalization probes remained at high levels. Results suggest that video modeling can be an effective technique to train staff to conduct discrete‐trial sessions.     

Pyramidal parent training using behavioral skills training: Training caregivers in the use of a differential reinforcement procedure

Six caregivers participated in a research study in which behavioral skills training (BST) was used within a pyramidal training model to train a differential reinforcement of an alternative behavior (DRA) procedure. Physical prompting was utilized to obtain correct responses across the identified alternative behavior. The caregivers were split into two tiers, comprised of three caregivers each. The experimenter trained tier‐one caregivers, who then trained tier‐two caregivers after meeting a predetermined mastery criterion. A multiple baseline design across participants research design was used to evaluate the effectiveness of correct implementation of the DRA procedure, demonstrating experimental control across participants. During baseline, caregivers did not implement DRA correctly. Following training, tier‐one and tier‐two caregivers demonstrated correct implementation of the DRA and prompting procedure. Intervention score was (M = 96%), from a baseline score of (M = 34.6%), for tier‐one participants. Intervention score was (M = 96.6%), from a baseline score of (M = 33%), for tier‐two participants. A follow‐up maintenance probe demonstrated correct implementation of the DRA procedure with prompting across both tiers of trained caregivers.     

Using Behavioral Skills Training to Promote the Generalization of Parenting Skills to Problematic Routines

Research has demonstrated the efficacy of a behavioral parent training program for skills acquisition; however, few studies have examined the extent to which those skills generalize to the home or the effect that they have on child behavior. A multiple baseline across participants design was used to assess (a) caregiver accuracy with implementation of three parenting skills, and (b) the effects of the parenting skills on child behavior. Results demonstrated that three caregiver participants successfully generalized parenting skills taught during behavioral skills training (BST) to naturally occurring routines, and the behavior of each caregiver's child improved following BST.     

Preference assessment training via self‐instruction: A replication and extension

We examined the effects of a self‐instructional and feedback package on participants’ implementation of a paired‐stimulus preference assessment. Specifically, in Experiment 1, we used a multiple baseline design across participants to replicate and extend the results of Graff and Karsten (2012) by evaluating the effectiveness of their self‐instructional manual. A majority of the participants (i.e., 5 of 7 undergraduate students and 4 of 5 in‐home behavior technicians) achieved mastery with the self‐instructional package. The remaining participants met the mastery criterion after brief modeling and feedback sessions. In Experiment 2, we identified the most effective component of the feedback condition from Experiment 1 when a self‐instructional package was not sufficient. Brief feedback sessions in which participants received a list of the targeted responses plus information regarding accuracy of emitted responses was sufficient for 5 of 6 participants to achieve mastery.     

Teaching children with autism to explain how: A case for problem solving?

Few studies have applied Skinner's (1953) conceptualization of problem solving to teach socially significant behaviors to individuals with developmental disabilities. The current study used a multiple probe design across behavior (sets) to evaluate the effects of problem‐solving strategy training (PSST) on the target behavior of explaining how to complete familiar activities. During baseline, none of the three participants with autism spectrum disorder (ASD) could respond to the problems presented to them (i.e., explain how to do the activities). Tact training of the actions in each activity alone was ineffective; however, all participants demonstrated independent explaining‐how following PSST. Further, following PSST with Set 1, tact training alone was sufficient for at least one scenario in sets 2 and 3 for all 3 participants. Results have implications for generative responding for individuals with ASD and further the discussion regarding the role of problem solving in complex verbal behavior.     

TELEPHONE CONVERSATIONAL SKILLS TRAINING WITH SOCIALLY ISOLATED,IMPAIRED NURSING HOME RESIDENTS

We evaluated the effectiveness of a comprehensive training program for enhancing the conversational skills of socially isolated, impaired elderly nursing home residents. A multiple baseline design across behaviors was used to train four subjects (aged 87, 85, 68, and 66), on four content-related conversational components: (a) expressing common courtesies, (b) making positive self-disclosures, (c) asking questions, and (d) making interjections and acknowledgments. Training procedures included instructions, modeling, behavior rehearsal, feedback, and reinforcement. Results showed positive effects with all four subjects; in two cases, changes were significant enough to affect untrained observers' perceptions of the elders' conversational skills.     

Enhancing frequency recording by developmental disabilities treatment staff

We evaluated a staff training and management package for increasing accuracy of recording frequency of problem behavior in a residential care facility. A multiple baseline design across the first and second work shifts showed that 2 of 8 participants increased their accuracy following in-service training, and all 8 improved during a condition with supervisor presence and feedback. Improvements were maintained when feedback was removed and generalized to activity periods when neither supervisor presence nor feedback was provided. Other staff behavior was not adversely affected by the intervention package.     

A component analysis of job interview training for young adults with autism spectrum disorder

The job interview is a vital component to acquire employment. Individuals with autism spectrum disorder may experience difficulties with job interviews due to notable deficits in social and communication skills. We evaluated the relative impact of several components of a job interview training package on six participants' responses to commonly asked interview questions. We used a multiple baseline design across participants to present the following components: written instructions, rehearsal and video self‐feedback with a commercially available training program, and verbal feedback delivered by the experimenter. Results demonstrated that all participants required an additional behavioral skills training session to meet our mastery criterion. However, once training was complete, all participants showed generalized performance when the interview questions were presented in a varied format and by a novel interviewer outside of the training environment. In addition, their performance was maintained at follow‐up.     

Effects of individualized video feedback combined with group parent training on inappropriate maternal behavior

The effects of adding individualized video feedback (IVF) to Webster-Stratton's (2000, 2001) group-based parent training program (GT) were evaluated using a multiple baseline design across four mother-child dyads. During all phases of the study, inappropriate maternal behavior was recorded from videotapes of playtime with their preschoolers with developmental disabilities. Results suggested that GT+IVF reduced inappropriate maternal behavior to levels below GT alone.     

The Effect of Feedback on Face‐Matching Accuracy

In face matching, observers have to decide if two photographs depict the same person or different people. This is a remarkably difficult task, so the current study investigated whether it can be improved when observers receive feedback for their performance. In five experiments, observers' initial matching performance was recorded before feedback for their accuracy was administered across three blocks. Improvements were then assessed with faces that had been seen previously with or without feedback and with completely new, previously unseen faces. In all experiments, feedback failed to improve face‐matching accuracy. However, trial‐by‐trial feedback helped to maintain accuracy at baseline level after feedback was withdrawn again, even with new faces (Experiments 1–3). By contrast, when no feedback was given throughout the experiment (Experiments 1–3) or when outcome feedback was administered at the end of blocks (Experiments 4 and 5), a continuous decline in matching accuracy was found, whereby observers found it increasingly difficult to tell different facial identities apart. A sixth experiment showed that this decline in accuracy continues throughout when the matching task is prolonged substantially. Together, these findings indicate that observers find it increasingly difficult to differentiate faces in matching tasks over time, but trial‐by‐trial feedback can help to maintain accuracy. The theoretical and practical implications of these findings are discussed. Copyright © 2013 John Wiley & Sons, Ltd.     

The effect of feedback training on distance estimation in virtual environments

It is often noted that distances are significantly underestimated in computer‐simulated (virtual) environments. Two experiments examine observers' ability to use error corrective feedback to improve the accuracy of judgments of egocentric and exocentric distances. In Experiment 1, observers viewed objects in an immersive virtual environment and estimated their distance through a blindfolded walking task. Different groups received feedback on either egocentric, exocentric or none of these judgments. Receiving feedback improved observers' ability to estimate only those distances for which feedback was provided. These effects persisted for at least 1 week. In Experiment 2, observers estimated egocentric distance by means of both a direct and indirect walking task. Receiving feedback on the direct walking task predominantly improved direct estimates and not indirect estimates. These findings suggest that although feedback training offers a relatively straightforward and immediate way of overcoming problems of distance estimation, its effects are specific to both the type of judgment and the type of response. Copyright © 2005 John Wiley & Sons, Ltd.     

TRAINING PARENTS IN BEHAVIORAL SELF-MANAGEMENT: AN ANALYSIS OF GENERALIZATION AND MAINTENANCE

This study examined the generalization and maintenance effects of three phases of parent training (Instructions plus Feedback and two Self-management Training phases) on levels of disruptive child behavior and the accuracy with which parents implemented programs. Data were collected from five families in three main settings: the initial training setting (the home), a variety of generalization settings in the community, and the family breakfast. A multiple baseline across subjects design was used. Instructions plus Feedback comprised instructing parents to use a range of behavior management procedures and provided home-based differential feedback concerning accuracy of program implementation. Self-management Training phases involved training parents in goal setting, self-monitoring, and planning skills, specific to their performance of appropriate parenting skills in generalization settings. Results indicated that the Instructions plus Feedback phase was sufficient to produce reduced levels of problem behavior at home and high levels of accurate implementation, but generalization effects out of home were equivocal. Self-management maintained reduced levels of problem behavior at home but, in addition, resulted in generalization effects in community settings for both children and parents. Maintenance probes 3 months following the program revealed the effects had been maintained.     

Assessing long‐term maintenance of staff performance following behavior skills training in a home‐based setting

We used a multiple baseline across participant design to evaluate the effects of behavior skills training on teaching three behavior therapists to implement discrete trial teaching (DTT) and evaluate the long‐term maintenance of skills acquired through behavioral skills training. For participants whose skills did not maintain, the authors evaluated an independent self‐evaluation procedure on their performance. Following DTT implementation training, maintenance probes were assessed at 2‐, 4‐, 6‐, and 8‐week follow‐ups. The results demonstrated that one participant maintained 100% procedural integrity (PI) through all follow‐ups, one participant decreased below mastery criterion at the 2‐week follow‐up, and one participant dropped below mastery criterion at the 4‐week follow‐up. Those participants that demonstrated decreased accuracy of implementation of DTT programs and were taught to implement a self‐evaluation procedure. Following self‐evaluation, PI maintained for up to 7 weeks for one participant. Our results suggest that if PI does not maintain, self‐evaluation may be a supplementary intervention to increase and maintain PI of new employees.     

Pyramidal training for families of children with problem behavior

The pyramidal training model was extended to multiple family members of children with behavior disorders. Three primary caregivers were taught to implement individualized treatments for problem behavior. They were then taught how to use various instructional strategies (e.g., prompting, feedback) to teach 2 other family members to implement the treatment. Results showed that pyramidal training was effective in increasing caregiver implementation of treatments across three families.     

A component analysis of behavioral skills training with volunteers teaching motor skills to individuals with developmental disabilities

This study included a component analysis of behavioral skills training (BST) for teaching volunteers how to use this training method to support individuals with developmental disabilities in a physical education program. In an alternating treatment design embedded within a multiple baseline design across five participants, the number of BST steps that volunteers completed correctly while teaching four motor skills was measured. In the initial training phase, each motor skill was taught to volunteers using a specific component of BST (i.e., instructions, modeling, rehearsal, or feedback). In subsequent training phases, BST components were combined to teach the volunteers the motor skills for which they did not reach a predetermined mastery criterion (a score of four correct responses across two consecutive trials). Maintenance was assessed. Results indicated that individual components of BST alone were sufficient for volunteers to meet the mastery criterion; however, the full BST framework was necessary for skill maintenance. Strengths, limitations, and recommendations for future research are discussed.     

Telehealth and in‐person training outcomes for novice discrete trial training therapists

The efficacy and efficiency of telehealth and in‐person training were compared while teaching seven undergraduate students to implement components of discrete trial training. A multiple‐baseline design across skills with elements of multiple probe and delayed multiple baseline combined with an alternating‐treatments design was used to evaluate the effects of behavioral skills training (BST) on (a) implementing a multiple stimulus without replacement preference assessment, (b) setting up an instructional context, (c) delivering antecedent prompts, and (d) delivering consequences for accurate and inaccurate responding. Two skills were trained via telehealth and two skills were trained in‐person using BST procedures with a mock student. All participants provided high acceptability ratings for both training procedures. Results also showed that telehealth training was as efficacious and efficient as in‐person training for all skills across all participants. Five of six participants showed high levels of maintenance of the newly acquired skills; these five also exhibited the skills during a novel instructional task.     

THE EFFECT OF FEEDBACK ON THE ACCURACY OF CHECKLIST COMPLETION DURING INSTRUMENT FLIGHT TRAINING

This study examined whether pilots completed airplane checklists more accurately when they receive postflight graphic and verbal feedback. Participants were 8 college students who are pilots with an instrument rating. The task consisted of flying a designated flight pattern using a personal computer aviation training device (PCATD). The dependent variables were the number of checklist items completed correctly. A multiple baseline design across pairs of participants with withdrawal of treatment was employed in this study. During baseline, participants were given postflight technical feedback. During intervention, participants were given postflight graphic feedback on checklist use and praise for improvements along with technical feedback. The intervention produced near perfect checklist performance, which was maintained following a return to the baseline conditions.