Using performance feedback to enhance implementation fidelity of the problem-solving team process

Implementation integrity is a potentially critical issue for problem-solving teams (PST) and most response-to-intervention models. The current study hypothesized that providing performance feedback, which has consistently been shown to increase implementation integrity, to PSTs would enhance the procedural integrity of the process. The PSTs for three elementary schools were provided performance feedback with a 20-item checklist created from the literature. A multiple-baseline design across schools revealed an immediate change in level after providing performance feedback. The resulting percentages of non-overlapping data were 90.9%, 90.0%, and 100%. However, PSTs still did not monitor student progress, assess the effectiveness of the intervention, or measure the integrity with which the intervention was implemented even after receiving feedback. Thus, providing performance feedback could be a method to increase the fidelity with which critical components of data-based problem-solving are implemented, but these data suggest the need for additional research.     

Using goal setting, task clarification, and feedback to increase the use of the hands-free technique by hospital operating room staff

We evaluated the effects of a behavioral treatment on the safe passing of sharp instruments using the hands-free technique among hospital operating room personnel during surgical procedures. Treatment consisted of participative goal setting, task clarification, and feedback. The average percentage of sharp instruments passed safely increased from 32% to 64% and 31% to 70% between baseline and treatment phases in the inpatient and outpatient surgery units, respectively. Five-month follow-up data suggested maintenance of treatment effects. These findings suggest the utility of organizational behavior management strategies in reducing risky behavior in hospital settings.     

The perseverance effect in the debriefing paradigm: Replication and extension

A classic study conducted by Ross, Lepper, and Hubbard (1975) revealed a perseverance effect wherein people who received positive performance feedback on an alleged social perceptiveness test reported more favorable self-perceptions in this domain than those who received negative feedback despite the fact that they had received standard outcome debriefing (i.e., been informed about the false, predetermined, and random nature of the feedback) prior to reporting self-assessments. The present studies extend this past research by revealing that (a) there is a form of outcome debriefing (i.e., informing participants about the bogus nature of the test as well as the bogus nature of the feedback) that effectively eliminates the perseverance effect, (b) the perseverance effect that occurs after standard outcome debriefing is limited to perceptions of specific task-relevant skills rather than more global abilities, and (c) affective reactions do not underlie the perseverance effect that occurs in the false feedback paradigm.     

Failure to warn: How student race affects warnings of potential academic difficulty

In two studies, we document “failure to warn”—a reduced likelihood of warning Black students against potential academic difficulty compared to White students. In both studies, participants placed in the role of academic advisors saw a highly challenging academic course plan, attributed to either a Black or a White student, and gave Black students less warning about the potential negative consequences of taking on the proposed plan. Study 1 (N = 172) demonstrates this effect using undergraduate peer academic advisors, and Study 2 (N = 58) provides evidence that this effect is moderated by Internal Motivation to Respond Without Prejudice (Plant & Devine, 1998), suggesting that this effect is driven by the fear that discouraging an ambitious Black student might reflect prejudice. This well-intentioned concern can have the ironic consequence of leading the recipients of this advice into academic difficulties.     

THE EFFECT OF FEEDBACK ON THE ACCURACY OF CHECKLIST COMPLETION DURING INSTRUMENT FLIGHT TRAINING

This study examined whether pilots completed airplane checklists more accurately when they receive postflight graphic and verbal feedback. Participants were 8 college students who are pilots with an instrument rating. The task consisted of flying a designated flight pattern using a personal computer aviation training device (PCATD). The dependent variables were the number of checklist items completed correctly. A multiple baseline design across pairs of participants with withdrawal of treatment was employed in this study. During baseline, participants were given postflight technical feedback. During intervention, participants were given postflight graphic feedback on checklist use and praise for improvements along with technical feedback. The intervention produced near perfect checklist performance, which was maintained following a return to the baseline conditions.     

THE EFFECTS OF RESPONSE CARDS ON STUDENT AND TEACHER BEHAVIOR DURING VOCABULARY INSTRUCTION

The use of response cards during whole‐class English vocabulary instruction was evaluated. Five low‐participating students were observed during hand‐raising conditions and response‐card conditions to observe the effects of response cards on student responding and test scores and teacher questions and feedback. Responding and test scores were higher for all targeted students in the response‐card condition. The teacher asked a similar number of questions in both conditions; however, she provided more feedback in the response‐card condition.     

The influence of performance feedback on goal-setting and mental effort regulation

Goal-setting and mental effort investment may be influenced by the perception of success or failure. The aim of the current study was to investigate the dynamics of motivational intensity model using false performance feedback. Forty participants performed a demanding cognitive task over five successive (5 min) blocks. Participants received performance feedback of either progressive success or progressive failure. A number of psychophysiological variables were used to index mental effort investment and emotion, including: HRV components, blood pressure, skin conductance level, EEG, and facial EMG. Subjective estimates of mood, workload and motivation were also collected alongside performance measures. The success group experienced positive affect and a less pronounced decline in subjective motivation in response to a perception of successful achievement. In contrast, feedback of failure led to adverse changes in mood/motivation, but did not lead to the absolute withdrawal of effort, although trends in the psychophysiological data suggest that participants in the failure group were on the verge of abandoning the task. The implications of these findings are discussed within the context of goal-setting and effort regulation models.     

Self-controlled concurrent feedback and the education of attention towards perceptual invariants

The present study investigates the effects of different types of concurrent feedback on the acquisition of perceptual-motor skills. Twenty participants walked through virtual corridors in which rhythmically opening and closing sliding doors were placed. The participants aimed to adjust their walking speed so as to cross the doors when the doors were close to their maximal aperture width. The highest level of performance was achieved by learners who practiced the task with unambiguous self-controlled concurrent feedback, which is to say, by learners who could request that feedback at wish. Practice with imposed rather than self-controlled feedback and practice without concurrent feedback were shown to be less effective. Finally, the way in which the self-controlled concurrent feedback was presented was also found to be of paramount importance; if the feedback is ambiguous, it may even prevent participants from learning the task. Clearly, unambiguous self-controlled feedback can give rise to higher levels of performance than other feedback conditions (compared to imposed schedule) but, depending on the way it is presented, the feedback can also prevent the participants from learning the task.In the discussion it is argued that unambiguous self-controlled concurrent feedback allows learners to more rapidly educate their attention towards more useful perceptual invariants and to calibrate the relation between perceptual invariants and action parameters.     

Generalizing Teaching Techniques from University to K-12 Classrooms: Teaching Preservice Teachers to Use What They Learn

Preservice teachers learn evidence-based practices in university classrooms but often fail to use them later on in their own K-12 classrooms. The problem may be a missing link in teacher preparation, i.e., failure to teach preservice teachers to generalize newly acquired techniques. Two experiments using multiple baseline designs across participants assessed effectiveness of a model to promote generalization and maintenance of a specific teaching skill. In Experiment 1, preservice teachers’ maintenance of behavior deteriorated from practicum to student teaching when intervention consisted of training to criteria alone. When a programming for generalization component (program common stimuli) was added to the intervention, teachers in Experiment 2 generalized and maintained behavior across settings (student teaching to own classrooms) at a higher average than occurred during intervention.     

Marginally perceptible outcome feedback, motor learning and implicit processes

Participants struck 500 golf balls to a concealed target. Outcome feedback was presented at the subjective or objective threshold of awareness of each participant or at a supraliminal threshold. Participants who received fully perceptible (supraliminal) feedback learned to strike the ball onto the target, as did participants who received feedback that was only marginally perceptible (subjective threshold). Participants who received feedback that was not perceptible (objective threshold) showed no learning. Upon transfer to a condition in which the target was unconcealed, performance increased in both the subjective and the objective threshold condition, but decreased in the supraliminal condition. In all three conditions, participants reported minimal declarative knowledge of their movements, suggesting that deliberate hypothesis testing about how best to move in order to perform the motor task successfully was disrupted by the impoverished disposition of the visual outcome feedback. It was concluded that sub-optimally perceptible visual feedback evokes implicit processes.