INSTRUCTIONS,FEEDBACK, AND REINFORCEMENT IN REDUCING ACTIVITY LEVELS IN THE CLASSROOM

The biomotometer, an electronic device which simultaneously measures motor activity and provides auditory feedback, was used in combination with material reinforcers in an experiment to reduce children's activity level in a classroom setting. Subjects were nine boys and two girls, aged 9–13, from a day hospital program for emotionally disturbed children. After five baseline trials, each child had five contingent reinforcement trials in which he/she received feedback “beeps” from the biomotometer and was given toy or candy rewards after each trial in which activity fell at least 20% below mean baseline level. Then five noncontingent reinforcement trials were run in which children received rewards for wearing the apparatus without the feedback attachment. Results indicated that the intervention “package,” including instructions, feedback, and contingent reinforcement, was successful in all five trials for 8 of 11 children. Activity levels increased during the final noncontingent phase.     

The use of feedback and delayed praise to increase participation in a group activity

An intervention package consisting of immediate feedback, delayed social reinforcement, and early access to free time was designed and implemented in an attempt to increase the participation of eight 4-year-old nursery school students in a group activity session. The effects of the intervention were evaluated by means of a single subject withdrawal design (ABAB). Participation in the group activity averaged only 48.2% during the baseline phase, but increased to a mean of 64.3% when the feedback and praise conditions were introduced. When feedback and praise were withdrawn, participation decreased to 47.7%, but reintroduction of the experimental conditions resulted in an even larger increase in participation, to a mean of 79.2%. In addition, the occurrence of inappropriate verbalizations decreased from 25.2% during baseline to only 7.2% during the final experimental phase, even though they were not directly consequated.     

A behaviour modification technique for the hyperactive child

This paper describes a procedure for the conditioning of attending behaviour in a brain-injured hyperactive boy.

Observations of the behaviour of two hyperactive children were made in the classroom setting. These observations were made from an observation bootn adjoining the classroom and provided data on the frequency of occurrence of the following high rate responses: walking, talking, distraction, “wiggling”. Each child was observed for a minimum of ten minutes a day, four days a week. Following several weeks of baseline observation, the conditioning procedure was begun with the expel imental subject. The conditioning trials took place in the classroom setting. During each time interval in which one of the high rate responses did not occur, S received an auditory stimulus (secondary reinforcer). This auditory stimulus had previously been paired with the delivery of candy and pennies. The stimulus was dispensed by a radio device which activated an earphone worn by the subject. At the end of each conditioning trial, S received whatever candy or pennies he had “earned”.

The data show that the control subject showed no significant change in the frequency of occurrence of the high rate responses during the three month period. The experimental subject showed a significant decrease in non-attending behaviour. This reduction in rate was maintained over a four week extinction period.     

Cognitive manipulation of GSR extinction: Analogues for conditioning therapies

Cognitive determinants of GSR activity during extinction trials were examined following conditioning. Conditioned GSRs extinguished rapidly when subjects were informed the UCS would not again be administered, compared to subjects not given this information. Of greater interest was the finding that (false) high feedback concerning subjects’ responsivity to the Cs+ during extinction served to maintain GSR activity at a higher level than subjects receiving (false) low feedback. The relationship was observed within both information conditions. Implications are drawn for both aversive conditioning therapy and systematic desensitization.     

Cognitive Manipulation of GSR Extinction: Analogues for Conditioning Therapies

Cognitive determinants of GSR activity during extinction trials were examined following conditioning. Conditioned GSRs extinguished rapidly when subjects were informed the UCS would not again be administered, compared to subjects not given this information. Of greater interest was the finding that (false) high feedback concerning subjects' responsivity to the Cs+ during extinction served to maintain GSR activity at a higher level than subjects receiving (false) low feedback. The relationship was observed within both information conditions. Implications are drawn for both aversive conditioning therapy and systematic desensitization.     

Late expression of brain-derived neurotrophic factor in the amygdala is required for persistence of fear memory

In many instances, increase in neuronal activity can induce biphasic secretion of a modulator. The initial release of the modulator triggers the induction of synaptic plasticity, whereas the second-phase release reinforces the efficacy of synaptic transmission and growth of dendrites and axons. In this study, we showed that fear conditioning not only induced the first but also a second peak of brain-derived neurotrophic factor (BDNF) expression. Fluorescent immunohistostaining confirmed that BDNF expression increased at 1 and 12 h after conditioning and returned to baseline at 30 h after conditioning. Mature BDNF expression increased in a similar manner. TrkB-IgG or K252a infusion before training impaired fear memory on days 1 and 7 after training. In contrast, TrkB-IgG or K252a infusion 9 h after fear conditioning did not affect memory retention on day 1 after training but impaired fear memory on day 7 after training. Fear conditioning significantly enhanced Zif268 expression in the amygdala at 12 h after training; this enhanced expression was completely inhibited by TrkB-IgG infusion 9 h after training. The level of growth-associated protein 43 (GAP-43), a marker of newly formed synapses, in the amygdala increased 7 days after fear conditioning. Moreover, conditioned rats had higher AMPA/NMDA ratio than unpaired rats. These results suggest that consolidated memory could be continuously modulated by previous molecular changes produced during memory acquisition.     

Evaluating public posting,goal setting,and rewards to increase physical activity during school recess

We evaluated a pedometer‐based intervention consisting of public posting between two teams of students, with additional self‐monitoring, goal setting, and reinforcement components, to increase physical activity during school recess. In the absence of self‐monitoring, performance feedback alone did not increase physical activity levels above those observed during baseline. Additionally, higher levels of physical activity were observed when goal‐setting was introduced, with the highest levels of activity observed when raffle tickets could be earned for exceeding a specified step‐total goal.     

The power of regression to the mean: A social norm study revisited

This research follows up on a study by Schultz et al. ( 2007 ), in which the effect of a social norm intervention on energy consumption was examined. The present studies included control groups to examine whether social norm effects would persist beyond regression to the mean. Both studies had a 2 (baseline consumption: below mean versus above mean) × 2 (message condition: no‐message control versus norm message) design . Based on baseline fruit ( Study 1 ) or unhealthy snack ( Study 2 ) consumption, students were classified as above mean or below mean for consumption. One week later, half of the students in the above‐mean and below‐mean groups received normative feedback; control groups did not. Neither study showed an effect of norm messages on behavior relative to control, providing evidence for regression to the mean as an alternative explanation. Findings highlight the importance of control groups to distinguish social norm intervention effects from mere regression to the mean.     

An evaluation of the effectiveness of exposure and response prevention on repetitive behaviors associated with Tourette's syndrome

Exposure and response prevention (ERP) was evaluated as treatment for three repetitive behaviors in an 11-year-old boy using a multiple baseline across behaviors design. The repetitive behaviors and associated self-reported distress were eliminated. At 3-month follow-up, the frequency for two of the three behaviors returned to baseline levels. This study demonstrates that ERP may be a useful treatment for repetitive behaviors, although booster sessions may be needed to maintain the treatment effects.     

Differential acetylcholine release in the prefrontal cortex and hippocampus during pavlovian trace and delay conditioning

Pavlovian trace conditioning critically depends on the medial prefrontal cortex (mPFC) and hippocampus (HPC), whereas delay conditioning does not depend on these brain structures. Given that the cholinergic basal forebrain system modulates activity in both the mPFC and HPC, it was reasoned that the level of acetylcholine (ACh) release in these regions would show distinct profiles during testing in trace and delay conditioning paradigms. To test this assumption, microdialysis probes were implanted unilaterally into the mPFC and HPC of rats that were pre-trained in appetitive trace and delay conditioning paradigms using different conditional stimuli in the two tasks. On the day of microdialysis testing, dialysate samples were collected during a quiet baseline interval before trials were initiated, and again during performance in separate blocks of trace and delay conditioning trials in each animal. ACh levels were quantified using high-performance liquid chromatography and electrochemical detection techniques. Consistent with our hypothesis, results showed that ACh release in the mPFC was greater during trace conditioning than during delay conditioning. The level of ACh released during trace conditioning in the HPC was also greater than the levels observed during delay conditioning. While ACh efflux in both the mPFC and HPC selectively increased during trace conditioning, ACh levels in the mPFC during trace conditioning testing showed the greatest increases observed. These results demonstrate a dissociation in cholinergic activation of the mPFC and HPC during performance in trace but not delay appetitive conditioning, where this cholinergic activity may contribute to attentional mechanisms, adaptive response timing, or memory consolidation necessary for successful trace conditioning.     

Staying Together: A Bidirectional Delay–Coupled Approach to Joint Action

To understand how individuals adapt to and anticipate each other in joint tasks, we employ a bidirectional delay–coupled dynamical system that allows for mutual adaptation and anticipation. In delay–coupled systems, anticipation is achieved when one system compares its own time‐delayed behavior, which implicitly includes past information about the other system’s behavior, with the other system’s instantaneous behavior. Applied to joint music performance, the model allows each system to adapt its behavior to the dynamics of the other. Model predictions of asynchrony between two simultaneously produced musical voices were compared with duet pianists’ behavior; each partner performed one voice while auditory feedback perturbations occurred at unpredictable times during live performance. As the model predicted, when auditory feedback from one musical voice was removed, the asynchrony changed: The pianist’s voice that was removed anticipated (preceded) the actions of their partner. When the auditory feedback returned and both musicians could hear each other, they rapidly returned to baseline levels of asynchrony. To understand how the pianists anticipated each other, their performances were fitted by the model to examine change in model parameters (coupling strength, time‐delay). When auditory feedback for one or both voices was removed, the fits showed the expected decrease in coupling strength and time‐delay between the systems. When feedback about the voice(s) returned, the coupling strength and time‐delay returned to baseline. These findings support the idea that when people perform actions together, they do so as a coupled bidirectional anticipatory system.     

A LONGITUDINAL STUDY OF UPWARD FEEDBACK

This study followed 92 managers during four administrations of an upward feedback program over 2.5 years. Managers' whose initial level of performance (defined as the average rating from subordinates) was low improved between Administrations 1 and 2, and sustained this improvement 2 years later. Most of the performance improvement occurred between the first and second administrations of the program. The observed performance improvement could not be attributed solely to regression to the mean and was unrelated to the number of times, or when, the managers received feedback. Our results suggest that the continued administration of an upward feedback program can result in sustained change over a fairly long period of time and that actually receiving feedback may be less important than the exposure to the valued behaviors. We use control theory and goal setting theory as frameworks for explaining the results and suggesting directions for future research.     

PREVENTING BACK INJURIES IN HOSPITAL SETTINGS: THE EFFECTS OF VIDEO MODELING ON SAFE PATIENT LIFTING BY NURSES

This study evaluated video scoring and feedback about scoring as a safety intervention among 6 nursing staff. The dependent variable was safety behavior on one‐person transfers. Following baseline, 5 nursing staff participated in an information phase. A video scoring phase was then introduced for all 6. A feedback phase was added for 2 participants. All participants experienced treatment withdrawal. Information resulted in improvements for all 5 participants who received it. Further improvements were observed during video scoring for the 5 participants who improved following information. No improvements were observed for the participant who received only video scoring. Safety feedback further improved safety for the 2 participants who received it. However, participants' behavior returned to video scoring levels during withdrawal.     

Behavioral interventions to improve performance in collegiate football

Using a multitreatment withdrawal design, this study evaluated the differential effects of publicly posted plus verbal feedback, goal setting plus verbal feedback, and publicly posted feedback, verbal feedback, and goal setting together on the performance of 3 collegiate football players in practice scrimmages. Also assessed was whether the changes in practice behavior generalized to games. The dependent variables were performances on three wide receiver skills. The results show that public posting with verbal feedback, goal setting, and public posting with verbal feedback and goal setting were effective in improving player performance to a 90% criterion level during practice, and these changes generalized to game performance.     

An experimental approach to the reduction of overactive behavior

An operant, differential reinforcement procedure (DRO) was employed in a playroom setting for the purpose of controlling overactivity. Six overactive, mentally retarded children, aged 8–13 yr were first observed individually for a period of 8 days in the playroom in order to obtain a baseline performance on a specially constructed check-list of hyperactive behavior. Following this, the conditioning phase began under a fixed schedule of reinforcement with tokens as the reinforcing agents (later to be exchanged for candy). A fading-out phase was instituted after the 30-day conditioning period in order to maintain resistance to extinction at a higher level. Post-conditioning observations were then made. It was conclusively shown that the disturbed, hyperactive behavior came under stimulus control with “grasshopper” play decreasing substantially during the latter part of conditioning and extinction periods.     

Influence of lithium chloride intensity on unconditioned stimulus-alone interference in a flavor aversion paradigm

Two studies were conducted to explore the influence of US preexposure intensity on the development of a flavor aversion. In the first experiment, subjects were exposed to four US-alone presentations [1 per day, every other day over 8 days at one of four dose levels (0, 0.5, 1.5, or 3.0 meq LiCl)]. Following the US-alone treatment, an equal number of rats from each US-alone dose level condition received a series of sucrose-illness pairings at one of three conditioning dose levels. The results of this study showed that if the US-alone dose level was below the conditioning dose level, less interference was found than when the preexposure and conditioning doses were equivalent. A strong proactive US-alone interference was found when the US-alone dose level was either equal to or above the conditioning US intensity. In Experiment 2, a greater range of preconditioning US-alone dose levels was used. Also, the number of US-alone exposures decreased to two in Experiment 2. The results of Experiment 2 showed that less proactive US-alone interference occurred when the US-alone dose was either below or slightly above the conditioning US dose than when the US-alone and conditioning dose levels were equal. Further, when the preexposure US intensity was much above the conditioning US intensity, the level of interference was equivalent to that produced when the US-alone and conditioning US intensities were equivalent. These observations are discussed in terms of context blocking and generalization decrement models of the US preexposure effect.     

Hippocampal and cerebellar single-unit activity during delay and trace eyeblink conditioning in the rat

In delay eyeblink conditioning, the CS overlaps with the US and only a brainstem-cerebellar circuit is necessary for learning. In trace eyeblink conditioning, the CS ends before the US is delivered and several forebrain structures, including the hippocampus, are required for learning, in addition to a brainstem-cerebellar circuit. The interstimulus interval (ISI) between CS onset and US onset is perhaps the most important factor in classical conditioning, but studies comparing delay and trace conditioning have typically not matched these procedures in this crucial factor, so it is often difficult to determine whether results are due to differences between delay and trace or to differences in ISI. In the current study, we employed a 580-ms CS-US interval for both delay and trace conditioning and compared hippocampal CA1 activity and cerebellar interpositus nucleus activity in order to determine whether a unique signature of trace conditioning exists in patterns of single-unit activity in either structure. Long-Evans rats were chronically implanted in either CA1 or interpositus with microwire electrodes and underwent either delay eyeblink conditioning, or trace eyeblink conditioning with a 300-ms trace period between CS offset and US onset. On trials with a CR in delay conditioning, CA1 pyramidal cells showed increases in activation (relative to a pre-CS baseline) during the CS-US period in sessions 1-4 that was attenuated by sessions 5-6. In contrast, on trials with a CR in trace conditioning, CA1 pyramidal cells did not show increases in activation during the CS-US period until sessions 5-6. In sessions 5-6, increases in activation were present only to the CS and not during the trace period. For rats with interpositus electrodes, activation of interpositus neurons on CR trials was present in all sessions in both delay and trace conditioning. However, activation was greater in trace compared to delay conditioning in the first half of the CS-US interval (during the trace CS) during early sessions of conditioning and, in later sessions of conditioning, activation was greater in the second half of the CS-US interval (during the trace interval). These results suggest that the pattern of hippocampal activation that differentiates trace from delay eyeblink conditioning is a slow buildup of activation to the CS, possibly representing encoding of CS duration or discrimination of the CS from the background context. Interpositus nucleus neurons show strong modeling of the eyeblink CR regardless of paradigm but show a changing pattern across conditioning that may be due to the necessary contributions of forebrain processing to trace conditioning.     

Evaluating public posting,goal setting,and rewards to increase physical activity in children

In this study, we evaluated several components of a pedometer-based intervention with children in an elementary-school-aged classroom, across 24-h sessions. The intervention included combinations of self-monitoring, goal setting, feedback, and reinforcement, and data were analyzed at both the classroom level (i.e., average daily step totals) and the individual level (i.e., daily step totals), across phases. The highest levels of physical activity were observed when components of self-monitoring, public posting, goal setting, and feedback with reward were applied concurrently.     

Operant conditioning and discrimination of alpha: some methodological limitations inherent in response-discrimination experiments

Studies on the operant conditioning of central nervous system activity have produced results interpreted as demonstrating that responses, certain properties of responses, or response-produced stimuli can function as discriminative stimuli. It is assumed that the feedback stimulus in biofeedback makes the subject aware of the internal response and that by becoming aware of the response, the subject can acquire voluntary control over it. In this context, awareness is operationally defined as the ability to use the response as a discriminative stimulus. Since direct evidence for the assumed relationship between control and discrimination is lacking, an attempt was made to test the hypothesis that discrimination of a response automatically leads to control over that response. The discriminative stimuli were the presence and absence of occipital alpha electroencephalograph (EEG) activity. Data from two experiments are reported. The first study, employing naive subjects, was designed to answer the following questions: (a) Since pilot data indicated that subjects seemed to match their responses to the more probable type of trial, would increases in the probability of a correct response result when the probabilities of alpha and nonalpha trials were held near .50? (b) If correct responding does increase, would performance of these subjects in an alpha feedback task be enhanced relative to that of subjects not previously given discrimination training? and (c) If subjects could not learn the discrimination task, would feedback training enhance their performance in a subsequent discrimination task? Results from this study indicate that holding the probabilities of alpha and nonalpha discrimination trials near .50 results in an absence of learning curves, but leaves open the possibility that sophisticated subjects are capable of discriminating alpha and nonalpha activity. The second study deals with two questions: (a) Can sophisticated subjects learn to discriminate occipital alpha activity from nonalpha activity? and (b) Does the procedure of providing subjects with salient stimuli, contingent on the presence and absence of alpha activity, establish stimulus control of the presence and absence of alpha activity? Results indicate that it is not possible to conclude that subjects can learn to discriminate alpha and nonalpha activity. However, learning to increase percent-time nonalpha or decrease percent-time alpha with respect to baseline levels by means of EEG-contingent stimulation provides subjects with the ability to suppress percent-time alpha in the absence of feedback. Information gained in both studies through subject interviews indicates that subjects most often acquired their control of alpha activity during feedback by a specific strategy and then used the strategy during the stimulus-control tests.     

Computer-assisted behavioral assessment of Pavlovian fear conditioning in mice

In Pavlovian fear conditioning, a conditional stimulus (CS, usually a tone) is paired with an aversive unconditional stimulus (US, usually a foot shock) in a novel context. After even a single pairing, the animal comes to exhibit a long-lasting fear to the CS and the conditioning context, which can be measured as freezing, an adaptive defense reaction in mice. Both context and tone conditioning depend on the integrity of the amygdala, and context conditioning further depends on the hippocampus. The reliability and efficiency of the fear conditioning assay makes it an excellent candidate for the screening of learning and memory deficits in mutant mice. One obstacle is that freezing in mice has been accurately quantified only by human observers, using a tedious method that can be subject to bias. In the present study we generated a simple, high-speed, and highly accurate algorithm that scores freezing of four mice simultaneously using NIH Image on an ordinary Macintosh computer. The algorithm yielded a high correlation and excellent linear fit between computer and human scores across a broad range of conditions. This included the ability to score low pretraining baseline scores and accurately mimic the effects of two independent variables (shock intensity and test modality) on fear. Because we used a computer and digital video, we were able to acquire a secondary index of fear, activity suppression, as well as baseline activity scores. Moreover, we measured the unconditional response to shock. These additional measures can enhance the sensitivity of the assay to detect interesting memory phenotypes and control for possible confounds. Thus, this computer-assisted system for measuring behavior during fear conditioning allows for the standardized and carefully controlled assessment of multiple aspects of the fear conditioning experience.