The power of one reinforcer: The effect of a single reinforcer in the context of shaping

During shaping, if the organism is engaged in behaviors other than the current approximation, the amount of time between reinforcers increases. In these situations, the shaper may resort to what is referred to as a “desperation‐driven click.” That is, after a period of no reinforcement, the shaper delivers one reinforcer for a nontarget approximation. Reports from professional animal trainers suggest that the animal may continue performing this new behavior, even if it is reinforced only once. This study attempted to model this phenomenon with college students. Results from the study demonstrated that a desperation‐driven click situation can be reliably produced in a controlled setting. When participants received one reinforcer for interacting with a new object following a period of no reinforcement, they interacted with the new object for a longer or equal amount of time as compared to an object that had a longer history of reinforcement. The results of this study have implications for the understanding of how reinforcement controls behavior.     

Enhanced conditioning produced by surprising increases in reinforcer value are unaffected by lesions of the amygdala central nucleus

In many experimental settings, lesions of the central nucleus of the amygdala (CN) interfere with surprise-induced enhancement of event processing. In those settings, surprise was produced by omitting an expected event. This experiment examined the effects of CN lesions on enhanced learning after surprise was induced by presenting an unexpected event. After extensive light-food pellet pairings, a light-noise compound was paired with food pellets, and a sucrose solution was unexpectedly delivered after the food. Relative to a control condition, this manipulation enhanced the formation of associations between the auditory conditioned stimulus and food, in both sham- and CN-lesioned rats. These results indicate that CN circuitry implicated in surprise-induced increases in event processing is preferentially engaged when expected events are omitted, and not when unexpected events are presented.     

Distinguishing blocking from attenuation in visual selective attention

Sensory information must be processed selectively in order to represent the world and guide behavior. How does such selection occur? Here we consider two alternative classes of selection mechanisms: In blocking, unattended stimuli are blocked entirely from access to downstream processes, and in attenuation, unattended stimuli are reduced in strength but if strong enough can still access downstream processes. Existing evidence as to whether blocking or attenuation is a more accurate model of human performance is mixed. Capitalizing on a general distinction between blocking and attenuation-blocking cannot be overcome by strong stimuli, whereas attenuation can-we measured how attention interacted with the strength of stimuli in two spatial selection paradigms, spatial filtering and spatial monitoring. The evidence was consistent with blocking for the filtering paradigm and with attenuation for the monitoring paradigm. This approach provides a general measure of the fate of unattended stimuli.     

Locus of the effect of a distinguishing feature in a memory search task

Subjects memorized one to four 8- or 16-sided random forms in a memory search task. The positive set forms ("yes" response) differed in number of sides from the negative set forms ("no" response) for the different set (DS) group, but this distinguishing feature was not available to the same set (SS) group. Mean reaction time increased as a linear function of log(2) of the positive set size for both groups, but the increase was greater for the SS than the DS group, suggesting that memory search rather than an encoding stage of information processing was influenced by the availability of a distinguishing feature. In a transfer task which followed, new forms were introduced in which the positive and negative set forms differed in number of sides for both groups. In this task, the two groups did not differ in memory search, but in encoding. It was proposed that (a) availability of a distinguishing feature influences search time because the information specifying the number of sides of the set of memorized forms can be used to influence the speed with which individual forms are examined in memory; (b) previous experience with a distinguishing feature influences encoding because the DS group had learned to extract the information specifying the set of memorized forms (not the information specifying individual forms) more efficiently than the SS group.     

Another look at the effect of a surprising intervening event on negative priming.

Tipper et al. (1991) reported that negative priming is eliminated when a low-probability event separates presentation of the prime display from the probe display. This finding is perfectly consistent with at least three of the major accounts of negative priming. However, each of these accounts can reasonably be argued to make different predictions regarding the effect of a surprising intervening event on attended repetition effects. The purpose of the experiment reported here was to determine which of these three predictions was correct. The results obtained were consistent with none of the three predictions. The low-probability intervening event did eliminate negative priming, but did so by slowing performance in the baseline condition relative to all other conditions. The results are discussed with respect to the role of surprise in responding to novel events.     

Varying wheel-running reinforcer duration within a session: effect on the revolution-postreinforcement pause relation

Previous investigations of wheel-running reinforcement that manipulated reinforcer duration across conditions showed a strong relation between wheel-running rate and average postreinforcement pause (PRP) duration. To determine if the basis of this relation across conditions was a local effect of fatigue or satiation, the correlation between revolutions run and the duration of the immediately following PRP was investigated under conditions in which reinforcer duration was either constant or variable within a session. Seven male Wistar rats pressed a lever on a fixed-interval 60-s reinforcement schedule with the opportunity to run for 60 s as the reinforcing consequence. In the constant-duration condition, the duration of the reinforcer was always 60 s. In the variable-duration condition, the duration of the reinforcer varied between 2 and 240 s with a mean of 60 s. Mean correlations between revolutions run and the next PRP duration for constant, variable, and constant conditions were -.07, .20, and -.07, respectively. Although the positive correlation in the variable-duration condition is consistent with an effect of momentary fatigue or satiation, little of the variance in PRP duration appears to be attributable to these factors.     

Eliminating the memory blocking effect

Six experiments investigated the memory blocking effect (MBE) in which exposure to orthographically similar words (e.g., BALLOON) impairs one's ability to complete a similar fragment (e.g., BAL_ON_, solution is BALCONY). Experiments 1 and 2 demonstrated that blocking is not observed after a 72-hour delay; however, repetition priming was observed after the same delay. Experiments 3 and 4 showed that presenting unrelated semantic information during the fragment completion test eliminates blocking. Experiment 5 demonstrated that the MBE persists despite directed-forgetting instructions, and Experiments 5 and 6 demonstrated that activating both the solutions and blocking words for a particular fragment at study eliminates blocking. Collectively, the data demonstrate that reading orthographically similar primes automatically triggers retrieval of the blocking word and an executive control process works to manage this interference. A working framework that describes how an executive control mechanism could govern memory retrieval in the memory-blocking paradigm is presented to stimulate development of more advanced theoretical models that can explain blocking.     

Eliminating the memory blocking effect

Six experiments investigated the memory blocking effect (MBE) in which exposure to orthographically similar words (e.g., BALLOON) impairs one's ability to complete a similar fragment (e.g., BAL_ON_, solution is BALCONY). Experiments 1 and 2 demonstrated that blocking is not observed after a 72-hour delay; however, repetition priming was observed after the same delay. Experiments 3 and 4 showed that presenting unrelated semantic information during the fragment completion test eliminates blocking. Experiment 5 demonstrated that the MBE persists despite directed-forgetting instructions, and Experiments 5 and 6 demonstrated that activating both the solutions and blocking words for a particular fragment at study eliminates blocking. Collectively, the data demonstrate that reading orthographically similar primes automatically triggers retrieval of the blocking word and an executive control process works to manage this interference. A working framework that describes how an executive control mechanism could govern memory retrieval in the memory-blocking paradigm is presented to stimulate development of more advanced theoretical models that can explain blocking.     

Associative blocking of the mccollough effect

After exposure to two simultaneously presented achromatic grids (A and B) on a coloured field, subjects reported colour aftereffects on each of the separately presented grids. These aftereffects were shown to be examples of the McCollough effect, since they were contingent upon the subjects having experienced the grid in combination with the coloured field. Exposure to the coloured field in advance of combining the colour field with the grids attenuated the strengths of the aftereffects on the A and B grids. Moreover, exposure to the A grid on the coloured field in advance of combining the B grid with the A grid on the coloured field abolished the aftereffect on the B grid. The failure of the B grid to arouse the aftereffect was due to the presence of the already trained A grid, since exposure to the A grid on the coloured field followed by exposure to the B grid on that field yielded the aftereffect on the B grid. The conditions under which the McCollough effect was attenuated are those under which learning fails to occur in Pavlovian conditioning procedures. The results, therefore, supported the view that the pairing between the grids and the colour resulted in a learned association between the grids and some aspect of the response by the visual system to the colour.     

Free-time as a reinforcer in the management of classroom behavior

Six subjects, comprising one class at a school for the deaf, were given reinforcement consisting of time free from school work for remaining seated in the classroom. As a result, the frequency of leaving their chairs was sharply reduced. A second procedure presented free-time not contingent on remaining seated. Little change was seen in the already lowered response rate. An extension of the time required to be seated with corresponding reduction in the number of daily free-time periods did not reduce the effectiveness of the procedure. A one-day observation after six weeks indicated that the procedure was still effective. A one-day contingency reversal, requiring subjects to leave their chairs at least once during each seated period in order to receive free-time, substantially raised the frequency of out-of-seat responses.     

Reexamining the frustration effect in rats: Aftereffects of surprising reinforcement and nonreinforcement

The reinforcement-omission effect (ROE; also called frustration effect), or greater response strength immediately after nonreinforcement (N) than reinforcement (R), has been traditionally interpreted in terms of one of two factors: transient facilitation after N induced by primary frustration or transient suppression after R induced by postconsummatory processes. Three instrumental lever-pressing experiments with rats demonstrated that the ROE can be caused by either factor in isolation, or by both acting simultaneously. The distribution of trials and the interval between N or R and the target response determine which factor would cause the ROE. Both aftereffects decay in time, but the after-N process decays at a slower rate than the after-R factor.     

The effect of change in US quality on the blocking effect

If one CS is paired with a US and then that CS together with a “redundant” stimulus is paired with the US, conditioning of that “redundant” stimulus is attenuated or blocked. The present experiment explores the effect upon this blocking of changing the quality of the US coincident with the introduction of the redundant stimulus. Changing US quality disrupted blocking only when the US potency was also increased. Quality changes in which the redundant stimulus was correlated with a lower potency US only increased blocking. These results are taken as supporting the conditioning model of Rescorla and Wagner but inconsistent with a casual informational model of conditioning.     

The effect of the instrumental training contingency on susceptibility to reinforcer devaluation

Two experiments investigated performance of instrumental lever pressing by rats following post-conditioning devaluation of the sucrose reinforcer produced by establishing an aversion to it. In Experiment I rats responded less in an extinction test after being averted from the sucrose following training on a ratio schedule, but not following an equivalent amount of training on an interval schedule. This was true even though the devalued sucrose would not act as an effective reinforcer on either the ratio or interval schedule. Experiment II provided a further investigation of the insensitivity of interval responding to reinforcer devaluation by comparing test performance under simple extinction with responding when the devalued reinforcer was presented on either a response-contingent or non-contingent schedule during the test. Once again simple extinction performance was unaffected by prior reinforcer devaluation. Furthermore, neither non-contingent nor contingent presentations of the devalued reinforcer significantly depressed responding below the level seen in the extinction condition. Ratio, but not interval performance appears to be controlled by knowledge about the instrumental contingency that encodes specific properties of the training reinforcer.     

Locus of the redundant-signals effect in bimodal divided attention: a neurophysiological analysis.

We reanalyzed the data from the study of Lamarre, Busby, and Spidalieri (1983). In that study, the activity of single neurons in area 4 of the motor cortex was recorded during a bimodal detection task in which a monkey (Macaca mulatta) had to respond as quickly as possible to a visual or an auditory signal or to both (redundant trials). Manual responses on redundant trials were speeded by the presence of both signals, as is typically found. The times between signal onsets and the first changes in neuronal activity were also speeded by redundant signals, but there was no difference between redundant-signals and single-signal trials in the time between the change in neuronal activity and movement onset. These results suggest that late motor processes are not speeded by redundant signals in bimodal detection tasks.     

Locus of the intensity effect in simple reaction time tasks

Evidence is still inconclusive regarding the locus of the stimulus intensity effect on information processing in reaction tasks. Miller, Ulrich, and Rinkenauer (1999) addressed this question by assessing the intensity effect on stimulus- and response-locked lateralized readiness potentials (LRPs) as indices of the sensory and motor parts of reaction time (RT). In the case of visual stimuli, they observed that application of brighter stimuli resulted in a shortening of RT and stimulus-locked LRP (S-LRP), but not of response-locked LRP (R-LRP). The results for auditory stimuli, however, were unclear. In spite of a clear RT reduction due to increased loudness, neither S-LRP nor R-LRP onset was affected. A reason for this failure might have been a relatively small range of intensity variation and the type of task. To check for this possibility, we performed three experiments in which broader ranges of stimulus intensities and simple, rather than choice, response tasks were used. Although the intensity effect on the R-LRP was negligible, S-LRP followed RT changes, irrespective of stimulus modality. These findings support the conclusion that stimulus intensity exerts its effect before the start of motoric processes. Finally, S-LRP and R-LRP findings are discussed within a broader information-processing perspective to check the validity of the claim that S-LRP and R-LRP can, indeed, be considered as pure estimates of the duration of sensory and motor processes.