Discrimination of a response-independent component in a multiple schedule

Pigeons were trained to respond in non-differential reinforcement pre-discrimination training, with a multiple variable-interval 1-min variable-interval 1-min schedule. Each bird then received discrimination training with a multiple variable-interval 1-min variable-time 1-min schedule. Thus, discrimination training was between response-dependent (variable-interval) and response-independent (variable-time) schedules with the rate of reinforcement equated. In Experiment I, only three sessions of non-differential reinforcement preceded discrimination training and for half the birds, a 0° line was correlated with the response-dependent schedule; for the remaining birds the 0° line was correlated with the response-independent schedule. Post-discrimination gradients of excitatory stimulus control were obtained from the former group, while the latter group showed little evidence of post-discrimination stimulus control by the 0° line. Differential responding to the variable-time schedule was not accompanied by behavioral contrast to the variable-interval schedule. In Experiment II, 20 sessions of non-differential reinforcement preceded discrimination training and the 0° line was correlated with variable-time reinforcement for each bird. Differential responding to the 0° line was accompanied by negative induction to the variable-interval schedule and by inhibitory stimulus control about the 0° line during a post-discrimination generalization test.     

Interocular generalization: a study of mirror-image reversal following monocular discrimination training in the pigeon

Generalization gradients along a continuum of angular orientation were obtained from four pigeons, following monocular training on a discrimination between a 45° oblique line (S+) and a 135° oblique line (S−). All pigeons were trained on a chain DRO VI 1 schedule of reinforcement. Generalization gradients obtained with the trained and untrained eye were compared. All pigeons responded maximally to the 45° line (S+) when tested with only the trained eye open. During generalization tests of interocular transfer with only the untrained eye open, three pigeons responded maximally to S− (135°), the mirror-image of the stimulus associated with reinforcement during training (45°). The other pigeon failed to show interocular transfer of the discrimination. Interocular reversal of left-right mirror-image stimuli has not been reported for any other species.     

Stimulus and reinforcer relativity in multiple schedules: Local and dimensional effects on sensitivity to reinforcement

Pigeons' responses in two successive components of multiple schedules were reinforced according to variable-interval schedules of reinforcement that varied over five different conditions. Within each session of all conditions, line orientations of 0°, 30°, or 45° in Component 1 alternated with orientations of 45°, 60°, or 90° in Component 2. Response rates were recorded in three successive subintervals of each component. Ratios were taken between the response rate in each Component 1 line orientation and the response rate in each Component 2 orientation. These ratios were found to be power functions of the corresponding ratios of obtained reinforcement rates. Sensitivity of response ratios to changes in reinforcer ratios, given by the value of the exponent of the power function, increased systematically with increasing disparity between the dimensional values of orientation stimuli. In addition, sensitivity decreased systematically over successive subintervals of components, that is, with increasing time since component alternation. Dimensional and local (subinterval) effects interacted in that sensitivity increased with stimulus disparity to a far greater extent in the first subinterval than later in components. The data could be described by a combination of rectangular hyperbolae which attributed the interaction between local and dimensional effects to limits set by local effects on the extent that stimulus differences could affect sensitivity.     

Factors influencing inhibitory stimulus control: discrimination training and prior non-differential reinforcement

In Exp. I, shallow U-shaped gradients of inhibition in the line-orientation dimension were obtained from birds that had a vertical (0°) line on a green surround correlated with extinction and a blank green surround correlated with reinforcement. Birds that had massed extinction in the presence of the 0° line showed flat gradients. Thus, discrimination training, but not massed extinction, appears to generate inhibitory control. In Exp. II, as in studies of control by a stimulus correlated with punishment, non-differential training across the line-orientation dimension preceded further sessions. Steep inverted gradients about the 0° line were obtained after discrimination training with the 0° line correlated with extinction. Gradients obtained after massed extinction tended to be flat. Again, discrimination training was critical in obtaining negative gradients of stimulus control.     

Spaced responding and choice: a preliminary analysis

Pigeons were exposed to reinforcement both for short (2 < IRT < 3 sec) and long (10 < IRT < 11 sec) interresponse times. They developed bimodal interresponse-time distributions, which were decomposable into two independent component distributions under the control of the short and long contingencies respectively. The birds' allocation of responses between these two distributions was determined by a simple power-law relationship between reinforcement ratios, and response ratios derived from the component distributions. Comparison between this situation and concurrent choice situations raises the possibility that the power-law relation between ratios may be a more general law of choice than the matching of relative frequencies (probabilities).     

A peak shift on a line-tilt continuum

Pigeons were trained to discriminate the presence or absence of a vertical line, and their performance on a subsequent generalization test was compared with that of other pigeons trained to discriminate a vertical from a 45° line. On the generalization gradient after discrimination training, the presence/absence discrimination group showed a peak at 0° (vertical) while the peak for the 0°/45° discrimination group shifted from 0° in a direction away from the 45° line. The results, discussed in connection with a recent suggestion about the role of color in the peak-shift effect, are interpreted as supporting the generality of the phenomenon.     

Topography of signal-centered behavior in the rat: Effects of deprivation state and reinforcer type

In a series of three experiments, groups of food-deprived and water-deprived rats were given pairings of a retractable lever (CS⁺) with response-independent deliveries of either solid or liquid reinforcers. In Experiment 1 food-deprived rats given a solid-pellet reinforcer differentially tended to sniff, paw, mouth, and bite the CS⁺ lever more often than a lever that was not paired with food (CS⁻), whereas food-deprived rats given a liquid reinforcer tended to differentially sniff, paw, and lick the CS⁺ lever. 23½-hour water-deprived rats given liquid reinforcers showed very little CS⁺ contact. In Experiment 2 increasing the severity of water deprivation from 23½ to 47½ hours significantly increased CS⁺ contact. In Experiment 3, subjects that were simultaneously food and water deprived and given a water reinforcer failed to exhibit differential CS⁺ contact, but subjects that were simultaneously food and water deprived and given a food reinforcer did acquire differential CS⁺-contact behavior. These results suggest that (a) even under a single motivational state the nature of signal-centered behavior can be determined by type of reinforcer, (b) although water reinforcement produces less signal contact than food reinforcement, this can be facilitated with more severe water-deprivation levels, and (c) high CS-contact rates using food reinforcement are not simply a product of reductions in body weight with food deprivation.     

Partial reinforcement (acquisition) effects within subjects

Acquisition performance of 22 rats in a straight alley runway was examined. The animals were subjected to partial reinforcement when the alley was black (B±) and continuous reinforcement when it was white (W+). The results indicated (a) higher terminal performance, for partial as against continuous reinforcement conditions, for starting-time and running-time measures, and (b) lower terminal performance under partial conditions for a goal-entry-time measure. These results confirm within subjects an effect previously demonstrated, in the runway, only in between-groups tests, where one group is run under partial reinforcement and a separate group is run under continuous reinforcement in the presence of the same external stimuli. Differences between the runway situation, employing a discrete-trial procedure and performance measures at three points in the response chain, and the Skinner box situation, used in its free-operant mode with a single performance measure, are discussed in relation to the present findings.     

Effects of component length and of the transitions among components in multiple schedules

Pigeons received equal variable-interval reinforcement during presentations of two line-orientation stimuli while five other orientations appeared in extinction. Component duration was 30 seconds for all orientations and the sequence was arranged so that each orientation preceded itself and each other orientation equally often. The duration of one component (0°) was shortened to 10 seconds and the other (90°) was lengthened to 50 seconds. All animals showed large increases in response rate in the shortened component and this increase was recoverable after an interpolated condition in which all components were again 30 seconds in duration. This effect was replicated in a second experiment in which component duration was changed from 150 seconds to 50 seconds and 250 seconds. An examination of local contrast effects during the first experiment showed that the shortened component produced local contrast during subsequent presentations of the lengthened component, just as would a component associated with more frequent reinforcement. When the presentation sequence was changed so that the lengthened component was always followed by the shortened component, response rates generally increased during the lengthened component. When the sequence was arranged so that the shortened component always preceded the longer component, response rate decreased in the former. These effects, as well as the increases in response rate following change in component length, seem not to be the product of local contrast effects among components.     

Human observing: Maintained by stimuli correlated with reinforcement but not extinction

College students received points exchangeable for money (reinforcement) on a variable-time 60-second schedule that alternated randomly with an extinction component. Subjects were informed that responding would not influence either the rate or distribution of reinforcement. Instead, presses on either of two levers (“observing responses”) produced stimuli. In each of four experiments, stimuli positively correlated with reinforcement and/or stimuli uncorrelated with reinforcement were each chosen over stimuli correlated with extinction. These results are consistent with prior results from pigeons in supporting the conditioned-reinforcement hypothesis of observing and in not supporting the uncertainty-reduction hypothesis.     

Reinforcement of inhibition

A differential-reinforcement-of-other-behavior (DRO) schedule with trials and delayed reinforcement was investigated. Periodically a wheel was briefly available to rats, followed six seconds later by brief availability of a bar. Variable-ratio food reinforcement of wheel turns was adjusted to give 95% turns. After variable-ratio-five reinforcement of bar presses produced 100% pressing, then separate ratio schedules were used for presses following turns (turn presses) and presses following nonturns (nonturn presses). Increasing nonturn-press reinforcements decreased turns, even though total reinforcements increased. Reversal by decreasing nonturn-press reinforcements raised turns, though with hysteresis. Thus food reinforcement increased nonturns even though delayed six to ten seconds after nonturns, a delay that greatly reduces response reinforcement. Those and other results indicate that the turn decrease was not due to reinforcement of competing responses. Evidence against other alternatives, and the reduction of responding by increased reinforcement, indicate that the term inhibition is appropriate for the phenomenon reinforced. Response-specific inhibition appears appropriate for this particular kind, since its effects are more specific to particular responses than Pavlovian conditioned-inhibition. Response-specific inhibition seems best considered a behavioral output comparable to responses (e.g., both reinforcible) but with important properties different from responses (e.g., different reinforcement-delay gradients).     

A facilitative role for corticosterone in the acquisition of a spatial task under moderate stress

Emotionally charged experiences alter memory storage via the activation of hormonal systems. Previously, we have shown that compared with rats trained for a massed spatial learning task in the water maze in warm water (25°C), animals that were trained in cold water (19°C) performed better and showed higher levels of the stress hormone corticosterone. Here, we examined whether manipulating the levels of corticosterone can determine the strength of spatial information acquisition and retention. Rats were injected with metyrapone (25, 50, and 75 mg/kg, i.p.) or with corticosterone (10 and 25 mg/kg, i.p.) and trained in a massed spatial task in either cold (19°C) or warm (25°C) water. We found that whereas animals injected with vehicle performed well in the spatial task in cold water (moderate stress), rats injected with the intermediate metyrapone dose showed impairment in performance. Moreover, whereas animals injected with vehicle on average did not perform well in warm water (mild stress), rats injected with the lower corticosterone dose showed improvement in performance in warm water. These two mirror experiments of corticosterone blockade and enhancement strongly suggest that corticosterone is instrumental in the acquisition and retention of the spatial learning task.     

Competitive fixed-interval performance in humans

Two persons responded in the same session in separate cubicles, but under a single schedule of reinforcement. Each time reinforcement was programmed, only the first response to occur, that is, the response of only one of the subjects, was reinforced. “Competitive” behavior that developed under these conditions was examined in three experiments. In Experiment 1 subjects responded under fixed-interval (FI) 30-s, 60-s, and 90-s schedules of reinforcement. Under the competition condition, relative to baseline conditions, the response rates were higher and the pattern was “break-and-run.” In Experiment 2, subjects were exposed first to a conventional FI schedule and then to an FI competition schedule. Next, they were trained to respond under either a differential-reinforcement-of-low-rate (DRL) or fixed-ratio (FR) schedule, and finally, the initial FI competition condition was reinstated. In this second exposure to the FI competition procedure, DRL subjects responded at lower rates than were emitted during the initial exposure to that condition and FR subjects responded at higher rates. For all subjects, however, responding gradually returned to the break-and-run pattern that had occurred during the first FI competition condition. Experiment 3 assessed potential variables contributing to the effects of the competitive FI contingencies during Experiments 1 and 2. Subjects were exposed to FI schedules where (a) probability of reinforcement at completion of each fixed interval was varied, or (b) a limited hold was in effect for reinforcement. Only under the limited hold was responding similar to that observed in previous experiments.     

Rapid adaptation to auditory-visual spatial disparity

The so-called ventriloquism aftereffect is a remarkable example of rapid adaptative changes in spatial localization caused by visual stimuli. After exposure to a consistent spatial disparity of auditory and visual stimuli, localization of sound sources is systematically shifted to correct for the deviation of the sound from visual positions during the previous adaptation period. In the present study, this aftereffect was induced by presenting, within 17 min, 1800 repetitive noise or pure-tone bursts in combination with synchronized, and 20° disparate flashing light spots, in total darkness. Post-adaptive sound localization, measured by a method of manual pointing, was significantly shifted 2.4° (noise), 3.1° (1 kHz tones), or 5.8° (4 kHz tones) compared with the pre-adaptation condition. There was no transfer across frequencies; that is, shifts in localization were insignificant when the frequencies used for adaptation and the post-adaptation localization test were different. It is hypothesized that these aftereffects may rely on shifts in neural representations of auditory space with respect to those of visual space, induced by intersensory spatial disparity, and may thus reflect a phenomenon of neural short-term plasticity.     

Deprivation and satiation: The interrelations between food and wheel running

Two experiments were designed to assess whether depriving rats of food would increase the reinforcement effectiveness of wheel running (Experiment 1) and whether satiation for wheel running would decrease the reinforcement effectiveness of food (Experiment 2). In Experiment 1, a progressive-ratio schedule was used to measure the reinforcement effectiveness of wheel running when rats were deprived or not deprived of food. Completion of a fixed number of lever presses released a brake on a running wheel for 60 s, and the response requirement was systematically increased until the rat stopped pressing or until 8 hr had elapsed. The ratio value reached (and the total number of lever presses) was an inverted-U function of food deprivation (percentage body weight). In Experiment 2, when wheel running preceded test sessions, fewer food-reinforced lever presses were maintained by the progressive-ratio schedule, and responding occurred at a lower rate on a variable-interval schedule. An interpretation of these results is that deprivation or satiation with respect to one event (such as food) alters the reinforcement effectiveness of a different event (such as access to wheel running).     

Pigeon concept formation: successive and simultaneous acquisition

Pigeons were trained to discriminate the presence of one or more human forms in displays projected on a panel above the response key. This task was mastered, although imperfectly, with successive and with simultaneous presentations of positive and negative instances. The course of acquisition of the discrimination was similar for the two training procedures. Animals were able to transfer the discrimination from the successive to the simultaneous situation. Various tests were carried out to control for artifactual cues on which the discrimination might have been based. The discrimination was maintained when new displays were presented, when reinforcement was omitted, and when displays were inverted 180°. Animals were also able to discriminate between pairs of displays that were identical, except that one member of the pair contained a human form. The research extends the techniques used by Herrnstein and Loveland (1964), and confirms their finding that pigeons can master the concept of “person-present” in a visual display.     

Information Processing and Decision-Making in Pathological Worriers and their Potential Role in Mechanisms of Generalized Anxiety Disorder

Systematic information processing and decision-making under uncertainty are key constructs of new conceptions explaining the severity of pathological worry. The current study attempted to analyze their usefulness in subclinical and clinical groups. In the first phase of the study (N = 251) participants were examined with the Penn State Worry Questionnaire (PSWQ), a GP consultationrelated survey, and a screening survey for generalized anxiety disorder (GAD). In the second phase (N = 220), the State-Trait Anxiety Inventory, the PSWQ, and tasks measuring systematic information processing (SIP) versus heuristic reasoning (HR) were applied. In the third phase (N = 60), GAD (n = 30) and healthy control (n = 30) groups were examined with the above methods and the Iowa Gambling Task (IGT). In the low risk group, a relationship between mood and the representativeness heuristic (ρ = 0.50), as well as anchoring and adjustment heuristic (anxiety-related stimuli) was found (ρ = −0.53). In the GAD group, significant correlations between the PSWQ score, the IGT loss avoidance score (ρ = 0.40), and total IGT score (ρ = 0.48) were found. The results did not confirm a particular usefulness of the systematic/heuristic information processing construct in subclinical and clinical groups. Theory-consistent results were rather found in the nonclinical groups. Nevertheless, the data revealed some interesting findings supporting potential explanatory power of some theoretical models.     

KNOWING BEFORE DOING: DISCRIMINATION BY RATS OF A BRIEF INTERRUPTION OF A TONE

Eight rats' lever presses were reinforced after an interruption in a tone, provided the lever had not been pressed before the tone interruption. After a few sessions, long before the animals reliably refrained from lever pressing before the interruption, the latencies of postinterruption presses (time from the termination of the interruption to the moment of the lever press) dissociated into two classes: short ones for to-be-rewarded presses, and long ones for presses in the other trials, which contained no reward because one or more lever presses had occurred before the interruption. Thus discrimination of impending reinforcement in the current trial occurred before there was evidence of sensitivity to reinforcement in the reinforcement-producing aspect of behavior. This finding is related to Shimp's (1981) contention that the temporal properties of recent behavior are reinforceable, if remembered. The present finding shows that learning to discriminate whether one's behavior has met a contingency, and learning to carry out this behavior, need not go together, implying that memory of temporal properties is probably a necessary but not a sufficient condition for learning the latter.     

Chronic, severe hypertension does not impair spatial learning and memory in Sprague-Dawley rats

This study tested the hypothesis that long-term hypertension impairs spatial learning and memory in rats. In 6-wk-old Sprague-Dawley rats, chronic hypertension was induced by placing one of three sizes of stainless steel clips around the descending aorta (above the renal artery), resulting in a 20–80-mm Hg increase of arterial pressure in all arteries above the clip, that is, the upper trunk and head. Ten months later, the rats were tested for 5 d in a repeated-acquisition water maze task, and on the fifth day, they were tested in a probe trial; that is, there was no escape platform present. At the end of the testing period, the nonsurgical and sham control groups had similar final escape latencies (16±4 sec and 23±9 sec, respectively) that were not significantly different from those of the three hypertensive groups. Rats with mild hypertension (140–160 mm Hg) had a final escape latency of 25±6 sec, whereas severely hypertensive rats (170–199 mm Hg) had a final escape latency of 21±7 sec and extremely hypertensive rats (>200 Hg) had a final escape latency of 19±5 sec. All five groups also displayed a similar preference for the correct quadrant in the probe trial. Together, these data suggest that sustained, severe hypertension for over 10 mo is not sufficient to impair spatial learning and memory deficits in otherwise normal rats.     

Effects of dl-amphetamine under concurrent VI DRL reinforcement

Three adult, food-deprived rats were given IP injections of dl-amphetamine sulfate under DRL and concurrent VI DRL reinforcement schedules. The drug results were as follows.(1) The IRT distributions of DRL responses shifted to the left, but some temporal discrimination remained. (2) The IRT distributions of VI responses shifted slightly to the left. (3) The distinguishing characteristics of VI and DRL IRT distributions were preserved. (4) The frequency distribution of number of VI responses between two consecutive DRL responses was relatively unaffected. (5) Over-all response rates on the two components of the concurrent schedules increased more or less proportionately.These findings imply that the primary behavioral effect of dl-amphetamine was a motor excitatory one. The drug's disruption of timing behavior was not due to a derangement of internal timing mechanisms, nor to interference with the topography or pattern of behavior. Rather, it might be a secondary result of the accelerated emission of overt behavior patterns mediating the temporal spacing of DRL bar presses.