Second-order schedules of token reinforcement with pigeons: effects of fixed- and variable-ratio exchange schedules

Pigeons' key pecks produced food under second-order schedules of token reinforcement, with light-emitting diodes serving as token reinforcers. In Experiment 1, tokens were earned according to a fixed-ratio 50 schedule and were exchanged for food according to either fixed-ratio or variable-ratio exchange schedules, with schedule type varied across conditions. In Experiment 2, schedule type was varied within sessions using a multiple schedule. In one component, tokens were earned according to a fixed-ratio 50 schedule and exchanged according to a variable-ratio schedule. In the other component, tokens were earned according to a variable-ratio 50 schedule and exchanged according to a fixed-ratio schedule. In both experiments, the number of responses per exchange was varied parametrically across conditions, ranging from 50 to 400 responses. Response rates decreased systematically with increases in the fixed-ratio exchange schedules, but were much less affected by changes in the variable-ratio exchange schedules. Response rates were consistently higher under variable-ratio exchange schedules than tinder comparable fixed-ratio exchange schedules, especially at higher exchange ratios. These response-rate differences were due both to greater pre-ratio pausing and to lower local rates tinder the fixed-ratio exchange schedules. Local response rates increased with proximity to food under the higher fixed-ratio exchange schedules, indicative of discriminative control by the tokens.     

Drug discrimination under a concurrent fixed-ratio fixed-ratio schedule.

Pigeons were trained to discriminate 5.0 mg/kg pentobarbital from saline under a two-key concurrent fixed-ratio 10 fixed-ratio 40 schedule of food presentation, in which the fixed-ratio component with the lower response requirement was programmed to reinforce responding on one key after drug administration (pentobarbital-biased key) and on the other key after saline administration (saline-biased key). After responding stabilized, pigeons averaged 98% of their responses on the pentobarbital-biased key during training sessions preceded by pentobarbital, and they averaged 90% of their responses on the saline-biased key during training sessions preceded by saline. In test sessions preceded by doses of pentobarbital, chlordiazepoxide, or ethanol, pigeons switched from responding on the saline-biased key at low doses to responding on the pentobarbital-biased key at higher doses (the dose-response curve was quantal). High doses of phencyclidine produced responding on both keys, whereas pigeons responded almost exclusively on the saline-biased key after all doses of methamphetamine. These and previous experiments using concurrent reinforcement schedules to study drug discrimination illustrate that the schedule of reinforcement is an important determinant of the shape of dose-effect curves in drug-discrimination experiments.     

Food and cocaine self-administration by baboons: effects of alternatives.

The effects of the availability of an alternative reinforcer on responding maintained by food pellets or drug solutions were examined in 8 adult male baboons (Papio hamadrayas anubis). During daily 23-hr experimental sessions, baboons had access to both food pellets and fluid under a two-choice procedure, in which the response requirement, under a fixed-ratio schedule, differed for the two commodities. There were no restrictions on access to water, which was continuously available from a spout at the rear of each cage. In Experiment 1, the fixed-ratio requirement, or cost, for fluid delivery remained constant while the fixed-ratio requirement for pellets was changed every 2 or 3 days when (a) no fluid, (b) a dilute dextrose vehicle, (c) 0.008 mg/kg per delivery cocaine, (d) 0.016 mg/kg per delivery cocaine, or (e) 0.032 mg/kg per delivery cocaine was available concurrently. In Experiment 1, progressively increasing the response requirement for pellets decreased pellet intake, but for 4 baboons pellet intake at maximum pellet cost was lower when cocaine, compared to the vehicle, was available. Increasing the response requirement for pellets had variable effects on vehicle intake. However, increasing the response requirement for pellets increased intake of at least one dose of cocaine to a greater extent than vehicle in all 8 baboons. Thus, cocaine could be considered a more effective economic substitute than vehicle for pellets. Experiment 2 systematically varied the order in which the response requirements for a pellet delivery were presented and added a control condition in which cocaine doses, yoked to the amount self-administered, were given three times during the session by the experimenter. Again, pellet intake at maximal pellet cost was lower when cocaine, compared to the vehicle, was available. In contrast, experimenter-given cocaine doses did not alter responding maintained by pellets. Thus, the effects of self-administered cocaine on responding maintained by food pellets differed from the effects of experimenter-given cocaine on responding maintained by food pellets.     

The role of the response-reinforcer relation in delay-of-reinforcement effects

The role of the response-reinforcer relation in maintaining operant behavior under conditions of delayed reinforcement was investigated by using a two-operandum (i.e., two-key) procedure with pigeons. Responding on one key was reinforced under a tandem variable-interval differential-reinforcement-of-other-behavior (tandem VI DRO) schedule. The schedule defined a resetting unsignaled delay-of-reinforcement procedure in that a response was required when the interfood interval of the VI schedule lapsed, but further responding during the DRO component on either key reset the time interval. This ensured a fixed delay duration between any response and reinforcement. Responding on another key, physically identical to the first one except for spatial location, otherwise was without consequence. The location of the key correlated with the delay-of-reinforcement procedure varied between sessions according to a semirandom sequence. Differences in response rates between the two keys were greater, with proportionally higher rates on the key correlated with the delay-of-reinforcement procedure, the longer the delay-of-reinforcement procedure remained correlated with the same key. Differences in responding on the two keys also increased within individual sessions. These results suggest that the response-reinforcer relation is the primary determinant of responding when responding is acquired and maintained with delayed reinforcement.     

Preference after training with differential changeover delays

Pigeons were trained on a multiple schedule in which each component consisted of concurrent variable-interval (VI) 30-s VI 60-s schedules. The two components of the multiple schedule differed only in terms of the changeover delays (COD): For one component short CODs were employed, and in the second component long CODs were used. After approximate matching was obtained in each component, probe tests involving new combinations of stimuli were presented (e.g., the VI 30-s schedule from each component) to determine how the different CODs affected preference. Despite shorter CODs producing higher changeover rates, the COD value had no systematic effect on preference on the probe trials. However, differences in reinforcement rate always produced preference for the schedule with the higher reinforcement rate. The results thus show that the the pattern of changeover behavior per se is not a critical determinant of choice in the probe-trial procedure.     

A local model of concurrent performance

Concurrent procedures may be conceptualized as consisting of two pairs of schedules with only one pair operating at a time. One schedule of each pair arranges reinforcers for staying in the current alternative, and the other schedule arranges reinforcers for switching to the other alternative. These pairs alternate operation as the animal switches between choices. This analysis of the contingencies suggests that variables operating within an alternative produce behavior that conforms to the generalized matching law. Rats were exposed to one pair of stay and switch schedules in each condition, and the probabilities of reinforcement varied across conditions. Both run length and visit duration were power functions of the ratio of the probabilities of reinforcement for staying and switching. The local model, a model of performance on concurrent procedures, was derived from this power function. Performance on concurrent schedules was synthesized from the performances on the separate pairs. Both the generalized matching law and the local model fitted the synthesized concurrent performances. These results are consistent with the view that the contingencies in the alternative, the probability of stay and switch reinforcement, are responsible for performance consistent with the generalized matching law. These results are compatible with momentary maximizing and molar maximizing accounts of concurrent performance. Models of concurrent performance that posit comparisons among the alternatives are not easily applied to these results.     

A COMPARISON OF THE EFFECTS OF BRIEF RULES, A TIMER, AND PREFERRED TOYS ON SELF-CONTROL

Some children make impulsive choices (i.e., choose a small but immediate reinforcer over a large but delayed reinforcer). Previous research has shown that delay fading, providing an alternative activity during the delay, teaching participants to repeat a rule during the delay, combining delay fading with an alternative activity, and combining delay fading with a countdown timer are effective for increasing self‐control (i.e., choosing the large but delayed reinforcer over the small but immediate reinforcer). The purpose of the current study was to compare the effects of various interventions in the absence of delay fading (i.e., providing brief rules, providing a countdown timer during the delay, or providing preferred toys during the delay) on self‐control. Results suggested that providing brief rules or a countdown timer during the delay was ineffective for enhancing self‐control. However, providing preferred toys during the delay effectively enhanced self‐control.     

Further analysis of variables that affect self-control with aversive events

The purpose of this study was to examine variables that affect self-control in the context of academic task completion by elementary school children with autism. In the baseline assessment of Study 1, mathematics problem completion was shown to be an aversive event, and sensitivity to task magnitude, task difficulty, and delay to task completion were measured. The effects of manipulating values of those parameters on self-control then were assessed. For all participants, self-control increased as a function of one or more changes in task parameter values. In Study 2, the effects of a commitment response on self-control was assessed. Results indicated that for all participants, levels of self-control were higher when the opportunity to commit to the immediate aversive event was available.     

RELATIONS AMONG ACUTE AND CHRONIC NICOTINE ADMINISTRATION,SHORT-TERM MEMORY,AND TACTICS OF DATA ANALYSIS

Emerging evidence suggests that nicotine may enhance short‐term memory. Some of this evidence comes from nonhuman primate research using a procedure called delayed matching‐to‐sample, wherein the monkey is trained to select a comparison stimulus that matches some physical property of a previously presented sample stimulus. Delays between sample stimulus offset and comparison stimuli onset are manipulated and accuracy is measured. The present research attempted to systematically replicate these enhancement effects with pigeons. In addition, the effects of nicotine were assessed under another, more dynamic, memory task called titrating‐delay matching‐to‐sample. In this procedure, the delay between sample offset and comparison onset adjusts as a function of the subject's performance. Correct matches increase the delay, mismatches decrease the delay, and titrated delay values serve as the primary dependent measure. Both studies examined nicotine's effects under acute and chronic administration. Neither provided clear or compelling evidence of memory enhancement following nicotine administration despite reliable and systematic dose‐related changes in response latency measures. A modest dose‐related effect on accuracy was found, but the magnitude of the effect appears to be directly related to tactics of data analysis involving best‐dose analyses of a very circumscribed subset of trial types.     

EFFECTS OF A SIGNALED DELAY TO REINFORCEMENT IN THE PREVIOUS AND UPCOMING RATIOS ON BETWEEN-RATIO PAUSING IN FIXED-RATIO SCHEDULES

Domestic hens responded under multiple fixed‐ratio fixed‐ratio schedules with equal fixed ratios. One component provided immediate reinforcement and the other provided reinforcement after a delay, signaled by the offset of the key light. The components were presented quasirandomly so that all four possible transitions occurred in each session. The delay was varied over 0, 4, 8, 16, and 32 s with fixed‐ratio 5 schedules, and over 0, 8 and 32 s with fixed‐ratio 1, 15 and 40 schedules. Main effects of fixed‐ratio value and delay duration were detected on between‐ratio pauses. Pauses were longer when the multiple‐schedule stimulus correlated with a delayed‐reinforcer component was presented, with the longest pauses occurring at the transition from a component with an immediate reinforcer to one with a delayed reinforcer. Pause durations were shortest during immediate components. Overall, both the presence or absence of a delay in the upcoming component, and the presence or absence of a delay in the preceding component affected pause length, but the upcoming delay had the larger effect. Thus changes in delay had similar effects to past reports of the effects of changes in response force, response requirement, and reinforcer magnitude in multiple fixed‐ratio fixed‐ratio schedules.