Self-control: teaching tolerance for delay in impulsive children.

We investigated a procedure to increase the selection of larger, more delayed reinforcers (i.e., more advantageous in the long run) over smaller immediate reinforcers, in an effort to increase a key aspect of self-control in children. Six preschoolers, including one comparison subject, identified by their teachers as impulsive, were preassessed and found consistently to select smaller immediate reinforcers over larger, more delayed ones. The teaching procedure consisted of gradually increasing the durations of the delay interval over many sessions. The follow-up assessments showed that 5 of these children increased the proportion of their choices of the delayed reinforcers. Before training, indifference points ranged from 1.7 to 51.7 s; following treatment, points rose to a range of 37.5 to at least 90 s, with 3 children preferring the larger reinforcer at all delay intervals tested. The results demonstrated the feasibility of teaching young children to make choices more advantageous to them in the long run.     

Self-instruction: An analysis of the differential effects of instruction and reinforcement

This study investigated the impact of training 9 first- and second-grade children to use a full self-instructional regimen, and then differentially reinforced the use of self-instruction only, accuracy only, or both self-instruction and accuracy. Three comparison children received no training in self-instruction and were reinforced for accuracy only. Children improved dramatically in academic accuracy subsequent to self-instructional training, independent of the use of self-instruction and of the specific behavior consequated. Children who were reinforced for using self-instruction did use self-instruction, and those who were not, did not. Comparison group children showed little improvement until training in problem-solving strategies was given after 9 days of reinforcement for accuracy. Self-instructional training is discussed as one type of event that increases the likelihood of accurate performance. Its effectiveness may be explained in terms of a teaching strategy rather than in terms of modifying cognitive processes.     

Effects of body weight on discriminative-stimulus control by phencyclidine in the pigeon.

Using a color-tracking procedure with responses reinforced under a second-order schedule, the discriminative-stimulus properties of phencyclidine were studied in pigeons maintained at 70%, 80%, or 90% of their free-feeding weights. The generalization curves for phencyclidine were similar at all three body weights. Generalization curves for pentobarbital, d-amphetamine, and saline were also unrelated to body weight. These data suggest that food deprivation may not influence the discriminative-stimulus properties of drugs in the way that it influences the reinforcing-stimulus properties of drugs. The reason may be that during discrimination training interoceptive stimuli resulting from food deprivation do not become conditioned to the stimulus properties of the drug, because the food-deprivation stimuli are paired equally often with the presence and absence of drug stimuli.     

Brief exposure to contingent reinforcement produces a sustained increment in the strength of an elicited response.

Squirrel monkeys' lever pressing produced by response-independent shock was measured before, and for an extended period following, exposure to a shock-avoidance procedure. Following avoidance training, the frequency of responding increased by multiples of 10 to 50 across subjects and evidence little or no decrement for up to 6 months of postreinforcement testing. Manual responding produced by intense environmental stimulation may be substantially strengthened by a brief history of reinforcement, such that it is sustained over long periods without reinforcement.     

A comparison of delays and ratio requirements in self-control choice.

In a discrete-trial procedure, pigeons could choose between 2-s and 6-s access to grain by making a single key peck. In Phase 1, the pigeons obtained both reinforcers by responding on fixed-ratio schedules. In Phase 2, they received both reinforcers after simple delays, arranged by fixed-time schedules, during which no responses were required. In Phase 3, the 2-s reinforcer was available through a fixed-time schedule and the 6-s reinforcer was available through a fixed-ratio schedule. In all conditions, the size of the delay or ratio leading to the 6-s reinforcer was systematically increased or decreased several times each session, permitting estimation of an "indifference point," the schedule size at which a subject chose each alternative equally often. By varying the size of the schedule for the 2-s reinforcer across conditions, several such indifference points were obtained from both fixed-time conditions and fixed-ratio conditions. The resulting "indifference curves" from fixed-time conditions and from fixed-ratio conditions were similar in shape, and they suggested that a hyperbolic equation describes the relation between ratio size and reinforcement value as well as the relation between reinforcer delay and its reinforcement value. The results from Phase 3 showed that subjects chose fixed-time schedules over fixed-ratio schedules that generated the same average times between a choice response and reinforcement.     

Reinforcement probability and ordinal position of response in fixed-interval schedules

Four rats pressed levers and received food pellets under fixed-interval reinforcement schedules of 20, 60, and 180 seconds. The number of responses in each interval was recorded. From these data, the probability of reinforcement was determined as a function of response count. These functions were generally increasing. This finding is consistent with previous suggestions that increasing response rates within fixed intervals may be a function of response count in addition to or instead of elapsed or remaining time.     

A pellet feeder for the birds

An alternative means of delivering food to pigeons in operant conditioning research is described. The feeder allows greater control of the amount of food delivered and reduces the amount of time necessary for the pigeon to collect the food. It is possible to extend the length of experimental sessions due to the reduction of food intake. Data obtained using the pellet feeder indicated that the control of responding is comparable to that observed with the standard grain-magazine feeder.     

Choice: Effects of changeover schedules on concurrent performance

The components of concurrent schedules were separated temporally by placing interval schedules on the changeover key. The rates of responding on both the main and changeover keys were examined as a function of the reinforcement rates. In the first experiment, the sensitivity of main-key performance to changing reinforcement rates was inversely related to the temporal separation of components, and changeover performance was monotonically related to the ratio of the reinforcement rates. In the second experiment, when the ratio of the reinforcement rates was scheduled to remain constant while the frequency of reinforcement was varied, changeover performance did not remain constant. A “sampling” interpretation of changeover responding was proposed and subsequently tested in a third experiment where extinction was always scheduled in one component and the frequency of reinforcement was varied in the second component. It was concluded that changeover performance can be interpreted using molar measures of reinforcement and that animals sample activities available to them at rates which are controlled by relative reinforcement rates.     

Transfer of matching performance in pigeons.

Three pigeons were given extensive training on three-key simultaneous matching problems using geometric-form and hue stimuli. After acquisition of matching, the birds were tested with pairs of stimuli involving one or both novel members. Matching during the test stimuli occurred less often than during the later stages of the acquisition phase, but more often than would occur if no transfer had taken place. Greater positive transfer was observed for problems that involved one, rather than two, novel stimuli. In the second phase of the experiment, previously trained birds were shifted to problems that required symbolic matching, i.e., the pigeons had to associate a particular center-key stimulus with a particular side-key stimulus. On each trial, one of two simuli was presented on the center key, and two other stimuli, different from those used on the center key, were displayed on the side keys. When the problem shift was introduced, correct responding was impaired, but remained considerably above chance level and quickly recovered in following sessions. The results were interpreted as favoring a stimulus-response-chaining account of matching behavior.