Undermatching and overmatching: The fixed-ratio changeover requirement

Concurrent variable-interval two-minute and six-minute schedules were arranged while the fixed-ratio changeover requirement was varied among one, two, and four responses. A four-response requirement produced overmatching in the response and time data. A one-response requirement produced consistent undermatching in the time data but mixed results in the response data. The two-response requirement showed undermatching in the time data and overmatching in the response data. The results are discussed in relation to previous research using changeover requirements of five and ten responses, which produced clear tendencies toward overmatching, especially with response data. Taken together, these findings suggest that matching is not a unique result, and that undermatching or overmatching can be produced by continuous variation of the changeover requirements.     

Human self-control and the density of reinforcement

Choice responding in adult humans on a discrete-trial button-pressing task was examined as a function of amount, delay, and overall density (points per unit time) of reinforcement. Reinforcement consisted of points that were exchangeable for money. In T 0 conditions, an impulsive response produced 4 points immediately and a self-control response produced 10 points after a delay of 15 s. In T 15 conditions, a constant delay of 15 s was added to both prereinforcer delays. Postreinforcer delays, which consisted of 15 s added to the end of each impulsive trial, equated trial durations regardless of choice, and was manipulated in both T 0 and T 15 conditions. In all conditions, choice was predicted directly from the relative reinforcement densities of the alternatives. Self-control was observed in all conditions except T 0 without postreinforcer delays, where the impulsive choices produced the higher reinforcement density. These results support previous studies showing that choice is a direct function of the relative reinforcement densities when conditioned (point) reinforcers are used. In contrast, where responding produces intrinsic (immediately consumable) reinforcers, immediacy of reinforcement appears to account for preference when density does not.     

Sequences of spaced responses: Behavioral units and the role of contiguity

Sequences of temporally spaced responses were reinforced to investigate the effects of delay of reinforcement on the formation of functional behavioral units. In Experiment 1, rats' two- and three-response demarcated sequences of left and right lever presses were reinforced such that different response distributions would occur depending on whether the sequences themselves or individual responses were functional units. The matching law could thus be obeyed either by individual responses or by sequences, but not by both; intermediate results were possible. Both regular (nonretractable) and retractable levers were used; the retractable levers precluded the occurrence of insufficiently spaced responses. At a minimum interresponse time of 5 s for regular levers and 7 s for retractable ones, matching results were intermediate, with greater evidence of sequence conditionability in the two-response sequences than in the three-response sequences. In Experiment 2, the required minimum interresponse spacing for two-response retractable-lever sequences was varied in an attempt to locate the sequence matching threshold. This attempt was unsuccessful, but the sequences (instead of individual responses) more closely obeyed the matching law. In the shortest spaced condition, conditional probability data on Lag 1 sequence emission order showed marked, highly similar patterning for all rats, indicating sequential control of the sequences. Post hoc definition of the behavioral unit in these studies is ambiguous. Although reinforcement contiguity was important, aspects of the results could support both molar- and molecular-level interpretations.     

IMPULSIVITY IN STUDENTS WITH SERIOUS EMOTIONAL DISTURBANCE: THE INTERACTIVE EFFECTS OF REINFORCER RATE,DELAY, AND QUALITY

We conducted two studies extending basic matching research on self-control and impulsivity to the investigation of choices of students diagnosed as seriously emotionally disturbed. In Study 1 we examined the interaction between unequal rates of reinforcement and equal versus unequal delays to reinforcer access on performance of concurrently available sets of math problems. The results of a reversal design showed that when delays to reinforcer access were the same for both response alternatives, the time allocated to each was approximately proportional to obtained reinforcement. When the delays to reinforcer access differed between the response alternatives, there was a bias toward the response alternative and schedule with the lower delays, suggesting impulsivity (i.e., immediate reinforcer access overrode the effects of rate of reinforcement). In Study 2 we examined the interactive effects of reinforcer rate, quality, and delay. Conditions involving delayed access to the high-quality reinforcers on the rich schedule (with immediate access to low-quality reinforcers earned on the lean schedule) were alternated with immediate access to low-quality reinforcers on the rich schedule (with delayed access to high-quality reinforcers on the lean schedule) using a reversal design. With 1 student, reinforcer quality overrode the effects of both reinforcer rate and delay to reinforcer access. The other student tended to respond exclusively to the alternative associated with immediate access to reinforcers. The studies demonstrate a methodology based on matching theory for determining influential dimensions of reinforcers governing individuals' choices.     

A cellular analogue of operant conditioning.

Using the hippocampal-slice preparation, we attempted to model operant conditioning in vitro by reinforcing pyramidal cell bursting responses with local micropressure applications of transmitters and drugs. The same injections were administered independently of bursting to provide a "noncontingent" control for direct pharmacological stimulation or facilitation of firing. The results suggested that the bursting responses of individual CA1 pyramidal neurons may be reinforced in a dose-related manner by response-contingent (but not noncontingent) injections of dopamine and the selective dopamine D2 agonist, N-0923. N-0924, a stereoisomer of N-0923 that is largely devoid of D2-agonist activity, failed to reinforce CA1 bursting. Burst-contingent injections of the excitatory neurotransmitter glutamate also failed to reinforce CA1 bursting; indeed, the glutamate applications (whether contingent or random) reduced the likelihood of bursts while increasing the frequency of solitary spikes. Reinforcement delays exceeding 200 ms largely eliminated the reinforcing efficacy of the D2 agonist N-0437 in CA1 operant conditioning. The results are consistent with the suggestion that the behaviorally reinforcing effects of dopaminergic agents can be modeled in vitro in the hippocampal-slice preparation.     

USING TIME DELAY TO PROMOTE SPONTANEOUS SPEECH IN AN AUTISTIC CHILD

One of the frequently observed deficits in autistic children is their lack of spontaneous speech. We used a multiple baseline across behaviors to investigate the effectiveness of a time delay procedure for inducing spontaneous speech in a 10-year-old male autistic child during play. We first taught the child to imitate the experimenter's verbal prompts that described the child's motor response. Once the child reached criteria on imitation, we implemented baseline wherein an immediate verbal prompt for speech was provided after each of the child's motor responses. Intervention consisted of a gradual delay in the presentation of the verbal prompts. The time delay effectively increased the child's spontaneous speech on trained items; some generalization to untrained items also occurred, but only within the same behavioral class of car play. Generalization was also observed across settings. Spontaneous speech remained at high levels during the 4-month maintenance for the behavior of car play but decreased for a second behavior. Decreases in the child's response latencies suggest that spontaneous speech may be an anticipatory verbal response.     

An experimental analysis of the cost of food in a closed economy.

Rats lived in individual chambers in which the only food available was delivered for lever pressing. During Stage I, a fixed number of presses was required for each food pellet. As this fixed ratio of presses per food pellet was increased daily, a rat's daily intake of food was reduced. During Stage II, the cost of a food pellet was increased by replacing each fixed ratio with its interval equivalent. Each interval was a rat's mean time between the first press of a ratio and the delivery of a pellet during Stage I. During Stage II, only two presses were every required for a food pellet: The first press initiated a delay and the second activated the pellet dispenser after that delay elapsed. Food intakes for the series of fixed ratios and a rat's series of delay equivalents were very similar when plotted as a function of delay, but not when plotted as a function of presses per pellet. Consequently, the fixed ratio reduced food intake because larger ratios increased delay to food from the first press of a ratio. Observations and an analysis of interresponse times further revealed that as the fixed ratio increased, and local as well as overall rate of food intake decreased, lever pressing became more stereotyped. Because this increased stereotypy resulted in greatly increased rates of lever pressing, delay to food was minimized, and perhaps more importantly, so too was the reduction of a rat's baseline daily intake.     

ERRORLESS LEARNING: REINFORCEMENT CONTINGENCIES AND STIMULUS CONTROL TRANSFER IN DELAYED PROMPTING

Delayed prompting can produce errorless discrimination learning. There is inherent in the procedure a disparity in reinforcement density which favors unprompted over prompted responses. We used three schedules of reinforcement to investigate the impact of reinforcement probability on transfer of stimulus control. One schedule of reinforcement was equal prior to and following a prompt (CRF/CRF), the second favored unprompted responses (CRF/FR3), and the third favored responses following the prompt (FR3/CRF). Experimental questions concerned the probability of errors, the probability of transfer, and the rate of transfer in the context of delayed prompting. Transfer was accelerated when reinforcement probability favored anticipatory responding. The schedule that favored prompted responses did not prevent a shift to unprompted responding. Errors were infrequent across procedures. Reinforcement probability contributes to but does not entirely determine transfer of stimulus control from a delayed prompt.     

Choice in a self-control paradigm: Quantification of experience-based differences

Previous quantitative models of choice in a self-control paradigm (choice between a larger, more-delayed reinforcer and a smaller, less-delayed reinforcer) have not described individual differences. Two experiments are reported that provide additional quantitative data on experience-based differences in choice between reinforcers of varying sizes and delays. In Experiment 1, seven pigeons in a self-control paradigm were exposed to a fading procedure that increased choices of the larger, more-delayed reinforcer through gradually decreasing the delay to the smaller of two equally delayed reinforcers. Three control subjects, exposed to each of the small-reinforcer delays to which the experimental subjects were exposed, but for fewer sessions, demonstrated that lengthy exposure to each of the conditions in the fading procedure may be necessary in order for the increase to occur. In Experiment 2, pigeons with and without fading-procedure exposure chose between reinforcers of varying sizes and delays scheduled according to a concurrent variable-interval variable-interval schedule. In both experiments, pigeons with fading-procedure exposure were more sensitive to variations in reinforcer size than reinforcer delay when compared with pigeons without this exposure. The data were described by the generalized matching law when the relative size of its exponents, representing subjects' relative sensitivity to reinforcer size and delay, were grouped according to subjects' experience.     

Choice and number of reinforcers

Pigeons were exposed to the concurrent-chains procedure in two experiments designed to investigate the effects of unequal numbers of reinforcers on choice. In Experiment 1, the pigeons were indifferent between long and short durations of access to variable-interval schedules of equal reinforcement density, but preferred a short high-density terminal link over a longer, lower density terminal link, even though in both sets of comparisons there were many more reinforcers per cycle in the longer terminal link. In Experiment 2, the pigeons preferred five reinforcers, the first of which was available after 30 sec, over a single reinforcer available at 30 sec, but only when the local interval between successive reinforcers was short. The pigeons were indifferent when this local interval was sufficiently long. The pigeons' behavior appeared to be under the control of local terminal-link variables, such as the intervals to the first reinforcer and between successive reinforcers, and was not well described in terms of transformed delays of reinforcement or reductions in average delay to reinforcement.