Molecular analyses of the effects of d-amphetamine on fixed-interval schedule performances of rats.

A series of doses (0.5 to 2.0 mg/kg) of d-amphetamine was administered to rats whose lever pressing was maintained by fixed-interval 30-s, 60-s, or 120-s schedules of reinforcement by sucrose delivery. Under both saline and d-amphetamine conditions, molecular features of responding were reliably described in terms of the distribution of postreinforcement pauses and local response rate following the onset of responding. Postreinforcement pause always varied from interval to interval but, on average, shortened under the drug. Local response rate (response rate exclusive of pause time) tended to decrease under the drug, and where acceleration occurred within runs of responses, it was reduced by the drug. All of these effects were dose-related. These findings suggest that fixed-interval behavior can be analyzed effectively at a molecular level, and that the effects of d-amphetamine are best described as disruption of temporal discrimination.     

The economics of the law of effect.

A corollary of the law of effect predicts that the larger the reinforcement, the greater the rate of responding. However, an animal must eat more small portions than large portions to obtain the same daily intake, and one would predict, therefore, that when eating smaller portions an efficient animal would eat less (conserving time and energy) and/or respond faster (conserving time). The latter of these predictions was supported by the present experiments with free-feeding rats for which portion size (pellet size or duration of feeder presentation) and portion price within meals were varied. Response rate was a function of the unit price (responses/g) of food: Rats responded faster when portions were smaller or when prices were higher. Meal size and frequency were relatively unaffected by unit price, but were influenced by the price of meal initiation. The results are discussed in relation to the economic differences between traditional operant and free-feeding paradigms and to both traditional and more recent formulations of the law of effect.     

Human concurrent performances: The effects of experience, instructions, and schedule-correlated stimuli

In order to investigate the effects of separate exposures to single schedules, of unique schedule-correlated stimuli, and of independency-informing instructions upon choice under concurrent variable-interval schedules, 28 human subjects were divided into eight groups. Each subject was exposed to a baseline procedure, an experimental procedure, and a return to the baseline procedure. Different combinations of these three manipulations were applied to the different groups only during the experimental phase (except for the independency-informing instructions, which were given to half of the groups at the start of training). For the group of subjects exposed to the combination of all three manipulations, the logarithms of the ratios of response frequencies tended to be linearly related to the logarithms of the ratios of reinforcement frequencies during the experimental phase. These orderly effects were not obtained with subjects in the other groups. The results suggest that human choice was well described by the generalized matching law when the three manipulations were simultaneously in effect, and that unreported differences in the use of these three procedural variables might partly account for contradictions between results in previous studies of human concurrent performance.     

Differential effects of pentobarbital and cocaine on punished and nonpunished responding.

Similar rates of punished and nonpunished responding, maintained with equated rates of reinforcement, were established in pairs of rats. One subject of each pair was exposed to a random-ratio schedule of food presentation. The interreinforcement intervals for this subject comprised the intervals of a random-interval schedule of reinforcement for the other (yoked) rat. The random-ratio schedule maintained rates of responding higher than those maintained by the same rate of reinforcement schedule according to the yoked random-interval contingency. A random-ratio schedule of electric foot shock added to the random-ratio schedule of food presentation suppressed rates of responding such that similar rates of responding were observed in rats of both groups. Pentobarbital (3.0 to 17.0 mg/kg) increased punished responding at doses that had little effect on or decreased nonpunished responding, whereas cocaine (5.6 to 30 mg/kg) increased nonpunished responding at doses that decreased or did not alter punished responding. Qualitatively different effects of pharmacological agents on punished and nonpunished responding can be obtained using procedures that generate similar rates and temporal patterns of punished and nonpunished responding. The effects of pentobarbital and cocaine on responding can be determined by factors other than simply the baseline rate of responding.     

Variable-ratio conditioning history produces high- and low-rate fixed-interval performance in rats

Four rats were exposed to an A-B-A-B series of 30 sessions each of variable-ratio 20 (A) and fixed-interval 30-s (B) schedules. Four other rats received 120 sessions of fixed-interval 30 s. The rats with a history of variable-ratio responding subsequently showed primarily high or low response-rate patterns on the fixed-interval schedule without evidence of classical scalloping (i.e., increased rates of responding throughout the interreinforcement interval), except infrequently in 1 rat. The rats exposed to only the fixed-interval 30-s schedule displayed the expected sequence of scalloping giving way to lower rate break-run or simply low-rate responding over time. This experiment shows that when naive rats are exposed to even a simple history of reinforcement (in this case, a variable-ratio 20), their subsequent fixed-interval performance is very different from comparable performance in naive rats, and might be said to be more similar to the responding of adult humans. The argument is made that care should be taken in comparing the fixed-interval performance of humans and nonhumans because humans have a complex history of reinforcement, whereas laboratory nonhumans are typically naive.     

Positive behavioral contrast across food and alcohol reinforcers.

The present study examined behavioral contrast during concurrent and multiple schedules that provided food and alcohol reinforcers. Concurrent-schedule contrast occurred in the responding reinforced by food when alcohol reinforcers were removed. It also occurred in the responding reinforced by alcohol when food was removed. Multiple-schedule contrast appeared for food when alcohol reinforcers were removed, but not for alcohol when food was removed. These results show that behavioral contrast may, but does not always, occur across qualitatively different reinforcers. They also show that multiple-schedule contrast may be more difficult to produce than concurrent-schedule contrast. The results have implications for a model of alcohol consumption.     

Concurrent variable-ratio schedules: Implications for the generalized matching law

Rats' responses were reinforced on concurrent variable-ratio variable-ratio schedules in which responses on one lever incremented the ratio counter and responses on a second lever changed the schedule and correlated stimulus. The relative frequency of reinforcement was varied from .10 to .99. In one set of conditions, responding on the main lever incremented both ratio counters, but reinforcement required a response in the presence of the stimulus correlated with the ratio that had been completed. In a second set of conditions, responses on the main lever incremented only the ratio correlated with the stimulus that was currently present. When main-lever responses incremented both ratio counters, subjects distributed responding and time in a manner consistent with the generalized matching law. When responses on the main lever incremented only the schedule currently in effect, the rats responded almost exclusively on the schedule producing the higher frequency of reinforcement. These results extend the applicability of the generalized matching law to dependent ratio schedules.     

Remote effects of aversive contingencies: Disruption of appetitive behavior by adjacent avoidance sessions

Disruption of ongoing appetitive behavior before and after daily avoidance sessions was examined. After baselines of appetitive responding were established under a fixed-interval 180-s schedule of food presentation, 4 rats were exposed to 40-min sessions of the appetitive schedule just prior to 100-min sessions of electric shock postponement, while another 4 rats received the 40-min appetitive sessions just following daily sessions of shock postponement. In all 8 subjects, fixed-interval response rates decreased relative to baseline levels, the effect being somewhat more pronounced when the avoidance sessions immediately followed. The disruption of fixed-interval responding was only partially reversed when avoidance sessions were discontinued. During the initial exposure to the avoidance sessions, patterns of responding under the fixed-interval schedule were differentially sensitive to disruption, with high baseline response rates generally more disturbed than low rates. These disruptions were not systematically related to changes in reinforcement frequency, which remained fairly high and invariant across all conditions of the experiment; they were also not systematically related to the response rates or to the shock rates of the adjacent avoidance sessions. The results, while qualitatively resembling patterns of conditioned suppression as typically studied, occurred on a greatly expanded time scale. As disruption of behavior extending over time, the present data suggest that some forms of conditioned suppression are perhaps best viewed within a larger temporal context.     

The role of verbal behavior in human learning: II. Developmental differences

When children in four different age ranges operated a response device, reinforcers were presented according to fixed-interval schedules ranging in value from 10 to 70 seconds. Only the behavior of the subjects in the youngest of the four groups, the preverbal infants, resembled that of other animal species. The children in age ranges 5 to 6½ and 7½ to 9 years exhibited either the low-rate or high-rate response patterns typical of human adults. Those who showed the low-rate pattern reported a time-based formulation of the contingencies and some of them were observed to occasionally count out the interval before responding. The performance of children aged 2½ to 4 years differed from that of both infants and older children, though containing some patterning elements similar to those produced by the older and younger subjects. The predominant response pattern of the infants consisted of a pause after reinforcement followed by an accelerated rate of responding that terminated when the next reinforcer was delivered. Analysis of postreinforcement-pause duration and response rate showed that infant performance, but not that of the older children, consistently exhibited the same kinds of schedule sensitivity observed in animal behavior. The evidence supports the suggestion that the development of verbal behavior greatly alters human operant performance and may account for many of the differences found between human and animal learning.     

Within-session changes in key and lever pressing for water during several multiple variable-interval schedules

Rats pressed keys or levers for water reinforcers delivered by several multiple variable-interval schedules. The programmed rate of reinforcement varied from 15 to 240 reinforcers per hour in different conditions. Responding usually increased and then decreased within experimental sessions. As for food reinforcers, the within-session changes in both lever and key pressing were smaller, peaked later, and were more symmetrical around the middle of the session for lower than for higher rates of reinforcement. When schedules provided high rates of reinforcement, some quantitative differences appeared in the within-session changes for lever and key pressing and for food and water. These results imply that basically similar factors produce within-session changes in responding for lever and key pressing and for food and water. The nature of the reinforcer and the choice of response can also influence the quantitative properties of within-session changes at high rates of reinforcement. Finally, the results show that the application of Herrnstein's (1970) equation to rates of responding averaged over the session requires careful consideration.