Concurrent-schedule performance in dairy cows: persistent undermatching.

Performance of dairy cows responding under concurrent variable-interval variable-interval schedules of food delivery was examined, with results analyzed in terms of the generalized matching equation. In Experiment 1, bias measures indicated that crushed barley was preferred over meatmeal when these foods were available under the alternative schedules. For whole-session data, substantial undermatching of response and time-allocation ratios to obtained reinforcement ratios was evident. Postreinforcement pause time ratios approximately matched obtained reinforcement rates. Subtracting these times from total time-allocation values yielded net time-allocation ratios that undermatched obtained reinforcement ratios to a greater degree than did whole-session time-allocation ratios. In Experiment 2, substantial undermatching was evident when the same foods (hay for 2 cows, crushed barley for 2 others) were available under the alternative schedules. Food-related activities and other defined behavior not related to food were quantified by direct observation, and were found to occupy a substantial proportion (roughly 40% to 80%) of experimental sessions. Subtracting the time spent in these activities from the time allocated to each component schedule did not reduce the degree of undermatching obtained. Across all conditions in both experiments, slopes of regression lines relating behavioral outputs to environmental inputs characteristically were below 0.6, which agrees with prior findings and suggests that, contrary to suggestions in the literature, undermatching in dairy cows is not the result of using different foods under alternative schedules or differential pausing under those schedules.     

Representing within-session response rates proportionally and entirely.

In this technical article, methods for collecting and representing response rates maintained by schedules of reinforcement are presented. First, the time in a session that each important event (e.g., responses, reinforcers) occurs is collected and stored by a computer. Another computer program is used, then, to convert each response to a percentage of the total responses in a session and to plot these percentages cumulatively as a function of the time in the session that they occurred. In this manner, response rates may be expressed proportionally (i.e., using the same y-axis scale regardless of absolute response rate) without requiring the arbitrary selection of an interval over which responses are aggregated and expressed relative to the entire-session rate. A property of these records is that deviations in the slope of the obtained record from the diagonal, which connects (x, y) = (start of session, 0%) to (x, y) = (end of session, 100%), occurring at any point and for any duration, represent changes in the local response rate from the entire-session rate. This method of representing ongoing responding is illustrated by several records of key pecking of a pigeon on a variable-interval 60-s schedule of food reinforcement. Relative local response rates were also computed from these data at several levels of resolution (i.e., the time over which responses were aggregated), including the level typically employed by those interested in within-session changes in response rates.     

Brief-stimulus presentations on multiform tandem schedules

Three experiments examined the influence of a brief stimulus (a light) on the behavior of food-deprived rats whose lever pressing on tandem schedules comprising components of different schedule types resulted in food presentation. In Experiment 1, either a tandem variable-ratio variable-interval or a tandem variable-interval variable-ratio schedule was used. The variable-interval requirement in the tandem variable-ratio variable-interval schedule was yoked to the time taken to complete the variable-ratio component in the tandem variable-interval variable-ratio schedule, and the length of the variable-interval component in the latter schedule was yoked to the variable-ratio component in the former schedule. If a brief stimulus occurred following completion of the first component, then behavior was differentiated in the two components; subjects responded more quickly in the variable-ratio than in the variable-interval component. If the stimulus was removed, then response rate was determined by the nature of the final component. Similar results were obtained in Experiments 2 and 3 with the use of a three-component tandem variable-ratio variable-interval variable-ratio schedule or tandem variable-interval variable-ratio variable-interval schedule. Thus, a brief stimulus that was not explicitly paired with reinforcement engendered behavior typical of the component schedule preceding its presentation.     

Precurrent contingencies: Behavior reinforced by altering reinforcement probability for other behavior

The present study explored the effects of a precurrent contingency in which one (precurrent) activity increased the reinforcement probability for another (current) activity. Four human subjects responded on a two-key computer mouse. Each right-key press was reinforced (points exchangeable for money) with .02 probability. In one condition (no precurrent contingency), pressing the left key had no scheduled consequence; in another condition (precurrent contingency), pressing the left key increased the reinforcement probability for right-key responding to .08 for 15 s. Initial exposure to the precurrent contingency resulted in acquisition of precurrent left-key responding for 3 subjects, but for the 4th subject a special contingency was required. Right-key responding occurred at a high stable rate across the conditions. Changeovers to left-key responding dropped to near zero when the precurrent contingency was absent and were maintained at enhanced levels when the precurrent contingency was present. Contacts with the left key consisted of short response runs. Right-key responses were more frequently emitted within 15 s of a left-key response when the precurrent contingency was present, an efficient adaptation to the contingency. Continued research on precurrent behavior may produce insights into complex phenomena such as autoclitics and self-control.     

Response-rate differences in variable-interval and variable-ratio schedules: An old problem revisited

In Experiment 1, a variable-ratio 10 schedule became, successively, a variable-interval schedule with only the minimum interreinforcement intervals yoked to the variable ratio, or a variable-interval schedule with both interreinforcement intervals and reinforced interresponse times yoked to the variable ratio. Response rates in the variable-interval schedule with both interreinforcement interval and reinforced interresponse time yoking fell between the higher rates maintained by the variable-ratio schedule and the lower rates maintained by the variable-interval schedule with only interreinforcement interval yoking. In Experiment 2, a tandem variable-interval 15-s variable-ratio 5 schedule became a yoked tandem variable-ratio 5 variable-interval x-s schedule, and a tandem variable-interval 30-s variable-ratio 10 schedule became a yoked tandem variable-ratio 10 variable-interval x-s schedule. In the yoked tandem schedules, the minimum interreinforcement intervals in the variable-interval components were those that equated overall interreinforcement times in the two phases. Response rates did not decline in the yoked schedules even when the reinforced interresponse times became longer. Experiment 1 suggests that both reinforced interresponse times and response rate–reinforcement rate correlations determine response-rate differences in variable-ratio 10 and yoked variable-interval schedules in rats. Experiment 2 suggests a minimal role for the reinforced interresponse time in determining response rates on tandem variable-interval 30-s variable-ratio 10 and yoked tandem variable-ratio 10 variable-interval x-s schedules in rats.     

Effects of reinforcement history on responding under progressive-ratio schedules of reinforcement.

The effects of experimental history on responding under a progressive-ratio schedule of reinforcement were examined. Sixteen pigeons were divided into four equal groups. Groups 1 to 3 were trained to peck a key for food under a fixed-ratio, variable-ratio, or differential-reinforcement-of-low-rate schedule of reinforcement. After training, these pigeons were shifted to a progressive-ratio schedule, later were shifted back to their original schedule (with decreased rates of reinforcement), and finally were returned to the progressive-ratio schedule. Pigeons in Group 4 (control) were maintained on the progressive-ratio schedule for the entire experiment. To test for potential "latent history" effects, pigeons responding under the progressive-ratio schedule were injected with d-amphetamine and given behavioral-momentum tests of prefeeding and extinction. Experimental histories affected responding in the immediate transition to the progressive-ratio schedule; response rates of pigeons with variable-ratio and fixed-ratio histories were higher than rates of pigeons with differential-reinforcement-of-low-rate and progressive-ratio-only histories. Pigeons with differential-reinforcement-of-low-rate histories, and to a lesser degree pigeons with variable-ratio and fixed-ratio histories, also had shorter postreinforcement pauses than pigeons with only a progressive-ratio history. No consistent long-term effects of prior contingencies on responding under the progressive-ratio schedule were evident. d-Amphetamine and resistance-to-change tests failed to reveal consistent latent history effects. The data suggest that history effects are sometimes transitory and not susceptible to latent influences.     

Instructional versus schedule control of humans' choices in situations of diminishing returns

Four adult humans chose repeatedly between a fixed-time schedule (of points later exchangeable for money) and a progressive-time schedule that began at 0 s and increased by a fixed number of seconds with each point delivered by that schedule. Each point delivered by the fixed-time schedule reset the requirements of the progressive-time schedule to its minimum value. Subjects were provided with instructions that specified a particular sequence of choices. Under the initial conditions, the instructions accurately specified the optimal choice sequence. Thus, control by instructions and optimal control by the programmed contingencies both supported the same performance. To distinguish the effects of instructions from schedule sensitivity, the correspondence between the instructed and optimal choice patterns was gradually altered across conditions by varying the step size of the progressive-time schedule while maintaining the same instructions. Step size was manipulated, typically in 1-s units, first in an ascending and then in a descending sequence of conditions. Instructions quickly established control in all 4 subjects but, by narrowing the range of choice patterns, they reduced subsequent sensitivity to schedule changes. Instructional control was maintained across the ascending sequence of progressive-time values for each subject, but eventually diminished, giving way to more schedule-appropriate patterns. The transition from instruction-appropriate to schedule-appropriate behavior was characterized by an increase in the variability of choice patterns and local increases in point density. On the descending sequence of progressive-time values, behavior appeared to be schedule sensitive, sometimes even optimally sensitive, but it did not always change systematically with the contingencies, suggesting the involvement of other factors.     

How to teach a pigeon to maximize overall reinforcement rate

In two experiments deviations from matching earned higher overall reinforcement rates than did matching. In Experiment 1 response proportions were calculated over a 360-response moving average, updated with each response. Response proportions that differed from the nominal reinforcement proportions, by a criterion that was gradually increased, were eligible for reinforcement. Response proportions that did not differ from matching were not eligible for reinforcement. When the deviation requirement was relatively small, the contingency proved to be effective. However, there was a limit as to how far response proportions could be pushed from matching. Consequently, when the deviation requirement was large, overall reinforcement rate decreased and pecking was eventually extinguished. In Experiment 2 a discriminative stimulus was added to the procedure. The houselight was correlated with the relationship between response proportions and the nominal (programmed) reinforcement proportions. When the difference between response and reinforcement proportions met the deviation requirement, the light was white and responses were eligible for reinforcement. When the difference between response and reinforcement proportions failed to exceed the deviation requirement, the light was blue and responses were not eligible for reinforcement. With the addition of the light, it proved to be possible to shape deviations from matching without any apparent limit. Thus, in Experiment 2 overall reinforcement rate predicted choice proportions and relative reinforcement rate did not. In contrast, in previous experiments on the relationship between matching and overall reinforcement maximization, relative reinforcement rate was usually the better predictor of responding. The results show that whether overall or relative reinforcement rate better predicts choice proportions may in part be determined by stimulus conditions.     

Normalized demand for drugs and other reinforcers.

The concepts of behavioral economics have proven to be useful for understanding the environmental control of overall levels of responding for a variety of commodities, including reinforcement by drug self-administration. These general concepts have implications for the assessment of abuse liability and drug abuse intervention and the formulation of public policy on drug abuse. An essential requirement is the ability to compare the demand for different drugs directly in order to assess relative abuse liability, and to compare demand for the same drug under different environmental and biological interventions to assess their ability to reduce demand. Until now, such comparisons were hampered by the confounding effect of varying drug doses and potencies that prevent quantitative comparisons of demand elasticity--sensitivity of consumption and responding to the constraint of price (effort). In this paper we describe a procedure to normalize demand-curve analysis that permits dose- and potency-independent comparisons of demand across drugs. The procedure is shown to be effective for comparing drug demand within and across the drug classes. The technique permits a quantitative ordering of demand that is consistent with the peak levels of responding maintained by the drugs. The same technique is generalized for the comparison of other types of reinforcers under different biological conditions.