RESPONSE REDUCTION THROUGH THE SUPERIMPOSITION OF CONTINUOUS REINFORCEMENT: A SYSTEMATIC REPLICATION

Prior clinical research suggests that superimposition and subsequent removal of a schedule of continuous reinforcement (CRF) may be a viable rate-decreasing procedure in that an extinction-like condition is arranged. The arrangement of similar conditions in the laboratory, however, resulted in the quick recovery of baseline rates. Lever-pressing patterns of eight male rats maintained by different schedules of variable-ratio and variable-interval food reinforcement were examined in an A-B-A experimental design of CRF food superimposition and removal. Responding was substantially reduced during the superimposition of CRF. Upon removal of the superimposed schedule, responding quickly approached presuperimposition baseline rates.     

An inverse relationship between baseline fixed-interval response rate and the effects of a tandem response requirement.

Previous experiments examining the effects of adding a tandem fixed-ratio response requirement on fixed-interval schedule performance have reported inconsistent results. One variable that may account for such inconsistencies is the baseline response rate in the fixed-interval condition. This possibility was investigated in the present study. Rats were given histories with either interresponse times greater than 11 s or fixed-ratio 40 schedules of reinforcement, which engendered either relatively low or high rates of responding, respectively, in the subsequent fixed-interval condition. A tandem ratio response requirement (fixed-ratio 9) was then introduced. The effects of adding this tandem response requirement were inversely related to the baseline fixed-interval response rates; low rates of responding in the fixed-interval condition were markedly increased, whereas high rates of responding were relatively unaffected. This inverse relationship appears to be similar to the rate-dependent relations observed in behavioral pharmacology. These results may provide an explanation for the inconsistent findings reported in previous studies on tandem fixed-interval fixed-ratio schedules and suggest that principles of behavioral pharmacology research may be applicable to the study of the effects of nonpharmacological variables on schedule-controlled behavior.     

Sequential effects of interval duration on fixed-interval performance

The bar pressing of rats was reinforced on a multiple fixed-interval schedule. The schedule intervals were 1 and 5 min long, and the sequence was such that intervals of either duration were equally likely to be followed by intervals of the same or of the other duration. Rates were higher during 1-min and after 5-min intervals. Best fit equations for cumulative responses during the 5-min intervals produced very similar exponents regardless of preceding duration. It was concluded that preceding duration may have affected the subjects' performances through direct effects on temporal discrimination.     

Psychological distance to reward: A human replication

Choice behavior in college students was examined in two experiments using the concurrent-chains procedure. In both experiments, the concurrent chains were presented on a microcomputer in the form of an air-defense game in which subjects used two radar systems to detect and subsequently destroy enemy aircraft. Access to one of two radar systems was controlled by a pair of independent concurrent variable-interval 60-s schedules with a 4-s changeover delay always in effect. In the terminal link, the appearance of an enemy aircraft was determined by a pair of differentially segmented fixed-time schedules (Experiment 1) or fixed-interval schedules (Experiment 2) of equal overall duration. In Experiment 1, the terminal-link duration was either 20 s or 40 s, and subjects preferred the unsegmented to the segmented intervals. In Experiment 2, the duration was either 10 s or 60 s, and the reinforcement contingencies required responding during the terminal link. Prior to the reinstatement of the initial link, subjects estimated the duration of the terminal-link schedule. Segmentation affected choice in the 60-s conditions but not in the 10-s ones. Preference for the unsegmented schedule was correlated with an overestimation of the durations for the segmented schedules. These results replicated those found in animal experiments and support the notion of increasing the psychological distance to reward by segmenting a time-based schedule of reinforcement.     

Matching, maximizing, and the behavioral unit: concurrent reinforcement of response sequences.

Pigeons pecked two keys in a probability matching situation in which four two-peck sequences were intermittently reinforced: left-left, left-right, right-left and right-right. In Phase 1, relative reinforcement rate was varied with respect to the first response of a sequence: reinforcers were differentially assigned for left-left and left-right sequences as opposed to right-left and right-right sequences. The second response of reinforced sequences occurred equally on the left and right keys across conditions. In Phase II, relative reinforcement rate was varied for sequences that involve an alternation as opposed to those that did not. The relative outputs of the different sequences matched the relative reinforcement rates for the different sequences in both phases. Relative response rates for key pecks did not always match relative reinforcement rates. The intertrial interval separating responses was varied in both phases; increases in the intertrial interval affected the relative frequency of different sequences. The results demonstrate that response sequences acted as functional units influencing choice and thus support a structural account of choice. At the same time, the matching of relative sequence proportion and relative reinforcement rate supports a matching account.     

Preference for unsegmented interreinforcement intervals in concurrent chains

Five pigeons were trained under concurrent-chain schedules in which a pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link and either both variable-interval or both fixed-interval schedules were presented in the terminal link. Except for the baseline, one of the terminal-link schedules was always a two-component chained schedule and the other was either a simple or a tandem schedule of equal mean interreinforcement interval. The values of the fixed-interval schedules were either 15 s or 60 s; that of the variable-interval schedules was always 60 s. A 1.5-s changeover delay operated during the initial link in some conditions. The pigeons preferred a simple or a tandem schedule to a chain. For the fixed-interval schedules, this preference was greater when the fixed interval was 60 s than when it was 15 s. For the variable-interval schedules, the preferences were less pronounced and occurred only when the changeover delay was in effect. For a given type of schedule and interreinforcement interval, similar preferences were obtained whether the nonchained schedule was a tandem or simple schedule. The changeover delay generally inflated preference and lowered the changeover rate, especially when the terminal-link schedules were either short (15 s) or aperiodic (variable-interval). The results were consistent with the notion that segmenting the interreinforcement interval of a schedule into a chain lowers the preference for it.     

Time-related processes in time-based prospective memory and in time-interval production

Time-based prospective memory tasks require the retrieval of previously formed plans (e.g., call me on my mobile phone) either at a specified time (e.g., at 3 p.m.) or after a specified period of time has elapsed (e.g., in 3 min). In the present study, we investigated whether the same time-related processes are recruited for a short-duration time-based prospective memory task and for a time-interval production task. In a dual-task paradigm, we required young adult participants to make category-membership decisions, while they were simultaneously engaged either in a time-based prospective memory tasks or in a time-interval production task. Under one set of conditions, participants were instructed to allocate attention equally to the two tasks, whereas in another set of conditions, they allocated attention primarily to the time-relevant task. The findings revealed that time estimates were not affected by the attention allocation manipulation, although it influenced performance on the concurrent category membership decision making task, and as expected time estimates were more accurate on the prospective memory task than on the time-production task. Based on the preponderance of the findings, we suggest that timing is managed by different mechanisms and/or strategies on time-interval production tasks and on short-duration time-based prospective memory tasks.     

Human performance on negative slope schedules of points exchangeable for money: a failure of molar maximization

Panel pressing was generated and maintained in 5 adult humans by schedules of points exchangeable for money. Following exposure to a variable-interval 30-s schedule and to a linear variable-interval 30-s schedule (which permitted points to accumulate in an unseen "store" in the absence of responding), subjects were exposed to a series of conditions with a point-subtraction contingency arranged conjointly with the linear variable-interval schedule. Specifically, points were added to the store according to the linear-variable interval 30-s schedule and were subtracted from the store according to a ratio schedule. Ratio value varied across conditions and was determined individually for each subject such that the subtraction contingency would result in an approximately 50% reduction in the rate of point delivery. Conditions that included the subtraction contingency were termed negative slope schedules because the feedback functions were negatively sloped across all response rates greater than the inverse of the variable-interval schedule, in this case, two per minute. Overall response rates varied inversely with the subtraction ratio, indicating sensitivity to the negative slope conditions, but were in excess of that required by accounts based on strict maximization of overall reinforcement rate. Performance was also not well described by a matching-based account. Detailed analyses of response patterning revealed a consistent two-state pattern in which bursts of high-rate responding alternated with periods of prolonged pausing, perhaps reflecting the joint influence of local and overall reinforcement rates.     

Effects of cocaine on performance under fixed-interval schedules with a small tandem ratio requirement

Daily administration of cocaine often results in the development of tolerance to its effects on responding maintained by fixed-ratio schedules. Such effects have been observed to be greater when the ratio value is small, whereas less or no tolerance has been observed at large ratio values. Similar schedule-parameter-dependent tolerance, however, has not been observed with fixed-interval schedules arranging comparable interreinforcement intervals. This experiment examined the possibility that differences in rate and temporal patterning between the two types of schedule are responsible for the differences in observed patterns of tolerance. Five pigeons were trained to key peck on a three-component multiple (tandem fixed-interval fixed-ratio) schedule. The interval values were 10, 30, and 120 s; the tandem ratio was held constant at five responses. Performance appeared more like that observed under fixed-ratio schedules than fixed-interval schedules. Effects of various doses of cocaine given weekly were then determined for each pigeon. A dose that reduced responding was administered prior to each session for 50 days. A reassessment of effects of the range of doses revealed tolerance. The degree of tolerance was similar across components of the multiple schedule. Next, the saline vehicle was administered prior to each session for 50 days to assess the persistence of tolerance. Tolerance diminished in all subjects. Overall, the results suggested that schedule-parameter-dependent tolerance does not depend on the temporal pattern of responding engendered by fixed-ratio schedules.     

Time and rate measures in choice transitions

Three experiments with pigeons studied the relation between time and rate measures of behavior under conditions of changing preference. Experiment 1 studied a concurrent chain schedule with random-interval initial links and fixed-interval terminal links; Experiment 2 studied a multiple chained random-interval fixed-interval schedule; and Experiment 3 studied simple concurrent random-interval random-interval schedules. In Experiment 1, and to a lesser extent in the other two experiments, session-average initial-link wait-time differences were linearly related to session-average response-rate differences. In Experiment 1, and to a lesser extent in Experiment 3, ratios of session-average initial-link wait times and response rates were related by a power function. The weaker relations between wait and response measures in Experiment 2 appear to be due to the absence of competition between responses. In Experiments 1 and 2, initial-link changes lagged behind terminal-link changes. These findings may have implications for the relations between fixed- and variable-interval procedures and suggest that more attention should be paid to temporal measures in studies of free-operant choice.