Beyond the breakpoint: reinstatement,renewal, and resurgence of ratio‐strained behavior

Three experiments were conducted using pigeons to assess the recurrence of responding eliminated by increasing the value of a progressive‐ratio schedule to the breakpoint of responding. The procedures used in these assessments were, in successive experiments, reinstatement, renewal and resurgence. Each was effective in returning temporarily the eliminated responding. Reinstatement occurred with both yoked‐time and fixed‐time food deliveries. Both renewal and resurgence resulted in immediate recurrence of the response, and, as in other experiments investigating resurgence, the key peck response resurged as the alternative response extinguished. The results of all three experiments suggest the generality of these recurrence procedures to responding under progressive‐ratio schedules, indicating that strained performance under these schedules is amenable to recovery under the investigated conditions.     

Preference,resistance to change,and the cumulative decision model

According to behavioral momentum theory (Nevin & Grace, 2000a), preference in concurrent chains and resistance to change in multiple schedules are independent measures of a common construct representing reinforcement history. Here I review the original studies on preference and resistance to change in which reinforcement variables were manipulated parametrically, conducted by Nevin, Grace and colleagues between 1997 and 2002, as well as more recent research. The cumulative decision model proposed by Grace and colleagues for concurrent chains is shown to provide a good account of both preference and resistance to change, and is able to predict the increased sensitivity to reinforcer rate and magnitude observed with constant‐duration components. Residuals from fits of the cumulative decision model to preference and resistance to change data were positively correlated, supporting the prediction of behavioral momentum theory. Although some questions remain, the learning process assumed by the cumulative decision model, in which outcomes are compared against a criterion that represents the average outcome value in the current context, may provide a plausible model for the acquisition of differential resistance to change.     

Rat choice in rapidly changing concurrent schedules

In two experiments, experimentally naïve rats were trained in concurrent variable‐interval schedules in which the reinforcer ratios changed daily according to a pseudorandom binary sequence. In Experiment 1, relative response rates showed clear sensitivity to current‐session reinforcer ratios, but not to previous sessions' reinforcer ratios. Within sessions, sensitivity to the current session's reinforcement rates increased steadily, and by session end, response ratios approached matching to the current‐session reinforcer ratios. Across sessions, sensitivity to the current session's reinforcer ratio decreased with continued exposure to the pseudorandom binary sequence, contrary to expectations based on previous studies demonstrating learning sets. Using a second group of naïve rats, Experiment 2 replicated the main results from Experiment 1 and showed that although there were increases over sessions in both changeover rate and response rate during the changeover delay, neither could explain the accompanying reductions in sensitivity. We consider the role of reinforcement history, showing that our results can be simulated using two separate representations, one local and one nonlocal, but a more complex approach will be needed to bring together these results and other history effects such as learning sets and spontaneous recovery.     

Processing ambiguous Spanish se in a minimal chain

The recovery of pieces of information that are not linguistically expressed is a constant feature of the process of language comprehension. In the processing literature, such missing information is generally referred to as “gaps”. Usually, one resolves gaps by finding “fillers” in either the sentence or the context. For instance, in Peter seemed to be upset, Peter is really the subject of being upset but appears as surface subject of seems. Sometimes constituents move, leaving gaps behind. Various Romance languages such as Spanish or Italian have a grammatical particle se/si, which, as it is extremely ambiguous, licenses different sorts of gaps. In Spanish, se can encode at least reflexive, impersonal, and passive meanings. In an eye-tracking experiment we contrast reflexive structures containing postverbal subjects with impersonal structures with no subjects (GAP se vendó apresuradamente el corredor/“the runner bandaged himself hurriedly” vs. GAP se vendó apresuradamente al corridor/“(someone) bandaged the runner hurriedly”). In a second manipulation we contrast the presence of an extra argument with se-passives (GAP se vendó el tobillo el corredor/“the runner bandaged his ankle” vs. GAP se vendó el tobillo al corridor/“the runner's ankle was bandaged”). Our comparisons involve contrasting standard transitive structures with nonstandard word order (postverbal subject and a preverbal subject gap) against inherently complex and less habitual structures such as impersonals (with no subject) or se-passives (with subjects in canonical object position). We evaluate the minimal chain principle (de Vincenzi, 1991 De Vincenzi, M. 1991. Syntactic parsing strategies in Italian, Dordrecht, , The Netherlands: Kluwer. [Crossref] , [Google Scholar]), according to which displacement is costly because it entails complex (derivational) “chains” that must be undone before phrasal packaging can commence. We show the minimal chain principle to be essentially correct when contrasting more complex but more frequent structures with less complex but less frequent structures. A noteworthy feature of this research is that the gaps appear before the fillers in the structures that we analyse.     

Assessment of a response bias for aggression over functionally equivalent appropriate behavior

We evaluated the effects of a dense (fixed-ratio 1) schedule of reinforcement for an 11-year-old boy's mands for toys while aggression produced the same toys on various schedules chosen on the basis of a progressive-ratio probe. Based on the probe session data, we accurately predicted that aggression would be more probable than mands when the schedules were equal or slightly discrepant, but that mands would be more probable when the schedule discrepancy was large.     

Human performance on negative slope schedules of points exchangeable for money: a failure of molar maximization

Panel pressing was generated and maintained in 5 adult humans by schedules of points exchangeable for money. Following exposure to a variable-interval 30-s schedule and to a linear variable-interval 30-s schedule (which permitted points to accumulate in an unseen "store" in the absence of responding), subjects were exposed to a series of conditions with a point-subtraction contingency arranged conjointly with the linear variable-interval schedule. Specifically, points were added to the store according to the linear-variable interval 30-s schedule and were subtracted from the store according to a ratio schedule. Ratio value varied across conditions and was determined individually for each subject such that the subtraction contingency would result in an approximately 50% reduction in the rate of point delivery. Conditions that included the subtraction contingency were termed negative slope schedules because the feedback functions were negatively sloped across all response rates greater than the inverse of the variable-interval schedule, in this case, two per minute. Overall response rates varied inversely with the subtraction ratio, indicating sensitivity to the negative slope conditions, but were in excess of that required by accounts based on strict maximization of overall reinforcement rate. Performance was also not well described by a matching-based account. Detailed analyses of response patterning revealed a consistent two-state pattern in which bursts of high-rate responding alternated with periods of prolonged pausing, perhaps reflecting the joint influence of local and overall reinforcement rates.     

Effects of cocaine on performance under fixed-interval schedules with a small tandem ratio requirement

Daily administration of cocaine often results in the development of tolerance to its effects on responding maintained by fixed-ratio schedules. Such effects have been observed to be greater when the ratio value is small, whereas less or no tolerance has been observed at large ratio values. Similar schedule-parameter-dependent tolerance, however, has not been observed with fixed-interval schedules arranging comparable interreinforcement intervals. This experiment examined the possibility that differences in rate and temporal patterning between the two types of schedule are responsible for the differences in observed patterns of tolerance. Five pigeons were trained to key peck on a three-component multiple (tandem fixed-interval fixed-ratio) schedule. The interval values were 10, 30, and 120 s; the tandem ratio was held constant at five responses. Performance appeared more like that observed under fixed-ratio schedules than fixed-interval schedules. Effects of various doses of cocaine given weekly were then determined for each pigeon. A dose that reduced responding was administered prior to each session for 50 days. A reassessment of effects of the range of doses revealed tolerance. The degree of tolerance was similar across components of the multiple schedule. Next, the saline vehicle was administered prior to each session for 50 days to assess the persistence of tolerance. Tolerance diminished in all subjects. Overall, the results suggested that schedule-parameter-dependent tolerance does not depend on the temporal pattern of responding engendered by fixed-ratio schedules.     

Time and rate measures in choice transitions

Three experiments with pigeons studied the relation between time and rate measures of behavior under conditions of changing preference. Experiment 1 studied a concurrent chain schedule with random-interval initial links and fixed-interval terminal links; Experiment 2 studied a multiple chained random-interval fixed-interval schedule; and Experiment 3 studied simple concurrent random-interval random-interval schedules. In Experiment 1, and to a lesser extent in the other two experiments, session-average initial-link wait-time differences were linearly related to session-average response-rate differences. In Experiment 1, and to a lesser extent in Experiment 3, ratios of session-average initial-link wait times and response rates were related by a power function. The weaker relations between wait and response measures in Experiment 2 appear to be due to the absence of competition between responses. In Experiments 1 and 2, initial-link changes lagged behind terminal-link changes. These findings may have implications for the relations between fixed- and variable-interval procedures and suggest that more attention should be paid to temporal measures in studies of free-operant choice.     

Effects of adding a second reinforcement alternative: implications for Herrnstein's interpretation of r(e)

Herrnstein's hyperbola describes the relation between response rate and reinforcer rate on variable-interval (VI) schedules. According to Herrnstein's (1970) interpretation, the parameter r(e) represents the reinforcer rate extraneous to the alternative to which the equation is fitted (the target alternative). The hyperbola is based on an assumption that extraneous reinforcer rate remains constant with changes in reinforcer rate on the target alternative (the constant-r(e) assumption) and that matching with no bias and perfect sensitivity occurs between response and reinforcer ratios. In the present experiment, 12 rats pressed levers for food on a series of 10 VI schedules arranged on the target alternative. Across conditions, six VI values and extinction were arranged on a second alternative. Reinforcer rate on the second alternative, r2, negatively covaried with reinforcer rate on the target alternative for five of the six VI values on the second alternative, and significant degrees of bias and undermatching occurred in response ratios. Given covariation of reinforcer rate on the second and target alternatives, the constant-r(e) assumption can be maintained only by assuming that reinforcer rate from unmeasured background sources, rb, covaries with reinforcer rate on the second alternative such that their sum, r(e), remains constant. In a single-schedule arrangement, however, r(e) equals rb and thus rb is assumed to remain constant, forcing a conceptual inconsistency between single- and concurrent-schedule arrangements. Furthermore, although an alternative formulation of the hyperbola can account for variations in bias and sensitivity, the modified equation also is based on the constant-r(e) assumption and therefore suffers from the same logical problem as the hyperbola when reinforcer rate on the second alternative covaries with reinforcer rate on the target alternative.     

An example of discovery research involving the transfer of stimulus control

The initial purpose of the present study was to replicate procedures for teaching preschool children to recruit attention at appropriate times by having an experimenter signal the availability and unavailability of attention (i.e., arrange a multiple schedule involving reinforcement and extinction; Tiger & Hanley, 2004). Following the development of discriminated social responding, the schedule-correlated stimuli were removed (i.e., a mixed schedule of reinforcement was arranged). However, discriminated responding continued during these conditions. Further evaluation suggested that stimulus control over children's social responding had transferred from the schedule-correlated stimuli to the delivery of reinforcement. The effect of a history of reinforcement under multiple-schedule conditions on performance under mixed schedules was then replicated with 2 participants in a reversal design. These findings suggest that following experience with schedule-correlated stimuli, these stimuli may be removed with only modest disruption to discriminated responding.