RESPONSE INTERRUPTION AND DRL FOR THE REDUCTION OF RAPID EATING

We assessed the efficacy of several procedures for reducing the rate of eating responses during mealtime by three institutionalized mentally retarded clients. A time-based (15 s) response interruption procedure was implemented which resulted in little change in eating responses for 2 of 3 subjects. A spaced-responding DRL 15-s procedure resulted in decreases in eating responses to target levels only after a prompting procedure was added. Procedures were evaluated using a multiple baseline across subjects design with assessment of generalization to nontreated meals. A change in eating behavior during breakfast occurred only after direct training in the breakfast setting. Maintenance data were collected at 1- and 5-month follow-up periods.     

Lick-trading by rats: on the substitutability of dry, water, and saccharin tubes.

Thirsty rats licked two metal tubes: a water tube paired with another water tube, with saccharin, or with a dry tube. For each pair, a multipoint baseline function was measured by offering free access to one tube throughout each session, and free or restricted access to the other. The three resulting baseline functions showed the members of each pair to be mutual substitutes: When access to either tube was restricted, the rats made more licks at the other. A linear function identified the two water tubes as perfect substitutes. Convex functions identified the members of the saccharin-water and the dry-water pair as imperfect substitutes. Each pair was also tested under several reciprocal fixed-ratio schedules that required instrumental licking of either tube for contingent access to the other. The resulting schedule functions showed the members of each pair to be perfect substitutes: Water licks decreased linearly as licks at the other water tube, the saccharin, or the dry tube increased, in agreement with a conservation model of instrumental performance. Baseline and schedule functions, indistinguishable in the water-water pair, indicated a schedule facilitation of dry-tube licking in the dry-water pair and of water-tube licking in the saccharin-water pair.     

Confirmation of linear system theory prediction: Rate of change of Herrnstein's kappa as a function of response-force requirement

Four human subjects worked on all combinations of five variable-interval schedules and five reinforcer magnitudes (¢/reinforcer) in each of two phases of the experiment. In one phase the force requirement on the operandum was low (1 or 11 N) and in the other it was high (25 or 146 N). Estimates of Herrnstein's κ were obtained at each reinforcer magnitude. The results were: (1) response rate was more sensitive to changes in reinforcement rate at the high than at the low force requirement, (2) κ increased from the beginning to the end of the magnitude range for all subjects at both force requirements, (3) the reciprocal of κ was a linear function of the reciprocal of reinforcer magnitude for seven of the eight data sets, and (4) the rate of change of κ was greater at the high than at the low force requirement by an order of magnitude or more. The second and third findings confirm predictions made by linear system theory, and replicate the results of an earlier experiment (McDowell & Wood, 1984). The fourth finding confirms a further prediction of the theory and supports the theory's interpretation of conflicting data on the constancy of Herrnstein's κ.     

Matching and maximizing with variable-time schedules.

Pigeons were offered choices between a variable-time schedule that arranged reinforcers throughout the session and a variable-time schedule that arranged reinforcers only when the pigeon was spending time on it. The subjects could maximize the overall rate of reinforcement in this situation by biasing their time allocation towards the latter schedule. This arrangement provides an alternative to concurrent variable-interval variable-ratio schedules for testing whether animals maximize overall rates or match relative rates, and has the advantage of being free of the asymmetrical response requirements present with those schedules. The results were contrary to those predicted by maximizing: The bias it predicts did not appear.     

Pure timing in temporal differentiation

Temporal control appears to depend on whether the critical durations are those of stimuli or those of responses. Stimulus timing (temporal discrimination) supports Weber's law, whereas response timing (temporal differentiation) indicates decreasing relative sensitivity with longer time intervals. The two types of procedure also yield different conclusions in scaling experiments designed to study the functional midpoint of two or more durations (temporal bisection procedures). In addition, the fractional-exponent power relation between emitted and required duration usually found with animals in differentiation experiments conflicts with deductions from formal analyses. The experiment reported here derived from considering differentiation arrangements as schedules of reinforcement. When analyzed from this perspective, the procedures are tandem schedules involving a required pause followed by a response, and it is the pause alone that involves temporal control. A choice procedure separated timing from responding, and enabled observations of pause timing in isolation. Pure temporal control in differentiation consisted of linear overestimation of the standard duration, and Weber's law described sensitivity. These results indicate that the two problems, the fractional-exponent power relations and the apparently different nature of sensitivity in differentiation and discrimination, disappear when temporal control is observed alone in differentiation.     

Some parameters of behavioral contrast and allocation of interim behavior in rats

Two experiments examined the effects of baseline reinforcement rate and component duration on behavioral contrast and on re-allocation of interim behavior in rats. Positive behavioral contrast occurred during multiple variable-interval 10-second extinction (VI 10 EXT) after a multiple VI 10 VI 10 baseline condition, but not during multiple VI 60 EXT following multiple VI 60 VI 60 baseline. Component duration had no significant effect on contrast. These results differed from those found in studies of pigeons' key pecking. Contrast was accompanied by an increased rate of drinking in the changed component, but drinking in the constant component did not decrease. These results are not consistent with the competition theory of contrast, but are consistent with the predictions based on the matching law. However, no current theory seems to account for all instances of behavioral contrast.     

Beyond the breakpoint: reinstatement,renewal, and resurgence of ratio‐strained behavior

Three experiments were conducted using pigeons to assess the recurrence of responding eliminated by increasing the value of a progressive‐ratio schedule to the breakpoint of responding. The procedures used in these assessments were, in successive experiments, reinstatement, renewal and resurgence. Each was effective in returning temporarily the eliminated responding. Reinstatement occurred with both yoked‐time and fixed‐time food deliveries. Both renewal and resurgence resulted in immediate recurrence of the response, and, as in other experiments investigating resurgence, the key peck response resurged as the alternative response extinguished. The results of all three experiments suggest the generality of these recurrence procedures to responding under progressive‐ratio schedules, indicating that strained performance under these schedules is amenable to recovery under the investigated conditions.     

Preference,resistance to change,and the cumulative decision model

According to behavioral momentum theory (Nevin & Grace, 2000a), preference in concurrent chains and resistance to change in multiple schedules are independent measures of a common construct representing reinforcement history. Here I review the original studies on preference and resistance to change in which reinforcement variables were manipulated parametrically, conducted by Nevin, Grace and colleagues between 1997 and 2002, as well as more recent research. The cumulative decision model proposed by Grace and colleagues for concurrent chains is shown to provide a good account of both preference and resistance to change, and is able to predict the increased sensitivity to reinforcer rate and magnitude observed with constant‐duration components. Residuals from fits of the cumulative decision model to preference and resistance to change data were positively correlated, supporting the prediction of behavioral momentum theory. Although some questions remain, the learning process assumed by the cumulative decision model, in which outcomes are compared against a criterion that represents the average outcome value in the current context, may provide a plausible model for the acquisition of differential resistance to change.     

Rat choice in rapidly changing concurrent schedules

In two experiments, experimentally naïve rats were trained in concurrent variable‐interval schedules in which the reinforcer ratios changed daily according to a pseudorandom binary sequence. In Experiment 1, relative response rates showed clear sensitivity to current‐session reinforcer ratios, but not to previous sessions' reinforcer ratios. Within sessions, sensitivity to the current session's reinforcement rates increased steadily, and by session end, response ratios approached matching to the current‐session reinforcer ratios. Across sessions, sensitivity to the current session's reinforcer ratio decreased with continued exposure to the pseudorandom binary sequence, contrary to expectations based on previous studies demonstrating learning sets. Using a second group of naïve rats, Experiment 2 replicated the main results from Experiment 1 and showed that although there were increases over sessions in both changeover rate and response rate during the changeover delay, neither could explain the accompanying reductions in sensitivity. We consider the role of reinforcement history, showing that our results can be simulated using two separate representations, one local and one nonlocal, but a more complex approach will be needed to bring together these results and other history effects such as learning sets and spontaneous recovery.     

Assessment of a response bias for aggression over functionally equivalent appropriate behavior

We evaluated the effects of a dense (fixed-ratio 1) schedule of reinforcement for an 11-year-old boy's mands for toys while aggression produced the same toys on various schedules chosen on the basis of a progressive-ratio probe. Based on the probe session data, we accurately predicted that aggression would be more probable than mands when the schedules were equal or slightly discrepant, but that mands would be more probable when the schedule discrepancy was large.