Early-extinction effects on a force response of humans

Humans were used to investigate changes in response force occurring soon after reinforcement was eliminated. In Experiment 1, in a 300-s baseline phase, 10 participants received a point for holding down a pressure sensor set to operate at a force equal to 85% of the maximum force the participants exerted during a pretest. Following this, during a 600-s extinction phase, criterion responses had no consequence. In Experiment 2, 6 participants worked on the same task, but (a) points were exchangeable for money and (b) after extinction, the reinforcement baseline phase was reinstated. In Experiment 3, 6 participants completed the same task as in Experiment 2, but the required minimum force was 60% of the maximum force exerted during the pretest. In each experiment, increases in response force relative to the mean and peak force exerted during the last 100 s of baseline were observed in most participants when force responses were aggregated into short sample intervals, but less so with longer ones. The increases, however, were not systematic across or within participants, questioning the generality of and the criteria for demonstrating an extinction burst.     

What is an extinction burst?: A case study in the analysis of transitional behavior

Among the tactics of experimental science discussed by Sidman (1960) were those used to study transitional behavior. Drawing from his insights, this review considers an often cited but infrequently analyzed aspect of the transition from reinforcement to extinction: the extinction burst. In particular, the review seeks to answer the question posed in its title. The generic definition of an extinction burst as an increase in response rate following the onset of extinction is found to be wanting, raising more questions than it answers. Because questions of definition in science usually come down to those of measurement, the answer to the title's question is suggested to be found in how behavior prior to extinction is maintained and measured, when and how extinction is introduced, and where in time and how behavior early in extinction is measured. This analysis suggests that a single, uniform, and precise definition of the extinction burst is misguided. Examining how each of these facets contributes to what has been described generically as the extinction burst is a small, but important, part of Sidman's methodological legacy to the experimental analysis of behavior.     

Trial and intertrial durations in Pavlovian conditioning: issues of learning and performance

Four experiments assessed the effects of trial (T) and intertrial (I) durations on magazine approach behavior in rats. In Experiments 1 and 2, different groups of animals were conditioned with various combinations of I and T durations. The rate of acquisition, in terms of the number of trials required to reach various acquisition criteria, generally was faster in groups trained with large I:T ratios. There also were differences in rate of acquisition and terminal response rates between groups trained with identical I:T ratios but with different absolute I and T durations. Differences evident at the end of conditioning persisted during a common test with various combinations of I and T durations. Experiments 3 and 4 provided a more specific test of the predictions of 2 general classes of theories and found results that were consistent with those theories that characterize group differences as indicative of differences in learning, rather than in performance.     

Reward Density And Variable-interval Schedule Performance In An Open Economy

There is no general agreement regarding the form of the relation between response rate and reinforcement rate when single schedules of reinforcement are studied in an open economy. The present study assessed the form of this relation using reward density, which incorporates both reinforcement rate and duration of access to food, as an independent variable. Reward density was manipulated with 4 pigeons by changing the value of the variable-interval schedule, the hopper duration, or both. The relations between response rate and reward density were sharply rising and hyperbolic in 3 of 4 pigeons, replicating results obtained by Catania and Reynolds (1968). Because eating efficiency was lower in conditions that provided longer hopper durations, programmed reward densities differed from obtained reward densities. When response rates were examined as a function of obtained reward densities, the same relations were demonstrated more strongly. In further clarifying the relation between response rate and reward density in an open economy, these results lend support to the conclusion that open and closed economies yield different behavioral effects.     

Effects of concurrent response-independent reinforcement on fixed-interval schedule performance

In three experiments, behavior maintained by fixed-interval schedules changed when response-independent reinforcement was delivered concurrently according to fixed- or variable-time schedules. In Experiment I, a pattern of positively accelerated responding during fixed interval was changed to a linear pattern when response-independent reinforcement occurred under a variable-time schedule. Overall response rates (total responses/total time) decreased as the frequency of response-independent reinforcement increased. Experiment II showed that the response-rate changes in the first experiment were controlled by the response-reinforcer relation, but the changes in patterns of responding were similar whether concurrently available reinforcement at varying times was response-dependent or response-independent. In the final experiment, the addition of response-independent reinforcement at fixed times to a fixed-interval schedule resulted in changes in both local and overall response rates and in the occurrence of positively accelerated responding between reinforcements. These results suggest that the temporal distribution of reinforcers determines response patterns and that both the response-reinforcement dependency and the schedule of reinforcement determine overall response rates during concurrently scheduled response-dependent and response-independent reinforcement.     

Some effects of response independent reinforcers in multiple schedules

In Exp. I, rats' lever presses were conditioned on multiple variable-interval variable-interval schedules. Changing one of the multiple schedule components to variable time reduced responding in that component. Further reductions in responding occurred in both components when the schedule was changed to multiple variable-time variable-time. After reinstating the multiple variable-interval variable-time schedule, lower response rates were maintained in the variable-time component during a series of stimulus reversals. In Exp. II, replacement of extinction components of multiple variable-interval extinction or multiple extinction extinction with variable-time schedules for single sessions (probe) resulted in response rate increments in those components. In the former schedule these increases were concomitant with response decreases during the variable-interval components. Response increases in the variable-time probes were related to conditioning history and, as a result, to response probability at the time of the probe.