Changeover delay and concurrent-schedule performance in domestic hens

Six domestic hens were exposed to a series of five pairs of two-key concurrent variable-interval schedules with a range of changeover delays from no delay to 15 s. Times spent responding on each alternative and total, within_, and post-changeover-delay response ratios were analyzed in terms of the generalized matching law. The sensitivity parameters, a, for response and time data were generally low when no changeover delay was programmed but were not 0.0. They were higher for all other changeover-delay values, with some tendency to increase as the changeover delay lengthened at very short delays. Within-delay responding was insensitive to reinforcement-rate differences at all changeover delays (a values close to 0.0). As a result of this insensitivity, post-changeover-delay responding was more sensitive to reinforcement-rate changes than was total responding. Interchangeover intervals increased systematically with changeover-delay duration. Responding, particularly after the changeover delay, was well predicted by an equation based on a reinforcer-loss model.     

Independence of reinforcement delay and magnitude in concurrent chains

A three-component concurrent-chains procedure was used to investigate preference between terminal-link schedules that differed in delay and magnitude of reinforcement. Response and time allocation data were well described by a generalized matching model. Sensitivity to delay appeared to be lower when reinforcement magnitudes were unequal than when they were equal, but when obtained rather than programmed time spent responding in the initial links was used in the model, the difference vanished. The results support independence of delay and magnitude as separate dimensions of reinforcement value, as required by the matching law, and the assumption of the contextual choice model (Grace, 1994) that sensitivities to delay and magnitude are affected similarly by temporal context. Although there was statistical evidence for interaction between successive components, the effects were small and transient. The multiple-component concurrent-chains procedure should prove useful in future research on multidimensional preference, although it may be necessary to control obtained initial-link time more precisely.     

Behavioral economics and behavioral momentum

Some relations between elasticity of demand and the conditions of reinforcement are reanalyzed in terms of resistance to change, in ways suggested by the metaphor of behavioral momentum; some relations between resistance to change and the conditions of reinforcement are reanalyzed in terms of elasticity of demand, in ways suggested by behavioral economics. In addition, some data on labor supply in relation to variable-ratio schedules and alternative reinforcement are reanalyzed in terms of resistance to change and compared with steady-state resistance data for performance on multiple and concurrent interval schedules. The results of these studies can be summarized by two functions based on the behavioral momentum approach, relating relative behavioral mass to relative reinforcement per response or per unit time. The former is a relation between relative unit price and relative behavioral mass, suggesting the possibility of convergent measurement of a theoretical construct common to both approaches. However, the momentum and economic approaches differ fundamentally on whether it is preferable to construe discriminated operant behavior as selected and strengthened by its consequences or as part of a behavior–consequence bundle that maximizes utility.     

Effects of variable-interval value and amount of training on stimulus generalization.

In Experiment 1 pigeons pecked a key that was illuminated with a 501-nm light and obtained food by doing so according to a variable-interval (VI) schedule of reinforcement, the mean value of which differed across groups: either 30 s, 120 s, or 240 s. The pigeons in all three groups were trained for 10 50-min sessions. Generalization testing was conducted in extinction with different wavelengths of light. Absolute and relative generalization gradients were similar in shape for the three groups. Experiment 2 was a systematic replication of Experiment 1 using line orientation as the stimulus dimension and a mean VI value of either 30 s or 240 s. Again, gradients of generalization were similar for the two groups. In Experiment 3 pigeons pecked a key that was illuminated with a 501-nm light and obtained food reinforcers according to either a VI 30-s or a 240-s schedule. Training continued until response rates stabilized (> 30 sessions). For subjects trained with the 30-s schedule, generalization gradients were virtually identical regardless of whether training was for 10 sessions (Experiment 1) or until response rates stabilized. For subjects trained with the VI 240-s schedule, absolute generalization gradients for subjects trained to stability were displaced upward relative to gradients for subjects trained for only 10 sessions (Experiment 1), and relative generalization gradients were slightly flatter. These results indicate that the shape of a generalization gradient does not necessarily depend on the rate of reinforcement during 10-session single-stimulus training but that the effects of prolonged training on stimulus generalization may be schedule dependent.     

Context effects on choice.

Four pigeons responded on a concurrent-chains schedule in four experiments that examined whether the effectiveness of a stimulus as a conditioned reinforcer is best described by a global approach, as measured by the average interreinforcement interval, or by a local contextual approach, as measured by the onset of the stimulus preceding the conditioned reinforcer. The interreinforcement interval was manipulated by the inclusion of an intertrial interval, which increased the overall time to reinforcement but did not change the local contingencies on a given trial A global analysis predicted choice for the richer alternative to decrease with the inclusion of an intertrial interval, whereas a local analysis predicted no change in preference. Experiment 1 examined sensitivity to intertrial intervals when each was signaled by the same houselight that operated throughout the session. In Experiment 2, the intertrial interval always was signaled by the stimulus correlated with the richer terminal link. In Experiment 3, the intertrial interval was signaled by the keylights correlated with the initial links and two novel houselights. Experiment 4 provided free food pseudorandomly during the intertrial interval. In all experiments, subjects' preferences were consistent with a local analysis of choice in concurrent chains. These results are discussed in terms of delay-reduction theory, which traditionally has failed to distinguish global and local contexts.     

Categorization of natural movements by pigeons: visual concept discrimination and biological motion

In three experiments, pigeons were exposed to a discriminated autoshaping procedure in which categories of moving stimuli, presented on videotape, were differentially associated with reinforcement. All stimuli depicted pigeons making defined responses. In Experiment 1, one category consisted of several different scenes of pecking and the other consisted of scenes of walking, flying, head movements, or standing still. Four of the 4 birds for which pecking scenes were positive stimuli discriminated successfully, whereas only 1 of the 4 for which pecking was the negative category did so. In the pecking-positive group, there were differences between the pecking rates in the presence of the four negative actions, and these differences were consistent across subjects. In Experiment 2, only the categories of walking and pecking were used; some but not all birds learned this discrimination, whichever category was positive, and these birds showed some transfer to new stimuli in which the same movements were represented only by a small number of point lights (Johansson's “biological motion” displays). In Experiment 3, discriminations between pecking and walking movement categories using point-light displays were trained. Four of the 8 birds discriminated successfully, but transfer to fully detailed displays could not be demonstrated. Pseudoconcept control groups, in which scenes from the same categories of motion were used in both the positive and negative stimulus sets, were used in Experiments 1 and 3. None of the 8 pigeons trained under these conditions showed discriminative responding. The results suggest that pigeons can respond differentially to moving stimuli on the basis of movement cues alone.     

Effects of the discriminability of alternatives in three-alternative concurrent-schedule performance

Six pigeons were trained on two- and three-alternative concurrent schedules in which the alternatives were signaled by different wavelengths of light on the main pecking key. The schedules were arranged according to a switching-key procedure in which pecks on a white side key produced a 3-s blackout and, intermittently, a change in the variable-interval schedule of food programmed on the main (center) key after the blackout. In Part 1, a two-alternative concurrent variable-interval schedule was arranged in which the alternatives were signaled by 560 nm and 630 nm. Parts 2 and 3 arranged three-alternative concurrent variable-interval schedules with the alternatives signaled by 560 nm, 600 nm, and 630 nm (Part 2) and 560 nm, 623 nm, and 630 nm (Part 3). Within each part, the relative rate of food reinforcers available on the alternatives was varied across a wide range. In all parts of the experiment, the ratios of responses emitted between pairs of alternatives were more extreme than the ratios of reinforcers obtained on the pairs of alternatives, a result termed overmatching. In Parts 2 and 3, generalized matching sensitivities between pairs of alternatives were found to be higher when the reinforcer rate on the third alternative was low than when it was high—an apparent failure of the constant-ratio rule. The data were well described by an extension of the Davison and Jenkins (1985) model, which assumes differing discriminabilities between concurrent-schedule alternatives in combination with a punishing effect of blackout following changeovers.     

Shortcomings of the behavioral competition theory of contrast: Reanalysis of McLean (1992)

McLean (1992) presented significant data showing that the occurrence of behavioral contrast in a multiple schedule was correlated with shifts in the frequency of reinforcers from a second source between components of the schedule, and interpreted his results as showing that contrast was due to changes in the degree of response competition within the constant component of the multiple schedule. Reanalysis of his data shows that there was an effect of reinforcement in the alternative component of the schedule independent of the shifts in reinforcers between components. Thus, the effect of relative rate of reinforcement cannot be ascribed, at least entirely, to the mechanisms proposed by the behavioral competition theory of contrast.     

Delay reduction and optimal foraging: variable-ratio search in a foraging analogue.

The present study investigated conditions under which the conditioned reinforcement principles of delay-reduction theory and views based on simple maximization of reinforcement rate make ordinally opposing predictions with respect to foraging-related choice behavior. The use of variable-ratio schedules in the choice phase also represents an extension of delay-reduction theory to schedules that may better mimic the effort involved in searching. Pigeons responded on modified concurrent-chains schedules in which equal variable-ratio schedules led to unequal variable-interval outcomes and unequal reinforcer amounts. All 4 subjects completed a minimum of two replications of conditions for which the predictions of delay-reduction theory and a simple rate-maximizing theory were opposed. Results were consistent with delay reduction's ordinal predictions in 11 of 11 replications of the divergent predictions favoring the smaller, more immediate alternative. The predictions of rate maximization were upheld only when they were consistent with those of delay reduction. Results are discussed in terms of conditioned reinforcement, sensitivity to reductions in delay to food, and possible rules of thumb that may be useful in characterizing foraging.