Concurrent schedules: Interaction of reinforcer frequency and reinforcer duration

Six pigeons were trained on concurrent variable-interval schedules with unequal reinforcer durations for the two responses. The schedules arranged on the two keys were kept equal while they were varied in absolute size. As the overall reinforcer rate was increased, both response-allocation and time-allocation measures of choice showed a trend toward indifference, and measures of sensitivity to reinforcer-duration ratios significantly decreased. Recent reports have shown that the generalized matching law cannot describe the changes in behavior allocation under constant delay-, duration-, or rate-ratios when changes are made in the absolute levels of each of these variables. The present results complement these findings by demonstrating that the concatenated generalized matching law cannot describe the interactions of two reinforcer variables on behavior allocation.     

Sensitivity to reinforcer duration in a self-control procedure

In a concurrent-chains procedure, pigeons' responses on left and right keys were followed by reinforcers of different durations at different delays following the choice responses. Three pairs of reinforcer delays were arranged in each session, and reinforcer durations were varied over conditions. In Experiment 1 reinforcer delays were unequal, and in Experiment 2 reinforcer delays were equal. In Experiment 1 preference reversal was demonstrated in that an immediate short reinforcer was chosen more frequently than a longer reinforcer delayed 6 s from the choice, whereas the longer reinforcer was chosen more frequently when delays to both reinforcers were lengthened. In both experiments, choice responding was more sensitive to variations in reinforcer duration at overall longer reinforcer delays than at overall shorter reinforcer delays, independently of whether fixed-interval or variable-interval schedules were arranged in the choice phase. We concluded that preference reversal results from a change in sensitivity of choice responding to ratios of reinforcer duration as the delays to both reinforcers are lengthened.     

Preference for starting and finishing behavior patterns

Pigeon's key pecking was reinforced with food in two experiments in which the correspondence between preference for starting one of two reinforced behavior patterns and the likelihood of finishing it subsequently was examined. Reinforcers were scheduled according to concurrent schedules for two classes of interresponse times, modified such that reinforcers followed a center-key peck terminating either a shorter interresponse time started by a left-key peck or a longer interresponse time started by a right-key peck. In Experiment 1, the times when reinforcers potentially were available were not discriminated, whereas in Experiment 2 they were. Absolute reinforced pattern durations were varied. The relative frequency of starting a particular pattern was highly correlated with relative frequency of that completed pattern in both experiments. Other relations between starting and finishing a pattern depended on whether reinforced interresponse times were discriminated. For instance, preference for starting a pattern sometimes correlated negatively with the likelihood of subsequently completing it. The present experiments are described as capturing part of the ordinary language meaning of "intention," according to which an organism's behavior at one moment sets the occasion for an observer to say that the organism "intends" in the future to engage in one behavior rather than another.     

Psychological distance to reward: A human replication

Choice behavior in college students was examined in two experiments using the concurrent-chains procedure. In both experiments, the concurrent chains were presented on a microcomputer in the form of an air-defense game in which subjects used two radar systems to detect and subsequently destroy enemy aircraft. Access to one of two radar systems was controlled by a pair of independent concurrent variable-interval 60-s schedules with a 4-s changeover delay always in effect. In the terminal link, the appearance of an enemy aircraft was determined by a pair of differentially segmented fixed-time schedules (Experiment 1) or fixed-interval schedules (Experiment 2) of equal overall duration. In Experiment 1, the terminal-link duration was either 20 s or 40 s, and subjects preferred the unsegmented to the segmented intervals. In Experiment 2, the duration was either 10 s or 60 s, and the reinforcement contingencies required responding during the terminal link. Prior to the reinstatement of the initial link, subjects estimated the duration of the terminal-link schedule. Segmentation affected choice in the 60-s conditions but not in the 10-s ones. Preference for the unsegmented schedule was correlated with an overestimation of the durations for the segmented schedules. These results replicated those found in animal experiments and support the notion of increasing the psychological distance to reward by segmenting a time-based schedule of reinforcement.     

Preference for unsegmented interreinforcement intervals in concurrent chains

Five pigeons were trained under concurrent-chain schedules in which a pair of independent, concurrent variable-interval 60-s schedules were presented in the initial link and either both variable-interval or both fixed-interval schedules were presented in the terminal link. Except for the baseline, one of the terminal-link schedules was always a two-component chained schedule and the other was either a simple or a tandem schedule of equal mean interreinforcement interval. The values of the fixed-interval schedules were either 15 s or 60 s; that of the variable-interval schedules was always 60 s. A 1.5-s changeover delay operated during the initial link in some conditions. The pigeons preferred a simple or a tandem schedule to a chain. For the fixed-interval schedules, this preference was greater when the fixed interval was 60 s than when it was 15 s. For the variable-interval schedules, the preferences were less pronounced and occurred only when the changeover delay was in effect. For a given type of schedule and interreinforcement interval, similar preferences were obtained whether the nonchained schedule was a tandem or simple schedule. The changeover delay generally inflated preference and lowered the changeover rate, especially when the terminal-link schedules were either short (15 s) or aperiodic (variable-interval). The results were consistent with the notion that segmenting the interreinforcement interval of a schedule into a chain lowers the preference for it.     

Effect of conducting behavioral observations and ratings on staff implementation of a paired-stimulus preference assessment

We assessed the effects of trainees observing and rating the accuracy of others implementing a paired-stimulus preference assessment from video on the trainees' subsequent implementation accuracy. These observational experiences increased implementation accuracy with both a confederate and an actual consumer. These results suggest conducting observations and accuracy ratings may prepare staff to implement behavioral procedures without need of a dedicated trainer.     

Mood and Creativity over Time in a Bipolar Participant

When depression alternates with mania, as in a bipolar affective disorder, creativity might be enhanced. To investigate this, we employed a single‐subject design, looking at both affective space and the spectral covariation of mood and creativity in a participant presenting with bipolar affective disorder. The study was conducted over a period of 54 days, and employed a standard measure of mood (the Brief Mood Introspection Scale) and a standard task of creativity (Alternative Uses Task). Both positive affect and negative affect appear to be somewhat undifferentiated for this participant, and her mood space does not conform to that described by the accepted major dimensions of Arousal and Pleasure. Conceivably, this is because of her rapid mood fluctuations. A 2.7‐day periodicity was found for Tired, Peppy, Nervous, and Calm, on the one hand, and ideational fluency, ideational flexibility, and originality, on the other. In addition, a 9‐day periodicity was common to Happy, Sad, and Gloomy—all three affects clustering in the same affective space—together with both ideational flexibility and originality. This finding brings into question the relationship between creativity and both positive and negative mood.     

Reinforcement uncertainty enhances preference for choice in humans

Under concurrent‐chains schedules of reinforcement, participants often prefer situations that allow selection among alternatives (free choice) to situations that do not (forced choice). The present experiment examined the effects of reinforcement probability on choice preferences. Preferences for free versus forced choice were measured under a condition in which participants' choices were always reinforced (reinforcement probability of 1.0) and a condition in which outcomes were uncertain (reinforcement probability of 0.5). Forty‐four college students participated and preferences were examined under a concurrent‐chains schedule of reinforcement. Participants preferred free choice under uncertain reinforcement, but a bias toward free choice was not observed when reinforcement was certain. These results align with previous findings of preference for free choice under conditions of uncertainty, but suggest that preference may be dependent upon probabilistic reinforcement contingencies in the terminal links of the concurrent‐chains arrangement. Thus, reinforcement probability is an important variable to consider when conducting similar studies on the value of choice.