Algorithmic shaping and misbehavior in the acquisition of token deposit by rats

In two experiments, rats were trained to deposit ball bearings down a hole in the floor, using an algorithmic version of shaping. The experimenter coded responses expected to be precursors of the target response, ball bearing deposit; a computer program reinforced these responses, or not, according to an algorithm that mimicked the processes thought to occur in conventional shaping. In the first experiment, 8 of 10 rats were successfully shaped; in the second, 5 of 5 were successfully shaped, and the median number of sessions required was the same as for a control group trained using conventional shaping. In both experiments, “misbehavior,” that is, excessive handling and chewing of the ball bearings, was observed, and when the algorithmic shaping procedure was used, misbehavior could be shown to occur in spite of reduced reinforcement for the responses involved.     

DOES EFFORT PLAY A ROLE IN THE EFFECT OF RESPONSE REQUIREMENTS ON DELAYED MATCHING TO SAMPLE?

The possible role of "effort" in the accuracy of pigeons' performance on a delayed matching-to-sample procedure was investigated by examining the effects of response requirements that accompanied a trial-initiating stimulus and that accompanied a sample stimulus. In the first experiment, the effect of varying the size of a fixed-ratio requirement for responses during an initiating stimulus was compared to that of varying a similar requirement for responses during the sample stimulus. Accuracy increased reliably with increases in the ratio scheduled during the sample stimulus, but was not significantly affected by increases in the ratio scheduled on the key during the initiating stimulus. In another phase of Experiment 1, sample duration was held constant while the ratio requirement was varied during the initiating stimulus. Again, accuracy of matching to sample was not significantly affected by the size of the ratio scheduled during the initiating stimulus. Experiment 2 provided a systematic replication of these results in another group of pigeons and included a more detailed analysis of responding. These results support the view that increases in sample-response requirement facilitate accuracy of delayed matching by increasing the durations of exposure to the sample stimuli, and do not support a role of effort in the sample-response effect. In Experiment 3, the facilitative effect of responses on the sample but not of those on the initiating stimulus was replicated using a simultaneous matching-to-sample procedure. This finding provides further evidence against an interpretation of response-requirement effects that appeals to effort; the finding also suggests that sample exposure might affect initial discrimination of the sample rather than remembering the sample.     

Superimposition of response-independent reinforcement

Studies that have superimposed response-independent reinforcement (or reinforcers scheduled by contingencies placed on the absence of responding) upon conventional response-dependent schedules are reviewed. In general, providing alternative sources of reinforcement reduced response rates below the levels observed when alternative reinforcement was absent. However, response-rate elevation was sometimes found, particularly when rates of superimposed response-independent reinforcement were low. Superimposition of schedules providing reinforcers contingent on the absence of responding usually produced more severe response-rate decrements than superimposition of response-independent reinforcement. A variant of Herrnstein's equation, which assumes that some of the alternative reinforcers function as if they were delivered by baseline response-dependent source of reinforcement, is in qualitative agreement with the overall body of results obtained, and can predict both increases and decreases in response rate as resulting from superimposed reinforcers.     

Drug-behavior interaction history: modification of the effects of morphine on punished behavior.

Squirrel monkeys were trained to respond under a multiple fixed-interval, fixed-interval schedule in which the first response after 5 min terminated a visual stimulus in the presence of which electric shocks could occur. During one component of the schedule, correlated with one color of stimulus lights, every 30th response also produced electric shock; responding was suppressed during this component to approximately 10 to 12% of that occurring in the alternate component in which responding was not punished. In contrast to previous research, morphine (0.03 to 1.0 mg/kg) increased punished responding. Unpunished responding, however, was either not affected or decreased at doses of morphine that increased punished responding. Increases in rate of punished responding also occurred when the single-schedule punishment condition was studied alone in these animals. Subsequent experimentation, which systematically analyzed the development of the rate-enhancing effects of morphine on punished responding, involved the study of drug effects in additional monkeys trained initially under a single-schedule punishment condition. The effects of morphine on punished responding were studied before, after, and then during exposure to the multiple schedule that included a component in which responding was not punished. Increases in response rate with morphine did not occur until it was administered during exposure to the multiple schedule that included a component in which responding was not punished. As with the other monkeys, once the rate increases in punished responding occurred under the multiple schedule, these effects of morphine persisted, even when the multiple schedule was removed.(ABSTRACT TRUNCATED AT 250 WORDS)     

The influence of mindset abstraction on preference for mixed versus extreme approaches to multigoal pursuits

Facing multiple conflicting goals, consumers may attempt to simultaneously pursue multiple goals by choosing mixed vice–virtue bundles in each consumption episode (mixed approach). Alternatively, they may maximize their pursuit of one goal at a time and sequentially manage multiple goals by alternating between pure-virtue and pure-vice bundles across consumption episodes (extreme approach). The current research proposes that consumer preferences between the two approaches depend on mindset abstraction. Across four experimental studies in the domains of food and financial decision-making, we demonstrate that, relative to an abstract mindset, a concrete mindset increases preference for the extreme approach over the mixed approach. Furthermore, by observing actual food choices over a seven-day period, this research provides a comprehensive picture of how a chronic mindset relates to multigoal management in long-term consumption patterns. The findings have both theoretical implications for the goal literature and managerial implications for marketers and policymakers.     

Choice between delayed reinforcers and fixed-ratio schedules requiring forceful responding.

This experiment measured pigeons' choices between delayed reinforcers and fixed-ratio schedules in which a force of approximately 0.48 N was needed to operate the response key. In ratio-delay conditions, subjects chose between a fixed-ratio schedule and an adjusting delay. The delay was increased or decreased several times a session in order to estimate an indifference point--a delay duration at which the two alternatives were chosen about equally often. Each ratio-delay condition was followed by a delay-delay condition in which subjects chose between the adjusting delay and a variable-time schedule, with the components of this schedule selected to match the ratio completion times of the preceding ratio-delay condition. The adjusting delays at the indifference point were longer when the alternative was a fixed-ratio schedule than when it was a matched variable-time schedule, which indicated a preference for the matched variable-time schedules over the fixed-ratio schedules. This preference increased in a nonlinear manner with increasing ratio size. This nonlinearity was inconsistent with a theory that states that indifference points for both time and ratio schedules can be predicted by multiplying the choice response-reinforcer intervals of the two types of schedules by different multiplicative constants. Two other theories, which predict nonlinear increases in preference for the matched variable-time schedules, are discussed.     

Social reinforcement of operant behavior in rats: a methodological note.

An apparatus was developed to study social reinforcement in the rat. Four Long-Evans female rats were trained to press a lever via shaping, with the reinforcer being access to a castrated male rat. Responding under a fixed-ratio schedule and in extinction was also observed. Social access was found to be an effective reinforcer. When social reinforcement was compared with food reinforcement under similar conditions of deprivation and reinforcer duration, no significant differences were observed.     

Temporal control of behavior: schedule interactions

In Experiment I the response that terminated the postreinforcement pauses occurring under a fixed-interval 60-second schedule was reinforced, if the pause duration exceeded 30 seconds. The percentage of such pauses, rather than increasing, decreased. There were complex effects on the discriminative control of the pause by the reinforcer terminating the previous fixed interval, depending on whether the fixed interval and the added reinforcer were the same or different. In Experiments II(a) and II(b), each reinforcement initiated an alternative fixed-interval interresponse-time-greater-than-t-sec schedule, the schedule values being systematically varied. When the response following a pause exceeding a given duration was reinforced, fewer such pauses occurred than when they were not reinforced, i.e., on the comparable simple fixed-interval schedule. There was no systematic relationship between mean interrinforcement interval and duration of the postreinforcement pause. The pause duration initiated by reinforcement was directly related to the dependency controlling the shortest pause at that time, regardless of changes in mean interreinforcement interval.     

Delayed reinforcement of fixed-ratio performance without mediating exteroceptive conditioned reinforcement

The performance of pigeons was studied under conditions in which the completion of a fixed-ratio requirement was not contiguous with the presentation of a reinforcer. Timein and timeout periods alternated throughout the experimental sessions. Responses made by an experimental bird during the timein period were accumulated, and when a fixed-ratio requirement had been met, grain was presented to the experimental bird and a yoked control following their first response in the next timein period. Across most manipulations of the fixed-ratio requirement and of the duration of the timeout period, the response rates of the experimental birds were considerably higher than those of their controls, suggesting that the response-reinforcer dependency controlled the behavior of the experimental bird in the absence of a close temporal association between responding on the ratio schedule and reinforcer presentations.     

Response strength in multiple periodic and aperiodic schedules

Responding in multiple periodic and aperiodic schedules of equal mean reinforcement rate was examined during extinction, satiation, and in the presence of various free-food schedules. In Experiments I and II, pigeons were trained on multiple variable-interval–fixed-interval schedules. Decreases in the rate of responding due to extinction, satiation, or food schedules were approximately equal regardless of the temporal pattern of reinforcer presentation. In Experiment III, pigeons responded on a two-component multiple schedule in which each component was a two-member homogeneous response chain terminating in a fixed-interval schedule during one component and in a variable-interval schedule during the other. The length of both terminal links was varied over a series of conditions. Initial-link responding in the fixed-interval component was reduced more by increasing terminal-link length than was initial-link responding in the variable-interval component. However, no differences in resistance to satiation and extinction were obtained across the fixed and variable components. If the relative decrease in responding produced by satiation and extinction is used as an index of the “value” of the conditions maintaining responding, then these data suggest that fixed and variable schedules of equal mean length are equally valued. This conclusion, however, is not consistent with findings of preference for variable over fixed schedules obtained in studies using concurrent-chain procedures.