Punishment as a discriminative stimulus and conditioned reinforcer with humans

Mental hospital patients were reinforced for responding in a two-response operant situation. When a noise was used to punish one of the responses, all subjects shifted to the unpunished one. When the noise was then paired with positive reinforcement, the subjects responded to produce the noise. Also, a novel response was reinforced by noise in the absence of other reinforcers. This study with humans extends the findings of previous studies with animals in revealing how a punishing stimulus can acquire discriminative or conditioned reinforcing properties.     

Effects of a conditioned reinforcer upon accuracy of match-to-sample behavior in pigeons

Three pigeons were trained to perform a two-key sequential match-to-sample task. During baseline conditions, food reinforcement was contingent upon the first match response to occur following 8-min periods, and orange illumination of both keys preceded the delivery of food by 0.5 sec. The baseline schedule of food reinforcement was in effect throughout the study. In some conditions, a 0.5-sec flash of orange keylight alone was presented contingent upon mismatch responses that followed variable time periods averaging 1 min. Rate of mismatch responses increased and accuracy of matching performances decreased as compared with baseline conditions. The ability of the 0.5-sec orange flash to reinforce mismatch responses was markedly reduced when it no longer immediately preceded the delivery of food.     

Pavlovian conditioned stimulus effects upon instrumental choice behavior are reinforcer specific

In a transfer-of-control experiment with rats, Pavlovian CSs were tested for the specificity of their effects. The instrumental behavior consisted of a discriminative, conditional two-lever choice task in which qualitatively different appetitive reinforcers were contingent upon the two correct choices. In a Pavlovian phase, subjects experienced conditioning to establish either a CS⁺ or CS^? for one reinforcer or a CS⁺ or CS^? for the other reinforcer. Finally, in a test, these CSs were presented when there was the opportunity to make choice responses. The CS⁺s evoked choices of the lever which had eventuated in the reinforcer that had served as the Pavlovian US, while the CS^?s showed only a slight tendency to evoke the other choice responses. When the CSs were compounded with the original S^Ds, the CS⁺s had little effect upon the vigor of responding while the CS^?s reduced the vigor of responding to the S^D for the reinforcer that was the same as the US used in establishing the CS^?. The results are discussed in terms of associative mediational theory and the reinforcer specificity of Pavlovian conditioned excitation and inhibition.     

Choice, foraging, and reinforcer duration.

Pigeons were exposed to a foraging schedule characterized by three different states, beginning with a search state in which completion of a variable interval on a white key led to a choice state. In the choice state the subject could, by appropriate responding on a fixed ratio of three, either accept or reject the schedule offered. If the subject accepted the schedule, it entered a handling state in which the appropriate reinforcer amount was presented according to a variable-interval schedule. In Experiment 1 the shorter duration reinforcer was more likely to be accepted the longer the duration of the search state and the shorter the equal durations of the handling states. In Experiment 2 the shorter duration reinforcer was more likely to be accepted the longer the handling time preceding the longer duration reinforcer. All of the results were in qualitative--and some were in quantitative--agreement with those predicted by the delay-reduction hypothesis and the optimal-diet model.     

A conditioned reinforcer maintained by temporal association with the termination of shock

Two experiments were conducted to determine whether a stimulus can be established as a positive conditioned reinforcer by associating it with the termination of shock, but without training the animal to make any response in its presence. In the first, six rats were conditioned to press a bar to terminate shock on a variable ratio schedule; white noise was then substituted as the immediate consequence, with the shock terminating 30 sec after the last press in its presence. It was found that the rate of pressing in the absence of noise depended on the contingency between the pressing and the noise. The second experiment sought to determine whether the difference in rates before and after the onset of the noise was due to the reinforcement of prior responding by the onset of the noise or to the suppression of subsequent responding by differential reinforcement of competing behavior. Six more rats were trained in the same manner, but with shock terminating 30 sec after the onset of the noise, regardless of what the animal did in its presence. Again the rate was higher before the onset of the noise, indicating that pressing was indeed maintained by the noise as a conditioned reinforcer.     

Acute alcohol intoxication paired with aversive reinforcement: ethanol odor as a conditioned reinforcer in rat pups

Previous research has suggested that infant rats process ethanol sensory properties during acute alcohol intoxication. The present study was designed in order to examine if alcohol odor could act as an aversive conditioned stimulus after the organism experiences the state of intoxication paired with nociceptive stimulation (footshock). In a first experiment 11-day-old pups received intragastric alcohol administration (1.5 g/kg). At different postabsorptive intervals footshock was presented (0-30, 30-60, 60-90, or 90-120 min). An explicitly unpaired control group which experienced footshock prior to the state of intoxication was also employed. All animals were subsequently tested in terms of alcohol intake and ethanol locational odor preferences. Both assessments indicated that pups which were exposed to the unconditioned peripheral stimulus 30-60 min after receiving ethanol expressed strong alcohol aversions. In a second experiment pups were exposed to footshock during this postabsorptive interval. Twenty four hours later, pups experienced ambient ethanol odor paired with soft or rough texture surfaces. Differential texture aversions were registered in experimental animals when compared with controls which suffered the state of intoxication explicitly unpaired with footshock, or unpaired presentations of ethanol odor and the tactile stimuli under consideration. These results appear to support the hypothesis concerning orosensory processing during an acute state of intoxication. Additionally it seems that the hedonic value of sensory attributes of this drug varies as a function of associative processes occurring during such a state.     

Induction by reinforcer schedules.

Traditional strategies for determining whether a reinforcer schedule enhances the occurrence of an activity are reviewed and critically evaluated. A basic assumption underlying these strategies is that it is possible to isolate the effect of reinforcer intermittency on schedule induction. It is concluded that this is not, in fact, possible. An alternative approach is proposed that emphasizes the inductive effects of the reinforcer schedule as a unit and the effects of particular aspects of the reinforcer schedule (e.g., interreinforcer interval, repetition of the reinforcer, reinforcer magnitude).     

Superconditioning from a reduced reinforcer

In four autoshaping experiments pigeons received conditioned inhibition training of the form A++, AB-, where ++ is a strong reinforcer and - is nonreinforcement. Subsequent AB+ training, in which + is a moderate reinforcer, resulted in enhanced conditioning of A, relative to an A stimulus receiving no treatment, one receiving A+ treatment, and one receiving A++ treatment. This enhancement of conditioning to Aconstitutes a demonstration of “superconditioning”. The presence of the inhibitory B sufficiently enhanced the reinforcing power of the moderate reinforcer (+) that it was able to further increase the excitation controlled by A. This occurred even though A had previously been paired with a stronger reinforcer (++). Superconditioning was also observed when A and B were extinguished prior to treatment with + or were originally neutral stimuli followed by + in the presence of an inhibitor trained elsewhere.     

Effects of social context, reinforcer probability, and reinforcer magnitude on humans' choices to compete or not to compete.

In the first two experiments, subjects' choices to earn points (exchangeable for money) either by competing with a fictitious opponent or by not competing were studied. Buskist, Barry, Morgan, and Rossi's (1984) competitive fixed-interval schedule was modified to include a second response option, a noncompetitive fixed-interval schedule. After choosing to enter either option, the opportunity for reinforcers became available after the fixed-interval's duration had elapsed. Under the no-competition condition, points were always available after the interval had elapsed. Under the competition condition, points were available based on a predetermined probability of delivery. Experiments 1 and 2 examined how reinforcer probabilities and reinforcer magnitudes affected subjects' choices to compete. Several general conclusions can be made about the results: (a) Strong preferences to compete were observed at high and moderate reinforcer probabilities; (b) competing was observed even at very low reinforcer probabilities; (c) response rates were always higher in the competition component than in the no-competition component; and (d) response rates and choices to compete were insensitive to reinforcer-magnitude manipulations. In Experiment 3, the social context of this choice schedule was removed to determine whether the high levels of competing observed in the first two experiments were due to a response preference engendered by the social context provided by the experimenters through instructions. In contrast to the first two experiments, these subjects preferred the 60-s fixed-interval schedule (formerly the no-competition option), indicating that the instructions themselves were responsible for the preference to compete. This choice paradigm may be useful to future researchers interested in the effects of other independent variables (e.g., drugs, social context, instructions) on competitive behavior.