Revisiting the role of bad news in maintaining human observing behavior

Results from studies of observing responses have suggested that stimuli maintain observing owing to their special relationship to primary reinforcement (the conditioned-reinforcement hypothesis), and not because they predict the availability and nonavailability of reinforcement (the information hypothesis). The present article first reviews a study that challenges that conclusion and then reports a series of five brief experiments that provide further support for the conditioned-reinforcement view. In Experiments 1 through 3, participants preferred occasional good news (a stimulus correlated with reinforcement) or no news (a stimulus uncorrelated with reinforcement) to occasional bad news (a stimulus negatively correlated with reinforcement). In Experiment 4 bad news was preferred to no news when the absence of stimulus change following a response to the bad-news option was reliably associated with good news. When this association was weakened in Experiment 5 the results were intermediate. The results support the conclusion that information is reinforcing only when it is positive or useful. As required by the conditioned-reinforcement hypothesis, useless information does not maintain observing.     

Conditioned reinforcement and response strength

Stimuli associated with primary reinforcers appear themselves to acquire the capacity to strengthen behavior. This paper reviews research on the strengthening effects of conditioned reinforcers within the context of contemporary quantitative choice theories and behavioral momentum theory. Based partially on the finding that variations in parameters of conditioned reinforcement appear not to affect response strength as measured by resistance to change, long-standing assertions that conditioned reinforcers do not strengthen behavior in a reinforcement-like fashion are considered. A signposts or means-to-an-end account is explored and appears to provide a plausible alternative interpretation of the effects of stimuli associated with primary reinforcers. Related suggestions that primary reinforcers also might not have their effects via a strengthening process are explored and found to be worthy of serious consideration.     

The CS-Preexposure Effect in Conditioned Taste-Aversion Learning in Golden Hamsters

In Experiment 1, golden hamsters were injected with either 0.9% saline or the nausea-inducing agent, lithium chloride (LiCL), immediately after consuming a flavored diet that was either novel or familiar. The LiCl-induced aversion was strong in hamsters for which the flavored diet was novel, but no significant aversion was observed in hamsters that were familiar with the flavored diet. In Experiment 2, the strength of the LiCl-induced aversion was related inversely to the amount of conditioned-stimulus (CS) preexposure and directly to the duration of the preexposure-conditioning interval. Thus, although some previous researchers have suggested that hamsters may not demonstrate the CS-preexposure effect in a conditioned taste-aversion paradigm, they clearly did so under the conditions of the present experiments, and moreover, the characteristics of the CS-preexposure effect in hamsters were generally similar to those observed in rats.     

The Effect of Negative Incentives in Serial Learning: VII. Theory of Punishment

Eighty three-, four-, five-, and six-year-old boys and girls were presented with experimental conditions where context, transformational complexity, and verbal cue were varied, Two experimental tasks, a perceptually Concrete and an Abstract task, were included and Ss were assigned to a Verbal Cue or a Nonverbal Cue condition. All Ss responded to both the present progressive and the past tenses. Results revealed significant effects of the Age and Tense factors, and improved performance on Comprehension over Production. Younger children made fewer overall errors than older ones. Ss performed better on the present progressive than on the past tense on the perceptually Concrete task, while the reverse was true on the Abstract task. These findings demonstrate that language performance is the result of a complex interrelationship between transformational complexity and the perceptual properties of linguistic structures.     

Resurgence of goal-directed actions and habits

This study investigated how goal-directed and habitual behaviors recover after extinction within the context of the resurgence effect, a form of relapse induced by the removal or worsening of alternative reinforcement. Rats were trained to press a target lever with one reinforcer (O1) for either minimal (4) or extended (16) sessions. An extinction test after the completion of O1 devaluation confirmed that minimal and extended training formed goal-directed and habitual behaviors, respectively. Then, pressing an alternative lever was reinforced with a second reinforcer (O2) while the target response was placed on extinction. When O2 was discontinued, the minimally trained target response resurged with goal-directed status as in the extinction test. However, the extinguished habitual behavior in the extensively trained rats did not recover as a habit but instead with goal-directed status, possibly due to the context specificity of habits or the introduction of a new response–reinforcer contingency. The critical finding that reinforcer devaluation consistently led to less resurgence regardless of the amount of acquisition training provides a clinical implication that coupling differential-reinforcement-of-alternative-behavior (DRA) treatments with the devaluation of the associated reinforcer of problematic behavior could effectively diminish its recurrence.     

The effects of preexposure-test and conditioning-test intervals on the magnitude of latent inhibition

Using the conditioned taste aversion paradigm, two experiments were conducted to examine the effects of the interval between preexposure and test and that between conditioning and test on the magnitude of latent inhibition. Experiment 1 revealed that the degree of latent inhibition was attenuated when rats were given a 21‐day interval between preexposure and test. It was also found that this attenuation was more marked in subjects which were given conditioning immediately after preexposure than those which were conditioned shortly before the test. Retention interval between preexposure and test was reduced to 12 days in Experiment 2, and exactly the same pattern of results as those found in Experiment 1 was obtained. These findings suggest that the memory of conditioning as well as that of preexposure decreases its retrievability after a long retention interval, although the former is more retainable than the latter.     

Stimulus Equivalence: Effects Of A Default-response Option On Emergence Of Untrained Stimulus Relations

Human subjects were exposed to a concurrent-chains schedule in which reinforcer amounts, delays, or both were varied in the terminal links, and consummatory responses were required to receive points that were later exchangeable for money. Two independent variable-interval 30-s schedules were in effect during the initial links, and delay periods were defined by fixed-time schedules. In Experiment 1, subjects were exposed to three different pairs of reinforcer amounts and delays, and sensitivity to reinforcer amount and delay was determined based on the generalized matching law. The relative responding (choice) of most subjects was more sensitive to reinforcer amount than to reinforcer delay. In Experiment 2, subjects chose between immediate smaller reinforcers and delayed larger reinforcers in five conditions with and without timeout periods that followed a shorter delay, in which reinforcer amounts and delays were combined to make different predictions based on local reinforcement density (i.e., points per delay) or overall reinforcement density (i.e., points per total time). In most conditions, subjects' choices were qualitatively in accord with the predictions from the overall reinforcement density calculated by the ratio of reinforcer amount and total time. Therefore, the overall reinforcement density appears to influence the preference of humans in the present self-control choice situation.     

Choice with delayed and probabilistic reinforcers: effects of prereinforcer and postreinforcer stimuli.

In Experiment 1, pigeons' pecks on a green key led to a 5-s delay with green houselights, and then food was delivered on 20% (or, in other conditions, 50%) of the trials. Pecks on a red key led to an adjusting delay with red houselights, and then food was delivered on every trial. The adjusting delay was used to estimate indifference points: delays at which the two alternatives were chosen about equally often. Varying the presence or absence of green houselights during the delays that preceded possible food deliveries had large effects on choice. In contrast, varying the presence of the green or red houselights in the intertrial intervals had no effects on choice. In Experiment 2, pecks on the green key led to delays of either 5 s or 30 s with green houselights, and then food was delivered on 20% of the trials. Varying the duration of the green houselights on nonreinforced trials had no effect on choice. The results suggest that the green houselights served as a conditioned reinforcer at some times but not at others, depending on whether or not there was a possibility that a primary reinforcer might be delivered. Given this interpretation of what constitutes a conditioned reinforcer, most of the results were consistent with the view that the strength of a conditioned reinforcer is inversely related to its duration.