The effects upon food-reinforced pecking and treadle-pressing of auditory and visual signals for response-independent food

Seven pigeons whose key-pecking was maintained by food reinforcement on a differential-reinforcement-of-low-rates 12-sec limited-hold 4-sec schedule and 12 other pigeons whose treadle-pressing was maintained by the same schedule received appetitive Pavlovian conditioning trials superimposed upon the instrumental baseline. Half the birds in each group received a tone as the CS, and the other half received a stimulus change on the key. Each CS was 20 sec long, and was immediately followed by 10-sec access to grain. The visual CS markedly facilitated the rate of pecking on the key for the birds whose baseline response was pecking. The visual CS produced auto-shaping of the key-peck and tended to produce suppression of treadle-pressing for the birds whose baseline response was treadle-pressing. The auditory CS produced inconsistent effects across birds regardless of the baseline response. In all cases the conditioned effects extinguished when response-independent food was omitted.     

Effects of differences in achievement motivation and amount of exposure on responses to uncontrollable rewards

Within a triadic experimental design, 80 subjects classified as high or low in achievement motivation were given either standard or extended exposure to uncontrollable rewards. Subjects high in achievement motivation displayed facilitation following standard training that was eliminated following extended training. While this conforms with Wortman and Brehm's model integrating reactance theory and learned helplessness theory, in general the results were more accurately described by predictions based on a modification of the theory of achievement motivation. Because the experimental procedure induced the perception of uncontrollability independently of perceived failure, the results were seen as extending the generality of the latter theory.     

A parametric study of learned helplessness in humans

In two experiments designed to assess the effect of varying amounts of exposure to noncontingency training, it was discovered that performance decrements could be produced after relatively brief training and again after extended training. Between these conditions was a period of recovery during which no performance deficits were evident. There was also a tendency for individual differences in motivation to moderate deficits following brief but not extended training. A four-stage model is proposed to account for these results. In response to uncontrollable outcomes, individuals are said to pass through a phase of no effect, followed by temporary helplessness, recovery, and final helplessness. The model also proposes that motivational differences and perceptions of noncontingency exert independent and opposing influences on learned helplessness deficits.     

Attributional processes in the learned helplessness paradigm: behavioral effects of global attributions

Following the learned helplessness paradigm, I assessed in this study the effects of global and specific attributions for failure on the generalization of performance deficits in a dissimilar situation. Helplessness training consisted of experience with noncontingent failures on four cognitive discrimination problems attributed to either global or specific causes. Experiment 1 found that performance in a dissimilar situation was impaired following exposure to globally attributed failure. Experiment 2 examined the behavioral effects of the interaction between stable and global attributions of failure. Exposure to unsolvable problems resulted in reduced performance in a dissimilar situation only when failure was attributed to global and stable causes. Finally, Experiment 3 found that learned helplessness deficits were a product of the interaction of global and internal attribution. Performance deficits following unsolvable problems were recorded when failure was attributed to global and internal causes. Results were discussed in terms of the reformulated learned helplessness model.     

Learned helplessness,depression and the perception of reinforcement

Depressed and nondepressed subjects were given escapable, inescapable, or no noise. Then, their perceptions of reinforcement contingencies in skill and chance tasks were assessed. Depressed-no noise and nondepressed-inescapable noise subjects exhibited smaller decreases in expectancy following failure in skill, but not in chance, than nondepressed-no noise subjects. So, depression and inescapable noise both produced perception of failure in skill as response-independent. Contrary to predictions, neither depression nor inescapable noise had a significant effect on increases in expectancy after success. These results partially support the learned helplessness model of depression which claims that a belief in independence between responding and reinforcement is central to the etiology and symptoms of depression in man.     

Effects of amount of helplessness training and internal-external locus of control on mood and performance.

Based on Wortman and Brehm's integration of reactance theory with Seligman's model of learned helplessness, an investigation was conducted to examine the effects of amount of helplessness training and internal--external locus of control on subsequent task performance and on self-ratings of mood. Subjects were divided into "internal" and "external" groups and were then given either high, low, or no helplessness training on a series of concept-formation problems. After completing a mood checklist, all subjects worked on an anagram task presented as a second experiment by a second experimenter. The results revealed that internals exhibited greater performance decrements and reported greater depression under high helplessness than did externals. In the low helplessness conditions, internals tended to perform better than control subjects, while externals tended to perform worse than control subjects; low helplessness subjects also reported the highest levels of hostility. The results are discussed within the context of Wortman and Brehm's integration of reactance and learned helplessness theories.     

Learned helplessness in groups

Group learned helplessness is demonstrated in Experiment I. Groups of 2 tried to turn off noise by their joint action. In the solvable group (S), noise offset was contingent on their sequence of button pushing. In the yoked, unsolvable group (U), noise offset was independent of all sequences of button pushes they produced. In a practice group (O). subjects practiced coordinated sequences of button pushes with their partners, but heard no noise. Later, all 3 groups were tested in pairs in a shuttlebox which required coordinated joint responding to turn off noise. The unsolvable group escaped more poorly than the other 2 groups, paralleling helplessness effects with individuals. Experiment 2 and 3 found no transfer from individual helplessness training to group testing and no transfer from group helplessness training to individual testing. We suggest that the same mechanism, the expectation of response ineffectiveness, may mediate both individual and group learned helplessness.     

Rats learn the relationship between responding and environmental events: An expansion of the learned helplessness hypothesis

Previous research has shown that preexposure to inescapable shock interferes with subsequent acquisition of escape responding, while pretraining with escapable shock facilitates subsequent acquisition of a different escape response. It has also been demonstrated that interference and facilitation persist when the aversive event is changed between the two phases of training. The present experiment extended these findings, showing generalized learning from an appetitive to an aversive situation. Six groups of rats received the following treatment in the presence of discriminative stimuli: One group was trained to nose press for food, a second to chain pull for food, and a third to chain pull to escape or avoid shock. Two groups received either signalled free food or inescapable shock, and a naive control group received no pretreatment. All groups were then tested in a nose-press escape-avoidance situation. The three groups with prior response training acquired responding most rapidly, and at the same rate. The naive controls acquired responding slowly, and the two groups with response-independent histories did not acquire responding during the 5 days of training. It was concluded that rats learn the relationship between responding and environmental events and that such learning strongly influences subsequent learning.     

Learned helplessness and immunization: sensitivity to response-reinforcer independence in immunized rats

In experiments 1 and 2, we examined the learned helplessness and immunization effects using a test in which appetitive responding was extinguished by delivering noncontingent reinforcers. Contrary to learned helplessness theory, "immunized" animals showed performance virtually identical to that of animals exposed only to inescapable shock, and different from nonshocked controls. Experiment 2 suggests that the helplessness effect and the lack of immunization are not due to direct response suppression resulting from shock. In Experiment 3, where the immunization effect was assessed by measuring the acquisition of a response to obtain food when there was a positive response-reinforcer contingency, immunization was observed. These results cannot be explained on the basis of proactive interference, but suggest that animals exposed to the immunization procedure acquire an expectancy of response-reinforcer independence during inescapable shock. Thus, immunization effects may reflect the differential expression of expectancies, rather than their differential acquisition as learned helplessness theory postulates.     

Response-independent milk delivery enhances persistence of pellet-reinforced lever pressing by rats

If, during training, one stimulus is correlated with a higher rate of reinforcement than another, responding will be more resistant to extinction in the presence of that higher rate signal, even if many of the reinforcers have been presented independently of responding. For the present study we asked if the response-independent reinforcers must be the same as the response-dependent reinforcers to enhance the response's persistence. Twelve Long-Evans hooded rats obtained 45-mg food pellets by lever pressing (variable-interval 100-s schedules) in the presence of two discriminative stimuli (blinking vs. steady lights) that alternated every minute during daily sessions. Also, in the presence of one of the stimuli (counterbalanced across rats), the rats received additional response-independent deliveries of sweetened condensed milk (a variable-time schedule). Extinction sessions were exactly like training sessions except that neither pellets nor milk were presented. Lever pressing was more resistant to extinction in the presence of the milk-correlated stimulus when (a) the size of the milk deliveries during training (under a variable-time 30 s schedule) was 0.04 ml (vs. 0.01 ml) and (b) 120-s or 240-s blackouts separated components. Response-independent reinforcers do not have to be the same as the response-dependent reinforcers to enhance persistence.     

The cognitive specificity of learned helplessness and depression deficits: The role of self-focused cognitions

Abstract

Four experiments assessed similarities and differences in learned helplessness and depression-related deficits in cognitive performance and self-focused cognitions. Subjects answered the Beck Depression Inventory (Beck, Ward, Mendelson, Mock, & Erbaugh, 1961), were exposed to no-feedback or failure in unsolvable problems, and their response time in a digit comparison task (with or without a memory component, with different number of digits, and different number of mental transformations) and self-focused cognitions were assessed. Learned helplessness and depression deficits were found in a memory task, and the deficits increased with the number of digits. Depression deficits also increased with the number of transformations, and were also found in the no-memory/two transformation condition. Finally, task-related worries were related to learned helplessness deficits, and task-irrelevant thoughts were related to depression deficits. Findings were discussed in terms of the cognitive specificity of learned helplessness and depression deficits.     

Resistance to the response-decrementing effects of response-independent reinforcement produced by delay and non-delay schedules of reinforcement

In two experiments, animals were initially exposed to response-dependent schedules of food before exposure to response-independent reinforcement matched for overall rate and temporal distribution of reinforcers to the preceding condition. In Experiment I, response decrements during the response-independent phase were smaller after delayed reinforcement training than after a comparable immediate reinforcement schedule, for both doves and rats. In Experiment II variable-interval and variable-ratio schedules, both with either immediate or delayed reinforcement, were used with rats. Both the delayed reinforcement schedules produced resistance to subsequent response-independent reinforcement, but response decrements were larger after either of the immediate reinforcement conditions. It was concluded that the critical factor in response maintenance under response-independent reinforcement was the type of response-reinforcer contiguities permitted under the response-dependent schedule rather than perception of response-reinforcer “contingencies”. If the response-dependent schedule was arranged so that behaviours other than a designated operant (key pecking or lever pressing) could be contiguous with food, responding was maintained well under response-independent schedules.     

Learned helplessness as a schedule-shift effect

The essentials of learned helplessness theory are described and supporting evidence surveyed. It is shown that two main empirical phenomena are associated with learned helplessness: a low rate of responding in laboratory animals following numerous discrete trials with continuous free relief and in human subjects following continuous nonrelief/reward or traditional extinction. The explanation Seligman and Maier give for these findings is critically analyzed and found to be unsupported at several critical points. The “patchwork” nature of the theory and observations is considered and it is contended that what is new in learned helplessness research is a schedule-shift effect like that observed when extinction follows partial reinforcement. A schedule-shift discrimination theory of “learned helplessness” effects is offered which is closely parallel to a widely accepted explanation of other schedule-shift effects, notably the partial reinforcement extinction effect. Although the behavioral effects of some schedule shifts resemble clinical depression, the latter is a more complex behavioral phenomena than the former which in turn has broader relevance to human behavior than just depression.     

Learning impairment following insoluble problems: Learned helplessness or altered hypothesis pool?

According to the learned helplessness hypothesis, the learning impairment typically displayed by subjects previously given insoluble problems results from the veridical learning of response-outcome independence. This learning is represented as a belief in helplessness which interferes with the subsequent acquisition of adaptive responses. However, this interpretation is suspect since subjects in a psychology experiment tend not to learn that random relationships are random. Instead, an alternative interpretation of these findings attributes the learning impairment following insoluble problems to a hypothesis pool alteration in the direction of (inappropriately) complex hypotheses. This alternative interpretation tended to be supported ported in Experiment 1, which varied the difficulty of the test task and found the impairment (relative to a no-treatment control) following insolubility to be inversely proportional to the test difficulty. In contrast, Experiment 2 employed a procedure which facilitated the attribution of response-outcome independence and found the impairment following insolubility to be directly proportional to the test difficulty. It was concluded that the results of Experiment 2 represented learned helplessness.     

Animal learning of independent and correlated events

Evidence suggests that experience of a truly random presentation of a conditioned and unconditioned stimulus (CS and US) retards subsequent acquisition of a classically conditioned response when the CS and US are paired. In these studies, no events reliably predict the US during the first part of training. The present experiment demonstrated impairment of subsequent appetitive conditioning in rats following a random CS-US presentation, both when another predictive cue is present and when it is absent during this experience. Results are discussed with reference to “general attention” theory, and learned helplessness. However, the data support an interpretation in terms of learning a specific relationship between a particular CS and US.     

A revised model of learned helesspleness in humans1

The present paper presents a revised model of learned helplessness in humans. The conditions under which performance deficits (helplessness) or enhanced performance (facilitation) will result from exposure to objective noncontingency are defined by a number of variables that have been shown to have an impact on human helplessness. The reformulated model specifies the operation of moderating variables as they affect a number of relationships: that between objective noncontingency and the perception of noncontingency; that between the perception of noncontingency and the future expectancy of response-reinforcement independence; and finally that between the expectancy of response-reinforcement independence and the behavirol deficits associated with learned helplessness. It is argued that exposure to noncontingency can affect both the value of future reward and the perceived probability of obtaining it. Performance deficits or enhanced performance will result from the perception of noncontingency depending on the nature of this double-edged effect of exposure to noncontingent delivery of reward.     

Effects of alternative reinforcement on human behavior: the source does matter

Competing theories regarding the effects of delivering periodic response-independent reinforcement (more accurately, response-independent points exchanged for money) on a baseline rate of behavior were evaluated in human subjects. Contiguity theory holds that these events decrease target responding because incompatible behavior is adventitiously strengthened when the point deliveries follow target behavior closely in time. Matching theory holds that response-independent points, like any other alternative reinforcer, should reduce target responding. On this view, temporal contiguity between target responding and response-independent point delivery is unimportant. In our experiment, four different responses (moving a joystick in four different directions) were reinforced with points exchangeable for money according to four independent variable-interval schedules. Different schedules of point delivery were then superimposed on these baselines. When all superimposed point deliveries occurred immediately after one of the four responses (the target response), time allocated to target responding increased. When the superimposed point deliveries could be delivered at any time, time allocated to target responding declined and other behavior increased. When superimposed points could never immediately follow target responses, time allocated to target responding decreased further and other behavior or pausing predominated. The findings underscore the contribution of temporal contiguity in the effects of response-independent deliveries of food, money, points, etc.     

A re-view of cognitive mediators in learned helplessness

The findings of Oakes and Curtis (1982), Tennen, Drum, Gillen, and Stanton (1982), and Tennen, Gillen, and Drum (1982) provide a challenge to learned helplessness theory's focus on cognitive mediators of the helplessness phenomenon. In response to these findings, Alloy (1982) argues that these studies do not challenge helplessness theory because they do not measure expected control and because they confuse necessary and sufficient causes of learned helplessness. Silver, Wortman, and Klos (1982) contend that these studies provide an inadequate test of the model because subjects are confronted with experiences which are unlike those in their natural environment. The present article argues that by Alloy's (1982) criteria, an adequate test of the learned helplessness model has not yet been conducted. Previous studies which measured expected control have not supported the model's predictions. Moreover, if perceived response–outcome independence is a sufficient, but not a necessary cause of learned helplessness, the model loses much of its heuristic value. In response to the argument that these studies lack ecological validity, this article clarifies the distinction between experimental realism and mundane realism. While real-world studies have discovered intriguing relations between perceptions of control, attributions, and coping with illness or victimization, they have not tested predictions of the learned helplessness model.     

Three accounts of the learned helplessness effect

Two experiments tested predictions drawn from test anxiety theory, learned helplessness theory, and Wortman and Brehm's (1975) integration of helplessness and reactance theories. Experiment 1 demonstrated that performance deficits predicted by learned helplessness do not rely on experimenter-induced failure. It also showed such deficits to be unrelated either to negative affect following exposure to pretreatment or to causal attributions about pretreatment task performance. Experiment 2 showed that experience of uncontrollability need not result in impaired performance, because failure on an unimportant task did not produce the deficits predicted by learned helplessness theory. This result provides qualified support for the integrative model. Finally, because the subjective measures used in Experiment 2 were not consistent with performance measures, the reliability of self-reports is questioned.     

Influence of two types of information trials on the formation of a discrimination-reversal learning set in Japanese monkeys

Abstract: Three groups of male adult Japanese monkeys were trained in 30 discrimination-reversal learning-set (LS) problems using the Wisconsin General Test Apparatus. A control group ( N = 3) was trained in the standard procedure: acquisition of up to 12 consecutive correct responses, reversal to the same criterion, and then shift to a new problem. To the other two groups, three information trials signaling the stimulus value in reversal were given after they reached the criterion in acquisition. Subjects in the positive-stimulus information (PSI) group ( N = 4) were exposed only to the reversal positive stimulus, and a response to it was rewarded. Subjects in the negative-stimulus information (NSI) group ( N = 4) were exposed only to the reversal negative stimulus, and any response to it was not rewarded. Information trials reduced reversal errors and NSI trials were more effective than PSI trials in error reduction ( p < .05). Information trials also aided in acquisition: the NSI and PSI groups learned the acquisition phase of the problems with significantly fewer errors than control group ( p < .01) in the last stage of training. The implications of these results are discussed in relation to strategy learning and attention learning in LS formation.