Motivational control of instrumental performance following a shift from thirst to hunger

Thirsty rats were trained to press a lever for either a sucrose solution or saline before performance was tested in extinction while the animals were either hungry alone or experiencing both hunger and a sodium appetite. Reinforcer-specific motivational control was observed in that the animals trained with the sucrose solution pressed more than those trained with the saline when they were tested hungry, but not when they were tested under combined hunger and sodium appetite. In order to assess the role of a Pavlovian incentive process in this effect, thirsty animals received non-contingent pairings of one stimulus with the sucrose solution and another with saline in the second experiment. In an extinction test the sucrose stimulus augmented lever pressing relative to the saline stimulus when the animals were hungry, but not when they were thirsty. In the subsequent experiments the contribution of the Pavlovian process was equated by giving concurrent training with both incentives. Lever pressing and chain pulling were reinforced concurrently, one with the sucrose solution and the other with saline, while the animals were thirsty. Once again, the animals pressed more in extinction if this action had been trained with the sucrose solution rather than the saline, but only if they were hungry rather than thirsty. Thus, instrumental performance across a thirst-to-hunger shift can also be controlled by an instrumental incentive process. The direct engagement of the instrumental process by this motivational shift contrasts to the absence of such control following a hunger-to-thirst transition (Dickinson & Dawson, 1987a), a fact attributed to the asymmetrical motivational interactions produced by water and food deprivation.     

The role of the instrumental contingency in the motivational control of performance

In four experiments we investigated an irrelevant incentive effect based upon a transition from hunger to thirst. Hungry rats were trained to lever press either for sucrose solution or for food pellets before performance was tested in extinction while they were thirsty. Reinforcer-specific motivational control was found in the first experiment in that the animals pressed the lever more on tests following training with the sucrose solution rather than with food pellets. Moreover, this effect was seen only when testing was conducted following water, but not following food deprivation. The outcome of the remaining experiments suggests that this motivational control is not mediated by the instrumental contingency between lever pressing and the sucrose reinforcer during training. In these studies lever pressing and chain pulling were reinforced concurrently, one with sucrose and the other with food pellets, in order to equate the noninstrumental functions of the incentives. Following this training, lever pressing in extinction under thirst was unaffected by the type of incentive used as its reinforcer during training.     

Effect of reinforcer devaluation on discriminative control of instrumental behavior

Two experiments examined the effect of reinforcer devaluation on the ability of a discriminative stimulus (Sd) to control instrumental behavior in Sprague-Dawley rats. In Experiment 1 reinforcer devaluation reduced, but did not eliminate, the ability of the Sd to control performance of the original response and to transfer its control to a new response trained with the same reinforcer. The effect of devaluation was more complete in Experiment 2, in which the reinforcer was delivered directly into the oral cavity. However, retraining the response with a different reinforcer partially restored the ability of the Sd to control performance of that response. These results suggest that an Sd may not augment its trained responses when the reinforcer has been completely devalued but may promote responses with which it shares a reinforcer, as long as those responses are associated with some reinforcer that retains its value. The implications of these results for the way that discriminative stimuli control instrumental behavior are discussed.     

The role of prior experience in language acquisition

Learners exposed to an artificial language recognize its abstract structural regularities when instantiated in a novel vocabulary (e.g., Gómez, Gerken, & Schvaneveldt, 2000; Tunney & Altmann, 2001). We asked whether such sensitivity accelerates subsequent learning, and enables acquisition of more complex structure. In Experiment 1, pre-exposure to a category-induction language of the form aX bY sped subsequent learning when the language is instantiated in a different vocabulary. In Experiment 2, while naíve learners did not acquire an acX bcY language, in which aX and bY co-occurrence regularities were separated by a c-element, prior experience with an aX bY language provided some benefit. In Experiment 3 we replicated this finding with a 24-hour delay between learning phases, and controlled for prior experience with the aX bY language's prosodic and phonological characteristics. These findings suggest that learners, and the structure they can acquire, change as a function of experience.     

The effect of the instrumental training contingency on susceptibility to reinforcer devaluation

Two experiments investigated performance of instrumental lever pressing by rats following post-conditioning devaluation of the sucrose reinforcer produced by establishing an aversion to it. In Experiment I rats responded less in an extinction test after being averted from the sucrose following training on a ratio schedule, but not following an equivalent amount of training on an interval schedule. This was true even though the devalued sucrose would not act as an effective reinforcer on either the ratio or interval schedule. Experiment II provided a further investigation of the insensitivity of interval responding to reinforcer devaluation by comparing test performance under simple extinction with responding when the devalued reinforcer was presented on either a response-contingent or non-contingent schedule during the test. Once again simple extinction performance was unaffected by prior reinforcer devaluation. Furthermore, neither non-contingent nor contingent presentations of the devalued reinforcer significantly depressed responding below the level seen in the extinction condition. Ratio, but not interval performance appears to be controlled by knowledge about the instrumental contingency that encodes specific properties of the training reinforcer.     

The role of prior task experience in temporal misestimation

The effect of experience with a preceding task on the accuracy of predictions of duration was examined in three experiments, where two tasks comprising similar or different mental operators were performed consecutively. Results supported an anchoring account of misestimation, which states that misestimation occurs because predictions are anchored to the duration of the preceding task. Preceding performance of a longer task led to overestimation on a shorter task with similar mental operators (Experiment 1), whereas preceding performance of a shorter task comprising similar or different mental operators led to underestimation on a longer task (Experiments 1 to 3). Contrary to the planning fallacy account (Kahneman & Tversky, 1979), these findings indicate that preceding task performance is considered when predicting duration, but that using such information does not necessarily improve accuracy.     

The role of prior task experience in temporal misestimation

The effect of experience with a preceding task on the accuracy of predictions of duration was examined in three experiments, where two tasks comprising similar or different mental operators were performed consecutively. Results supported an anchoring account of misestimation, which states that misestimation occurs because predictions are anchored to the duration of the preceding task. Preceding performance of a longer task led to overestimation on a shorter task with similar mental operators (Experiment 1), whereas preceding performance of a shorter task comprising similar or different mental operators led to underestimation on a longer task (Experiments 1 to 3). Contrary to the planning fallacy account (Kahneman & Tversky, 1979), these findings indicate that preceding task performance is considered when predicting duration, but that using such information does not necessarily improve accuracy.     

Variations in the sensitivity of instrumental responding to reinforcer devaluation

In five experiments hungry rats were trained to make a lever press response for a sucrose reinforcer. That sucrose was subsequently devalued by conditioning a food-aversion to it, and the ability of the rats to integrate knowledge about the instrumental contingency with that gained from aversion training was assessed in an extinction test. Experiment I showed successful integration following limited but not extended instrumental training. Experiment II suggested that the crucial factor was the spacing of training; successful integration was seen after massed but not distributed training. The third experiment implicated distributed experience with the reinforcer, rather than distributed response practice, in failures of integration. Experiment IV showed that if the distribution of food-aversion learning was dissimilar to that of instrumental training then a failure of integration could result; this finding was able to account for the distribution of training effects seen in previous studies, but not the effect of extended training. Experiment V replicated the extended training effect seen in Experiment I, and provided evidence that this may reflect the degree of exposure to the reinforcer rather than the extent of response practice.     

The role of prior quitting experience in the prediction of smoking cessation

Aims: In the Transtheoretical Model (TTM), the preparation stage (as applied to smoking cessation) is defined as planning to quit in the next 30 days plus having quit for at least 24 h in the last year. This study examined the value of prior quitting experience as a stage classification criterion by investigating whether prediction of making a quit attempt differed as a function of prior quitting experience. Participants: One thousand and forty-six participants, all planning to quit in the next 30 days, in a randomised trial of the effectiveness of a telephone counselling and computer-generated tailored advice intervention were followed up at 3 months. Findings: A multivariate predictive model had markedly greater capacity to predict making a quit attempt among participants with prior quitting experience (as defined in several different ways), compared to analyses of the overall sample. A previous attempt of 24 h in the previous month was associated with the greatest difference in prediction. A quit attempt in the previous year (the TTM definition) did not discriminate. Conclusions: Recent prior quitting experience moderated the predictive capacity of some variables that influence smoking cessation. The findings provide some support for a stage model of smoking cessation but not its operationalisation by the TTM.     

Incentive learning and the motivational control of instrumental performance

Hungry rats were trained to press a lever and pull a chain concurrently, with one action being reinforced with a sucrose solution and the other with food pellets. In addition, in the first two experiments all animals experienced non-contingent presentations of the two incentives in the absence of the operant manipulanda while either thirsty or hungry and either before (Experiment 1A) or after (Experiment 1B) the instrumental training. When lever pressing was assessed subsequently in extinction under thirst, the animals pressed at a relatively high rate only if (1) this action had been reinforced with the sucrose solution rather than the food pellets during training and (2) they had received the non-contingent presentations of the sucrose solution and food pellets on days on which they were thirsty rather than hungry. A third experiment demonstrated that non-contingent exposure to the sucrose solution alone, but not to water under thirst was sufficient to bring about this type of motivational control of instrumental performance.     

Pavlovian processes in the motivational control of instrumental performance

Hungry rats were rewarded for pressing a lever on a multiple schedule. During one component the reward was a sucrose solution, whereas food pellets acted as the reward during another component. Lever pressing was never rewarded during the third component. When the drive state was switched from hunger to thirst and the animals tested in extinction, they pressed more in the presence of the component stimulus that had been associated with the sucrose reward during training. A similar effect was observed during the extinction test of a second study in which the component stimuli had signalled non-contingent presentations of either the sucrose or pellet rewards in the absence of the lever. This suggests that the instrumental irrelevant incentive effect observed in the first experiment was due, at least in part, to the Pavlovian relationship between the component stimuli and the reinforcers during training. In fact, when the size of the effects controlled by purely Pavlovian and supposedly instrumental contingencies was compared directly in the final study, no difference could be detected.     

The role of experience in spatial test performance: A meta-analysis

The hypothesis that spatial ability is, in part, experientially determined, and that sex differences in spatial ability can be explained by sex differences in spatial experience, can be studied in a correlational manner by examining the relationship between spatial activity participation and spatial ability test performance for males and females. Alternatively, an experimental training situation, comparing male and female susceptibility to training, has been proposed to test the hypothesis that environment has an impact on spatial skills and sex differences in ability. Both lines of research are reviewed here, through the use of meta-analytic techniques. The first meta-analysis reveals a weak but reliable relationship between spatial activity participation and spatial ability. This relationship appears similar for males and females. The second meta-analysis reveals that spatial ability test performance can be improved by training for both sexes. This improvement does not appear different for males and females, however, contrary to a predominant hypothesis in the literature. Training to asymptote may be a better test of the relevance of differential experience to sex differences. Content and duration of training are also discussed as important factors in the effectiveness of training.This research was supported by Grant No. MH39671 from the National Institute of Mental Health. A version of this paper was presented at the biennial meetings of the Society for Research in Child Development, Baltimore, Maryland, April 1987. We are grateful to Margaret Signorella and Susan Resnick for providing data. We would also like to thank Judith Dubas, Susan Resnick, Ralph Rosnow, Carolyn Spies, Lance Weinmann, and Marsha Weinraub for helpful comments on earlier drafts of this article.     

The role of temporal intervals on reinforcer accumulation

Animals accumulate reinforcers when they forgo the opportunity to consume available food in favor of acquiring additional food for later consumption. Laboratory research has shown that reinforcer accumulation is facilitated when an interval (either spatial or temporal) separates earning from consuming reinforcers. However, there has been no systematic investigation on the interval separating consuming reinforcers from earning additional reinforcers. This oversight is problematic because this second interval is an integral part of much of the previous research on reinforcer accumulation. The purpose of the current study was to determine the independent contributions of these two temporal intervals on reinforcer accumulation in rats. Each left lever press earned a single food pellet; delivery of the accumulated pellet(s) occurred upon a right lever press. Conditions varied based on the presence of either an intertrial interval (ITI) that separated pellet delivery from the further opportunity to accumulate more pellets, or a delay‐to‐reinforcement that separated the right lever press from the delivery of the accumulated pellet(s). Delay and ITI values of 0, 5, 10 and 20 s were investigated. The delay‐to‐reinforcement conditions produced greater accumulation relative to the ITI conditions, despite accumulation increasing the density of reinforcement more substantially in the ITI conditions. This finding suggests that the temporal separation between reinforcer accumulation and subsequent delivery and consumption was a more critical variable in controlling reinforcer accumulation.     

Stimulus control in a simple instrumental task: The role of internal and external stimuli

Two experiments using rats in a straight alley runway task tested the hypothesis that standard stimuli such as tones and lights (“external” stimuli) and schedule-generated aftereffect stimuli (“internal” stimuli) operate similarly and are similarly subject to the compounding rules specified by R. A. Rescorla and A. R. Wagner (In A. Black & W. Prokasy (Eds.), Classical conditioning II: Current theory and research. New York: Appleton-Century-Crofts, 1972). The experimental task was an instrumental analog of the classic blocking experiment (L. J. Kamin, In M. R. Jones (Ed.). In Experiment 1, blocking of an external discriminative stimulus by a different asymptotic discrimination was accomplished. In Experiment 2, blocking of an internal stimulus discrimination by an asymptotic external stimulus discrimination was obtained. The present results support the view that internal and external stimuli are indeed similar and function in the same manner with regard to blocking of stimulus control.     

Motivational determinants of motor performance: The hidden second task

Summary The present study was designed to test facilitating and debilitating effects of motivational processes on motor behavior. It was predicted that motivational processes have a more pronounced effect on motor performance when control is frequently transferred to attentional mechanisms (i. e., early in the acquisition phase). The results were consistent with this expectation. A strong motive to achieve success and pretreatment designed to enhance achievement motivation were associated with an increase in the quality of performance. A strong tendency to engage in state-oriented cognitive activities, by contrast, (e.g., thinking about the potential threat to one's selfesteem resulting from failure) was associated with poorer performance, It is concluded that experiments on motor behavior in which subjects are instructed to perform a single motor task may actually involve dual-task (or even multiple-task) performance if some part of the subjects' attentional capacity is used for task-irrelevant cognitive activities.     

Delayed matching-to-sample performance: Effects of relative reinforcer frequency and of signaled versus unsignaled reinforcer magnitudes

Six pigeons were trained on a delayed red-green matching-to-sample task that arranged four delays within sessions. Matching responses intermittently produced either 1.5-s access to food or 4.5-s access to food, and nonmatching responses produced either 1.5-s or 4.5-s blackout. Two phases were conducted: a signaled phase in which the reinforcer magnitudes (small and large) were signaled by houselights (positioned either on the left or right of the chamber), and an unsignaled phase in which there was no correlation between reinforcer magnitude and houselight position. In both phases, the relative frequency with which red and green matching responses produced food was varied across five values. Both matching accuracy and the sensitivity of performance to the distribution of reinforcers for matching responses decreased with increasing delays in both phases. In addition, accuracy and reinforcer sensitivity were significantly lower on signaled small-reinforcer trials compared with accuracy and sensitivity values on signaled large-reinforcer trials and on both types of unsignaled trials. These results are discussed in the context of research on both nonhuman animal and human memory.     

Motivational cues: The role of perceived senders' self‐control ability in raters' deception judgements

Previous studies have found that senders' personal traits may be used by others to make judgements about the senders' truthfulness. Two studies were conducted to examine whether perceived self‐control ability has an effect on deception judgement. Perceived self‐control was hypothesized to act as a motivational cue that participants would use to assess the sender's motivation to lie, which in turn would influence their deception judgement. Results revealed that when participants assessed the sender as having higher self‐control ability, they would consider the sender to be less motivated to lie in daily life (Study 1), and judge the sender more truthful in a text‐based deception judgement task (Study 2). However, the effect of perceived self‐control ability disappeared in a video‐based task (Study 2), likely due to the multitude of various cues available in audio‐visual stimuli. The theoretical and applied implications of the results are discussed.     

Virtual navigation performance: the relationship to field of view and prior video gaming experience

Two experiments examined whether learning a virtual environment was influenced by field of view and how it related to prior video gaming experience. In the first experiment, participants (42 men, 39 women; M age = 19.5 yr., SD = 1.8) performed worse on a spatial orientation task displayed with a narrow field of view in comparison to medium and wide field-of-view displays. Counter to initial hypotheses, wide field-of-view displays did not improve performance over medium displays, and this was replicated in a second experiment (30 men, 30 women; M age = 20.4 yr., SD = 1.9) presenting a more complex learning environment. Self-reported video gaming experience correlated with several spatial tasks: virtual environment pointing and tests of Judgment of Line Angle and Position, mental rotation, and Useful Field of View (with correlations between .31 and .45). When prior video gaming experience was included as a covariate, sex differences in spatial tasks disappeared.     

Motivational control of blocking

Hungry and thirsty rats lever pressed for food pellets in 1 visual stimulus (V1) and for a saline solution in another stimulus (V2). In a 2nd phase, the rats were made either hungry or thirsty and pressed for a starch solution in 2 stimulus compounds, each containing 1 of the visual cues and an auditory cue, that is, V1A1 and V2A2. On test, rats responded less to A1 than to A2 when hungry but less to A2 than to A1 when thirsty. Two further experiments replicated this selective blocking effect when the rats were both hungry and thirsty during Phase 2 and demonstrated that the magnitude of blocking was comparable to that observed when the reinforcer identity was held constant across the 2 phases.