Order of partial and consistent reward,reward magnitude shift,and resistance to extinction

In a separate-phase runway experiment with rats, four schedules involving partial (P) and consistent (C) reward (CC, CP, PC, and PP) were crossed with three reward magnitude shift conditions (upshift, nonshift, and downshift). The data revealed three major findings: (a) Reward magnitude downshift generally led to rapid extinction; (b) consistent reward prior to partial reward (CP) resulted in slower extinction than the reverse order (PC) under conditions of reward magnitude shift (particularly downshift); and (c) the relative performance of PC and CP under conditions of reward magnitude shift was reversed from postshift to extinction. On the basis of these data it was suggested that processes not presently identified by reinforcement level theory and stimulus analyzer theory influence extinction following separate-phase acquisition. A modification of reward level theory was presented to provide an account of extinction performance following separate-phase reward reduction.     

The differential influences of positive affect,random reward,and performance-contingent reward on cognitive control

Growing evidence suggests that positive affect and reward have differential effects on cognitive control. So far, however, these effects have never been studied together. Here, the authors present one behavioral study investigating the influences of positive affect and reward (contingent and noncontingent) on proactive control. A modified version of the AX-continuous performance task, which has repeatedly been shown to be sensitive to reward and affect manipulations, was used. In a first phase, two experimental groups received either neutral or positive affective pictures before every trial. In a second phase, the two halves of a given affect group additionally received, respectively, performance-contingent or random rewards. The results replicated the typical affect effect, in terms of reduced proactive control under positive as compared to neutral affect. Also, the typical reward effects associated with increased proactive control were replicated. Most interestingly, performance-contingent reward counteracted the positive affect effect, whereas random reward mirrored that effect. In sum, this study provides first evidence that performance-contingent reward, on the one hand, and positive affect and performance-noncontingent reward, on the other hand, have oppositional effects on cognitive control: Only performance-contingent reward showed a motivational effect in terms of a strategy shift toward increased proactive control, whereas positive affect alone and performance-noncontingent reward reduced proactive control. Moreover, the integrative design of this study revealed the vulnerability of positive affect effects to motivational manipulations. The results are discussed with respect to current neuroscientific theories of the effects of dopamine on affect, reward, and cognitive control.     

The amygdala, reward and emotion

Recent research provides new insights into amygdala contributions to positive emotion and reward. Studies of neuronal activity in the monkey amygdala and of autonomic responses mediated by the monkey amygdala show that, contrary to a widely held view, the amygdala is just as important for processing positive reward and reinforcement as it is for negative. In addition, neuropsychological studies reveal that the amygdala is essential for only a fraction of what might be considered 'stimulus-reward processing', and that the neural substrates for emotion and reward are partially nonoverlapping. Finally, evidence suggests that two systems within the amygdala, operating in parallel, enable reward-predicting cues to influence behavior; one mediates a general, arousing effect of reward and the other links the sensory properties of reward to emotion.     

Self-consciousness, self-awareness, and justice in reward allocation

To what extent can self-awareness affect behavior in justice-related situations? The present study investigated the impact of both chronic levels (public and private self-consciousness), and experimentally induced self-awareness on responsiveness to concurrently operative hut opposing standards of justice in an allocation of pay situation. Subjects were exposed to an externally based (equity) standard and an internally based (equality) standard before dividing pay between themselves and a coworker. The results indicated that high public, low private self-consciousness persons conformed to the external standard by allocating equitably; high private, low public individuals confirmed to the internal standard by allocating equally. Further, subjects who divided their pay in the presence of a mirror allocated most equitably, followed by those whose allocations were made public, while those allocating in private allocated most equally. These latter results were discussed in terms of Wicklund and Hormuth's (1981) vs. Hull and Levy's (1979) conception of self-awareness phenomena. Finally, the importance of the self as a source for evaluating differing criteria of justice was discussed.     

Sex differences,sex-role orientation,and reward allocations

In study 1, 52 male and 52 female undergraduates allocated rewards to pairs of children for their performances in team and competitive situations. Males allocated rewards more equitably, especially when allocating to boys in competition, while females allocated rewards more equally. Boys, but not girls, who did more work received more rewards than their partner; and children with greater work inputs under competitive conditions received more rewards than children in team conditions. In study 2, the sex-role orientation of 60 college students was found to be related to their reward allocations. Males and females with a masculine sex-role orientation allocated rewards equitably, while individuals with a feminine sex-role orientation allocated rewards equally. Results indicated that sex and situational differences in reward allocations are affected by sex-role orientation and differential socialization practices by adults.Portions of study 1 were presented at the Midwestern Psychological Association Meeting, Chicago, May 1978.     

Age‐related differences in delay discounting: Immediate reward,reward magnitude,and social influence

Delay discounting refers to the tendency of individuals to subjectively devalue rewards that are to be received in the future, with high rates of delay discounting being associated with a variety of maladaptive life outcomes (e.g., unhealthy dietary and exercise behaviors). The current study explored the psychological and social processes involved in adult age‐related differences in delay discounting of monetary rewards. Younger adults exhibited higher levels of delay discounting than older adults. This increased level of patience in older adults was found whether smaller‐sooner rewards were to be received immediately or in the future. However, there was an interaction with reward magnitude, whereby younger adults exhibited higher levels of delay discounting for smaller reward magnitudes but not larger reward magnitudes. Social influence on delay discounting was investigated by having participants complete three phases of the delay‐discounting task: an individual precollaboration phase, a collaboration phase in age‐group‐matched dyads, and an individual postcollaboration phase. A convergence effect was observed in that dyad members' postcollaboration choices were significantly more similar compared to their baseline choices during the precollaboration phase. Moreover, levels of convergence were comparable between younger and older adults, suggesting age invariance in social influence on delay discounting. The current results demonstrate a degree of malleability in delay discounting that extends into older adulthood, making interventions targeting the construct a promising avenue for future research.     

Transfer between downshift in reward magnitude and continuous delay of reward

Two separate experiments were conducted to investigate transfer of persistence between delay and a downshift in reward magnitude. In the first experiment, experimental rats were initially downshifted in reward magnitude and later tested for persistence to continuous delay of large reward. It was found that these rats were more persistent to the effects of delay than control rats which did not receive prior experience with a downshift in reward magnitude. In the second experiment, experimental rats were first trained to receive large reward under delayed conditions and then tested for persistence to a downshift in reward magnitude. Compared to control rats which received no prior experience with delay, the experimental rats showed a significantly smaller negative contrast effect. The results were interpreted as supporting Amsel's theory of persistence as well as Capaldi's recent interpretation of contrast effects.     

Synaptic tagging, evaluation of memories, and the distal reward problem

Long-term synaptic plasticity exhibits distinct phases. The synaptic tagging hypothesis suggests an early phase in which synapses are prepared, or "tagged," for protein capture, and a late phase in which those proteins are integrated into the synapses to achieve memory consolidation. The synapse specificity of the tags is consistent with conventional neural network models of associative memory. Memory consolidation through protein synthesis, however, is neuron specific, and its functional role in those models has not been assessed. Here, using a theoretical network model, we test the tagging hypothesis on its potential to prolong memory lifetimes in an online-learning paradigm. We find that protein synthesis, though not synapse specific, prolongs memory lifetimes if it is used to evaluate memory items on a cellular level. In our model we assume that only "important" memory items evoke protein synthesis such that these become more stable than "unimportant" items, which do not evoke protein synthesis. The network model comprises an equilibrium distribution of synaptic states that is very susceptible to the storage of new items: Most synapses are in a state in which they are plastic and can be changed easily, whereas only those synapses that are essential for the retrieval of the important memory items are in the stable late phase. The model can solve the distal reward problem, where the initial exposure of a memory item and its evaluation are temporally separated. Synaptic tagging hence provides a viable mechanism to consolidate and evaluate memories on a synaptic basis.     

Self-stimulating rats combine subjective reward magnitude and subjective reward rate multiplicatively

For rats that bar pressed for intracranial electrical stimulation in a 2-lever matching paradigm with concurrent variable interval schedules of reward, the authors found that the time allocation ratio is based on a multiplicative combination of the ratio of subjective reward magnitudes and the ratio of the rates of reward. Multiplicative combining was observed in a range covering approximately 2 orders of magnitude in the ratio of the rates of reward from about 1:10 to 10:1) and an order of magnitude change in the size of rewards. After determining the relation between the pulse frequency of stimulation and subjective reward magnitude, the authors were able to predict from knowledge of the subjective magnitudes of the rewards and the obtained relative rates of reward the subject's time allocation ratio over a range in which it varied by more than 3 orders of magnitude.