Value, pleasure and choice in the ventral prefrontal cortex

Rapid advances have recently been made in understanding how value-based decision-making processes are implemented in the brain. We integrate neuroeconomic and computational approaches with evidence on the neural correlates of value and experienced pleasure to describe how systems for valuation and decision-making are organized in the prefrontal cortex of humans and other primates. We show that the orbitofrontal and ventromedial prefrontal (VMPFC) cortices compute expected value, reward outcome and experienced pleasure for different stimuli on a common value scale. Attractor networks in VMPFC area 10 then implement categorical decision processes that transform value signals into a choice between the values, thereby guiding action. This synthesis of findings across fields provides a unifying perspective for the study of decision-making processes in the brain.     

Dissociating affective evaluation and social cognitive processes in the ventral medial prefrontal cortex

In recent studies, various regions of the ventral medial prefrontal cortex (vmPFC) have been implicated in at least two potentially different mental functions: reasoning about the minds of other people (social cognition) and processing reward related information (affective evaluation). In this study, we test whether the activation in a specific area of the vmPFC, the para-anterior cingulate cortex (PACC), correlates with the reward value of stimuli in general or is specifically associated with social cognition. Participants performed a time estimation task with trial-to-trial feedback in which reward and social context were manipulated separately. Reward was manipulated by giving either positive or negative feedback in the form of small squirts of fluid delivered orally. Social context was manipulated by instructing participants that positive and negative feedback was determined by another person or a computer. The data demonstrate a main effect of feedback, but not social context, in the PACC, suggesting that this area of the vmPFC serves a general function in evaluating and/or representing reward value. In addition, activity in a more anterior subregion of the vmPFC demonstrated reward-related sensitivity only in the social context. Another area that showed a similar interaction was the subgenual cingulate, but this region was only sensitive to negative feedback in the social condition. These findings suggest that, within the vmPFC, the PACC subserves primarily an affective function, whereas in other regions social context can modulate affective responses.     

Delayed recall of fear extinction in rats with lesions of ventral medial prefrontal cortex

Extinction of auditory fear conditioning is thought to form a new memory. We previously found that rats with vmPFC lesions could extinguish fear to the tone within a session, but showed no recall of extinction 24 h later. One interpretation is that the vmPFC is the sole storage site of extinction memory. However, it is also possible that lesioned rats were unable to retrieve extinction memory stored in other structures. To determine if a latent extinction memory could be retrieved with additional training, we repeated the experiment but added an additional 5 d of extinction reminder trials. Replicating our previous findings, vmPFC-lesioned rats extinguished normally on day 1, but showed no recall of extinction on day 2. Over the next 5 d, however, lesioned rats showed significant savings in their rate of re-extinction. Thus, the vmPFC is not the only site where extinction memory is stored. Nevertheless, lesioned rats receiving only two extinction trials per day required twice as many days to initiate extinction as controls. Although recall of extinction is possible without the vmPFC, it is significantly delayed. We suggest that the vmPFC accelerates extinction by permitting access to recently learned extinction trials, thereby maximizing behavioral flexibility.     

The mid-ventrolateral prefrontal cortex and active mnemonic retrieval

The role of the mid-ventrolateral prefrontal cortex in memory retrieval is examined and compared with the role of the mid-dorsolateral prefrontal cortex in the monitoring of information in memory. It has been argued that the mid-ventrolateral prefrontal cortex (areas 47/12 and 45) is involved in the active retrieval of information from posterior cortical association areas. Active retrieval is required when stimuli in memory do not bear stable relations to each other and therefore retrieval cannot be automatically driven by strong, stable, and unambiguous stimulus or context relations. Data from functional activation studies with normal human subjects are presented that have demonstrated specific changes in activity within the mid-ventrolateral region of the frontal cortex in relation to the active retrieval of information from memory. By contrast, increases in activity in the mid-dorsolateral region of the frontal cortex occur when the performance of the tasks requires monitoring of information in memory.     

Role of the ventral medial prefrontal cortex in mediating behavioral control-induced reduction of later conditioned fear

A prior experience of behavioral control over a stressor interferes with subsequent Pavlovian fear conditioning, and this effect is dependent on the activation of the ventral medial prefrontal cortex (mPFCv) at the time of the initial experience with control. It is unknown whether mPFCv activity is necessary during fear learning and/or testing for this interference to occur. One week following controllable stress, the infralimbic cortex (IL) was temporarily inactivated either before fear learning or later testing. Inactivation of the IL before the test for conditioned fear, but not before conditioning, blocked the fear reducing effects of prior controllable stress. This suggests that the experience with control interferes with the expression of fear behavior and not the learning of the association, and that the mPFCv is needed to regulate conditioned fear behavior.     

Differential effects of inactivation of the orbitofrontal cortex on strategy set-shifting and reversal learning

Different subregions of the rodent prefrontal cortex (PFC) mediate dissociable types of behavioral flexibility. For example, lesions of the medial or orbitofrontal (OFC) regions of the PFC impair extradimensional shifts and reversal learning, respectively, when novel stimuli are used during different phases of the task. In the present study, we assessed the effects of inactivation of the OFC on strategy set-shifting and reversal learning, using a maze based set-shifting task mediated by the medial PFC. Long–Evans rats were trained initially on a visual-cue discrimination to obtain food. On the subsequent day, rats had to shift to using a response strategy (e.g., always turn left). On Day 3 (reversal), rats were required to reverse the direction of their turn (e.g., always turn right). Infusions of the local anesthetic bupivacaine into the OFC did not impair initial visual discrimination learning, nor did it impair performance on the set-shift. In contrast, inactivation of the OFC did impair reversal learning; yet, these rats ceased using the previously acquired response rule as readily as controls. Instead, rats receiving OFC inactivations made a disproportionate number of erroneous arm entries towards the visual-cue, suggested that these animals reverted back to using the original visual-cue based strategy. These findings, in addition to previous data, further support the notion that the OFC and medial PFC play dissociable roles in reversal learning and set-shifting. Furthermore, the lack of effect of OFC inactivations on the set-shift indicates that this type of behavioral flexibility does not require cognitive operations related to reversal learning.     

Microstructural organization of corpus callosum projections to prefrontal cortex predicts bimanual motor learning

The corpus callosum (CC) is the largest white matter tract in the brain. It enables interhemispheric communication, particularly with respect to bimanual coordination. Here, we use diffusion tensor imaging (DTI) in healthy humans to determine the extent to which structural organization of subregions within the CC would predict how well subjects learn a novel bimanual task. A single DTI scan was taken prior to training. Participants then practiced a bimanual visuomotor task over the course of 2 wk, consisting of multiple coordination patterns. Findings revealed that the predictive power of fractional anisotropy (FA) was a function of CC subregion and practice. That is, FA of the anterior CC, which projects to the prefrontal cortex, predicted bimanual learning rather than the middle CC regions, which connect primary motor cortex. This correlation was specific in that FA correlated significantly with performance of the most difficult frequency ratios tested and not the innately preferred, isochronous frequency ratio. Moreover, the effect was only evident after training and not at initiation of practice. This is the first DTI study in healthy adults which demonstrates that white matter organization of the interhemispheric connections between the prefrontal structures is strongly correlated with motor learning capability.     

The amygdala and ventromedial prefrontal cortex in morality and psychopathy

Recent work has implicated the amygdala and ventromedial prefrontal cortex in morality and, when dysfunctional, psychopathy. This model proposes that the amygdala, through stimulus-reinforcement learning, enables the association of actions that harm others with the aversive reinforcement of the victims' distress. Consequent information on reinforcement expectancy, fed forward to the ventromedial prefrontal cortex, can guide the healthy individual away from moral transgressions. In psychopathy, dysfunction in these structures means that care-based moral reasoning is compromised and the risk that antisocial behavior is used instrumentally to achieve goals is increased.     

The role of prefrontal cortex in resolving distractor interference

We investigate the hypothesis that those subregions of the prefrontal cortex (PFC) found to support proactive interference resolution may also support delay-spanning distractor interference resolution. Ten subjects performed delayed-recognition tasks requiring working memory for faces or shoes during functional MRI scanning. During the 15-sec delay interval, task-irrelevant distractors were presented. These distractors were either all faces or all shoes and were thus either congruent or incongruent with the domain of items in the working memory task. Delayed-recognition performance was slower and less accurate during congruent than during incongruent trials. Our fMRI analyses revealed significant delay interval activity for face and shoe working memory tasks within both dorsal and ventral PFC. However, only ventral PFC activity was modulated by distractor category, with greater activity for congruent than for incongruent trials. Importantly, this congruency effect was only present for correct trials. In addition to PFC, activity within the fusiform face area was investigated. During face distraction, activity was greater for face relative to shoe working memory. As in ventrolateral PFC, this congruency effect was only present for correct trials. These results suggest that the ventrolateral PFC and fusiform face area may work together to support delay-spanning interference resolution.     

Psychopathy,frustration, and reactive aggression: The role of ventromedial prefrontal cortex

Psychopathy is a developmental disorder marked by emotional hyporesponsiveness and an increased risk for instrumental and reactive aggression. The increased risk for reactive aggression is the focus of the current paper. It will be argued that the increased risk for reactive aggression does not relate to an increased sensitivity to threatening stimuli since psychopathy is associated with a reduced sensitivity to threat. Instead, it is argued that the increased risk for reactive aggression relates to an increased risk for frustration; i.e., the emotional state following the performance of an action in the expectation of a particular reward and not receiving this reward. Two impairments seen in psychopathy would increase the risk for frustration and consequent potential reactive aggression; impairments in stimulus‐reinforcement learning and reversal learning. It is argued that both are known consequences of impairment in ventromedial prefrontal cortex, one of the regions principally implicated in psychopathy.     

Dorsolateral prefrontal cortex and Stroop performance: Tackling the lateralization

Neuroscience research has identified the involvement of the dorsolateral prefrontal cortex (DLPFC) in cognitive control. Questions remain, however, about its lateralization correlates during Stroop task performance, an experimental cornerstone on which a large amount of cognitive control research is based. After reviewing the literature, we find that three Stroop variants have been used in an attempt to uncover different aspects of cognitive control related to DLPFC involvement. In sum, rapid and sequential up-regulation of the attentional set seems to be related to the left DLPFC. These attentional adjustments are based on participants’ expectancies regarding the conflicting nature of the upcoming trial, and not on the conflict itself. In contrast, the right DLPFC is associated with an overall up-regulation of the attentional set when attentional conflict is experienced.     

Neonatal ventral hippocampus lesions disrupt extra-dimensional shift and alter dendritic spine density in the medial prefrontal cortex of juvenile rats

Recent data showed that neonatal ventral hippocampus (VH) lesions, an approach used to model schizophrenia symptoms in rodents, produce premature deficits of working memory believed to be associated with early medial prefrontal cortex (mPFC) maldevelopment. This experiment expands the investigation of mPFC integrity in juvenile rats with neonatal VH lesions by assessing behavioral flexibility and dendritic spine density. Sixteen Sprague-Dawley male pups received bilateral microinjections of ibotenic acid in the VH or SHAM surgery on postnatal day (PND) 6. On PND 29 and 30, rats were subjected to a spatial shift task in a cross-maze; an attentional set-shifting task was then administered on two consecutive days, between PND 33 and PND 35. Rats were sacrificed at PND 36 and dendritic spine density in the mPFC was assessed using Golgi-Cox staining procedure. Results revealed impaired extra-dimensional shift in VH-lesioned rats and inconsistent reversal discrimination outcomes. Although lesioned animals displayed intact performance in the spatial shift, rates of perseverative responses were higher than normal in this task. Neonatal VH damage resulted in lower dendritic spine density in the mPFC than measured in control brains; however, no significant correlation was found between this outcome and behavioral data. Juvenile morphological and cognitive perturbations are consistent with the early emergence of mPFC anomalies following neonatal VH lesions. Results are discussed in relation with potential common mechanisms linking pre- and post-pubertal onsets of behavioral dysfunction.     

Anterior temporal cortex and semantic memory: Reconciling findings from neuropsychology and functional imaging

Studies of semantic impairment arising from brain disease suggest that the anterior temporal lobes are critical for semantic abilities in humans; yet activation of these regions is rarely reported in functional imaging studies of healthy controls performing semantic tasks. Here, we combined neuropsychological and PE T functional imaging data to show that when healthy subjects identify concepts at a specific level, the regions activated correspond to the site of maximal atrophy in patients with relatively pure semantic impairment. The stimuli were color photographs of common animals or vehicles, and the task was category verification at specific (e.g., robin), intermediate (e.g., bird), or general (e.g., animal) levels. Specific, relative to general, categorization activated the antero-lateral temporal cortices bilaterally, despite matching of these experimental conditions for difficulty. Critically, in patients with atrophy in precisely these areas, the most pronounced deficit was in the retrieval of specific semantic information.     

The role of prefrontal cortex during tests of episodic memory

Recent studies of episodic memory using functional neuroimaging techniques indicate that right prefrontal cortex (PFC) is activated while people remember events. Our review suggests that left PFC is also activated during remembering, depending on the reflective demands of the task. As more, or more complex, reflective processes are required (e.g. when criteria for evaluation have to be established and maintained, when the complexity of the evaluation required increases, and when retrieval of additional information is required beyond that activated by an initial cue), left PFC activity is more likely to occur. Our `cortical asymmetry of reflective activity' (CARA) hypothesis summarizes available findings and suggests directions for future research.