Neural substrates for episodic encoding and recognition of unfamiliar faces

Functional MRI was used to investigate brain activation in healthy volunteers during encoding of unfamiliar faces as well as during correct recognition of newly learned faces (CR) compared to correct identification of distractor faces (CF), missed alarms (not recognizing previously presented faces, MA), and false alarms (incorrectly recognizing newly presented faces, FA). Encoding was associated with frontal, occipital/fusiform, thalamic, and cerebellar activation. CR produced activation in frontal and cerebellar regions, whereas CF activated frontal and occipitotemporal regions as well as the thalamus. In contrast, MA was associated with frontal and thalamic activation, and FA with frontal activation. The CR minus CF comparison showed left lateral prefrontal and parietal activation, while no suprathreshold positive signal changes were detected when subtracting the other conditions (CR minus MA, CR minus FA, and vice versa). These results support the view that the successful episodic retrieval of newly learned faces is based on a dorsal visual stream mechanism.     

Direct comparison of episodic encoding and retrieval of words: an event-related fMRI study

Functional magnetic resonance imaging (fMRI) was used to compare directly episodic encoding and retrieval. During encoding, subjects studied visually presented words and reported via keypress whether each word represented a pleasant or unpleasant concept (intentional, deep encoding). During the retrieval phase, subjects indicated (via keypress) whether visually presented words had previously been studied. No reliable differences were found during the recognition phase for words that had been previously studied and those that had not been studied. Areas preferentially active during encoding (relative to retrieval) included left superior frontal cortex, medial frontal cortex, left superior temporal cortex, posterior cingulate, left parahippocampal gyrus, and left inferior frontal gyrus. Regions more active in retrieval than encoding included bilateral inferior parietal cortex, bilateral precuneus, right frontal polar cortex, right dorsolateral prefrontal cortex, and right inferior frontal/insular cortex.     

Direct Comparison of Episodic Encoding and Retrieval of Words: An Event-related fMRI Study

Functional magnetic resonance imaging (fMRI) was used to compare directly episodic encoding and retrieval. During encoding, subjects studied visually presented words and reported via keypress whether each word represented a pleasant or unpleasant concept (intentional, deep encoding). During the retrieval phase, subjects indicated (via keypress) whether visually presented words had previously been studied. No reliable differences were found during the recognition phase for words that had been previously studied and those that had not been studied. Areas preferentially active during encoding (relative to retrieval) included left superior frontal cortex, medial frontal cortex, left superior temporal cortex, posterior cingulate, left parahippocampal gyrus, and left inferior frontal gyrus. Regions more active in retrieval than encoding included bilateral inferior parietal cortex, bilateral precuneus, right frontal polar cortex, right dorsolateral prefrontal cortex, and right inferior frontal/insular cortex.     

Incidental retrieval of emotional contexts in post-traumatic stress disorder and depression: an fMRI study

In the present study, we used fMRI to assess patients suffering from post-traumatic stress disorder (PTSD) or depression, and trauma-exposed controls, during an episodic memory retrieval task that included non-trauma-related emotional information. In the study phase of the task neutral pictures were presented in emotional or neutral contexts. Participants were scanned during the test phase, when they were presented with old and new neutral images in a yes/no recognition memory task. fMRI results for the contrast between old and new items revealed activation in a predominantly left-sided network of cortical regions including the left middle temporal, bilateral posterior cingulate, and left prefrontal cortices. Activity common to all three groups when correctly judging pictures encoded in emotional contexts was much more limited. Relative to the control and depressed groups the PTSD group exhibited greater sensitivity to correctly recognised stimuli in the left amygdala/ventral striatum and right occipital cortex, and more specific sensitivity to items encoded in emotional contexts in the right precuneus, left superior frontal gyrus, and bilateral insula. These results are consistent with a substantially intact neural system supporting episodic retrieval in patients suffering from PTSD. Moreover, there was little indication that PTSD is associated with a marked change in the way negatively valenced information, not of personal significance, is processed.     

Age-related neural activity during allocentric spatial memory

Age-related decline in allocentric (viewer-independent) spatial memory is seen across species. We employed a virtual reality analogue of the Morris Water Maze to study the effect of healthy ageing on neural activity during allocentric spatial memory using functional magnetic resonance imaging. Voxel-based morphometry was used to ascertain hippocampal volumetric integrity. A widespread neural network comprising frontal, parietal, occipital, thalamic, and cerebellar regions was activated in young and older adults, but only young adults significantly activated bilateral hippocampus and left parahippocampus, as well as right frontal pole and dorso-lateral prefrontal cortex (DLPFC) during encoding and right DLPC during retrieval. Hippocampal grey matter volume was unchanged in older adults; however, prefrontal and parahippocampal functional attenuation was accompanied by volumetric reduction. We conclude that the decline in allocentric spatial memory with age is associated with attenuated hippocampal function, as well as compromised function and structure of prefrontal and parahippocampal regions.     

Mapping cognition to the brain through neural interactions

Brain imaging methods, such as positron emission tomography (PET) and functional magnetic resonance imaging (fMRI), provide a unique opportunity to study the neurobiology of human memory. As these methods can measure most of the brain, it is possible to examine the operations of large-scale neural systems and their relation to cognition. Two neuroimaging studies, one concerning working memory and the other episodic memory retrieval, serve as examples of application of two analytic methods that are optimised for the quantification of neural systems, structural equation modelling, and partial least squares. Structural equation modelling was used to explore shifting prefrontal and limbic interactions from the right to the left hemisphere in a delayed match-to-sample task for faces. A feature of the functional network for short delays was strong right hemisphere interactions between hippocampus, inferior prefrontal, and anterior cingulate cortices. At longer delays, these same three areas were strongly linked, but in the left hemisphere, which was interpreted as reflecting change in task strategy from perceptual to elaborate encoding with increasing delay. The primary manipulation in the memory retrieval study was different levels of retrieval success. The partial least squares method was used to determine whether the image-wide pattern of covariances of Brodmann areas 10 and 45/47 in right prefrontal cortex (RPFC) and the left hippocampus (LGH) could be mapped on to retrieval levels. Area 10 and LGH showed an opposite pattern of functional connectivity with a large expanse of bilateral limbic cortices that was equivalent for all levels of retrieval as well as the baseline task. However, only during high retrieval was area 45/47 included in this pattern. The results suggest that activity in portions of the RPFC can reflect either memory retrieval mode or retrieval success depending on other brain regions to which it is functionally linked, and imply that regional activity must be evaluated within the neural context in which it occurs. The general hypothesis that learning and memory are emergent properties of large-scale neural network interactions is discussed, emphasising that a region can play a different role across many functions and that role is governed by its interactions with anatomically related regions.     

In Search of the Self: A Positron Emission Tomography Study

Abstract—Previous work using positron emission tomography (PET) has shown that memory encoding processes are associated with preferential activation of left frontal regions of the brain, whereas retrieval processes are associated predominantly with right frontal activations. One possible reason for the asymmetry is that episodic retrieval necessarily involves reference to the self, and the self-concept may be represented (at least partially) in right frontal regions. Accordingly, the present study investigated the possibility that encoding of self-related material might also activate right frontal areas. Eight right-handed volunteers judged trait adjectives under four separate PET scan conditions: (a) relevance to self, (b) relevance to a well-known public figure, (c) social desirability, and (d) number of syllables. The results showed that self-related encoding yielded left frontal activations similar to those associated with other types of semantic encoding, but also specific activations in the right frontal lobe. It is concluded that the concept of self involves both general schematic structures and further specific components involved in episodic memory retrieval.     

Mapping Cognition to the Brain Through Neural Interactions

Brain imaging methods, such as positron emission tomography (PET) and functional magnetic resonance imaging (fMRI), provide a unique opportunity to study the neurobiology of human memory. As these methods can measure most of the brain, it is possible to examine the operations of large-scale neural systems and their relation to cognition. Two neuroimaging studies, one concerning working memory and the other episodic memory retrieval, serve as examples of application of two analytic methods that are optimised for the quantification of neural systems, structural equation modelling, and partial least squares. Structural equation modelling was used to explore shifting prefrontal and limbic interactions from the right to the left hemisphere in a delayed match-to-sample task for faces. A feature of the functional network for short delays was strong right hemisphere interactions between hippocampus, inferior prefrontal, and anterior cingulate cortices. At longer delays, these same three areas were strongly linked, but in the left hemisphere, which was interpreted as reflecting change in task strategy from perceptual to elaborate encoding with increasing delay. The primary manipulation in the memory retrieval study was different levels of retrieval success. The partial least squares method was used to determine whether the image-wide pattern of covariances of Brodmann areas 10 and 45/47 in right prefrontal cortex (RPFC) and the left hippocampus (LGH) could be mapped on to retrieval levels. Area 10 and LGH showed an opposite pattern of functional connectivity with a large expanse of bilateral limbic cortices that was equivalent for all levels of retrieval as well as the baseline task. However, only during high retrieval was area 45/47 included in this pattern. The results suggest that activity in portions of the RPFC can reflect either memory retrieval mode or retrieval success depending on other brain regions to which it is functionally linked, and imply that regional activity must be evaluated within the neural context in which it occurs. The general hypothesis that learning and memory are emergent properties of large-scale neural network interactions is discussed, emphasising that a region can play a different role across many functions and that role is governed by its interactions with anatomically related regions.     

PET studies of encoding and retrieval: The HERA model

We review positron emission tomography (PET) studies whose results converge on the hemispheric encoding/retrieval asymmetry (HERA) model of the involvement of prefrontal cortical regions in the processes of human memory. The model holds that the left prefrontal cortex is differentially more involved in retrieval of information from semantic memory, and in simultaneously encoding novel aspects of the retrieved information into episodic memory, than is the right prefrontal cortex. The right prefrontal cortex, on the other hand, is differentially more involved in episodic memory retrieval than is the left prefrontal cortex. This general pattern holds for different kinds of information (e.g., verbal materials, pictures, faces) and a variety of conditions of encoding and retrieval.     

Large,colorful, or noisy? Attribute- and modality-specific activations during retrieval of perceptual attribute knowledge

Position emission tomography was used to investigate whether retrieval of perceptual knowledge from long-term memory activates unique cortical regions associated with the modality and/or attribute type retrieved. Knowledge about the typical color, size, and sound of common objects and animals was probed, in response to written words naming the objects. Relative to a nonsemantic control task, all the attribute judgments activated similar left temporal and frontal regions. Visual (color, size) knowledge selectively activated the right posterior inferior temporal (PIT) cortex, whereas sound judgments elicited selective activation in the left posterior superior temporal gyrus and the adjacent parietal cortex. All of the attribute judgments activated a left PIT region, but color retrieval generated more activation in this area. Size judgments activated the right medial parietal cortex. These results indicate that the retrieval of perceptual semantic information activates not only a general semantic network, but also cortical areas specialized for the modality and attribute type of the knowledge retrieved.     

Episodic encoding and recognition of pictures and words: role of the human medial temporal lobes

In the present PET study, we examined brain activity related to processing of pictures and printed words in episodic memory. Our goal was to determine how the perceptual format of objects (verbal versus pictorial) is reflected in the neural organization of episodic memory for common objects. We investigated this issue in relation to encoding and recognition with a particular focus on medial temporal-lobe (MTL) structures. At encoding, participants saw pictures of objects or their written names and were asked to make semantic judgments. At recognition, participants made yes-no recognition judgments in four different conditions. In two conditions, target items were pictures of objects; these objects had originally been encoded either in picture or in word format. In two other conditions, target items were words; they also denoted objects originally encoded either as pictures or as words. Our data show that right MTL structures are differentially involved in picture processing during encoding and recognition. A posterior MTL region showed higher activation in response to the presentation of pictures than of words across all conditions. During encoding, this region may be involved in setting up a representation of the perceptual information that comprises the picture. At recognition, it may play a role in guiding retrieval processes based on the perceptual input, i.e. the retrieval cue. Another more anterior right MTL region was found to be differentially involved in recognition of objects that had been encoded as pictures, irrespective of whether the retrieval cue provided was pictorial or verbal in nature; this region may be involved in accessing stored pictorial representations. Our results suggest that left MTL structures contribute to picture processing only during encoding. Some regions in the left MTL showed an involvement in semantic encoding that was picture specific; others showed a task-specific involvement across pictures and words. Together, our results provide evidence that the involvement of some but not all MTL regions in episodic encoding and recognition is format specific.     

Aging effects on memory encoding in the frontal lobes

Functional magnetic resonance imaging (fMRI) was used to compare frontal-lobe activation in younger and older adults during encoding of words into memory. Participants made semantic or nonsemantic judgments about words. Younger adults exhibited greater activation for semantic relative to nonsemantic judgments in several regions, with the largest activation in the left inferior frontal gyrus. Older adults exhibited greater activation for semantic judgments in the same regions. but the extent of activation was reduced in left prefrontal regions. In older adults, there was a significant association between behavioral tests of declarative and working memory and extent of frontal activation. These results suggest that age-associated decreases in memory ability may be due to decreased frontal-lobe contributions to the initial encoding of experience.     

Developmental shifts in fMRI activations during visuospatial relational reasoning

To investigate maturational plasticity of fluid cognition systems, functional brain imaging was undertaken in healthy 8-19 year old participants while completing visuospatial relational reasoning problems similar to Raven's matrices and current elementary grade math textbooks. Analyses revealed that visuospatial relational reasoning across this developmental age range recruited activations in the superior parietal cortices most prominently, the dorsolateral prefrontal, occipital-temporal, and premotor/supplementary cortices, the basal ganglia, and insula. There were comparable activity volumes in left and right hemispheres for nearly all of these regions. Regression analyses indicated increasing activity predominantly in the superior parietal lobes with developmental age. In contrast, multiple anterior neural systems showed significantly less activity with age, including dorsolateral and ventrolateral prefrontal, paracentral, and insula cortices bilaterally, basal ganglia, and particularly large clusters in the midline anterior cingulate/medial frontal cortex, left middle cingulate/supplementary motor cortex, left insula-putamen, and left caudate. Findings suggest that neuromaturational changes associated with visuospatial relational reasoning shift from a more widespread fronto-cingulate-striatal pattern in childhood to predominant parieto-frontal activation pattern in late adolescence.     

Bi-hemispheric engagement in the retrieval of autobiographical episodes

Functional magnetic resonance imaging (fMRI) was used to study the neural correlates of neutral, stressful, negative and positive autobiographical memories. The brain activity produced by these different kinds of episodic memory did not differ significantly, but a common pattern of activation for different kinds of autobiographical memory was revealed that included (1) largely bilateral portions of the medial and superior temporal lobes, hippocampus and parahippocampus, (2) portions of the ventral, medial, superior and dorsolateral prefrontal cortex, (3) the anterior and posterior cingulate, including the retrosplenial, cortex, (4) the parietal cortex, and (5) portions of the cerebellum. The brain regions that were mainly activated constituted an interactive network of temporal and prefrontal areas associated with structures of the extended limbic system. The main bilateral activations with left-sided preponderance probably reflected reactivation of complex semantic and episodic self-related information representations that included previously experienced contexts. In conclusion, the earlier view of a strict left versus right prefrontal laterality in the retrieval of semantic as opposed to episodic autobiographical memory, may have to be modified by considering contextual variables such as task demands and subject variables. Consequently, autobiographical memory integration should be viewed as based on distributed bi-hemispheric neural networks supporting multi-modal, emotionally coloured components of personal episodes.     

Sentence processing strategies in healthy seniors with poor comprehension: an fMRI study

We used fMRI to examine patterns of brain recruitment in 22 healthy seniors, half of whom had selective comprehension difficulty for grammatically complex sentences. We found significantly reduced recruitment of left posterolateral temporal [Brodmann area (BA) 22/21] and left inferior frontal (BA 44/6) cortex in poor comprehenders compared to the healthy seniors with good sentence comprehension, cortical regions previously associated with language comprehension and verbal working memory, respectively. The poor comprehenders demonstrated increased activation of left prefrontal (BA 9/46), right dorsal inferior frontal (BA 44/6), and left posterior cingulate (BA 31/23) cortices for the grammatically simpler sentences that they understood. We hypothesize that these brain regions support an alternate, nongrammatical strategy for processing complex configurations of symbolic information. Moreover, these observations emphasize the crucial role of the left perisylvian network for grammatically guided sentence processing in subjects with good comprehension.     

Co-occurring anxiety influences patterns of brain activity in depression

Brain activation associated with anhedonic depression and co-occurring anxious arousal and anxious apprehension was measured by fMRI during performance of an emotion word Stroop task. Consistent with EEG findings, depression was associated with rightward frontal lateralization in the dorsolateral prefrontal cortex (DLPFC), but only when anxious arousal was elevated and anxious apprehension was low. Activity in the right inferior frontal gyrus (IFG) was also reduced for depression under the same conditions. In contrast, depression was associated with more activity in the anterior cingulate cortex (dorsal ACC and rostral ACC) and the bilateral amygdala. Results imply that depression, particularly when accompanied by anxious arousal, may result in a failure to implement top-down processing by appropriate brain regions (left DLPFC, right IFG) due to increased activation in regions associated with responding to emotionally salient information (right DLPFC, amygdala).     

Brain activation during episodic memory retrieval: sex differences

Behavioral studies have shown a tendency for women to outperform men on episodic memory tasks. Here, data from a series of positron emission tomography (PET) studies were analyzed to examine sex differences in brain activity associated with episodic memory retrieval (yes/no recognition). A total of 17 women and 17 men were included in the analyses. The strongest effect of the design was a retrieval-related increase in activity, involving right prefrontal and anterior cingulate regions, that was common to women and men. In addition, a significant task-by-sex interaction effect was observed which involved a distributed set of brain regions, including several frontal areas. These results suggest that while the neural correlate of episodic memory retrieval is largely the same for men and women, some differences do exist. Possible explanations for the observed differences are discussed, and it is concluded that biological and experiential factors jointly contribute to sex differences in brain activity.     

Right amygdalar and temporofrontal activation during autobiographic, but not during fictitious memory retrieval

What distinguishes the recall of real-life experiences from that of self-created, fictitious emotionally laden information? Both kinds of information belong to the episodic memory system. Autobiographic memories constitute that part of the episodic memory system that is composed of significant life episodes, primarily of the distant past. Functional imaging was used to study the neural networks engaged in retrieving autobiographic and fictitious information of closely similar content. The principally activated brain regions overlapped considerably and constituted temporal and inferior prefrontal regions plus the cerebellum. Selective activations of the right amygdala and the right ventral prefrontal cortex (at the level of the uncinate fascicle interconnnecting prefrontal and temporopolar areas) were found when subtracting fictitious from autobiographic retrieval. Furthermore, distinct foci in the left temporal lobe were engaged. These data demonstrate that autobiographic memory retrieval uses (at least in non-brain damaged individuals) a network of right hemispheric ventral prefrontal and temporopolar regions and left hemispheric lateral temporal regions. It is concluded that it is the experiential character, its special emotional infiltration and its arousal which distinguishes memory of real-life from that of fictitious episodes. Consequently, our results point to the engagement of a bi-hemispheric network in which the right temporo-prefrontal hemisphere is likely to be responsible for the affective/arousal side of information retrieval and the left-hemispheric temporal gyrus for its engram-like representation. Portions of the neural activation found during retrieval might, however, reflect re-encoding processes as well.     

Brain activation while forming memories of fearful and neutral faces in women and men

Event-related functional MRI (fMRI) was used to assess brain activity during encoding of fearful and neutral faces in 12 women and 12 men. In a subsequent memory analysis, the authors separated successful from unsuccessful encoding of both types of faces, based on whether they were remembered or forgotten in a later recognition memory test. Overall, women and men recruited overlapping neural circuitries. Both sexes activated right-sided medial-temporal regions during successful encoding of fearful faces. Successful encoding of neutral faces was associated with left-sided lateral prefrontal and right-sided superior frontal activation in both sexes. In women, relatively greater encoding related activity for neutral faces was seen in the superior parietal and parahippocampal cortices. By contrast, men activated the left and right superior/middle frontal cortex more than women during successful encoding of the same neutral faces. These findings suggest that women and men use similar neural networks to encode facial information, with only subtle sex differences observed for neutral faces.     

Neural correlates of autobiographical memory retrieval in children and adults

Autobiographical memory (AM) is a critically important form of memory for life events that undergoes substantial developmental changes from childhood to adulthood. Relatively little is known regarding the functional neural correlates of AM retrieval in children as assessed with fMRI, and how they may differ from adults. We investigated this question with 14 children ages 8–11 years and 14 adults ages 19–30 years, contrasting AM retrieval with semantic memory (SM) retrieval. During scanning, participants were cued by verbal prompts to retrieve previously selected recent AMs or to verify semantic properties of words. As predicted, both groups showed AM retrieval-related increased activation in regions implicated in prior studies, including bilateral hippocampus, and prefrontal, posterior cingulate, and parietal cortices. Adults showed greater activation in the hippocampal/parahippocampal region as well as prefrontal and parietal cortex, relative to children; age-related differences were most prominent in the first 8?sec versus the second 8?sec of AM retrieval and when AM retrieval was contrasted with semantic retrieval. This study is the first to characterise similarities and differences during AM retrieval in children and adults using fMRI.