Recognition memory for realistic synthetic faces

A series of experiments examined short-term recognition memory for trios of briefly presented, synthetic human faces derived from three real human faces. The stimuli were a graded series of faces, which differed by varying known amounts from the face of the average female. Faces based on each of the three real faces were transformed so as to lie along orthogonal axes in a 3-D face space. Experiment 1 showed that the synthetic faces' perceptual similarity structure strongly influenced recognition memory. Results were fit by a noisy exemplar model (NEMO) of perceptual recognition memory. The fits revealed thatrecognition memory was influenced both by the similarity of the probe to the series items and by the similarities among the series items themselves. Nonmetric multidimensional scaling (MDS) showed that the faces' perceptual representations largely preserved the 3-D space in which the face stimuli were arrayed. NEMO gave a better account of the results when similarity was defined as perceptual MDS similarity, rather than as the physical proximity of one face to another. Experiment 2 confirmed the importance of within-list homogeneity directly, without mediation of a model. We discuss the affinities and differences between visual memory for synthetic faces and memory for simpler stimuli.     

Visual perception and aging.

A series of studies performed in our laboratory on aging and its effect on perceptual processing and working memory capacity for visual stimuli are reviewed. Specifically, studies on luminance, colour, motion, texture, and symmetry processing are reported. Furthermore, experiments on the capacity to retain size and spatial frequency information are also discussed. The general conclusion is that there are a number of perceptual abilities that diminish with age. However, the extent of these deficits will depend on the complexity of the neural circuitry involved for processing a given task. This is also true for visual working memory where no evidence of loss due to aging is demonstrated for processing low-level visual information, when individual differences in sensory input are compensated for. It is concluded that perceptual processing deficits due to aging (like working memory) will become evident when the computational load reaches a certain level of complexity (larger or more complex network) even if the tasks remain cognitively simple.     

The role of attention and study time in explicit and implicit memory for unfamiliar visual stimuli

The effects of limited attentional resources and study time on explicit and implicit memory were studied using Schacter and Cooper’s possible and impossible objects in their recognition and object decision paradigm. In one experiment, when attention at study was limited by a flanking digits procedure, object recognition was diminished but object decision priming for possible objects was unaffected; in another experiment, limiting attention plus reducing stimulus study time impaired object recognition and eliminated object priming. Recognition memory and perceptual priming for previously unfamiliar visual stimuli were both influenced by attention, although to different degrees. The intervening variable of study time determined the degree to which priming was affected by attentional resources. These results support a limited capacity attentional model for both recognition and perceptual priming of unfamiliar visual stimuli, and they highlight the need for assessing the interaction of attentional resources and study time in explicit and implicit memory tasks.     

The fidelity of visual memory for faces and non-face objects

The fidelity of visual working memory was assessed for faces and non-face objects. In two experiments, four levels of memory load (1, 2, 3, or 4 items) were combined with four perceptual distances between probe and study items, with maximum item confusability occurring for the minimum memory load. Under these conditions, recognition memory for multiple faces exceeded that of a single face. This result was primarily due to the higher false alarm rates for faces than non-face objects, even though the two classes of stimuli had been matched for perceptual discriminability. Control experiments revealed that this counterintuitive result emerged only for old–new recognition choices based on near-threshold image differences. For non-face objects, instead, recognition performance decreased with increasing memory load. It is speculated that the low memorial discriminability of the transient properties of a face may serve the purpose of enhancing recognition at the individual-exemplar level.     

Competition between memory and perceptual tasks involving physically similar stimuli

Performance on a perceptual recognition task and a concurrently performed short-term memory (STM) task was studied. The stimuli used in the STM task were either visually similar, acoustically similar, or dissimilar to the stimuli in the perceptual task. The results demonstrated that any type of concurrent list memorization has a detrimental effect upon perceptual performance, but this effect is magnified if the stimuli used in the 2 tasks are visually similar. Acoustic similarity had no effect. The results document the fact that distinct tasks interfere, when the tasks compete for a limited total processing capacity, or when the tasks demand the same visual coding program.     

Dissociation of rapid response learning and facilitation in perceptual and conceptual networks of person recognition

Repetition priming is a prominent example of non‐declarative memory, and it increases the accuracy and speed of responses to repeatedly processed stimuli. Major long‐hold memory theories posit that repetition priming results from facilitation within perceptual and conceptual networks for stimulus recognition and categorization. Stimuli can also be bound to particular responses, and it has recently been suggested that this rapid response learning, not network facilitation, provides a sound theory of priming of object recognition. Here, we addressed the relevance of network facilitation and rapid response learning for priming of person recognition with a view to advance general theories of priming. In four experiments, participants performed conceptual decisions like occupation or nationality judgments for famous faces. The magnitude of rapid response learning varied across experiments, and rapid response learning co‐occurred and interacted with facilitation in perceptual and conceptual networks. These findings indicate that rapid response learning and facilitation in perceptual and conceptual networks are complementary rather than competing theories of priming. Thus, future memory theories need to incorporate both rapid response learning and network facilitation as individual facets of priming.     

Computational model of enactive visuospatial mental imagery using saccadic perceptual actions

From the onset of cognitive revolution, the concept of mental imagery has been given different, many times opposing, theoretical accounts. Mental imagery appears to be a ubiquitous, yet wholly individual, easy to explain experience on the one hand, being hard to deal with scientifically on the other hand. The focus of this research is on an enactive approach to visuospatial mental imagery, inspired by Sima’s perceptual instantiation theory. We designed a hybrid computational model, composed of a forward model, an inverse model, both implemented as neural networks, and a memory/controller module, that grounds simple mental concepts, such as a triangle and a square, in perceptual actions, and is able to reimagine these objects by performing the necessary perceptual actions in a simulated humanoid robot. We tested the model on three tasks – salience-based object recognition, imagination-based object recognition and object imagination – and achieved very good results showing, as a proof of concept, that perceptual actions are a viable candidate for grounding the visuospatial mental concepts as well as the credible substrate of visuospatial mental imagery.     

Familiarity supports associative recognition memory for face stimuli that can be unitised: Evidence from receiver operating characteristics

According to dual-process models, associative recognition memory mainly relies on recollection without benefiting from familiarity. This study investigates the circumstances under which familiarity may support associative recognition judgements by comparing recognition memory for arbitrarily paired items (i.e., pairs of face stimuli depicting two different persons; interitem associations) with recognition memory for pairs of items that are highly overlapping and can be unitised into a coherent whole (i.e., pairs of physically different but very similar face stimuli depicting the same person; intraitem associations). Estimates of familiarity and recollection were derived from receiver operating characteristics. Consistent with the hypothesis that familiarity is able to support associative recognition memory, but only when the to-be-associated stimuli can be unitised, results from two experiments revealed higher familiarity estimates for intra- compared to interitem associations. By contrast, recollection for recombined pairs was higher for inter- compared to intraitem associations. We propose a hypothetical model on how intraitem associations may benefit from familiarity.     

Hippocampal CA1 spiking during encoding and retrieval: relation to theta phase

The hippocampal theta rhythm is a prominent oscillation in the field potential observed throughout the hippocampus as a rat investigates stimuli in the environment. A recent computational model [Hasselmo, M. E., Bodelon, C., & Wyble, B. P. (2002a). A proposed function for hippocampal theta rhythm: separate phases of encoding and retrieval enhance reversal of prior learning. Neural Computation, 14, 793-817. Neuromodulation, theta rhythm and rat spatial navigation. Neural Networks, 15, 689-707] suggested that the theta rhythm allows the hippocampal formation to alternate rapidly between conditions that promote memory encoding (strong synaptic input from entorhinal cortex to areas CA3 and CA1) and conditions that promote memory retrieval (strong synaptic input from CA3 to CA1). That model predicted that the preferred theta phase of CA1 spiking should differ for information being encoded versus information being retrieved. In the present study, the spiking activity of CA1 pyramidal cells was recorded while rats performed either an odor-cued delayed nonmatch-to-sample recognition memory test or an object recognition memory task based on the animal's spontaneous preference for novelty. In the test period of both tasks, the preferred theta phase exhibited by CA1 pyramidal cells differed between moments when the rat inspected repeated (match) and non-repeated (nonmatch) items. Also in the present study, additional modeling work extended the previous model to address the mean phase of CA1 spiking associated with stimuli inducing varying levels of retrieval relative to encoding, ranging from novel nonmatch stimuli with no retrieval to highly familiar repeated stimuli with extensive retrieval. The modeling results obtained here demonstrated that the experimentally observed phase differences are consistent with different levels of CA3 synaptic input to CA1 during recognition of repeated items.     

Memory encoding of stimulus features in human perceptual learning

Two experiments analysed memory encoding in human perceptual learning. Both experiments started with preexposure without feedback to four checkerboards composed by a unique feature each and sharing a common feature (AX, BX, CX, and DX). Elements of one pair were presented intermixed and elements of the other pair were presented in separate blocks. Immediately after preexposure participants completed a memory recognition task in which the characteristics of the distractors were manipulated. Experiment 1 showed that only intermixed presentation results in good encoding of the unique features of the stimuli. Experiment 2 demonstrated that intermixed preexposure results in different encoding of unique versus common features of the stimuli: Participants are able to remember A and B better than they remember X, whereas for the blocked condition memory for C, D, and X does not differ. Overall, the results presented here support the proposal that intermixing stimuli results in differential memory traces for unique versus common features and that this contributes to the intermixed/blocked effect.     

Relative fluency and illusions of recognition memory

A hallmark of the experience of perceptual fluency is the sense that a familiar stimulus seems to pop out from its background, such as when one notices the face of a friend in a crowd of strangers. This experience suggests that fluency-based illusions of recognition memory may be more powerful when there are only a few fluent stimuli presented in a recognition context. The results of the present study were consistent with this prediction. The magnitude of fluency-based illusions of recognition memory was inversely related to the percentage of fluent stimuli on a recognition test. Furthermore, standard fluency manipulations did not impact recognition responses in between-participants designs. The results suggest that illusions of recognition memory may be more powerful when fluency is encountered in a context in which the surrounding stimuli are less fluent.     

Applying the attractor field model to social cognition: Perceptual discrimination is facilitated, but memory is impaired for faces displaying evaluatively congruent expressions

A new model of mental representation is applied to social cognition: the attractor field model. Using the model, the authors predicted and found a perceptual advantage but a memory disadvantage for faces displaying evaluatively congruent expressions. In Experiment 1, participants completed a same/different perceptual discrimination task involving morphed pairs of angry-to-happy Black and White faces. Pairs of faces displaying evaluatively incongruent expressions (i.e., happy Black, angry White) were more likely to be labeled as similar and were less likely to be accurately discriminated from one another than faces displaying evaluatively congruent expressions (i.e., angry Black, happy White). Experiment 2 replicated this finding and showed that objective discriminability of stimuli moderated the impact of attractor field effects on perceptual discrimination accuracy. In Experiment 3, participants completed a recognition task for angry and happy Black and White faces. Consistent with the attractor field model, memory accuracy was better for faces displaying evaluatively incongruent expressions. Theoretical and practical implications of these findings are discussed.     

The discovery and comparison of symbolic magnitudes

Humans and other primates are able to make relative magnitude comparisons, both with perceptual stimuli and with symbolic inputs that convey magnitude information. Although numerous models of magnitude comparison have been proposed, the basic question of how symbolic magnitudes (e.g., size or intelligence of animals) are derived and represented in memory has received little attention. We argue that symbolic magnitudes often will not correspond directly to elementary features of individual concepts. Rather, magnitudes may be formed in working memory based on computations over more basic features stored in long-term memory. We present a model of how magnitudes can be acquired and compared based on BARTlet, a representationally simpler version of Bayesian Analogy with Relational Transformations (BART; Lu, Chen, & Holyoak, 2012). BARTlet operates on distributions of magnitude variables created by applying dimension-specific weights (learned with the aid of empirical priors derived from pre-categorical comparisons) to more primitive features of objects. The resulting magnitude distributions, formed and maintained in working memory, are sensitive to contextual influences such as the range of stimuli and polarity of the question. By incorporating psychological reference points that control the precision of magnitudes in working memory and applying the tools of signal detection theory, BARTlet is able to account for a wide range of empirical phenomena involving magnitude comparisons, including the symbolic distance effect and the semantic congruity effect. We discuss the role of reference points in cognitive and social decision-making, and implications for the evolution of relational representations.     

Cognitive advantage in sport: the nature of perceptual structures

To extend and clarify the nature of the perceptual processes used by sport experts to perceive schematic sport information, two experiments used schematic football diagrams that varied in structure (structured vs. unstructured) and complexity (complex vs. easy). The primary objective was to examine and characterize the nature of the perceptual structures (chunks) that are initially encoded, stored, and subsequently retrieved. In Experiment 1, compared with nonexperts, experts recalled larger perceptual structures following the initial stimulus presentation of structured stimuli only, replicating the recall findings of previous research in other skill domains. Experiment 2 used a long-term memory recognition task and a sorting task. Experts had superior recall and recognition of structured stimuli only, along with more discriminating sorting criteria of perceptual structures within long-term memory. This suggests that experts possess a highly refined semantic network or organized, structured schematic information. This research extends and clarifies the similarities between the perceptual processes of experts in sport (i.e., football) and experts in skill domains that require obvious cognitive involvement (i.e., chess). The results are discussed with reference to the perceptual and conceptual chunking hypotheses. It is proposed that sport experts' knowledge of a conceptual category enables them to retrieve elements using a "generate-and-test process."     

On the relationship between autobiographical memory and perceptual learning

Although the majority of research on human memory has concentrated on a person's ability to recall or recognize items as having been presented in a particular situation, the effects of memory are also revealed in a person's performance of a perceptual task. Prior experience with material can make that material more easily identified or comprehended in perceptually difficult situations. Unlike with standard retention tests, effects of prior experience on a perceptual task do not logically require that a person be aware that he or she is remembering. Indeed, amnesic patients purportedly show effects of practice in their subsequent performance of a perceptual or motor task even though they profess that they do not remember having engaged in that prior experience. The experiments that are reported were designed to explore the relationship between the more aware autobiographical form of memory that is measured by a recognition memory test and the less aware form of memory that is expressed in perceptual learning. Comparisons of effects on perceptual learning and recognition memory reveal two classes of variables. Variables such as the level of processing of words during study influenced recognition memory, although they had no effect on subsequent perceptual recognition. A study presentation of a word had as large an effect on its later perceptual recognition when recognition memory performance was very poor as it did when recognition memory performance was near perfect. In contrast, variables such as the number and the spacing of repetitions produced parallel effects on perceptual recognition and recognition memory. Following Mandler and others, it is suggested that there are two bases for recognition memory. If an item is readily perceived so that it seems to "jump out" from the page, a person is likely to judge that he or she has previously seen the item in the experimental situation. Variables that influence ease of perceptual recognition, then, can also have an effect on recognition memory, so parallel effects are found. The second basis for recognition memory involves elaboration of a word's study context and depends on such factors as level of processing during study--factors that are not important for perceptual recognition of isolated words. Comparisons of perceptual recognition and recognition memory are shown to be useful for determining how a variable has its effect. Effects of study on perceptual recognition appear to be totally due to memory for physical or graphemic information. Results reported are also relevant to theories of perceptual learning. A single presentation of an item is shown to have large and long-lasting effects on its later perceptual recognition. At least partially, effects of study on perceptual recognition depend on the same variables as do effects on more standard memory tests.     

Domain‐specific development of face memory but not face perception

How does the remarkable human ability for face recognition arise over development? Competing theories have proposed either late maturity (beyond 10 years) or early maturity (before 5 years), but have not distinguished between perceptual and memory aspects of face recognition. Here, we demonstrate a perception–memory dissociation. We compare rate of development for (adult, human) faces versus other social stimuli (bodies), other discrete objects (cars), and other categories processed in discrete brain regions (scenes, bodies), from 5 years to adulthood. For perceptual discrimination, performance improved with age at the same rate for faces and all other categories, indicating no domain‐specific development. In contrast, face memory increased more strongly than non‐face memory, indicating domain‐specific development. The results imply that each theory is partly true: the late maturity theory holds for face memory, and the early maturity theory for face perception.     

Experts’ memory: an ERP study of perceptual expertise effects on encoding and recognition

This study examined how perceptual expertise facilitates encoding and recognition. The electroencephalogram of car experts and car novices was recorded in the study as well as test phases of a remember/know task with car and bird stimuli. Car expertise influenced performance and event-related potentials (ERPs) for cars but not birds. Experts recognized and “recollected” cars more accurately, while novices had more false alarms. The ERPs provided neural evidence for theoretical assumptions about expert memory. Memory encoding in the study phase was less effortful and more elaborate for experts than novices, as indicated by lower mean amplitudes for subsequently “recollected” cars and by indistinguishable differences due to memory for recollection and familiarity. The parietal old/new effect, a correlate of recollection measured during recognition testing, was only found for experts. The results show that refined perceptual and semantic processing, characteristics of perceptual expertise, facilitate both memory encoding and recognition memory.     

Inattentional blindness for ignored words: Comparison of explicit and implicit memory tasks

Inattentional blindness is described as the failure to perceive a supra-threshold stimulus when attention is directed away from that stimulus. Based on performance on an explicit recognition memory test and concurrent functional imaging data Rees, Russell, Frith, and Driver [Rees, G., Russell, C., Frith, C. D., & Driver, J. (1999). Inattentional blindness versus inattentional amnesia for fixated but ignored words. Science, 286, 2504–2507] reported inattentional blindness for word stimuli that were fixated but ignored. The present study examined both explicit and implicit memory for fixated but ignored words using a selective-attention task in which overlapping picture/word stimuli were presented at fixation. No explicit awareness of the unattended words was apparent on a recognition memory test. Analysis of an implicit memory task, however, indicated that unattended words were perceived at a perceptual level. Thus, the selective-attention task did not result in perfect filtering as suggested by Rees et al. While there was no evidence of conscious perception, subjects were not blind to the implicit perceptual properties of fixated but ignored words.     

The sensory match effect in recognition memory: Perceptual fluency or episodic trace?

The sensory match effect in recognition memory refers to the finding that recognition is better when the sensory form in which an item is tested is the same as that in which it was studied. This paper examines the basis for the sensory match effect by manipulating whether a studied fragmented picture is tested with the same or a complementary set of fragments in a recognition memory test (Experiment 1) and in a fragment-identification test (Experiment 2). Assuming that fragment identification is a direct measure of perceptual fluency, we expected identical patterns of results across the two tests if perceptual fluency accounted for the sensory match effect in recognition memory. Instead, recognition memory showed a robust overall sensory match effect (the same fragmented image was recognized better than the complementary image), whereas fragment identification showed no overall sensory match effect (the same fragmented image was identified no better than the complementary fragmented image). Experiments 3 and 4 combined the two responses and showed that the basis for the sensory match effect in recognition memory was a subject’s ability to recognize the matching fragments in the absence of conceptual information (when the test stimulus could not be identified), supporting the idea that the episodic trace of the sensory code is responsible for the sensory match effect in recognition memory. Experiment 5 demonstrated that subjects are able to use this sensory code as the sole basis for recognition memory.     

Enhanced perceptual priming for neutral stimuli occurring in a traumatic context: two experimental investigations

Intrusive memories in posttraumatic stress disorder are often triggered by stimuli that are perceptually similar to those present shortly before or during the trauma. The present study aims to examine the possible role of perceptual priming in this phenomenon. It further investigates whether the degree of perceptual priming is associated with dissociation and whether both perceptual priming and intrusive memories can be reduced through elaboration. Two experiments measured perceptual priming for neutral stimuli that immediately preceded a "traumatic" event. Volunteers (N=46, 92) watched a series of "traumatic" and neutral picture stories, and completed a blurred object identification (perceptual priming) memory task, and a recognition memory task. Participants in Experiment 1 were selected to score either high or low on the Trait Dissociation Questionnaire [Murray, Ehlers, & Mayou (2002). Dissociation and posttraumatic stress disorder: Two prospective studies of motor vehicle accident survivors. British Journal of Psychiatry, 180, 363-368]. They also completed a state dissociation measure in the session. Experiment 2 randomly allocated participants to an experimental condition designed to increase elaboration or to a control condition. This experiment also included a measure of intrusive memories. Both experiments found enhanced perceptual priming for the stimuli that immediately preceded the "traumatic" stories compared to those preceding neutral stories. Participants with high trait dissociation showed relatively stronger perceptual perceptual priming. The degree of perceptual priming for stimuli from the "traumatic" stories also correlated with state dissociation (Experiment 1). Experimental manipulation of the elaboration of the stories showed that elaboration reduced the enhanced perceptual priming effect and the relative probability of reexperiencing symptoms (Experiment 2). The results support the role of perceptual priming in intrusions after traumatic events.