Expertise for upright faces improves the precision but not the capacity of visual working memory

Considerable research has focused on how basic visual features are maintained in working memory, but little is currently known about the precision or capacity of visual working memory for complex objects. How precisely can an object be remembered, and to what extent might familiarity or perceptual expertise contribute to working memory performance? To address these questions, we developed a set of computer-generated face stimuli that varied continuously along the dimensions of age and gender, and we probed participants’ memories using a method-of-adjustment reporting procedure. This paradigm allowed us to separately estimate the precision and capacity of working memory for individual faces, on the basis of the assumptions of a discrete capacity model, and to assess the impact of face inversion on memory performance. We found that observers could maintain up to four to five items on average, with equally good memory capacity for upright and upside-down faces. In contrast, memory precision was significantly impaired by face inversion at every set size tested. Our results demonstrate that the precision of visual working memory for a complex stimulus is not strictly fixed but, instead, can be modified by learning and experience. We find that perceptual expertise for upright faces leads to significant improvements in visual precision, without modifying the capacity of working memory.     

Visual working memory for line orientations and face identities

Previous studies have shown that the number of objects we can actively hold in visual working memory is smaller for more complex objects. However, complex objects are not just more complex but are often more similar to other complex objects used as test probes. To separate effects of complexity from effects of similarity, we measured visual memory following a 1-sec delay for complex and simple objects at several levels of memory-to-test similarity. When memory load was one object, memory accuracy for a face (a complex attribute) was similar to a line orientation (a simple attribute) when the face changed in steps of 10% along a morphing continuum and the line changed in steps of 5° in orientation. Performance declined with increasing memory load and increasing memory-to-test similarity. Remarkably, when memory load was three or four objects, face memory was better than orientation memory at similar changed steps. These results held when memory for line orientations was compared with that for inverted faces. We conclude that complex objects do not always exhaust visual memory more quickly than simple objects do.     

The effects of categorical similarity and feature-space proximity on visual working memory processing

Two patterns of data predict that similarity has a positive effect and a negative effect on visual working memory (VWM) processing. We assume that these two empirical outcomes do not distinguish categorical similarity from feature-space proximity, resulting in this divergence. To investigate how categorical similarity and feature-space proximity modulate VWM, we tested memory for an array of pictures drawn from either mixed categories or a single category in which feature-space proximity varied along a morph continuum in a change-detection task. We found that memory under the mixed-category condition was better than that under the single-category condition, whereas memory under high feature-space proximity was superior to that under low feature-space proximity. These patterns were unaffected by manipulations of stimulus type (faces or scenes), encoding duration (limited or self-paced), and presentation format (simultaneous or sequential). These results are consistent with our hypotheses that categorical similarity inhibits VWM, whereas feature-space proximity facilitates VWM. We also found that memory for items with low feature-space proximity benefited more from mixed-category encoding than that for items with high feature-space proximity. Memory for faces benefited more from mixed-category encoding than scenes, whereas memory for scenes benefited more from feature-space proximity than faces. These results suggest that centre-surround inhibition organization might underlie similarity effects in VWM. Centre-surround inhibition organization for complex real-world objects could have both categorical level and feature-space level. The feature-space level might differ by category.     

Why are some people’s names easier to learn than others? The effects of face similarity on memory for face-name associations

Using synthetic faces that varied along four perceptual dimensions (Wilson, Loffler, & Wilkinson, 2002), we examined the effects of face similarity on memory for face-name associations. The nature of these stimuli allowed us to go beyond the categorical similarity manipulations used in previous verbal associative memory studies to trace out the parametric relation between similarity and various performance measures. In Experiment 1, we found that recall performance diminished as a function of how many studied faces were in the vicinity of the cue face in similarity space. Also, incorrect recalls were more likely to come from nearby positions in face space. Experiments 2 and 3, respectively, demonstrated analogous effects with a set of more distinguishable, photorealistic faces, and in an associative recognition task. These results highlight the similarity between associative recall and associative recognition, and between face-name association and other domains of associative memory.     

Gaze behavior in face comparison: The roles of sex, task, and symmetry

Knowing where people look on a face provides an objective insight into the information entering the visual system and into cognitive processes involved in face perception. In the present study, we recorded eye movements of human participants while they compared two faces presented simultaneously. Observers’ viewing behavior and performance was examined in two tasks of parametrically varying difficulty, using two types of face stimuli (sex morphs and identity morphs). The frequency, duration, and temporal sequence of fixations on previously defined areas of interest in the faces were analyzed. As was expected, viewing behavior and performance varied with difficulty. Interestingly, observers compared predominantly the inner halves of the face stimuli—a result inconsistent with the general left-hemiface bias reported for single faces. Furthermore, fixation patterns and performance differed between tasks, independently of stimulus type. Moreover, we found differences in male and female participants’ viewing behaviors, but only when the sex of the face stimuli was task relevant.     

The effects of precedence on Navon-induced processing bias in face recognition

Macrae and Lewis (2002) showed that repeated reporting of the global dimension of Navon stimuli improved performance in a subsequent face identification task, whilst reporting the features of the Navon stimuli impaired performance. Using a face composite task, which is assumed to require featural processing, Weston and Perfect (2005) showed the complementary pattern: Featural responding to Navon letters speeded performance. However, both studies used Navon stimuli with global precedence, in which the overall configuration is easier to report than the features. Here we replicate the two studies above, whilst manipulating the precedence (global or featural) of the letter stimuli in the orientation task. Both studies replicated the previously reported findings with global precedence stimuli, but showed the reverse pattern with local precedence stimuli. These data raise important questions as to what is transferred between the Navon orientation task and the face-processing tasks that follow.     

Processes underlying the cross-race effect: an investigation of holistic, featural, and relational processing of own-race versus other-race faces

Adults are often better at recognising own-race than other-race faces. Unlike previous studies that reported an own-race advantage after administering a single test of either holistic processing or of featural and relational processing, we used a cross-over design and multiple tasks to assess differential processing of faces from a familiar race versus a less familiar race. Caucasian and Chinese adults performed four tasks, each with Caucasian and Chinese faces. Two tasks measured holistic processing: the composite face task and the part/whole task. Both tasks indicated holistic processing of own-race and other-race faces that did not differ in degree. Two tasks measured featural and relational processing: the Jane/Ling task, in which same/ different judgments were made about face pairs that differed in features of their spacing, and the scrambled/blurred task, in which test faces were scrambled (isolates memory for components) or blurred (isolates memory for relations). Both tasks provided evidence of an own-race advantage in both featural and relational processing. We conclude that even when adults process other-race faces holistically, other manifestations of an own-race advantage remain.     

A developmental investigation of other‐race contact and the own‐race face effect

Research over the past two decades has demonstrated that individuals are better at recognizing and discriminating faces of their own race versus other races. The own‐race effect has typically been investigated in relation to recognition memory; however, some evidence supports an own‐race effect at the level of perceptual encoding in adults. The current study investigated the developmental basis of the own‐race effect in White primary students (aged 7–11), secondary students (aged 12–15) and university students. Face stimuli were generated by morphing South Asian and White parent faces together along a linear continuum. In a same/different perceptual discrimination task, participants judged whether the face stimuli (morphs and parent faces) were physically identical to or different from the original parent faces. Results revealed a significant race of face effect for each age group, whereby participants were better at discriminating White relative to Asian faces. A significantly larger own‐race effect was observed for the secondary and university students than for primary students. A questionnaire was used to assess other‐race social anxiety and contact; however, this self‐report measure was not found to be related to the observed own‐race effect.     

Computer graphic studies of the role of facial similarity in judgements of attractiveness

Anecdotally, spouses are often said to resemble one another. This study investigates the effects of similarity between participants and stimuli on judgements of facial attractiveness: does “like prefer like”? Using computer graphic techniques, opposite sex facial stimuli were generated from subjects' photographs. Experiment 1 showed a correlation between attractiveness and similarity but the effect can be explained by the attractiveness of average faces. Beyond this, there was a trend for individual subjects to rate opposite sex images with a similar face shape to their own face as more attractive than other subjects. Experiment 2 allowed subjects to interactively manipulate an opposite sex facial image along a continuum from a self-similar shape, through an average face shape, to a face with opposite characteristics. No significant preferences for self-similar or opposite characteristics were found. Preferences for average faces are stronger than preferences for self-similar faces.     

Computer graphic studies of the role of facial similarity in judgements of attractiveness

Anecdotally, spouses are often said to resemble one another. This study investigates the effects of similarity between participants and stimuli on judgements of facial attractiveness: does “like prefer like”? Using computer graphic techniques, opposite sex facial stimuli were generated from subjects' photographs. Experiment 1 showed a correlation between attractiveness and similarity but the effect can be explained by the attractiveness of average faces. Beyond this, there was a trend for individual subjects to rate opposite sex images with a similar face shape to their own face as more attractive than other subjects. Experiment 2 allowed subjects to interactively manipulate an opposite sex facial image along a continuum from a self-similar shape, through an average face shape, to a face with opposite characteristics. No significant preferences for self-similar or opposite characteristics were found. Preferences for average faces are stronger than preferences for self-similar faces.     

Recognition memory for realistic synthetic faces

A series of experiments examined short-term recognition memory for trios of briefly presented, synthetic human faces derived from three real human faces. The stimuli were a graded series of faces, which differed by varying known amounts from the face of the average female. Faces based on each of the three real faces were transformed so as to lie along orthogonal axes in a 3-D face space. Experiment 1 showed that the synthetic faces' perceptual similarity structure strongly influenced recognition memory. Results were fit by a noisy exemplar model (NEMO) of perceptual recognition memory. The fits revealed thatrecognition memory was influenced both by the similarity of the probe to the series items and by the similarities among the series items themselves. Nonmetric multidimensional scaling (MDS) showed that the faces' perceptual representations largely preserved the 3-D space in which the face stimuli were arrayed. NEMO gave a better account of the results when similarity was defined as perceptual MDS similarity, rather than as the physical proximity of one face to another. Experiment 2 confirmed the importance of within-list homogeneity directly, without mediation of a model. We discuss the affinities and differences between visual memory for synthetic faces and memory for simpler stimuli.     

Visual and phonological components of working memory in children

Previous studies have shown that young children's immediate memory for a short series of drawings of objects is mediated by a visual component of working memory, whereas older children rely chiefly upon a phonological component. Three experiments investigated the hypothesis that older children rely also, but to a lesser extent, on visual working memory. Experiment 1 confirmed previous evidence that 11-year-olds' memory is disrupted by phonemic similarity of object names, but is unaffected by visual similarity of the objects themselves. However, when articulatory suppression was used to prevent phonological coding, levels of recall were sensitive to visual rather than phonemic similarity. Experiment 2 compared the effects of interpolating an auditory-verbal or a visual postlist task on memory for drawings viewed either with or without suppression. The visual task had a clear disruptive effect only in the suppression condition, where it interfered selectively with recall of the most recent item. Experiment 3 compared the effects of interpolating an auditory-verbal or a mixed-modality (visual-auditory) postlist task when subjects were not required to suppress. There was greater interference from the mixed-modality task, and this effect was confined to the last item presented. These experiments are taken as confirming the presence of a small but reliable contribution from visual memory in 11-year-old children's recall. As in younger children, visual working memory in 11-year-olds is sensitive to visual similarity and is responsible for a final-item visual recency effect. The results also show that older children's use of visual working memory is usually masked by the more pervasive phonological component of recall. Some implications for the structure of working memory and its development are discussed.     

The fidelity of visual memory for faces and non-face objects

The fidelity of visual working memory was assessed for faces and non-face objects. In two experiments, four levels of memory load (1, 2, 3, or 4 items) were combined with four perceptual distances between probe and study items, with maximum item confusability occurring for the minimum memory load. Under these conditions, recognition memory for multiple faces exceeded that of a single face. This result was primarily due to the higher false alarm rates for faces than non-face objects, even though the two classes of stimuli had been matched for perceptual discriminability. Control experiments revealed that this counterintuitive result emerged only for old–new recognition choices based on near-threshold image differences. For non-face objects, instead, recognition performance decreased with increasing memory load. It is speculated that the low memorial discriminability of the transient properties of a face may serve the purpose of enhancing recognition at the individual-exemplar level.     

Object files can be purely episodic

Our ability to track an object as the same persisting entity over time and motion may primarily rely on spatiotemporal representations which encode some, but not all, of an object's features. Previous researchers using the 'object reviewing' paradigm have demonstrated that such representations can store featural information of well-learned stimuli such as letters and words at a highly abstract level. However, it is unknown whether these representations can also store purely episodic information (i.e. information obtained from a single, novel encounter) that does not correspond to pre-existing type-representations in long-term memory. Here, in an object-reviewing experiment with novel face images as stimuli, observers still produced reliable object-specific preview benefits in dynamic displays: a preview of a novel face on a specific object speeded the recognition of that particular face at a later point when it appeared again on the same object compared to when it reappeared on a different object (beyond display-wide priming), even when all objects moved to new positions in the intervening delay. This case study demonstrates that the mid-level visual representations which keep track of persisting identity over time--e.g. 'object files', in one popular framework can store not only abstract types from long-term memory, but also specific tokens from online visual experience.     

Probing the visual representation of faces with adaptation: A view from the other side of the mean

Sensory adaptation and visual aftereffects have long given insight into the neural codes underlying basic dimensions of visual perception. Recently discovered perceptual adaptation effects for complex shapes like faces can offer similar insight into high-level visual representations. In the experiments reported here, we demonstrated first that face adaptation transfers across a substantial change in viewpoint and that this transfer occurs via processes unlikely to be specific to faces. Next, we probed the visual codes underlying face recognition using face morphs that varied selectively in reflectance or shape. Adaptation to these morphs affected the perception of "opposite" faces both from the same viewpoint and from a different viewpoint. These results are consistent with high-level face representations that pool local shape and reflectance patterns into configurations that specify facial appearance over a range of three-dimensional viewpoints. These findings have implications for computational models of face recognition and for competing neural theories of face and object recognition.     

The time course of working memory effects on visual attention

Previous work has generated inconsistent results with regard to what extent working memory (WM) content guides visual attention. Some studies found effects of easy to verbalize stimuli, whereas others only found an influence of visual memory content. To resolve this, we compared the time courses of memory-based attentional guidance for different memory types. Participants first memorized a colour, which was either easy or difficult to verbalize. They then looked for an unrelated target in a visual search display and finally completed a memory test. One of the distractors in the search display could have the memorized colour. We varied the time between the to-be-remembered colour and the search display, as well as the ease with which the colours could be verbalized. We found that the influence of easy to verbalize WM content on visual search decreased with increasing time, whereas the influence of visual WM content was sustained. However, visual working memory effects on attention also decreased when the duration of visual encoding was limited by an additional task or when the memory item was presented only briefly. We propose that for working memory effects on visual attention to be sustained, a sufficiently strong visual representation is necessary.     

Working memory deficits in boys with attention deficit/hyperactivity disorder (ADHD): An examination of orthographic coding and episodic buffer processes

The episodic buffer component of working memory was examined in children with attention deficit/hyperactivity disorder (ADHD) and typically developing peers (TD). Thirty-two children (ADHD = 16, TD = 16) completed three versions of a phonological working memory task that varied with regard to stimulus presentation modality (auditory, visual, or dual auditory and visual), as well as a visuospatial task. Children with ADHD experienced the largest magnitude working memory deficits when phonological stimuli were presented via a unimodal, auditory format. Their performance improved during visual and dual modality conditions but remained significantly below the performance of children in the TD group. In contrast, the TD group did not exhibit performance differences between the auditory- and visual-phonological conditions but recalled significantly more stimuli during the dual-phonological condition. Furthermore, relative to TD children, children with ADHD recalled disproportionately fewer phonological stimuli as set sizes increased, regardless of presentation modality. Finally, an examination of working memory components indicated that the largest magnitude between-group difference was associated with the central executive. Collectively, these findings suggest that ADHD-related working memory deficits reflect a combination of impaired central executive and phonological storage/rehearsal processes, as well as an impaired ability to benefit from bound multimodal information processed by the episodic buffer.     

知觉或记忆条件下对连续变化刺激的相似判断

控制不同材料(图形和字母)的大小、位置和长宽比连续变化,在标准和待判断刺激同时(知觉任务)或相继呈现(记忆任务)两种条件下进行相似判断的实验研究。结论为(1)任务方式对图形的相似判断有非常显著的影响;(2)知觉任务中相似判断的反应时非常显著地长于记忆任务中的反应时;(3)对材料各种特征的相似判断和加工速度差异非常显著．某些特征在相似表征中有较重要的作用。     

Summary statistics in the attentional blink

We used the attentional blink (AB) paradigm to investigate the processing stage at which extraction of summary statistics from visual stimuli (“ensemble coding”) occurs. Experiment 1 examined whether ensemble coding requires attentional engagement with the items in the ensemble. Participants performed two sequential tasks on each trial: gender discrimination of a single face (T1) and estimating the average emotional expression of an ensemble of four faces (or of a single face, as a control condition) as T2. Ensemble coding was affected by the AB when the tasks were separated by a short temporal lag. In Experiment 2, the order of the tasks was reversed to test whether ensemble coding requires more working-memory resources, and therefore induces a larger AB, than estimating the expression of a single face. Each condition produced a similar magnitude AB in the subsequent gender-discrimination T2 task. Experiment 3 additionally investigated whether the previous results were due to participants adopting a subsampling strategy during the ensemble-coding task. Contrary to this explanation, we found different patterns of performance in the ensemble-coding condition and a condition in which participants were instructed to focus on only a single face within an ensemble. Taken together, these findings suggest that ensemble coding emerges automatically as a result of the deployment of attentional resources across the ensemble of stimuli, prior to information being consolidated in working memory.     

客体运动方向的视觉工作记忆存储方式

采用变化觉察范式,以独立运动的客体为对象,通过两个实验,探讨多个客体的运动方向在视觉工作记忆中的存储机制,即单个对象独立存储,抑或其存储受多个客体构型的影响。实验一和实验二相继考察了非目标客体运动方向变化,以及是否存在非目标客体对觉察目标客体运动方向的影响。结果发现,非目标客体运动方向变化条件下的觉察正确率显著低于不变的条件,然而只呈现目标客体条件下的觉察正确率与同时呈现目标和非目标条件无显著差异。该结果与前人在静态条件下对目标客体的觉察受目标客体和非目标客体整体构型影响的结论不一致。本研究的结果支持多个客体的运动方向信息在工作记忆中是以独立方式存储的假设。