Probing the visual representation of faces with adaptation: A view from the other side of the mean

Sensory adaptation and visual aftereffects have long given insight into the neural codes underlying basic dimensions of visual perception. Recently discovered perceptual adaptation effects for complex shapes like faces can offer similar insight into high-level visual representations. In the experiments reported here, we demonstrated first that face adaptation transfers across a substantial change in viewpoint and that this transfer occurs via processes unlikely to be specific to faces. Next, we probed the visual codes underlying face recognition using face morphs that varied selectively in reflectance or shape. Adaptation to these morphs affected the perception of "opposite" faces both from the same viewpoint and from a different viewpoint. These results are consistent with high-level face representations that pool local shape and reflectance patterns into configurations that specify facial appearance over a range of three-dimensional viewpoints. These findings have implications for computational models of face recognition and for competing neural theories of face and object recognition.     

Dissociable neural subsystems underlie visual working memory for abstract categories and specific exemplars

An ongoing debate concerns whether visual object representations are relatively abstract, relatively specific, both abstract and specific within a unified system, or abstract and specific in separate and dissociable neural subsystems. Most of the evidence for the dissociable subsystems theory has come from experiments that used familiar shapes, and the usage of familiar shapes has allowed for alternative explanations for the results. Thus, we examined abstract and specific visual working memory when the stimuli were novel objects viewed for the first and only time. When participants judged whether cues and probes belonged to the same abstract visual category, they performed more accurately when the probes were presented directly to the left hemisphere than when they were presented directly to the right hemisphere. In contrast, when participants judged whether or not cues and probes were the same specific visual exemplar, they performed more accurately when the probes were presented directly to the right hemisphere than when they were presented directly to the left hemisphere. For the first time, results from experiments using visual working memory tasks support the dissociable subsystems theory.     

Early development of letter specialization in left fusiform is associated with better word reading and smaller fusiform face area

A functional region of left fusiform gyrus termed “the visual word form area” (VWFA) develops during reading acquisition to respond more strongly to printed words than to other visual stimuli. Here, we examined responses to letters among 5‐ and 6‐year‐old early kindergarten children (N = 48) with little or no school‐based reading instruction who varied in their reading ability. We used functional magnetic resonance imaging (fMRI) to measure responses to individual letters, false fonts, and faces in left and right fusiform gyri. We then evaluated whether signal change and size (spatial extent) of letter‐sensitive cortex (greater activation for letters versus faces) and letter‐specific cortex (greater activation for letters versus false fonts) in these regions related to (a) standardized measures of word‐reading ability and (b) signal change and size of face‐sensitive cortex (fusiform face area or FFA; greater activation for faces versus letters). Greater letter specificity, but not letter sensitivity, in left fusiform gyrus correlated positively with word reading scores. Across children, in the left fusiform gyrus, greater size of letter‐sensitive cortex correlated with lesser size of FFA. These findings are the first to suggest that in beginning readers, development of letter responsivity in left fusiform cortex is associated with both better reading ability and also a reduction of the size of left FFA that may result in right‐hemisphere dominance for face perception.     

Dissociable Neural Subsystems Underlie Abstract and Specific Object Recognition

Participants named objects presented in the left or right visual field during a test phase, after viewing centrally presented same-exemplar objects, different-exemplar objects, and words that name objects during an initial encoding phase. In two experiments, repetition priming was exemplar-abstract yet visual when test objects were presented directly to the left cerebral hemisphere, but exemplar-specific when test objects were presented directly to the right cerebral hemisphere, contrary to predictions from single-system theories of object recognition. In two other experiments, stimulus degradation during encoding and task demands during test modulated these results in predicted ways. The results support the theory that dissociable neural subsystems operate in parallel (not in sequence) to underlie visual object recognition: An abstract-category subsystem operates more effectively than a specific-exemplar subsystem in the left hemisphere, and a specific-exemplar subsystem operates more effectively than an abstract-category subsystem in the right hemisphere.     

大脑腹侧视觉通路知觉表征神经机制研究

大脑腹侧视觉通路知觉表征的神经机制是认知神经科学研究面临的基本问题。本文系统介绍了该问题研究中比较有影响力的理论模型,归纳分析了模型之间的分歧与各自的局限。文章分析指出大脑自上而下的调控机制是腹侧视觉通路神经表征机制问题研究的另一重要维度,如何有效整合知觉表征模型与大脑调控机制的相关研究是进一步深化知觉表征神经机制问题研究的关键。     

Object categorisation,object naming,and viewpoint independence in visual remembering: Evidence from young children's drawings of a novel object

A simple object-drawing task confirms a three-way association between object categorisation, viewpoint independence, and longer-term visual remembering. Young children (5- to 7-year-olds) drew a familiar object or a novel object, immediately after it had been hidden from view or on the following day. Both objects were shown from a full range of viewpoints or from just two viewpoints, from neither of which would either object normally be drawn after unrestricted viewing. When drawing from short-term memory after restricted viewing, both objects were most likely to be depicted from a seen viewpoint. When drawing from longer-term memory after restricted viewing, the novel object continued to be drawn from a seen viewpoint, but the mug was now most likely to be drawn from a preferred viewpoint from which it had not been seen. Naming the novel object with a novel count noun (“Look at this. This is a dax”), to signal that it belonged to an object category, resulted in it being drawn in the same way as the familiar object. The results concur with other evidence indicating that short-term and longer-term visual remembering are differentially associated with viewpoint-dependent representations of individual objects and viewpoint independent representations of object categories, respectively.     

Object categorisation, object naming, and viewpoint independence in visual remembering: evidence from young children's drawings of a novel object

A simple object-drawing task confirms a three-way association between object categorisation, viewpoint independence, and longer-term visual remembering. Young children (5- to 7-year-olds) drew a familiar object or a novel object, immediately after it had been hidden from view or on the following day. Both objects were shown from a full range of viewpoints or from just two viewpoints, from neither of which would either object normally be drawn after unrestricted viewing. When drawing from short-term memory after restricted viewing, both objects were most likely to be depicted from a seen viewpoint. When drawing from longer-term memory after restricted viewing, the novel object continued to be drawn from a seen viewpoint, but the mug was now most likely to be drawn from a preferred viewpoint from which it had not been seen. Naming the novel object with a novel count noun ("Look at this. This is a dax"), to signal that it belonged to an object category, resulted in it being drawn in the same way as the familiar object. The results concur with other evidence indicating that short-term and longer-term visual remembering are differentially associated with viewpoint-dependent representations of individual objects and viewpoint independent representations of object categories, respectively.     

Facelikeness matters: A parametric multipart object set to understand the role of spatial configuration in visual recognition

There is a view that faces and objects are processed by different brain mechanisms. Different factors may modulate the extent to which face mechanisms are used for objects. To distinguish these factors, we present a new parametric multipart three-dimensional object set that provides researchers with a rich degree of control of important features for visual recognition such as individual parts and the spatial configuration of those parts. All other properties being equal, we demonstrate that perceived facelikeness in terms of spatial configuration facilitated performance at matching individual exemplars of the new object set across viewpoint changes (Experiment 1). Importantly, facelikeness did not affect perceptual discriminability (Experiment 2) or similarity (Experiment 3). Our findings suggest that perceptual resemblance to faces based on spatial configuration of parts is important for visual recognition even after equating physical and perceptual similarity. Furthermore, the large parametrically controlled object set and the standardized procedures to generate additional exemplars will provide the research community with invaluable tools to further understand visual recognition and visual learning.     

A neural circuit analysis of visual recognition memory: role of perirhinal, medial, and lateral entorhinal cortex

Using a continuous recognition memory procedure for visual object information, we sequentially presented rats with eight novel objects and four repeated objects (chosen from the 8). These were selected from 120 different three-dimensional objects of varying sizes, shapes, textures, and degree of brightness. Repeated objects had lags ranging from 0 to 4 (from 0 to 4 different objects between the first and repeated presentation). An object was presented on one side of a long table divided in half by an opaque Plexiglas guillotine door, and the latency between opening the door and the rat moving the object was measured. The first presentation of an object resulted in reinforcement, but repeated presentations did not result in a reinforcement. After completion of acquisition training (significantly longer latencies for repeated presentation compared with the first presentation of an object), rats received lesions of the perirhinal, medial, or lateral entorhinal cortex or served as sham operated controls. On the basis of postsurgery testing and additional tests, the results indicated that rats with perirhinal cortex lesions had a sustained impairment in performing the task. There were no sustained deficits with medial or lateral entorhinal cortex lesions. The data suggest that recognition memory for visual object information is mediated primarily by the perirhinal cortex but not by the medial or lateral entorhinal cortex.     

镜像等效或守恒及其打破：从行为到认知神经机制的研究证据

镜像等效或守恒是动物与人类个体对两侧对称自然物体的一种进化自适应加工。但是, 这种知觉特性会妨碍包含镜像字符的文字阅读学习。阅读者有必要学会利用镜像泛化抑制的“去学习”机制, 打破镜像等效或守恒, 以获得识别镜像字符的能力。这一过程中, 左侧梭状回皮层通过与早期视觉皮层、顶叶皮层和口语脑网络的交互作用, 逐渐发展出一个可以识别镜像字符的视觉词形区(visual word form area, VWFA)。今后的研究需要关注两半球及其连合纤维在镜像等效或守恒加工中的作用、镜像泛化与抑制的详尽加工机制及其对镜像书写的影响、正常汉语儿童的汉字镜像泛化加工等问题。     

视觉适应及其神经机制

视适应使得视觉系统可以连续地根据外界环境的变化做出调整, 改善了对世界的感知。研究提示, 适应影响了对许多基本的视觉属性的加工, 诸如亮度、对比度、运动、颜色等, 也包括对复杂的刺激如面孔等。视适应发生于视觉加工流的多个阶段, 从视网膜到初级视觉皮层以及之后的脑区(例如纹外皮层, 梭状回面孔区)。关于视适应的机制解释, 已从早期的神经元反应疲劳解释发展成当今更流行的标准化模型理论等。最近的适应研究证明, 视觉适应由时间尺度上快慢不同的多重机制控制, 这被认为赋予了视觉系统有效应对环境中不同时间尺度的变化的能力。     

The resilience of object predictions: Early recognition across viewpoints and exemplars

Recognition of everyday objects can be facilitated by top-down predictions. We have proposed that these predictions are derived from rudimentary image information, or gist, extracted rapidly from the low spatial frequencies (LSFs) (Bar Journal of Cognitive Neuroscience 15: 600–609, 2003). Because of the coarse nature of LSF representations, we hypothesized here that such predictions can accommodate changes in viewpoint as well as facilitate the recognition of visually similar objects. In a repetition-priming task, we indeed observed significant facilitation of target recognition that was primed by LSF objects across moderate viewpoint changes, as well as across visually similar exemplars. These results suggest that the LSF representations are specific enough to activate accurate predictions, yet flexible enough to overcome small changes in visual appearance. Such gist representations facilitate object recognition by accommodating changes in visual appearance due to viewing conditions, and help generalize from familiar to novel exemplars.     

Gender, Video Game Playing Habits and Visual Memory Tasks

The current research examined whether visuospatial recall of both abstract and common objects was related to gender or object familiarity. Seventy two undergraduates from a university in the Southern U.S. were asked to draw the Rey Complex Figure and a series of common objects from memory. A pilot sample of seventy three undergraduates had previously identified common objects as “male” “female” and “neutral” exemplars. Males were significantly better at drawing “male” and “neutral” exemplars whereas females were better at drawing “female” exemplars. Neither gender was significantly better at the Rey task. These results question whether males have an inherent advantage in visual memory. Results also found that experience with playing violent video games was associated with higher visual memory recall.     

Cerebral asymmetries in sleep-dependent processes of memory consolidation

Preference for previously seen, unfamiliar objects reflects a memory bias on affective judgment, known as the “mere exposure effect” (MEE). Here, we investigated the effect of time, post-exposure sleep, and the brain hemisphere solicited on preference generalization toward objects viewed in different perspectives. When presented in the right visual field (RVF), which promotes preferential processing in the left hemisphere, same and mirrored exemplars were preferred immediately after exposure. MEE generalized to much dissimilar views after three nights of sleep. Conversely, object presentation in the left visual field (LVF), promoting right hemisphere processing, elicited a MEE for same views immediately after exposure, then for mirror views after sleep. Most importantly, sleep deprivation during the first post-exposure night, although followed by two recovery nights, extinguished MEE for all views in the LVF but not in the RVF. Besides demonstrating that post-exposure time and sleep facilitate the generalization process by which we integrate various representations of an object, our results suggest that mostly in the right hemisphere, sleep may be mandatory to consolidate the memory bias underlying affective preference. These interhemispheric differences tentatively call for a reappraisal of the role of cerebral asymmetries in wake- and sleep-dependent processes of memory consolidation.     

Unraveling mechanisms for expert object recognition: bridging brain activity and behavior

Behavioral sensitivity to object transformations and the response to novel objects (Greebles) in the fusiform face area (FFA) was measured several times during expertise training. Sensitivity to 3 transformations increased with expertise: (a) configural changes in which halves of objects were misaligned, (b) configural changes in which some of the object parts were moved, and (c) the substitution of an object part with a part from a different object. The authors found that holistic-configural effects can arise from object representations that are differentiated in terms of features or parts. Moreover, a holistic-inclusive effect was correlated with changes in the right FFA. Face recognition may not be unique in its reliance on holistic processing, measured in terms of both behavior and brain activation.     

双侧梭状回面孔区在面孔加工中的功能分工与协作

梭状回面孔区(fusiform face area,FFA)是视觉皮层上专门加工面孔的区域。然而,双侧FFA在面孔加工中的功能分工与协作还存在争议。在特异性刺激的加工上,右侧FFA主要负责人类面孔类别的知觉,而左侧FFA的功能与面孔精细特征的感知有关;在皮层可塑性上,右侧FFA主要参与青少年的社会适应学习,而左侧FFA负责成年人的知觉学习;在面孔网络中,二者与不同区域的连接用以适应不同的认知需求;他们之间的有向协作具有任务特定性。未来研究需要回答三个问题:左侧FFA的可塑性程度及这一可塑性是否是认知特定的、左侧FFA及其形成的网络连接的认知意义,双侧FFA在面孔网络中的连接有向性等问题。     

Hemispheric differences in object identification

Although the right hemisphere is thought to be preferentially involved in visuospatial processing, the specialization of the two hemispheres with respect to object identification is unclear. The present study investigated the effects of hemifield presentation on object and word identification by presenting objects (Experiment 1) and words (Experiment 2) in a rapid visual stream of distracters. In Experiment 1, object images presented in the left visual field (i.e., to the right hemisphere) were identified with shorter display times. In addition, the left visual field advantage was greater for inverted objects. In Experiment 2, words presented in the right visual field (i.e., to the left hemisphere) under similar conditions were identified with shorter display times. These results support the idea that the right hemisphere is specialized with regard to object identification.     

Spatial updating during locomotion does not eliminate viewpoint-dependent visual object processing

Two experiments were conducted to investigate whether locomotion to a novel test view would eliminate viewpoint costs in visual object processing. Participants performed a sequential matching task for object identity or object handedness, using novel 3-D objects displayed in a head-mounted display. To change the test view of the object, the orientation of the object in 3-D space and the test position of the observer were manipulated independently. Participants were more accurate when the test view was the same as the learned view than when the views were different no matter whether the view change of the object was 50° or 90°. With 50° rotations, participants were more accurate at novel test views caused by participants’ locomotion (object stationary) than caused by object rotation (observer stationary) but this difference disappeared when the view change was 90°. These results indicate that facilitation of spatial updating during locomotion occurs within a limited range of viewpoints, but that such facilitation does not eliminate viewpoint costs in visual object processing.     

Memory for objects in canonical and noncanonical viewpoints

This article investigates how the perspective from which we see an object affects memory. Object identification can be affected by the orientation of the object. Palmer, Rosch, and Chase (1981) coined the term canonical to describe perspectives in which identification performance is best. We present two experiments that tested the effects of object perspective on memory. Our results revealed a double dissociation between task (recognition and recall) and type of object perspective. In recognition, items studied in the noncanonical viewpoint produced higher proportions of “old” responses than did items studied in the canonical viewpoint, whereas new objects presented from a noncanonical viewpoint produced fewer “old” responses than did new objects presented from the canonical viewpoint. In free recall, conversely, objects studied from the noncanonical viewpoint produced lower recall rates than did objects studied from the canonical viewpoint. These results, which reveal a pattern similar to word frequency effects, support the psychological reality of canonical viewpoints and the frequencyof-exposure-based accounts of canonical viewpoint effects. 2008 Psychonomic Society, Inc     

Incongruent object/context relationships in visual scenes: Where are they processed in the brain?

Rapid object visual categorization in briefly flashed natural scenes is influenced by the surrounding context. The neural correlates underlying reduced categorization performance in response to incongruent object/context associations remain unclear and were investigated in the present study using fMRI. Participants were instructed to categorize objects in briefly presented scenes (exposure duration = 100 ms). Half of the scenes consisted of objects pasted in an expected (congruent) context, whereas for the other half, objects were embedded in incongruent contexts. Object categorization was more accurate and faster in congruent relative to incongruent scenes. Moreover, we found that the two types of scenes elicited different patterns of cerebral activation. In particular, the processing of incongruent scenes induced increased activations in the parahippocampal cortex, as well as in the right frontal cortex. This higher activity may indicate additional neural processing of the novel (non experienced) contextual associations that were inherent to the incongruent scenes. Moreover, our results suggest that the locus of object categorization impairment due to contextual incongruence is in the right anterior parahippocampal cortex. Indeed in this region activity was correlated with the reaction time increase observed with incongruent scenes. Representations for associations between objects and their usual context of appearance might be encoded in the right anterior parahippocampal cortex.