Understanding the role of configural processing in face emotion recognition in Parkinson’s disease

This investigation examined whether impairment in configural processing could explain deficits in face emotion recognition in people with Parkinson’s disease (PD). Stimuli from the Radboud Faces Database were used to compare recognition of four negative emotion expressions by older adults with PD (n = 16) and matched controls (n = 17). Participants were tasked with categorizing emotional expressions from upright and inverted whole faces and facial composites; it is difficult to derive configural information from these two types of stimuli so featural processing should play a larger than usual role in accurate recognition of emotional expressions. We found that the PD group were impaired relative to controls in recognizing anger, disgust and fearful expressions in upright faces. Then, consistent with a configural processing deficit, participants with PD showed no composite effect when attempting to identify facial expressions of anger, disgust and fear. A face inversion effect, however, was observed in the performance of all participants in both the whole faces and facial composites tasks. These findings can be explained in terms of a configural processing deficit if it is assumed that the disruption caused by facial composites was specific to configural processing, whereas inversion reduced performance by making it difficult to derive both featural and configural information from faces.     

面孔知觉中特征、结构和整体加工策略的眼动研究

考察面孔知觉中特征加工、结构加工和整体加工三种不同加工方式对应的眼动模式。实验1中, 将以特征信息为主的错乱面孔和以结构信息为主的模糊面孔作为线索刺激, 引发对测试面孔的特征加工和结构加工, 眼动分析表明：特征加工表现为对面孔各特征内更长的凝视时间, 结构加工表现为对面孔各特征间高频的眼跳。实验2采用相同的研究范式, 将完整面孔、轻度错乱面孔和低水平模糊面孔作为线索刺激, 引发对测试面孔除特征加工和结构加工外的另一种加工方式-- 整体加工, 表现为注视点更多地落在测试面孔中央区的鼻子部位以扩大注视范围, 进而把握整张面孔信息。本研究揭示了三种不同面孔加工方式眼动模式的差异。     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

7～10岁自闭症谱系障碍儿童对情绪面孔的觉察与加工

为了考察自闭症谱系障碍(autism spectrum disorder,ASD)儿童对不同情绪面孔的觉察和加工情况,设计两个眼动实验任务,要求14名7～10岁ASD儿童和20名同年龄正常儿童观看图片。实验一采用将情绪面孔嵌入风景图片中引起语义不一致的刺激;实验二采用含有情绪面孔的无意义背景乱序图片刺激。结果发现:(1)ASD儿童对不同情绪面孔的觉察时间都显著长于正常儿童;(2)与正常儿童一样,ASD儿童表现出对恐惧面孔的注意偏向;(3)实验二中,ASD儿童对不同情绪面孔内部特征区的注意分配与正常儿童不同;正常儿童能注意最能展示该类情绪特征信息的区域,如恐惧的眼睛、愉快的嘴巴,而ASD儿童对三类情绪面孔特征区的注意分配方式相似;(4)两个实验条件下,ASD者对不同情绪面孔的觉察、加工模式与正常儿童相似。     

Perception of novel faces: the parts have it!

It has been suggested that, as a result of expertise, configural information plays a predominant role in face processing. We investigated this idea using novel and learned faces. In experiment 1, sixteen participants matched two subsequently presented blurred or scrambled faces, which could be either upright or inverted, in a sequential same -different matching task. By means of blurring, featural information is hampered, whilst scrambling disrupts configural information. Each face was unfamiliar to the participants and was presented for 1000 ms. An ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 2, fourteen participants were tested with the same design, except that the second face was always intact. Again, the ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 3 half of the faces were learned in a familiarisation block prior to the experiment. The ANOVA of these d' values revealed a significant interaction of familiarity and condition, showing that blurred stimuli were better recognised when the faces were familiar. These results suggest that recognition of novel faces, compared to learned faces, relies relatively more on the processing of featural information. In the course of familiarisation the importance of configural information increases.     

Faces elicit different scanning patterns depending on task demands

Eye movements were recorded while participants discriminated upright and inverted faces that differed with respect to either configural or featural information. Two hypotheses were examined: (1) whether featural and configural information processing elicit different scanning patterns; (2) whether fixations on a specific region of the face dominate scanning patterns. Results from two experiments were compared to examine whether participants’ prior knowledge of the kind of information that would be relevant for the task (i.e., configural vs featural) influences eye movements. In Experiment 1, featural and configural discrimination trials were presented in random order such that participants were unaware of the information that would be relevant on any given trial. In Experiment 2, featural and configural discrimination trials were blocked and participants were informed of the nature of the discriminations. The results of both experiments suggest that faces elicit different scanning patterns depending on task demands. When participants were unaware of the nature of the information relevant for the task at hand, face processing was dominated by attention to the eyes. When participants were aware that relational information was relevant, scanning was dominated by fixations to the center of the face. We conclude that faces elicit scanning strategies that are driven by task demands.     

An own-race advantage for components as well as configurations in face recognition

The own-race advantage in face recognition has been hypothesized as being due to a superiority in the processing of configural information for own-race faces. Here we examined the contributions of both configural and component processing to the own-race advantage. We recruited 48 Caucasian participants in Australia and 48 Chinese participants in Hong Kong, and had them study Caucasian and Chinese faces. After study, they were shown old faces (along with distractors) that were either blurred (isolating configural processing), in which high spatial frequencies were removed from the intact faces, or scrambled (isolating component processing), in which the locations of all face components were rearranged. Participants performed better on the memory test for own-race faces in both the blurred (configural) and scrambled (component) conditions, showing an own-race advantage for both configural and component processing. These results suggest that the own-race advantage in face recognition is due to a general facilitation in different forms of face processing.     

威胁相关面孔表情对眼睛注视方向知觉的影响

以往研究发现眼睛注视方向知觉受面孔表情的影响,愤怒面孔相较于恐惧面孔更倾向被判断为看着观察者。虽然研究者对此提出了不同的解释,但目前尚不清楚愤怒和恐惧表情在注视方向知觉中的这种差异影响到底来自于面孔的结构信息还是物理特征信息。本研究采用注视方向辨别任务,计算直视知觉范围（The Cone of Direct Gaze,CoDG）为因变量,分别以直立,倒置及模糊图片为实验材料,试图通过分离面孔结构信息和物理特征信息,对以上问题进行探讨。结果发现在保留面孔全部信息的情况下（实验1）愤怒面孔的CoDG大于恐惧面孔;在破坏结构信息加工,只保留特征信息加工的情况下（实验2））愤怒和恐惧表情在直视知觉范围上的差异消失了;在削弱物理特征信息加工,保留结构信息加工的情况下（实验3）二者在CoDG上的差异又复现。本研究结果说明不同威胁性面孔表情对眼睛注视知觉的影响主要来自于二者在与情绪意义相关的结构信息加工上的不同,而二者非低级的物理信息上的差异,支持信号共享假说和情绪评价假说对威胁性面孔表情与注视方向整合加工解释的理论基础。     

The other-race effect: Holistic coding differences and beyond

We evaluate claims that the other-race effect in face memory reflects stronger holistic coding of own-race than other-race faces. Considering evidence from a range of paradigms, including the inversion effect, part–whole effect, composite effect, and the scrambled/blurred task, we find considerable inconsistency, both between paradigms and between participant ethnicities. At the same time, however, studies that isolate configural and component feature processing consistently show better featural, as well as better configural, processing of own-race faces, for both Caucasian and Asian participants. These results raise the possibility that the key feature of own-race face processing is not stronger holistic processing per se, but rather more effective processing of all types of face information (featural as well as holistic).     

Effects of geometric distortions on face-recognition performance

The importance of 'configural' processing for face recognition is now well established, but it remains unclear precisely what it entails. Through four experiments we attempted to clarify the nature of configural processing by investigating the effects of various affine transformations on the recognition of familiar faces. Experiment 1 showed that recognition was markedly impaired by inversion of faces, somewhat impaired by shearing or horizontally stretching them, but unaffected by vertical stretching of faces to twice their normal height. In experiment 2 we investigated vertical and horizontal stretching in more detail, and found no effects of either transformation. Two further experiments were performed to determine whether participants were recognising stretched faces by using configural information. Experiment 3 showed that nonglobal vertical stretching of faces (stretching either the top or the bottom half while leaving the remainder undistorted) impaired recognition, implying that configural information from the stretched part of the face was influencing the process of recognition--ie that configural processing involves global facial properties. In experiment 4 we examined the effects of Gaussian blurring on recognition of undistorted and vertically stretched faces. Faces remained recognisable even when they were both stretched and blurred, implying that participants were basing their judgments on configural information from these stimuli, rather than resorting to some strategy based on local featural details. The tolerance of spatial distortions in human face recognition suggests that the configural information used as a basis for face recognition is unlikely to involve information about the absolute position of facial features relative to each other, at least not in any simple way.     

The face inversion effect—Parts and wholes: Individual features and their configuration

The face inversion effect (FIE) is a reduction in recognition performance for inverted faces (compared to upright faces) that is greater than that typically observed with other stimulus types (e.g., houses). The work of Diamond and Carey, suggests that a special type of configural information, “second-order relational information” is critical in generating this inversion effect. However, Tanaka and Farah concluded that greater reliance on second-order relational information did not directly result in greater sensitivity to inversion, and they suggested that the FIE is not entirely due to a reliance on this type of configural information. A more recent review by McKone and Yovel provides a meta-analysis that makes a similar point. In this paper, we investigated the contributions made by configural and featural information to the FIE. Experiments 1a and1b investigated the link between configural information and the FIE. Remarkably, Experiment 1b showed that disruption of all configural information of the type considered in Diamond and Carey's analysis (both first and second order) was effective in reducing recognition performance, but did not significantly impact on the FIE. Experiments 2 and 3 revealed that face processing is affected by the orientation of individual features and that this plays a major role in producing the FIE. The FIE was only completely eliminated when we disrupted the single feature orientation information in addition to the configural information, by using a new type of transformation similar to Thatcherizing our sets of scrambled faces. We conclude by noting that our results for scrambled faces are consistent with an account that has recognition performance entirely determined by the proportion of upright facial features within a stimulus, and that any ability to make use of the spatial configuration of these features seems to benefit upright and inverted normal faces alike.     

Face imagery is based on featural representations

The effect of imagery on featural and configural face processing was investigated using blurred and scrambled faces. By means of blurring, featural information is reduced; by scrambling a face into its constituent parts configural information is lost. Twenty-four participants learned ten faces together with the sound of a name. In following matching-to-sample tasks participants had to decide whether an auditory presented name belonged to a visually presented scrambled or blurred face in two experimental conditions. In the imagery condition, the name was presented prior to the visual stimulus and participants were required to imagine the corresponding face as clearly and vividly as possible. In the perception condition name and test face were presented simultaneously, thus no facilitation via mental imagery was possible. Analyses of the hit values showed that in the imagery condition scrambled faces were recognized significantly better than blurred faces whereas there was no such effect for the perception condition. The results suggest that mental imagery activates featural representations more than configural representations.     

正立和倒立的威胁性身体表情的识别

为探索身体表情的加工时程以及加工方式是否为构形加工,采用ERP技术考察对正立和倒立的威胁性身体表情（恐惧和愤怒）的识别。行为结果发现倒置效应存在。ERP结果发现：早期阶段已有对威胁性情绪（P1）和倒置效应（N1）的加工;中期阶段主要存在对倒置效应的加工（N170）;晚期阶段,威胁性情绪在正立条件上得到更多的加工（P3和LPP）。结果表明,威胁性身体表情加工有独特的时间进程,加工方式以构形加工为主。     

Features are also important: contributions of featural and configural processing to face recognition

It has been suggested that face recognition is primarily based on configural information, with featural information playing little or no role. We investigated this idea by comparing the prototype effect for face prototypes that emphasized either featural or configural processing. In Experiment 1, participants showed a tendency to commit false alarms in response to nonstudied prototypes, and this tendency was equivalent for featural and configural prototypes. Experiment 2 replicated this finding, and provided support for the assumption that the two types of prototypes differed in terms of featural and configural processing: Face inversion eliminated the prototype effect for configural prototypes but not for featural prototypes. These results suggest that both featural and configural processing make important contributions to face recognition, and that their effects are dissociable.     

The recognition and categorization of upright and inverted emotional expressions by 7-month-old infants

Upright and inverted faces were used to determine whether 7-month-old infants discriminate emotional expressions on the basis of affectively relevant information. In Experiment 1, infants recognized the similarity of happy faces over changing identities and discriminated this expression from fear and anger when the stimuli were presented upright, but not when they were inverted. In Experiment 2, infants were able to discriminate happiness from fear and anger posed by a single model, regardless of the orientation of the stimuli. From these studies it was suggested that categorizing emotional expressions depends upon attending to affectively relevant, orientation-specific information, whereas the discrimination of emotional expressions can be done on a featural basis, something that remains invariant regardless of the orientation of the stimuli. In Experiment 3, infants discriminated toothy happiness posed by several models from nontoothy happiness and nontoothy anger when the stimuli were presented upright and inverted. Thus, when salient features were available, the infants based their discriminations on perceptual aspects rather than on conceptual aspects such as categories of emotions.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

The interference effect of emotional expressions on facial identity recognition in preschool-aged children

The present study aims to explore the influence of facial emotional expressions on pre-scholars' identity recognition was analyzed using a two-alternative forced-choice matching task. A decrement was observed in children's performance with emotional faces compared with neutral faces, both when a happy emotional expression remained unchanged between the target face and the test faces and when the expression changed from happy to neutral or from neutral to happy between the target and the test faces (Experiment 1). Negative emotional expressions (i.e. fear and anger) also interfered with children's identity recognition (Experiment 2). Obtained evidence suggests that in preschool-age children, facial emotional expressions are processed in interaction with, rather than independently from, the encoding of facial identity information. The results are discussed in relationship with relevant research conducted with adults and children.     

自闭症谱系障碍儿童对面孔加工的同龄偏向效应

采用视觉追踪技术,探讨自闭症谱系障碍(autism spectrum disorders, ASD)儿童面孔加工的同龄偏向效应。实验1选取19名ASD儿童和23名生理年龄匹配的普通儿童(typically developing, TD)为被试,通过自由观看同龄和异龄中性面孔,探讨ASD儿童是否存在面孔加工的同龄偏向效应;实验2选取22名ASD儿童和生理年龄匹配的25名TD儿童,通过自由观看快乐、愤怒和恐惧面孔,探讨情绪对ASD儿童面孔加工同龄偏向的影响。结果发现,(1)ASD儿童对同龄中性面孔的注视时间显著大于异龄中性面孔;(2)ASD儿童在愤怒和恐惧情绪下对同龄面孔的注视时间显著大于异龄面孔,而在快乐情绪下同龄和异龄的注视时间则无显著差异。这表明ASD儿童对面孔的注视加工存在同龄偏向效应,且受情绪的影响。     

Affective theory of mind inferences contextually influence the recognition of emotional facial expressions

The recognition of emotional facial expressions is often subject to contextual influence, particularly when the face and the context convey similar emotions. We investigated whether spontaneous, incidental affective theory of mind inferences made while reading vignettes describing social situations would produce context effects on the identification of same-valenced emotions (Experiment 1) as well as differently-valenced emotions (Experiment 2) conveyed by subsequently presented faces. Crucially, we found an effect of context on reaction times in both experiments while, in line with previous work, we found evidence for a context effect on accuracy only in Experiment 1. This demonstrates that affective theory of mind inferences made at the pragmatic level of a text can automatically, contextually influence the perceptual processing of emotional facial expressions in a separate task even when those emotions are of a distinctive valence. Thus, our novel findings suggest that language acts as a contextual influence to the recognition of emotional facial expressions for both same and different valences.     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.