整体加工方式下面孔结构与特征关系

探讨面孔整体性加工方式下结构信息和特征信息加工之间的关系。通过聚焦窗口技术在结构信息和特征信息的权变过程中考察二者对面孔整体性加工的影响, 从而进一步确定两类信息的加工关系模式。结果表明: 面孔以整体的方式进行加工; 结构信息加工系统和特征信息加工系统两者并行存在, 在当前实验任务中两类信息加工之间为竞争关系; 面孔以结构信息加工为主还是以特征信息加工为主取决于两类信息在当前任务中提取和加工难度。     

7～10岁自闭症谱系障碍儿童对情绪面孔的觉察与加工

为了考察自闭症谱系障碍(autism spectrum disorder,ASD)儿童对不同情绪面孔的觉察和加工情况,设计两个眼动实验任务,要求14名7～10岁ASD儿童和20名同年龄正常儿童观看图片。实验一采用将情绪面孔嵌入风景图片中引起语义不一致的刺激;实验二采用含有情绪面孔的无意义背景乱序图片刺激。结果发现:(1)ASD儿童对不同情绪面孔的觉察时间都显著长于正常儿童;(2)与正常儿童一样,ASD儿童表现出对恐惧面孔的注意偏向;(3)实验二中,ASD儿童对不同情绪面孔内部特征区的注意分配与正常儿童不同;正常儿童能注意最能展示该类情绪特征信息的区域,如恐惧的眼睛、愉快的嘴巴,而ASD儿童对三类情绪面孔特征区的注意分配方式相似;(4)两个实验条件下,ASD者对不同情绪面孔的觉察、加工模式与正常儿童相似。     

面孔吸引力的整体表征及其动态性增强

面孔作为一种高级的视觉刺激,在人际交往中有着无可替代的作用。其中,面孔吸引力更是影响着日常生活的重要社交决策,如择偶、交友、求职、社会交换等。长久以来,研究者们从面孔特征、社会信息和观察者因素等角度不断探索着人们对静态面孔吸引力的感知,且多从进化角度加以解释。但是,人们如何表征面孔吸引力以及其动态性增强机制仍未可知。本项目通过两个研究,分别从面孔吸引力的整体表征,以及面孔动态性通过影响整体加工、影响对整体信息和特征信息的注意、以及影响社会信息来增强吸引力,从这两个角度尝试回答这一问题。在研究1中,本项目从整体加工的角度探索了面孔吸引力的认知表征。研究1.1通过评分任务和适应范式探索高空间频率（更多局部特征）和低空间频率（更多整体特征）对面孔吸引力的影响,旨在从空间频率探讨面孔吸引力的整体表征。研究1.2通过操纵面孔对称性和面孔常态性探索面孔常态性在面孔对称性和面孔吸引力间的中介作用,探讨面孔吸引力的常态构型表征。研究1.3引入“三庭五眼”这一中国传统面孔审美理论,通过评分任务和适应范式研究“三庭五眼” 构型是否符合中国人对高吸引力中国面孔的表征,以此探讨面孔吸引力的整体表征。研究1.4通过评分任务和适应范式考察局部面孔遮挡是否促进整体面孔吸引力,以及这种促进作用是否由于人们通过局部特征“脑补”出了完整面孔。研究2从整体加工、注意和生命力的角度探讨面孔吸引力的动态性增强机制。研究2.1使用合成效应范式测量动态面孔吸引力的整体加工,探索动静态面孔的吸引力差异是否源于其整体加工程度的不同。研究2.2使用注意分散范式,并结合眼动技术,探讨人们对动静态面孔的注视模式是否存在差异,这种差异是否能解释动态面孔吸引力的增强。研究2.3结合问卷法、实验法和结构方程模型,考察了生命力这一社会因素对动静态面孔吸引力的影响。本项目探讨了面孔吸引力的认知表征以及其动态性增强机制,有助于我们进一步理解人们对面孔吸引力的认知加工以及人类欣赏美这一高级智能。同时,本项目的结果对于日常人际交往和面孔吸引力相关算法的优化等方面也有潜在的应用价值。     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

信息类型和位置对儿童不同时期面孔加工的作用

采用多维面孔任务（face dimensions task）探讨了信息类型和位置对7～17岁儿童面孔加工的作用。该任务通过改变面孔的类型信息（特征和结构）和位置信息（眼部和嘴部）,要求儿童对同时呈现的面孔图片进行“相同”或“不同”的判断。研究发现,儿童面孔加工水平随年龄提高,13～14岁表现最好;对面孔特征的加工好于结构加工,而眼部和嘴部的加工差异从11～12岁开始出现;类型信息和位置信息共同作用于面孔加工,表现为儿童在嘴部的特征和结构加工上未出现显著差异,但眼部的特征加工显著好于眼部的结构加工。     

知觉经验对面孔整体加工的影响

基于经验的整体加工理论认为, 随着知觉经验的增多, 人们加工面孔的专家化能力逐渐增强。其中一种表现形式为, 在知觉面孔时更倾向于整体加工。该理论已经得到了一些实验证据的支持, 但未能解释另外一些研究的发现, 即对他族人群没有长期知觉经验的被试在加工他族面孔时也有强烈的整体加工。本研究旨在考察知觉经验对面孔整体加工的影响, 包括两个实验。实验1a通过组合面孔范式测量了中国被试在辨别本族面孔、他族面孔和种族融合面孔时的组合面孔效应(即面孔整体加工强度)。结果发现, 被试在知觉种族融合面孔时没有表现出组合面孔效应, 在知觉本族面孔和他族面孔时都表现出强烈的组合面孔效应。实验1b以灰阶图重复了实验1a。结果发现, 被试在知觉种族融合面孔时仍然没有表现出组合面孔效应, 在知觉本族面孔和他族面孔时表现出强烈的组合面孔效应。实验2通过操纵种族融合面孔的有或无, 测量5 s的知觉经验对融合面孔的组合效应的影响。结果发现, 在经过短时的知觉经验后, 被试在知觉融合面孔时也表现出强烈的组合面孔效应。上述实验结果表明, 中国被试在加工本族面孔、他族面孔和种族融合面孔时所诱发组合面孔效应有显著的、量的差别, 且这种整体加工的差异不会受到面孔肤色信息的影响。在经过短时的知觉经验后, 中国被试在加工种族融合面孔时表现出强烈的整体加工。该研究的发现提示, 不论是短时知觉经验还是长期知觉经验, 知觉经验的增加是面孔整体加工的一个关键要素。     

不同任务情境中5~6岁儿童卡通面孔加工的眼动研究

以卡通面孔图片为刺激材料,赋予5~6岁儿童三种不同的加工任务,包括卡通面孔识别、分类和吸引力评价,旨在比较其在不同任务情境中的眼动差异。结果表明:(1)任务情境会影响儿童对卡通面孔的加工。在不同的面孔加工任务中,儿童的反应时、正确率、注视时间和次数等存在差异;(2)随着三种任务难度的逐渐加大,儿童的加工程度也相应地加深;(3)儿童在三种任务中的加工方式一致,对面部不同部位的关注程度不同:加工初期特别关注鼻子,而后眼睛部位耗费最多的注意资源,其次是鼻子、嘴巴、前额和脸颊,极少关注下巴;(4)男女童在卡通面孔分类任务中表现出较显著的性别差异,女童具有速度方面的优势,而男童对于关键信息的搜索则更为积极主动。     

背景性质对7-10岁自闭症谱系障碍儿童面孔搜索与加工的作用

为了考察背景性质对ASD者搜索面孔的影响,设计两个眼动实验任务,要求14名7~10岁ASD儿童和20名同年龄正常儿童观看图片。实验一采用将面孔嵌入风景图片中引起语义不一致的刺激;实验二采用含有面孔的无意义背景乱序图片刺激。结果发现：（1）面孔与背景语义不一致并不能促进ASD儿童对面孔的搜索;（2）乱序背景对ASD儿童面孔搜索与加工没有产生干扰作用,但使正常儿童的搜索时间变长;（3）一旦觉察到面孔后,ASD儿童对面孔的注视时间少于正常儿童。表明正常儿童对面孔的搜索与加工受背景性质的影响,而ASD儿童不受背景性质的影响;一旦发现面孔,ASD儿童的注意维持较短,但面孔加工模式与正常儿童相似。     

网页设计中的人的视觉搜索因素

网页设计需要考虑到人的视觉加工机制,尤其是人的视觉搜索机制。网页信息的视觉呈现会影响人的视觉搜索效率,包括页面信息的密度特点,页面标签和页面结构,文本的分栏方式以及视觉刺激间的匹配。在网页设计时需要考虑到的人的视觉特征主要包括视觉搜索的位置特征,搜索模式,眼动特点以及视觉搜索的非对称性。     

不同位置的情绪面孔加工对返回抑制的影响

分别将情绪面孔图片作为线索（实验一）或靶子（实验二）呈现,利用线索-靶子范式考察了定位任务中情绪面孔加工对返回抑制的影响。结果发现：以不同情绪面孔作为线索时,返回抑制稳定出现,表现出与情绪加工的分离;而当情绪面孔作为靶子时,与中性面孔相比,情绪面孔引发的返回抑制量显著较小。该研究表明,在定位任务中,返回抑制不受线索生物性的影响,但是会受到靶子性质的影响,反映出机体在不同条件下对空间注意和情绪加工的灵活性。     

Face imagery is based on featural representations

The effect of imagery on featural and configural face processing was investigated using blurred and scrambled faces. By means of blurring, featural information is reduced; by scrambling a face into its constituent parts configural information is lost. Twenty-four participants learned ten faces together with the sound of a name. In following matching-to-sample tasks participants had to decide whether an auditory presented name belonged to a visually presented scrambled or blurred face in two experimental conditions. In the imagery condition, the name was presented prior to the visual stimulus and participants were required to imagine the corresponding face as clearly and vividly as possible. In the perception condition name and test face were presented simultaneously, thus no facilitation via mental imagery was possible. Analyses of the hit values showed that in the imagery condition scrambled faces were recognized significantly better than blurred faces whereas there was no such effect for the perception condition. The results suggest that mental imagery activates featural representations more than configural representations.     

Perception of novel faces: the parts have it!

It has been suggested that, as a result of expertise, configural information plays a predominant role in face processing. We investigated this idea using novel and learned faces. In experiment 1, sixteen participants matched two subsequently presented blurred or scrambled faces, which could be either upright or inverted, in a sequential same -different matching task. By means of blurring, featural information is hampered, whilst scrambling disrupts configural information. Each face was unfamiliar to the participants and was presented for 1000 ms. An ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 2, fourteen participants were tested with the same design, except that the second face was always intact. Again, the ANOVA on the d' values revealed a significant advantage for scrambled faces. In experiment 3 half of the faces were learned in a familiarisation block prior to the experiment. The ANOVA of these d' values revealed a significant interaction of familiarity and condition, showing that blurred stimuli were better recognised when the faces were familiar. These results suggest that recognition of novel faces, compared to learned faces, relies relatively more on the processing of featural information. In the course of familiarisation the importance of configural information increases.     

Emotion recognition: The role of featural and configural face information

Several studies investigated the role of featural and configural information when processing facial identity. A lot less is known about their contribution to emotion recognition. In this study, we addressed this issue by inducing either a featural or a configural processing strategy (Experiment 1) and by investigating the attentional strategies in response to emotional expressions (Experiment 2). In Experiment 1, participants identified emotional expressions in faces that were presented in three different versions (intact, blurred, and scrambled) and in two orientations (upright and inverted). Blurred faces contain mainly configural information, and scrambled faces contain mainly featural information. Inversion is known to selectively hinder configural processing. Analyses of the discriminability measure (A′) and response times (RTs) revealed that configural processing plays a more prominent role in expression recognition than featural processing, but their relative contribution varies depending on the emotion. In Experiment 2, we qualified these differences between emotions by investigating the relative importance of specific features by means of eye movements. Participants had to match intact expressions with the emotional cues that preceded the stimulus. The analysis of eye movements confirmed that the recognition of different emotions rely on different types of information. While the mouth is important for the detection of happiness and fear, the eyes are more relevant for anger, fear, and sadness.     

The other-race effect: Holistic coding differences and beyond

We evaluate claims that the other-race effect in face memory reflects stronger holistic coding of own-race than other-race faces. Considering evidence from a range of paradigms, including the inversion effect, part–whole effect, composite effect, and the scrambled/blurred task, we find considerable inconsistency, both between paradigms and between participant ethnicities. At the same time, however, studies that isolate configural and component feature processing consistently show better featural, as well as better configural, processing of own-race faces, for both Caucasian and Asian participants. These results raise the possibility that the key feature of own-race face processing is not stronger holistic processing per se, but rather more effective processing of all types of face information (featural as well as holistic).     

Two routes to face perception: evidence from psychophysics and computational modeling

The aim of this study was to separately analyze the role of featural and configural face representations. Stimuli containing only featural information were created by cutting the faces into their parts and scrambling them. Stimuli only containing configural information were created by blurring the faces. Employing an old-new recognition task, the aim of Experiments 1 and 2 was to investigate whether unfamiliar faces (Exp. 1) or familiar faces (Exp. 2) can be recognized if only featural or configural information is provided. Both scrambled and blurred faces could be recognized above chance level. A further aim of Experiments 1 and 2 was to investigate whether our method of creating configural and featural stimuli is valid. Pre-activation of one form of representation did not facilitate recognition of the other, neither for unfamiliar faces (Exp. 1) nor for familiar faces (Exp. 2). This indicates a high internal validity of our method for creating configural and featural face stimuli. Experiment 3 examined whether features placed in their correct categorical relational position but with distorted metrical distances facilitated recognition of unfamiliar faces. These faces were recognized no better than the scrambled faces in Experiment 1, providing further evidence that facial features are stored independently of configural information. From these results we conclude that both featural and configural information are important to recognize a face and argue for a dual-mode hypothesis of face processing. Using the psychophysical results as motivation, we propose a computational framework that implements featural and configural processing routes using an appearance-based representation based on local features and their spatial relations. In three computational experiments (Experiments 4–6) using the same sets of stimuli, we show how this framework is able to model the psychophysical data.     

An own-race advantage for components as well as configurations in face recognition

The own-race advantage in face recognition has been hypothesized as being due to a superiority in the processing of configural information for own-race faces. Here we examined the contributions of both configural and component processing to the own-race advantage. We recruited 48 Caucasian participants in Australia and 48 Chinese participants in Hong Kong, and had them study Caucasian and Chinese faces. After study, they were shown old faces (along with distractors) that were either blurred (isolating configural processing), in which high spatial frequencies were removed from the intact faces, or scrambled (isolating component processing), in which the locations of all face components were rearranged. Participants performed better on the memory test for own-race faces in both the blurred (configural) and scrambled (component) conditions, showing an own-race advantage for both configural and component processing. These results suggest that the own-race advantage in face recognition is due to a general facilitation in different forms of face processing.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

威胁相关面孔表情对眼睛注视方向知觉的影响

以往研究发现眼睛注视方向知觉受面孔表情的影响,愤怒面孔相较于恐惧面孔更倾向被判断为看着观察者。虽然研究者对此提出了不同的解释,但目前尚不清楚愤怒和恐惧表情在注视方向知觉中的这种差异影响到底来自于面孔的结构信息还是物理特征信息。本研究采用注视方向辨别任务,计算直视知觉范围（The Cone of Direct Gaze,CoDG）为因变量,分别以直立,倒置及模糊图片为实验材料,试图通过分离面孔结构信息和物理特征信息,对以上问题进行探讨。结果发现在保留面孔全部信息的情况下（实验1）愤怒面孔的CoDG大于恐惧面孔;在破坏结构信息加工,只保留特征信息加工的情况下（实验2））愤怒和恐惧表情在直视知觉范围上的差异消失了;在削弱物理特征信息加工,保留结构信息加工的情况下（实验3）二者在CoDG上的差异又复现。本研究结果说明不同威胁性面孔表情对眼睛注视知觉的影响主要来自于二者在与情绪意义相关的结构信息加工上的不同,而二者非低级的物理信息上的差异,支持信号共享假说和情绪评价假说对威胁性面孔表情与注视方向整合加工解释的理论基础。     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.