Sensitivity to the displacement of facial features in negative and inverted images

Subjects have previously been reported to show difficulties in recognising faces which are either inverted or in photographic negative. Experiments are reported in which a two-alternative forced-choice technique was used to measure sensitivity for distinguishing faces which have been modified by having the eyes moved vertically or horizontally. Subjects were less sensitive to such changes for inverted faces or negative faces, and were even less sensitive for faces that were both inverted and negative. No such effects were found for a control stimulus consisting simply of three solid circles in the same positions as the eyes and mouth of a face. When the stimuli consisted of eyes, nose, and mouth, but without a surround, no evidence of inversion or negation effects was found, which suggests that a facial surround is necessary. When the stimulus consisted of a facial surround with the eyes, nose, and mouth replaced by solid circles, effects of negation were found, but no effects of inversion. This dissociation of the effects of negation and inversion may suggest that they are the result of different underlying mechanisms.     

Attending to faces: change detection,familiarization, and inversion effects

We tested detection of changes to eye position, eye color (brightness), mouth position, and mouth color in frontal views of faces. Two faces were presented sequentially for 555 ms each, with a blank screen of 120 ms separating the two. Faces were presented either both upright or both inverted. Measures of detection (d') were calculated for several different degrees of change for each of the four dimensions of change. We first compared results to an earlier experiment that used an oddity design, in which subjects indicated which of three simultaneously viewed and otherwise identical faces had been altered on one of these four dimensions. Subjects in both of these experiments were partially cued, in that they knew the four possible types of changes that could occur on a given trial. The change-detection results correlated well with the oddity data. They confirmed that face inversion had little effect upon detection of changes in eye color, a moderate effect upon detection of eye-position or mouth-color changes, and caused a drastic reduction in the detection of mouth-position changes. An experiment in which uncued and fully cued subjects were compared showed that cueing significantly improved detection of feature color changes, but there was little difference between upright and inverted faces. Full cueing eliminated all effects of inversion. Compared to partial cueing, changes in mouth color were poorly detected by uncued subjects. Last, a change in the frequency of the base (unaltered) face in an experiment from 75% to 40% showed that increased short-term familiarity decreased the detection of eye changes and increased the detection of mouth changes, regardless of face orientation and the type of change made (color or position). We conclude that uncued subjects encode the spatial relations of features more than the colors of features, that mouth color in particular is not considered a relevant dimension for encoding, and that familiarization redistributes attention from more to less salient facial regions. Inversion effects are not simply an exaggeration of the salience effects revealed by withdrawing cueing, but represent an interaction of spatial encoding with salience, in that the greatest inversion effects occur for spatial shifts in less salient facial regions, and can be eliminated through the use of focused attention.     

Effects of geometric distortions,Gaussian blur,and contrast negation on recognition of familiar faces

It is assumed that “configural processing” is important for recognizing people whom we know. Studies have shown better discrimination of relational changes between facial features when faces are presented upright than upside down and when presented as photographic negatives. However, studies have also demonstrated tolerance for complex changes to facial configuration of familiar faces when images are geometrically distorted. In two experiments, we explored effects of linear stretching, Gaussian blur, and contrast negation on recognition of familiar or unfamiliar faces (Experiment 1) and familiar or unfamiliar company brand logos (Experiment 2). Only contrast negation severely impaired recognition of familiar faces but not unfamiliar faces or company brand logos. Effects of contrast negation were additional to linear stretching, whereas linear stretching independently had no impact on recognition. These findings highlight an important deficit in the recognition of familiar faces caused by contrast negation.     

Configural features in the context of upright and inverted faces

When faces are turned upside down, recognition is known to be severely disrupted. This effect is thought to be due to disruption of configural processing. Recently, Leder and Bruce (2000, Quarterly Journal of Experimental Psychology A 53 513-536) argued that configural information in face processing consists at least partly of locally processed relations between facial elements. In three experiments we investigated whether a local relational feature (the interocular distance) is processed differently in upside-down versus upright faces. In experiment 1 participants decided in which of two sequentially presented photographic faces the interocular distance was larger. The decision was more difficult in upside-down presentation. Three different conditions were used in experiment 2 to investigate whether this deficit depends upon parts of the face beyond the eyes themselves; displays showed the eye region alone, the eyes and nose, or the eyes and nose and mouth. The availability of additional features did not interact with the inversion effect which was observed strongly even when the eyes were shown in isolation. In experiment 3 all eyes were turned upside down in the inverted face condition as in the Thatcher illusion (Thompson, 1980 Perception 9 483-484). In this case no inversion effect was found. These results are in accordance with an explanation of the face-inversion effect in which the disruption of configural facial information plays the critical role in memory for faces, and in which configural information corresponds to spatial information that is processed in a way which is sensitive to local properties of the facial features involved.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

Facial Attention and Spacetime Fragments

Inverting a face impairs perception of its features and recognition of its identity. Whether faces are special in this regard is a current topic of research and debate. Kanizsa studied the role of facial features and environmental context in perceiving the emotion and identity of upright and inverted faces. He found that observers are biased to interpret faces in a retinal coordinate frame, and that this bias is readily overruled by increased realism of facial features, but not easily overruled by environmental context. An additional factor contributing to a retinal coordinate-frame interpretation may be the ambiguous nature of the face stimuli. Since his facial expressions are interpretable both upright and inverted, they may in both orientations activate an endogenous attentional process for faces. We present visual search and change-blindness experiments that explore how inversion, negation, and facial emotion affect visual attention to static faces. We find that attention to faces is impaired by inversion and negation. We also find that the parts of the face that receive greater attention can be influenced by the emotional expression of the face. We propose to extend these experiments to dynamic faces. To this end, we develop a theory of the visual representation of dynamic faces, in which faces are represented by classes of `spacetime fragments'-moving regions of the face with high informational content. We then present ideas for future experiments which are motivated by the spacetime fragment theory, and which should serve to constrain its further development.     

Evidence for holistic processing of faces viewed as photographic negatives

Inversion and photographic negation both impair face recognition. Inversion seems to disrupt processing of the spatial relationship between facial features ('relational' processing) which normally occurs with upright faces and which facilitates their recognition. It remains unclear why negation affects recognition. To find out if negation impairs relational processing, we investigated whether negative faces are subject to the 'chimeric-face effect'. Recognition of the top half of a composite face (constructed from top and bottom halves of different faces) is difficult when the face is upright, but not when it is inverted. To perform this task successfully, the bottom half of the face has to be disregarded, but the relational processing which normally occurs with upright faces makes this difficult. Inversion reduces relational processing and thus facilitates performance on this particular task. In our experiments, subjects saw pairs of chimeric faces and had to decide whether or not the top halves were identical. On half the trials the two chimeras had identical tops; on the remaining trials the top halves were different. (The bottom halves were always different.) All permutations of orientation (upright or inverted) and luminance (normal or negative) were used. In experiment 1, each pair of 'identical' top halves were the same in all respects. Experiment 2 used differently oriented views of the same person, to preclude matches being based on incidental features of the images rather than the faces displayed within them. In both experiments, similar chimeric-face effects were obtained with both positive and negative faces, implying that negative faces evoke some form of relational processing. It is argued that there may be more than one kind of relational processing involved in face recognition: the 'chimeric-face effect' may reflect an initial 'holistic' processing which binds facial features into a 'Gestalt', rather than being a demonstration of the configurational processing involved in individual recognition.     

Attention misplaced: the role of diagnostic features in the face-inversion effect

Inversion disproportionately impairs recognition of face stimuli compared to nonface stimuli arguably due to the holistic manner in which faces are processed. A qualification is put forward in which the first point fixated on is different for upright and inverted faces and this carries some of the face-inversion effect. Three experiments explored this possibility by using fixation crosses to guide attention to the eye or mouth region of the to-be-presented faces in different orientations. Recognition was better when the fixation cross appeared at the eye region than at the mouth region. The face-inversion effect was smaller when the eyes were cued than when the mouth was cued or when there was no cueing. The results suggest that the first facial feature attended to is important for accurate face recognition and this may carry some of the effects of inversion.     

The effect of inversion on the encoding of normal and “thatcherized” faces

In the “Thatcher illusion” a face, in which the eyes and mouth are inverted relative to the rest of the face, looks grotesque when shown upright but not when inverted. In four experiments we investigated the contribution of local and global processing to this illusion in normal observers. We examined inversion effects (i.e., better performance for upright than for inverted faces) in a task requiring discrimination of whether faces were or were not “thatcherized”. Observers made same/different judgements to isolated face parts (Experiments 1-2) and to whole faces (Experiments 3-4). Face pairs had the same or different identity, allowing for different process- ing strategies using feature-based or configural information, respectively. In Experiment 1, feature-based matching of same-person face parts yielded only a small inversion effect for normal face parts. However, when feature-based matching was prevented by using the face parts of different people on all trials (Experiment 2) an inversion effect occurred for normal but not for thatcherized parts. In Experiments 3 and 4, inversion effects occurred with normal but not with thatcherized whole faces, on both same- and different-person matching tasks. This suggests that a common configural strategy was used with whole (normal) faces. Face context facilitated attention to misoriented parts in same-person but not in different-person matching. The results indicate that (1) face inversion disrupts local configural processing, but not the processing of image features, and (2) thatcherization disrupts local configural processing in upright faces.     

The effects of face inversion on the perception of long-range and local spatial relations in eye and mouth configuration

A recent study hypothesized a configurational anisotropy in the face inversion effect, with vertical relations more difficult to process. However, another difference in the stimuli of that report was that the vertical but not horizontal shifts lacked local spatial references. Difficulty processing long-range spatial relations might also be predicted from a relevance-interaction explanation, which proposes that in inverted faces, spatial relations are processed efficiently only within high-relevance local regions. The authors performed 2 experiments to distinguish between these hypotheses. Experiment 1 showed that the inversion effect for vertical shifts of the eyes alone was more similar to that for horizontal eye shifts than for vertical shifts of the eyes and eyebrows. In Experiment 2, focused attention reduced the inversion effect for vertical mouth position more than that for vertical shifts of the eyes and brows. The authors concluded that face inversion impairs the perception of both local spatial relations in low-relevance regions and long-range spatial relations extending across multiple facial regions, consistent with a loss of efficient whole-face processing of the spatial relations between features.     

Revisiting the perception of upside-down faces

In two experiments, the effect of orientation on face perception was assessed. Using a scale from 1 ( normal ) to 7 ( bizarre ), participants rated normal, unaltered faces and faces in which changes had been made to spatial-relational properties (eyes and mouth inverted or relative position of the eyes and mouth altered) or to component properties (eyes whitened and teeth blackened). For unaltered and component-distortion faces, bizarreness ratings increased linearly as orientation increased from 0° to 180°. For spatial-distortion faces, a discontinuity in the function relating orientation and bizarreness was in evidence between 90° and 120°. The results provide support for the view that there is a qualitative difference in the processing of upright and inverted faces due to the disproportionate effect of inversion on the encoding of spatial-relational information.     

Shades of emotion: What the addition of sunglasses or masks to faces reveals about the development of facial expression processing

Three studies investigated developmental changes in facial expression processing, between 3years-of-age and adulthood. For adults and older children, the addition of sunglasses to upright faces caused an equivalent decrement in performance to face inversion. However, younger children showed better classification of expressions of faces wearing sunglasses than children who saw the same faces un-occluded. When the mouth area was occluded with a mask, children under nine years showed no impairment in expression classification, relative to un-occluded faces. An early selective focus of attention on the eyes may be optimal for socialization, but mediate against accurate expression classification. The data support a model in which a threshold level of attentional control must be reached before children can develop adult-like configural processing skills and be flexible in their use of face- processing strategies.     

Effects of inversion and negation on social inferences from faces

Judgments about personality and other social characteristics based on facial appearance are remarkably consistent across individuals. However, whereas the facial cues that underpin age and sex judgments are already well understood, the physical bases for judgments of characteristics such as intelligence or trustworthiness are still unknown. Inversion and photographic negation are used here to investigate the visual processes underlying social inferences from the face and to explore whether various judgments might rely on different perceptual representations. In experiment 1, the perceptions of age, sex, attractiveness, approachability, intelligence, and trustworthiness, but not distinctiveness, were affected by inversion, and all these characteristics were affected by negation. The effects of inversion and negation were independent, suggesting that they impaired the encoding of different types of information. Moreover, an independent manipulation of hue and luminance in experiment 2 showed that the effects of negation were mainly due to the reversal of luminance values. These results are consistent with the view that information about the configuration of features (the processing of which is impaired by inversion) and information about surface properties (the processing of which is impaired by brightness negation) are both used in the perception of social characteristics from faces. In addition, the fact that there was a similar pattern of impairment across most judgments suggests that there is an initial common perceptual representation of the face, from which most characteristics are inferred.     

哭泣表情面孔的注意偏向:眼动的证据

研究采用双选择Oddball范式和线索-靶子范式,并结合眼动技术,以微笑、哭泣和中性表情面孔为刺激材料,综合考察哭泣表情面孔在识别和解离过程中的注意偏向。研究发现:在识别阶段,哭泣表情面孔的识别正确率和反应速度都显著优于微笑表情面孔,进一步的兴趣区注视偏向分析发现,哭泣和微笑表情面孔的注视模式既具有一致的规律,又存在细微的差异;在解离阶段,返回抑制受线索表情类型的影响,在有效线索条件下,哭泣表情线索呈现后个体对目标刺激的平均注视时间和眼跳潜伏期都显著短于其它表情线索。表明哭泣表情面孔在识别和解离过程中具有不同的注意偏向表现,在识别阶段表现为反应输出优势和注视模式上的一致性与差异性;在解离阶段表现为有效线索条件下,对目标刺激定位和视觉加工的促进作用。     

Emotion regulates attention: The relation between facial configurations,facial emotion,and visual attention

We used threatening, friendly, and neutral schematic facial stimuli, in which three, two, or one feature(s) conveyed emotion, to test the hypothesis that humans preferentially orient attention towards threat, and to examine the relation between facial features, emotional impression, and visual attention. Using a visual search paradigm, participants searched for discrepant faces in arrays of otherwise identical faces. Subsequently they also rated their emotional impression of the involved stimuli. Across four experiments, we found faster and more accurate detection of threatening than friendly faces, even when only one feature conveyed the emotion. Facial features affected both attention and emotion in the rank order eyebrows > mouth > eyes. Finally, the emotional impression of a face predicted its effect on attention.     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.     

When context hinders! Learn-test compatibility in face recognition

Some theories of holistic face processing propose that parts in faces (eyes, nose, mouth, etc.) are not explicitly represented. So far, the empirical evidence has shown that whole-to-part superiority is found when wholes are learned. We substantiated this using photographic faces. More importantly, we investigated whether learning parts also reveals holistic effects. This has not been attempted before. Four experiments showed that after learning facial parts, recognition of these parts was disrupted when the part was shown in the full face. This distraction effect was strongest when perceivers were not directed to focus on a particular facial feature. Thus, it is very difficult to ignore irrelevant parts in faces. In fact, this might be the essence of holistic face processing.     

Facial perception of conspecifics: chimpanzees (Pan troglodytes) preferentially attend to proper orientation and open eyes

This paper reports on the use of an eye-tracking technique to examine how chimpanzees look at facial photographs of conspecifics. Six chimpanzees viewed a sequence of pictures presented on a monitor while their eye movements were measured by an eye tracker. The pictures presented conspecific faces with open or closed eyes in an upright or inverted orientation in a frame. The results demonstrated that chimpanzees looked at the eyes, nose, and mouth more frequently than would be expected on the basis of random scanning of faces. More specifically, they looked at the eyes longer than they looked at the nose and mouth when photographs of upright faces with open eyes were presented, suggesting that particular attention to the eyes represents a spontaneous face-scanning strategy shared among monkeys, apes, and humans. In contrast to the results obtained for upright faces with open eyes, the viewing times for the eyes, nose, and mouth of inverted faces with open eyes did not differ from one another. The viewing times for the eyes, nose, and mouth of faces with closed eyes did not differ when faces with closed eyes were presented in either an upright or inverted orientation. These results suggest the possibility that open eyes play an important role in the configural processing of faces and that chimpanzees perceive and process open and closed eyes differently.     

A smile biases the recognition of eye expressions: Configural projection from a salient mouth

A smile is visually highly salient and grabs attention automatically. We investigated how extrafoveally seen smiles influence the viewers' perception of non-happy eyes in a face. A smiling mouth appeared in composite faces with incongruent non-happy (fearful, neutral, etc.) eyes, thus producing blended expressions, or it appeared in intact faces with genuine expressions. Attention to the eye region was spatially cued while foveal vision of the mouth was blocked by gaze-contingent masking. Participants judged whether the eyes were happy or not. Results indicated that the smile biased the evaluation of the eye expression: The same non-happy eyes were more likely to be judged as happy and categorized more slowly as not happy in a face with a smiling mouth than in a face with a non-smiling mouth or with no mouth. This bias occurred when the mouth and the eyes appeared simultaneously and aligned, but also to some extent when they were misaligned and when the mouth appeared after the eyes. We conclude that the highly salient smile projects to other facial regions, thus influencing the perception of the eye expression. Projection serves spatial and temporal integration of face parts and changes.     

Search asymmetries with real faces: testing the anger-superiority effect

The anger-superiority hypothesis states that angry faces are detected more efficiently than friendly faces. Previously research used schematized stimuli, which minimizes perceptual confounds, but violates ecological validity. The authors argue that a confounding of appearance and meaning is unavoidable and even unproblematic if real faces are presented. Four experiments tested carefully controlled photos in a search-asymmetry design. Experiments 1 and 2 revealed more efficient detection of an angry face among happy faces than vice versa. Experiment 3 indicated that the advantage was due to the mouth, but not to the eyes, and Experiment 4, using upright and inverted thatcherized faces, suggests a perceptual basis. The results are in line with a sensory-bias hypothesis that facial expressions evolved to exploit extant capabilities of the visual system.