A new look at social attention: Orienting to the eyes is not (entirely) under volitional control

People tend to look at other people's eyes, but whether this bias is automatic or volitional is unclear. To discriminate between these two possibilities, we used a "don't look" (DL) paradigm. Participants looked at a series of upright or inverted faces, and were asked either to freely view the faces or to avoid looking at the eyes, or as a control, the mouth. As previously demonstrated, participants showed a bias to attend to both eyes and mouths during free viewing. In the DL condition, participants told to avoid the eyes of upright faces were unable to fully suppress the tendency to fixate on the faces' eyes, whereas participants told to avoid the mouth of upright faces successfully eliminated their bias to overtly attend to that feature. When faces were inverted, participants were equally able to suppress looks to the eyes and mouth. Together, these results suggest that the tendency to look at the eyes reflects orienting that is both volitional and automatic, and that the engagement of holistic or configural face processing mechanisms during upright face viewing has an influence in guiding gaze automatically to the eyes. (PsycINFO Database Record (c) 2012 APA, all rights reserved).     

First fixations in face processing: The more diagnostic they are the smaller the face-inversion effect

Hills, Ross, and Lewis (2011) introduced the concept that the face-inversion effect may, in part, be carried by the first feature attended to, since the first feature fixated upon is different for upright and inverted faces. An eye-tracking study that directly assesses this hypothesis by using fixation crosses to guide attention to the eye or mouth region of the to-be-presented upright and inverted faces was devised. Recognition was better when the fixation cross appeared at the eye region than at the mouth region. The face-inversion effect was smaller when the eyes were cued than when the mouth was cued or when there was no cueing. The eye-tracking measures confirmed that the fixation crosses attracted the first fixation but did not affect other measures of eye-movements. Furthermore, the location of the first fixation predicted recognition accuracy: when the first fixation was to the eyes, recognition accuracy was higher than when the first fixation was to the mouth, irrespective of facial orientation. The results suggest that the first facial feature attended to is more predictive of recognition accuracy than the face orientation in which they are presented.     

How the Thatcher illusion reveals evolutionary differences in the face processing of primates

Face recognition in humans is a complex cognitive skill that requires sensitivity to unique configurations of eyes, mouth, and other facial features. The Thatcher illusion has been used to demonstrate the importance of orientation when processing configural information within faces. Transforming an upright face so that the eyes and mouth are inverted renders the face grotesque; however, when this “Thatcherized” face is inverted, the effect disappears. Due to the use of primate models in social cognition research, it is important to determine the extent to which specialized cognitive functions like face processing occur across species. To date, the Thatcher illusion has been explored in only a few species with mixed results. Here, we used computerized tasks to examine whether nonhuman primates perceive the Thatcher illusion. Chimpanzees and rhesus monkeys were required to discriminate between Thatcherized and unaltered faces presented upright and inverted. Our results confirm that chimpanzees perceived the Thatcher illusion, but rhesus monkeys did not, suggesting species differences in the importance of configural information in face processing. Three further experiments were conducted to understand why our results differed from previously published accounts of the Thatcher illusion in rhesus monkeys.     

Effects of motion and audio-visual redundancy on upright and inverted face and feature preferences in 4-13-month old pre- and full-term NICU graduates

NICU infants are reported to have diminished social orientation and increased risk of socio-communicative disorders. In this eye tracking study, we used a preference for upright compared to inverted faces as a gauge of social interest in high medical risk full- and pre-term NICU infants. We examined the effects of facial motion and audio-visual redundancy on face and eye/mouth preferences across the first year. Upright and inverted baby faces were simultaneously presented in a paired-preference paradigm with motion and synchronized vocalization varied. NICU risk factors including birth weight, sex, and degree of CNS injury were examined. Overall, infants preferred the more socially salient upright faces, making this the first report, to our knowledge, of an upright compared to inverted face preference among high medical risk NICU infants. Infants with abnormalities on cranial ultrasound displayed lower social interest, i.e. less of a preferential interest in upright faces, when viewing static faces. However, motion selectively increased their upright face looking time to a level equal that of infants in other CNS injury groups. We also observed an age-related sex effect suggesting higher risk in NICU males. Females increased their attention to the mouth in upright faces across the first year, especially between 7–10 months, but males did not. Although vocalization increased diffuse attention toward the screen, contrary to our predictions, there was no evidence that the audio-visual redundancy embodied in a vocalizing face focused additional attention on upright faces or mouths. This unexpected result may suggest a vulnerability in response to talking faces among NICU infants that could potentially affect later verbal and socio-communicative development.     

Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

Face perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.     

Revisiting the perception of upside-down faces

In two experiments, the effect of orientation on face perception was assessed. Using a scale from 1 ( normal ) to 7 ( bizarre ), participants rated normal, unaltered faces and faces in which changes had been made to spatial-relational properties (eyes and mouth inverted or relative position of the eyes and mouth altered) or to component properties (eyes whitened and teeth blackened). For unaltered and component-distortion faces, bizarreness ratings increased linearly as orientation increased from 0° to 180°. For spatial-distortion faces, a discontinuity in the function relating orientation and bizarreness was in evidence between 90° and 120°. The results provide support for the view that there is a qualitative difference in the processing of upright and inverted faces due to the disproportionate effect of inversion on the encoding of spatial-relational information.     

Losing face: impaired discrimination of featural and configural information in the mouth region of an inverted face

Given that all faces share the same set of features—two eyes, a nose, and a mouth—that are arranged in similar configuration, recognition of a specific face must depend on our ability to discern subtle differences in its featural and configural properties. An enduring question in the face-processing literature is whether featural or configural information plays a larger role in the recognition process. To address this question, the face dimensions task was designed, in which the featural and configural properties in the upper (eye) and lower (mouth) regions of a face were parametrically and independently manipulated. In a same–different task, two faces were sequentially presented and tested in their upright or in their inverted orientation. Inversion disrupted the perception of featural size (Exp. 1), featural shape (Exp. 2), and configural changes in the mouth region, but it had relatively little effect on the discrimination of featural size and shape and configural differences in the eye region. Inversion had little effect on the perception of information in the top and bottom halves of houses (Exp. 3), suggesting that the lower-half impairment was specific to faces. Spatial cueing to the mouth region eliminated the inversion effect (Exp. 4), suggesting that participants have a bias to attend to the eye region of an inverted face. The collective findings from these experiments suggest that inversion does not differentially impair featural or configural face perceptions, but rather impairs the perception of information in the mouth region of the face.     

Configural features in the context of upright and inverted faces

When faces are turned upside down, recognition is known to be severely disrupted. This effect is thought to be due to disruption of configural processing. Recently, Leder and Bruce (2000, Quarterly Journal of Experimental Psychology A 53 513-536) argued that configural information in face processing consists at least partly of locally processed relations between facial elements. In three experiments we investigated whether a local relational feature (the interocular distance) is processed differently in upside-down versus upright faces. In experiment 1 participants decided in which of two sequentially presented photographic faces the interocular distance was larger. The decision was more difficult in upside-down presentation. Three different conditions were used in experiment 2 to investigate whether this deficit depends upon parts of the face beyond the eyes themselves; displays showed the eye region alone, the eyes and nose, or the eyes and nose and mouth. The availability of additional features did not interact with the inversion effect which was observed strongly even when the eyes were shown in isolation. In experiment 3 all eyes were turned upside down in the inverted face condition as in the Thatcher illusion (Thompson, 1980 Perception 9 483-484). In this case no inversion effect was found. These results are in accordance with an explanation of the face-inversion effect in which the disruption of configural facial information plays the critical role in memory for faces, and in which configural information corresponds to spatial information that is processed in a way which is sensitive to local properties of the facial features involved.     

Preference for human direct gaze in infant chimpanzees (Pan troglodytes)

We studied gaze perception in three infant chimpanzees (Pan troglodytes), aged 10-32 weeks, using a two-choice preferential-looking paradigm. The infants were presented with two photographs of a human face: (a) with the eyes open or closed, and (b) with a direct or an averted gaze. We found that the chimpanzees preferred looking at the direct-gaze face. However, in the context of scrambled faces, the infants showed no difference in gaze discrimination between direct and averted gazes. These findings suggest that gaze perception by chimpanzees may be influenced by the surrounding facial context. The relationship between gaze perception, face processing, and the adaptive significance of gaze perception are discussed from an evolutionary perspective.     

Perceptual integrality of componential and configural information in faces

The relative contribution of componential and configural information to face perception is controversial. We addressed this issue in the present study by examining how componential information and configural information interact during face processing, using Garner’s (1974) speeded classification paradigm. When classifying upright faces varying in components (eyes, nose, and mouth) and configural information (intereyes and nose-mouth spacing), observers could not selectively attend to components without being influenced by irrelevant variation in configural information, and vice versa, indicating that componential information and configural information are integral in upright face processing. Performance with inverted faces showed selective attention to components but not to configural information, implying dominance of componential information in processing inverted faces. When faces varied only in components, selective attention to different components was observed in upright and inverted faces, indicating that facial components are perceptually separable. These results provide strong evidence that integrality of componential and configural information, rather than the relative dominance of either, is the hallmark of upright face perception.     

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.     

A unique look at face processing: the impact of masked faces on the processing of facial features

This experiment utilized a masked priming paradigm to explore the early processes involved in face recognition. The first experiment investigated implicit processing of the eyes and mouth in an upright face, using prime durations of 33 and 50 ms. The results demonstrate implicit processing of both the eyes and mouth, and support the configural processing theory of face processing. The second experiment used the same method with inverted faces and the third experiment was a combination of Experiments 1 and 2. The fourth experiment utilized misaligned faces as the primes. Based on the pattern of results from these experiments, we suggest that, when a face is inverted, the eyes and mouth are initially processed individually and are not linked until a later stage of processing. An upright face is proposed to be processed by analysis of its configuration, whereas an inverted face is initially processed using first-order relational information, and then converted to an upright representation and transferred to face specific regions for configural analysis.     

Attention misplaced: the role of diagnostic features in the face-inversion effect

Inversion disproportionately impairs recognition of face stimuli compared to nonface stimuli arguably due to the holistic manner in which faces are processed. A qualification is put forward in which the first point fixated on is different for upright and inverted faces and this carries some of the face-inversion effect. Three experiments explored this possibility by using fixation crosses to guide attention to the eye or mouth region of the to-be-presented faces in different orientations. Recognition was better when the fixation cross appeared at the eye region than at the mouth region. The face-inversion effect was smaller when the eyes were cued than when the mouth was cued or when there was no cueing. The results suggest that the first facial feature attended to is important for accurate face recognition and this may carry some of the effects of inversion.     

Now you see me,now you don't: evidence that chimpanzees understand the role of the eyes in attention

Chimpanzees appear to understand something about the attentional states of others; in the present experiment, we investigated whether they understand that the attentional state of a human is based on eye gaze. In all, 116 adult chimpanzees were offered food by an experimenter who engaged in one of the four experimental manipulations: eyes closed, eyes open, hand over eyes, and hand over mouth. The communicative behavior of the chimpanzees was observed. More visible behaviors were produced when the experimenter's eyes were visible than when the experimenter's eyes were not visible. More vocalizations were produced when the experimenter's eyes were closed than when they were open, but there were no differences in other attention getting behaviors. There was no effect of age or rearing history. The results suggest that chimpanzees use the presence of the eyes as a cue that their visual gestures will be effective.     

眼睛区域构型信息与特征信息的跨维共变增益效应及其加工特异性

面孔知觉可能在区域尺度上发生多维信息整合, 但迄今无特异性实验证据。本研究在两个实验中操纵面孔眼睛区域或嘴巴区域的单维构型或特征信息, 测量人们觉察单维变化或跨维共变的敏感度, 以此检测面孔区域尺度上的多维信息整合有何现象与规律, 进而揭示面孔知觉的多维信息整合机制。实验获得3个发现：(1)正立面孔眼睛区域的信息变化觉察呈现出“跨维共变增益效应”, 跨维信息共变觉察的敏感度显著高于任意一种单维信息变化觉察的敏感度; (2)“跨维共变增益效应”只在正立面孔的眼睛区域出现, 在倒置面孔的眼睛区域、正立面孔的嘴巴区域或倒置面孔的嘴巴区域都没有出现, 因此具有面孔区域特异性和面孔朝向特异性; (3)就单维信息变化觉察而言, 眼睛区域的敏感度不会受到面孔倒置的损伤, 但是嘴巴区域的敏感度会受到面孔倒置的显著损伤。综合可知, 面孔知觉确实会发生区域尺度上的信息整合, 它不是普遍性的信息量效应, 而是特异性的眼睛效应(只发生在正立面孔的眼睛区域)。这是面孔整体加工(face holistic processing)在单维信息分辨和多维信息整合之间建立联系的必经环节。这提示我们对全脸多维信息知觉整合的理解需要从传统的面孔整体加工假设升级到以眼睛为中心的层级化多维信息整合算法(a hierarchical algorithm for multi-dimensional information integration)。     

The role of facial orientation in newborn infants’ preference for attractive faces

Several previous experiments have found that newborn and young infants will spend more time looking at attractive faces when these are shown paired with faces judged by adults to be unattractive. Two experimental conditions are described whose aim was to find whether the ‘attractiveness effect’ is affected by the orientation of the facial stimuli. Pairs of attractive and less attractive faces (as judged by adults) were shown to newborn infants (mean age 2 days 20.5 hours), where each pair was presented both upright and inverted through 180°. In the former (upright) condition, but not the latter (inverted) condition, the infants looked longer at the attractive faces, and the difference in attractiveness preference between the conditions was statistically significant. These findings are clear evidence that infants’ early representation of faces contains information about faces that is orientation‐specific. The results are discussed in terms of innate facial representations and rapid learning about faces in the hours from birth.     

Automatic gaze to the nose region cannot be inhibited during observation of facial expression in Eastern observers

Humans can extract a great deal of information about others very quickly. This is partly because the face automatically captures observers’ attention. Specifically, the eyes can attract overt attention. Although it has been reported that not only the eyes but also the nose can capture initial oculomotor movement in Eastern observers, its generalizability remains unknown. In this study, we applied the “don’t look” paradigm wherein participants are asked not to fixate on a specific facial region (i.e., eyes, nose, and mouth) during an emotion recognition task with upright (Experiment 1) and inverted (Experiment 2) faces. In both experiments, we found that participants were less able to inhibit the initial part of their fixations to the nose, which can be interpreted as the nose automatically capturing attention. Along with previous studies, our overt attention tends to be attracted by a part of the face, which is the nose region in Easterner observers.     

Aberrant first fixations when looking at inverted faces in various poses: The result of the centre‐of‐gravity effect?

Face recognition is essential in everyday human life, and all faces are encountered in different poses. However, when a face is inverted, difficulties arise for recognition and eye movements may (Barton, Radcliffe, Cherkasova, Edleman, & Intriligator, 2006) or may not be disrupted (Williams & Henderson, 2007). The present study explored the effects of orientation and pose on recognition and eye movements during a standard old/new recognition task in order to resolve whether inversion disrupts eye movements. Eye‐tracking data looked at the first fixations, the number of fixations, and the duration of fixations over a face. A standard inversion effect was observed, but the three‐quarter view advantage was not observed. Eye‐movement data revealed that the eyes were the most sampled feature (in terms of first fixation, number of fixations, and duration of fixation) for all upright faces, however, other features were sampled first for inverted faces. These results are consistent with Barton et al.'s (2006) but not Williams and Henderson's (2007) findings: possible explanations for this are discussed with the caveat that the same images were used from learning to test.     

Sensitivity to the displacement of facial features in negative and inverted images

Subjects have previously been reported to show difficulties in recognising faces which are either inverted or in photographic negative. Experiments are reported in which a two-alternative forced-choice technique was used to measure sensitivity for distinguishing faces which have been modified by having the eyes moved vertically or horizontally. Subjects were less sensitive to such changes for inverted faces or negative faces, and were even less sensitive for faces that were both inverted and negative. No such effects were found for a control stimulus consisting simply of three solid circles in the same positions as the eyes and mouth of a face. When the stimuli consisted of eyes, nose, and mouth, but without a surround, no evidence of inversion or negation effects was found, which suggests that a facial surround is necessary. When the stimulus consisted of a facial surround with the eyes, nose, and mouth replaced by solid circles, effects of negation were found, but no effects of inversion. This dissociation of the effects of negation and inversion may suggest that they are the result of different underlying mechanisms.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.