Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

Face perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.     

Sensitivity to the displacement of facial features in negative and inverted images

Subjects have previously been reported to show difficulties in recognising faces which are either inverted or in photographic negative. Experiments are reported in which a two-alternative forced-choice technique was used to measure sensitivity for distinguishing faces which have been modified by having the eyes moved vertically or horizontally. Subjects were less sensitive to such changes for inverted faces or negative faces, and were even less sensitive for faces that were both inverted and negative. No such effects were found for a control stimulus consisting simply of three solid circles in the same positions as the eyes and mouth of a face. When the stimuli consisted of eyes, nose, and mouth, but without a surround, no evidence of inversion or negation effects was found, which suggests that a facial surround is necessary. When the stimulus consisted of a facial surround with the eyes, nose, and mouth replaced by solid circles, effects of negation were found, but no effects of inversion. This dissociation of the effects of negation and inversion may suggest that they are the result of different underlying mechanisms.     

Testing a two-component model of face identification: effects of inversion, contrast reversal, and direction of lighting

Enns and Shore (1997 Perception & Psychophysics 59 23-31) found additive effects of test orientation (upright or inverted) and direction of lighting (brow or chin lit) when they studied the inversion effect on face identification. A two-stage model was inferred in which inversion was processed by an orientation-sensitive component after which chin-lighting was processed by a lighting-sensitive component. Face identification is also strongly influenced by contrast reversal. A study is reported which aimed to (i) determine if contrast reversal interacts with lighting direction or orientation, findings that would support Enns and Shore's model; and (ii) to test their assumption that holistic encoding is prerequisite for their model by inducing featural encoding through training names to inverted faces. Names for unfamiliar brow-lit positive-contrast faces were trained with the faces upright or inverted. Identification accuracy was measured with combinations of orientation, lighting, and contrast. Consistent with their model, test orientation and direction of lighting were additive after training on upright faces and lighting and contrast reversal interacted. When holistic encoding was prevented following training on inverted faces, test orientation and lighting direction interacted for positive-contrast faces. Negative faces showed only an effect of direction of lighting. These results support Enns and Shore's two-stage model and their interpretation that orientation and direction of lighting interact following featural encoding of faces.     

Physical and perceptual accuracy of upright and inverted face drawings

This study considers the conception that drawing or copying a face that is vertically inverted will improve the accuracy of the drawing by preventing holistic interference. We used a novel parameterized face space both for generating face stimuli and for measuring the physical accuracy of drawings. One group of participants (the artists) were asked to draw 16 parameterized faces (eight upright and eight inverted). We computed two physical measures of accuracy by comparing the face-space representation of each drawing to the original face. A second and third group of participants (the raters) compared the similarity between each original face and each pair of drawings of that face (one upright and one inverted per artist). For the second group, all faces were presented upright; for the third group, all faces were presented inverted. Our results showed that upright drawings were more accurate than inverted drawings, both in terms of the physical face-space measure and in terms of the perceptual judgments for both orientations. Our data suggest that holistic processing may aid rather than hinder face drawing accuracy.     

A new "fat face" illusion

We report a novel fat face illusion that when two identical images of the same face are aligned vertically, the face at the bottom appears 'fatter'. This illusion emerged when the faces were shown upright, but not inverted, with the size of the illusion being 4%. When the faces were presented upside down, the illusion did not emerge. Also, when upright clocks were shown in the same vertically aligned fashion, we did not observe the illusion, indicating that the fat illusion does not generalize to every category of canonically upright objects with similar geometric shape as a face.     

Orienting to eye gaze and face processing

The author conducted 7 experiments to examine possible interactions between orienting to eye gaze and specific forms of face processing. Participants classified a letter following either an upright or inverted face with averted, uninformative eye gaze. Eye gaze orienting effects were recorded for upright and inverted faces, irrespective of whether the faces were simple, schematic faces or more realistic faces. In contrast, inversion affected orienting to targets appearing along the vertical axis. Switching the contrast between the iris and sclera reversed orienting to eye gaze. Lifting the eyelid to expose more of the iris-sclera contrast led to a potentiation of orienting to eye gaze. Raising the eyebrow alone without the eyelid did not affect orienting. The findings suggest that local perceptual information is critical for orienting to eye gaze and that the effect can occur with a degree of independence from certain types of face processing.     

Recognising faces: effects of lighting direction, inversion, and brightness reversal.

When information about three-dimensional shape obtained from shading and shadows is ambiguous, the visual system favours an interpretation of surface geometry which is consistent with illumination from above. If pictures of top-lit faces are rotated the resulting stimulus is both figurally inverted and illuminated from below. In this study the question of whether the effects of figural inversion and lighting orientation on face recognition are independent or interactive is addressed. Although there was a clear inversion effect for faces illuminated from the front and above, the inversion effect was found to be reduced or eliminated for faces illuminated from below. A strong inversion effect for photographic negatives was also found but in this case the effect was not dependent on the direction of illumination. These findings are interpreted as evidence to suggest that lighting faces from below disrupts the formation of surface-based representations of facial shape.     

Attention capture by faces

We report three experiments that investigate whether faces are capable of capturing attention when in competition with other non-face objects. In Experiment 1a participants took longer to decide that an array of objects contained a butterfly target when a face appeared as one of the distracting items than when the face did not appear in the array. This irrelevant face effect was eliminated when the items in the arrays were inverted in Experiment 1b ruling out an explanation based on some low-level image-based properties of the faces. Experiment 2 replicated and extended the results of Experiment 1a. Irrelevant faces once again interfered with search for butterflies but, when the roles of faces and butterflies were reversed, irrelevant butterflies no longer interfered with search for faces. This suggests that the irrelevant face effect is unlikely to have been caused by the relative novelty of the faces or arises because butterflies and faces were the only animate items in the arrays. We conclude that these experiments offer evidence of a stimulus-driven capture of attention by faces.     

Effects of normal and abnormal visual experience on the development of opposing aftereffects for upright and inverted faces

We used opposing figural aftereffects to investigate whether there are at least partially separable representations of upright and inverted faces in patients who missed early visual experience because of bilateral congenital cataracts (mean age at test 19.5 years). Visually normal adults and 10-year-olds were tested for comparison. Adults showed the expected opposing aftereffects for upright and inverted faces. Ten-year-olds showed an adultlike aftereffect for upright faces but, unlike the adult group, no aftereffect for inverted faces. Patients failed to show an aftereffect for either upright or inverted faces. Overall, the results suggest that early visual input is necessary for the later development of (at least partially) separable representations of upright and inverted faces, a developmental process that takes many years to reach an adult-like refinement.     

Pulling faces: an investigation of the face-distortion aftereffect

After adaptation to a face distorted to look unnaturally thin or fat, a normal face appears distorted in the opposite direction (Webster and MacLin 1999 Psychonomic Bulletin & Review 6 647-653). When the adapting face is oriented 45 degrees from vertically upright and the test face 45 degrees in the opposite direction, the axis of perceived distortion changes with the orientation of the face. The magnitude of this aftereffect shows a reduction of approximately 40% from that found when both adapting and test faces are tilted identically. This finding suggests that to a large degree the aftereffect is mediated not by low-level retinotopic (image-based) visual mechanisms but at a higher level of object-based processing. Aftereffects of a similar magnitude are obtained when adapting and test images are both either upright or inverted, or for an upright adapter and an inverted test; but aftereffects are smaller when the adapter is inverted and the test upright. This pattern of results suggests that the face-distortion aftereffect is mediated by object-processing mechanisms including, but not restricted to, configurational face-processing mechanisms.     

The ups and downs of face perception: evidence for holistic encoding of upright and inverted faces

A visual-search task was used to investigate the influence of facial organisation on discrimination of an internal facial feature. Participants searched for a downturned mouth in arrays of one to six faces that differed only in the target feature, with distractor faces containing an upturned mouth. Feature search was tested in four different face contexts: upright unaltered faces, inverted unaltered faces, upright faces in which the internal features were scrambled, or inverted scrambled faces. Normal face organisation facilitated feature search in upright faces, but slowed it in inverted faces. These findings demonstrate an interdependence of features and their configuration in the perceptual analysis of both upright and inverted faces.     

When feature information comes first! Early processing of inverted faces

We investigated the early stages of face recognition and the role of featural and holistic face information. We exploited the fact that, on inversion, the alienating disorientation of the eyes and mouth in thatcherised faces is hardly detectable. This effect allows featural and holistic information to be dissociated and was used to test specific face-processing hypotheses. In inverted thatcherised faces, the cardinal features are already correctly oriented, whereas in undistorted faces, the whole Gestalt is coherent but all information is disoriented. Experiment 1 and experiment 3 revealed that, for inverted faces, featural information processing precedes holistic information. Moreover, the processing of contextual information is necessary to process local featural information within a short presentation time (26 ms). Furthermore, for upright faces, holistic information seems to be available faster than for inverted faces (experiment 2). These differences in processing inverted and upright faces presumably cause the differential importance of featural and holistic information for inverted and upright faces.     

Practice and incentive motivation in recognition of inverted faces

In each of three experiments, participants received successive daily practice sessions on the task of recognizing inverted faces. In all practice sessions, an initial study series of 25 inverted faces was followed immediately by a test series of 17 pairs of inverted faces. Each test pair comprised a face from the study series and a new face. Completely new sets of faces were used in each session. Recognition of inverted faces did not improve across sessions in Exp. 1 but did improve in Exps. 2 and 3. Unlike Exp. 1, Exps. 2 and 3 employed an explicit incentive for improved performance. These results show that sufficiently motivated participants can become quite proficient at recognizing inverted faces. Implications of the results for the role of expertise at recognition in producing the inversion effect are discussed.     

The influence of divided attention on holistic face perception.

There is evidence that upright, but not inverted, faces are encoded holistically. The holistic coding of faces was examined in four experiments by manipulating the attention allocated to target faces. In Experiment 1, participants in a divided attention condition were asked to match two upright flanker faces while encoding a centrally presented upright target face. Although holistic coding was evident in the full attention conditions, dividing attention disrupted holistic coding of target faces. In Experiment 2, we found that while matching upright flanker faces disrupted holistic coding, matching inverted flanker faces did not. Experiment 3 demonstrated that the differential effects of flanker orientation were not due to participants taking longer to match upright, than inverted, flanker faces. In Experiment 4, we found that matching fractured faces had an intermediate effect to that of matching upright and inverted flankers, on the holistic coding of the target faces. The findings emphasize the differences in processing of upright, fractured and inverted faces and suggest that there are limitations in the number of faces that can be holistically coded in a brief time.     

Self-face recognition is characterized by “bilateral gain” and by faster,more accurate performance which persists when faces are inverted

We examine interhemispheric cooperation in the recognition of personally known faces whose long-term familiarity ensures frequent co-activation of face-sensitive areas in the right and left brain. Images of self, friend, and stranger faces were presented for 150 ms in upright and inverted orientations both unilaterally, in the right or left visual field, and bilaterally. Consistent with previous research, we find a bilateral advantage for familiar but not for unfamiliar faces, and we demonstrate that this gain occurs for inverted as well as upright faces. We show that friend faces are recognized more quickly than unfamiliar faces in upright but not in inverted orientations, suggesting that configural processing underlies this particular advantage. Novel to this study is the finding that people are faster and more accurate at recognizing their own face over both stranger and friend faces and that these advantages occur for both upright and inverted faces. These findings are consistent with evidence for a bilateral representation of self-faces.     

Neural developmental changes in processing inverted faces

We explored developmental changes in neural substrates for face processing, using fMRI. Children and adults performed a perceptual-matching task with upright and inverted face and animal stimuli. Behaviorally, inversion disrupted face processing more than animal processing for adults and older children. In line with this behavioral pattern, the left middle occipital gyrus showed a stronger face than animal inversion effect in adults. Moreover, a superior aspect of this region showed a greater face inversion effect in older than in younger children, indicating a developmental change in the processing of inverted faces. The visual regions recruited for inverted face processing in adults also overlapped more with brain regions involved in the viewing of upright objects than with regions involved in the viewing of upright faces in an independent localizer task. Hence, when faces are inverted, adults recruit regions normally engaged for recognizing objects, possibly pointing to a role for the featural processing of inverted faces.     

Recognition of upright and inverted faces: a correlational study

An investigation of ninety-five university admission candidates failed to replicate the finding by Yin of a negative correlation between the ability to recognise upright and inverted faces. A zero correlation was obtained when unknown faces were both learned and recognised upside down, but when well-known faces were presented normally and upside down for identification, a significant positive correlation appeared. Rock has suggested that inverted faces are difficult to recognise because they overtax a mechanism for correcting disoriented stimuli. This explanation satisfactorily accounts for the data with the proviso that, when inverted faces are to be remembered, the best strategy is not to attempt to correct their orientation, but to learn isolated features of the face. This describes the data more parsimoniously than Yin's face-specific mechanism.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.     

Beyond U-Shaped Development in Infants' Processing of Faces: An Information-Processing Account

The development of the "inversion" effect in face processing was examined in infants 3 to 6 months of age by testing their integration of the internal and external features of upright and inverted faces using a variation of the "switch" visual habituation paradigm. When combined with previous findings showing that 7-month-olds use integrative processing of an upright face, but featural processing of an inverted face (Cohen & Cashon, 2001a), the present findings suggest that from 3 to 7 months, infants' ability to integrate facial features follows an N-shaped developmental pattern for upright faces and an inverted U-shaped pattern for inverted faces. We discuss these results in terms of a set of domain-general information-processing principles.     

A reversal of the search asymmetry favouring negative schematic faces

Quite a number of studies have tested whether the affective valence of stimuli can guide attention in visual search. Studies using schematic affective faces frequently found a relative search asymmetry (RSA), with more efficient search for a negative face in a friendly crowd than vice versa. Whether, however, this effect relates to differences in affect or to the confounded differences in perceptual features is unknown. The present study proposes and tests a similarity-based account for the RSA. Experiments 1a and 1b first replicate the typical RSA. Experiment 2 shows that the stimulus could be simplified to some degree without losing the RSA. Experiments 3 and 4, finally, demonstrate that the RSA could be reversed by a rather simple stimulus change, that leaves the facial expression intact. It is concluded that the strong dependence of the RSA on stimulus factors seriously questions the claim that emotional factors drive the RSA.