How the Thatcher illusion reveals evolutionary differences in the face processing of primates

Face recognition in humans is a complex cognitive skill that requires sensitivity to unique configurations of eyes, mouth, and other facial features. The Thatcher illusion has been used to demonstrate the importance of orientation when processing configural information within faces. Transforming an upright face so that the eyes and mouth are inverted renders the face grotesque; however, when this “Thatcherized” face is inverted, the effect disappears. Due to the use of primate models in social cognition research, it is important to determine the extent to which specialized cognitive functions like face processing occur across species. To date, the Thatcher illusion has been explored in only a few species with mixed results. Here, we used computerized tasks to examine whether nonhuman primates perceive the Thatcher illusion. Chimpanzees and rhesus monkeys were required to discriminate between Thatcherized and unaltered faces presented upright and inverted. Our results confirm that chimpanzees perceived the Thatcher illusion, but rhesus monkeys did not, suggesting species differences in the importance of configural information in face processing. Three further experiments were conducted to understand why our results differed from previously published accounts of the Thatcher illusion in rhesus monkeys.     

Recognizing facial cues: individual discrimination by chimpanzees (Pan troglodytes) and rhesus monkeys (Macaca mulatta)

Faces are one of the most salient classes of stimuli involved in social communication. Three experiments compared face-recognition abilities in chimpanzees (Pan troglodytes) and rhesus monkeys (Macaca mulatta). In the face-matching task, the chimpanzees matched identical photographs of conspecifics' faces on Trial 1, and the rhesus monkeys did the same after 4 generalization trials. In the individual-recognition task, the chimpanzees matched 2 different photographs of the same individual after 2 trials, and the rhesus monkeys generalized in fewer than 6 trials. The feature-masking task showed that the eyes were the most important cue for individual recognition. Thus, chimpanzees and rhesus monkeys are able to use facial cues to discriminate unfamiliar conspecifics. Although the rhesus monkeys required many trials to learn the tasks, this is not evidence that faces are not as important social stimuli for them as for the chimpanzees.     

Seeing two faces together: preference formation in humans and rhesus macaques

Humans, great apes and old world monkeys show selective attention to faces depending on conspecificity, familiarity, and social status supporting the view that primates share similar face processing mechanisms. Although many studies have been done on face scanning strategy in monkeys and humans, the mechanisms influencing viewing preference have received little attention. To determine how face categories influence viewing preference in humans and rhesus macaques (Macaca mulatta), we performed two eye-tracking experiments using a visual preference task whereby pairs of faces from different species were presented simultaneously. The results indicated that viewing time was significantly influenced by the pairing of the face categories. Humans showed a strong bias towards an own-race face in an Asian–Caucasian condition. Rhesus macaques directed more attention towards non-human primate faces when they were paired with human faces, regardless of the species. When rhesus faces were paired with faces from Barbary macaques (Macaca sylvanus) or chimpanzees (Pan troglodytes), the novel species’ faces attracted more attention. These results indicate that monkeys’ viewing preferences, as assessed by a visual preference task, are modulated by several factors, species and dominance being the most influential.     

Holistic face processing can be independent of gaze behaviour: Evidence from the composite face illusion

People tend to perceive identical top halves (i.e. above the nose) of two face stimuli as being different when they are aligned with distinct bottom halves. This composite face illusion is generally considered as the most compelling evidence that facial features are integrated into a holistic representation. Here, we recorded eye‐movements during the composite face illusion in a delayed matching task of top halves of faces. Behavioural results showed a strong composite face effect, participants making more mistakes and taking longer time to match two identical top halves of faces when they were aligned (vs. misaligned) with different bottom halves. Importantly, fixation sites and eye‐movements were virtually identical when the top and bottom parts were aligned (composite illusion) or misaligned (no illusion), indicating that holistic face processing can be independent of gaze behaviour. These findings reinforce the view that holistic representations of individual faces can be extracted early on from information at a relatively coarse scale, independently of overt attention.     

Robust representations of individual faces in chimpanzees (<Emphasis Type="Italic">Pan troglodytes</Emphasis>) but not monkeys (<Emphasis Type="Italic">Macaca mulatta</Emphasis>)

Being able to recognize the faces of our friends and family members no matter where we see them represents a substantial challenge for the visual system because the retinal image of a face can be degraded by both changes in the person (age, expression, pose, hairstyle, etc.) and changes in the viewing conditions (direction and degree of illumination). Yet most of us are able to recognize familiar people effortlessly. A popular theory for how face recognition is achieved has argued that the brain stabilizes facial appearance by building average representations that enhance diagnostic features that reliably vary between people while diluting features that vary between instances of the same person. This explains why people find it easier to recognize average images of people, created by averaging multiple images of the same person together, than single instances (i.e. photographs). Although this theory is gathering momentum in the psychological and computer sciences, there is no evidence of whether this mechanism represents a unique specialization for individual recognition in humans. Here we tested two species, chimpanzees (Pan troglodytes) and rhesus monkeys (Macaca mulatta), to determine whether average images of different familiar individuals were easier to discriminate than photographs of familiar individuals. Using a two-alternative forced-choice, match-to-sample procedure, we report a behaviour response profile that suggests chimpanzees encode the faces of conspecifics differently than rhesus monkeys and in a manner similar to humans.     

Geometric distortions affect face recognition in chimpanzees (<Emphasis Type="Italic">Pan troglodytes</Emphasis>) and monkeys (<Emphasis Type="Italic">Macaca mulatta</Emphasis>)

All primates can recognize faces and do so by analyzing the subtle variation that exists between faces. Through a series of three experiments, we attempted to clarify the nature of second-order information processing in nonhuman primates. Experiment one showed that both chimpanzees (Pan troglodytes) and rhesus monkeys (Macaca mulatta) tolerate geometric distortions along the vertical axis, suggesting that information about absolute position of features does not contribute to accurate face recognition. Chimpanzees differed from monkeys, however, in that they were more sensitive to distortions along the horizontal axis, suggesting that when building a global representation of facial identity, horizontal relations between features are more diagnostic of identity than vertical relations. Two further experiments were performed to determine whether the monkeys were simply less sensitive to horizontal relations compared to chimpanzees or were instead relying on local features. The results of these experiments confirm that monkeys can utilize a holistic strategy when discriminating between faces regardless of familiarity. In contrast, our data show that chimpanzees, like humans, use a combination of holistic and local features when the faces are unfamiliar, but primarily holistic information when the faces become familiar. We argue that our comparative approach to the study of face recognition reveals the impact that individual experience and social organization has on visual cognition.     

The organization of conspecific face space in nonhuman primates

Humans and chimpanzees demonstrate numerous cognitive specializations for processing faces, but comparative studies with monkeys suggest that these may be the result of recent evolutionary adaptations. The present study utilized the novel approach of face space, a powerful theoretical framework used to understand the representation of face identity in humans, to further explore species differences in face processing. According to the theory, faces are represented by vectors in a multidimensional space, the centre of which is defined by an average face. Each dimension codes features important for describing a face's identity, and vector length codes the feature's distinctiveness. Chimpanzees and rhesus monkeys discriminated male and female conspecifics’ faces, rated by humans for their distinctiveness, using a computerized task. Multidimensional scaling analyses showed that the organization of face space was similar between humans and chimpanzees. Distinctive faces had the longest vectors and were the easiest for chimpanzees to discriminate. In contrast, distinctiveness did not correlate with the performance of rhesus monkeys. The feature dimensions for each species’ face space were visualized and described using morphing techniques. These results confirm species differences in the perceptual representation of conspecific faces, which are discussed within an evolutionary framework.     

A comparative study of face processing using scrambled faces

It is a widespread assumption that all primate species process faces in the same way because the species are closely related and they engage in similar social interactions. However, this approach ignores potentially interesting and informative differences that may exist between species. This paper describes a comparative study of holistic face processing. Twelve subjects (six chimpanzees Pan troglodytes and six rhesus monkeys Macaca mulatta) were trained to discriminate whole faces (faces with features in their canonical position) and feature-scrambled faces in two separate conditions. We found that both species tended to match the global configuration of features over local features, providing strong evidence of global precedence. In addition, we show that both species were better able to generalize from a learned configuration to an entirely novel configuration when they were first trained to match feature-scrambled faces compared to when they were trained with whole faces. This result implies that the subjects were able to access local information easier when facial features were presented in a scrambled configuration and is consistent with a holistic processing hypothesis. Interestingly, these data also suggest that, while holistic processing in chimpanzees is tuned to own-species faces, monkeys have a more general approach towards all faces. Thus, while these data confirm that both chimpanzees and rhesus monkeys process faces holistically, they also indicate that there are differences between the species that warrant further investigation.     

Sequential responding and planning in capuchin monkeys (Cebus apella)

Previous experiments have assessed planning during sequential responding to computer generated stimuli by Old World nonhuman primates including chimpanzees and rhesus macaques. However, no such assessment has been made with a New World primate species. Capuchin monkeys (Cebus apella) are an interesting test case for assessing the distribution of cognitive processes in the Order Primates because they sometimes show proficiency in tasks also mastered by apes and Old World monkeys, but in other cases fail to match the proficiency of those other species. In two experiments, eight capuchin monkeys selected five arbitrary stimuli in distinct locations on a computer monitor in a learned sequence. In Experiment 1, shift trials occurred in which the second and third stimuli were transposed when the first stimulus was selected by the animal. In Experiment 2, mask trials occurred in which all remaining stimuli were masked after the monkey selected the first stimulus. Monkeys made more mistakes on trials in which the locations of the second and third stimuli were interchanged than on trials in which locations were not interchanged, suggesting they had already planned to select a location that no longer contained the correct stimulus. When mask trials occurred, monkeys performed at levels significantly better than chance, but their performance exceeded chance levels only for the first and the second selections on a trial. These data indicate that capuchin monkeys performed very similarly to chimpanzees and rhesus monkeys and appeared to plan their selection sequences during the computerized task, but only to a limited degree.     

Is the inversion effect in rhesus monkeys face-specific?

This study investigated the face inversion effect in rhesus monkeys (Macaca mulatta). Face stimuli consisted of ten black-and-white examples of unfamiliar rhesus monkey faces, brown capuchin faces, and human faces. Two non-face categories included ten examples of automobiles and abstract shapes. All stimuli were presented in a sequential matching-to-sample format using an automated joystick-testing paradigm. Subjects performed significantly better on upright than on inverted presentations of automobiles, rhesus monkey and capuchin faces, but not human faces or abstract shapes. These results are inconsistent with data from humans and chimpanzees that show the inversion effect only for categories of stimuli for which subjects have developed expertise. The inversion effect in rhesus monkeys does not appear to be face-specific, and should therefore not be used as a marker of specialized face processing in this species. Received: 18 November 1998 / Accepted after revision: 9 May 1999     

Electrophysiological correlates of the composite face illusion: Disentangling perceptual and decisional components of holistic face processing in the human brain

When the bottom halves of two faces differ, people’s behavioral judgment of the identical top halves of those faces is impaired: they report that the top halves are different, and/or take more time than usual to provide a response. This behavioral measure is known as the composite face effect (CFE) and has traditionally been taken as evidence that faces are perceived holistically. Recently, however, it has been claimed that this effect is driven almost entirely by decisional, rather than perceptual, factors ( Richler, Gauthier, Wenger, & Palmeri, 2008). To disentangle the contribution of perceptual and decisional brain processes, we aimed to obtain an event-related potential (ERP) measure of the CFE at a stage of face encoding ( Jacques & Rossion, 2009) in the absence of a behavioral CFE effect. Sixteen participants performed a go/no-go task in an oddball paradigm, lifting a finger of their right or left hand when the top half of a face changed identity. This change of identity of the top of the face was associated with an increased ERP signal on occipito-temporal electrode sites at the N170 face-sensitive component (∼160 ms), the later decisional P3b component, and the lateralized readiness potential (LRP) starting at ∼350 ms. The N170 effect was observed equally early when only the unattended bottom part of the face changed, indicating that an identity change was perceived across the whole face in this condition. Importantly, there was no behavioral response bias for the bottom change trials, and no evidence of decisional biases from electrophysiological data (no P3b and LRP deflection in no-go trials). These data show that an early CFE can be measured in ERPs in the absence of any decisional response bias, indicating that the CFE reflects primarily the visual perception of the whole face.     

Effects of the menstrual cycle on looking preferences for faces in female rhesus monkeys

Fluctuations of ovarian hormones across the menstrual cycle influence a variety of social and cognitive behaviors in primates. For example, female rhesus monkeys exhibit heightened interest for males and increased agonistic interactions with other females during periods of high estrogen levels. In the present study, we hypothesized that females’ preference for males during periods of high estrogen levels is also expressed at the level of face perception. We tested four intact females on two face-tasks involving neutral portraits of male and female rhesus monkeys, chimpanzees and humans. In the visual preference task (VP), monkeys had to touch a button to view a face image. The image remained on the screen as long as the button was touched, and the duration of pressing was taken as an index of the monkey's looking time for the face stimulus. In the Face-Delayed Recognition Span Test (Face-DRST), monkeys were rewarded for touching the new face in an increasing number of serially presented faces. Monkeys were tested 5 days a week across one menstrual cycle. Blood was collected every other day for analysis of estradiol and progesterone. Two of the four females were cycling at the time of testing. We did not find an influence of the cycle on Face-DRST, likely due to a floor effect. In the VP however, the two cycling individuals looked longer at conspecific male faces than female faces during the peri-ovulatory period of the cycle. Such effects were absent for human and chimpanzee faces and for the two noncycling subjects. These data suggest that ovarian hormones may influence females’ preferences for specific faces, with heightened preference for male faces during the peri-ovulatory period of the cycle. Heightened interest for stimuli of significant reproductive relevance during periods of high conception risk may help guide social and sexual behavior in the rhesus monkey.     

Discrimination of familiar human faces in dogs (Canis familiaris)

Faces are an important visual category for many taxa, and the human face is no exception to this. Because faces differ in subtle ways and possess many idiosyncratic features, they provide a rich source of perceptual cues. A fair amount of those cues are learned through social interactions and are used for future identification of individual humans. These effects of individual experience can be studied particularly well in hetero-specific face perception. Domestic dogs represent a perfect model in this respect, due to their proved ability to extract important information from the human face in socio-communicative interactions. There is also suggestive evidence that dogs can identify their owner or other familiar human individuals by using visual information from the face. However, most studies have used only dogs’ looking behavior to examine their visual processing of human faces and it has been demonstrated only that dogs can differentiate between familiar and unknown human faces. Here, we examined the dog's ability to discriminate the faces of two familiar persons by active choice (approach and touch). Furthermore, in successive stages of the experiment we investigated how well dogs discriminate humans in different representations by systematically reducing the informational richness and the quality of the stimuli. We found a huge inter-individual and inter-stage variance in performance, indicating differences across dogs in their learning ability as well as their selection of discriminative cues. On a group level, the performance of dogs significantly decreased when they were presented with pictures of human heads after having learned to discriminate the real heads, and when – after relearning – confronted with the same pictures showing only the inner parts of the heads. However, as two dogs quickly mastered all stages, we conclude that dogs are in principle able to discriminate people on the basis of visual information from their faces and by making active choices.     

The inversion effect reveals species differences in face processing

Face recognition is a complex skill that requires the integration of facial features across the whole face, e.g., holistic processing. It is unclear whether, and to what extent, other species process faces in a manner that is similar to humans. Previous studies on the inversion effect, a marker of holistic processing, in nonhuman primates have revealed mixed results in part because many studies have failed to include alternative image categories necessary to understand whether the effects are truly face-specific. The present study re-examined the inversion effect in rhesus monkeys and chimpanzees using comparable testing methods and a variety of high quality stimuli including faces and nonfaces. The data support an inversion effect in chimpanzees only for conspecifics' faces (expert category), suggesting face-specific holistic processing similar to humans. Rhesus monkeys showed inversion effects for conspecifics, but also for heterospecifics' faces (chimpanzees), and nonfaces images (houses), supporting important species differences in this simple test of holistic face processing.     

Priming global and local processing of composite faces: revisiting the processing-bias effect on face perception

We used the composite-face illusion and Navon stimuli to determine the consequences of priming local or global processing on subsequent face recognition. The composite-face illusion reflects the difficulty of ignoring the task-irrelevant half-face while attending the task-relevant half if the half-faces in the composite are aligned. On each trial, participants first matched two Navon stimuli, attending to either the global or the local level, and then matched the upper halves of two composite faces presented sequentially. Global processing of Navon stimuli increased the sensitivity to incongruence between the upper and the lower halves of the composite face, relative to a baseline in which the composite faces were not primed. Local processing of Navon stimuli did not influence the sensitivity to incongruence. Although incongruence induced a bias toward different responses, this bias was not modulated by priming. We conclude that global processing of Navon stimuli augments holistic processing of the face.     

What meaning means for same and different: Analogical reasoning in humans (Homo sapiens), chimpanzees (Pan troglodytes), and rhesus monkeys (Macaca mulatta)

Thus far, language- and token-trained apes (e.g., D. Premack, 1976; R. K. R. Thompson, D. L. Oden, & S. T. Boysen, 1997) have provided the best evidence that nonhuman animals can solve, complete, and construct analogies, thus implicating symbolic representation as the mechanism enabling the phenomenon. In this study, the authors examined the role of stimulus meaning in the analogical reasoning abilities of three different primate species. Humans (Homo sapiens), chimpanzees (Pan troglodytes), and rhesus monkeys (Macaca mulatta) completed the same relational matching-to-sample (RMTS) tasks with both meaningful and nonmeaningful stimuli. This discrimination of relations-between-relations serves as the basis for analogical reasoning. Meaningfulness facilitated the acquisition of analogical matching for human participants, whereas individual differences among the chimpanzees suggest that meaning can either enable or hinder their ability to complete analogies. Rhesus monkeys did not succeed in the RMTS task regardless of stimulus meaning, suggesting that their ability to reason analogically, if present at all, may be dependent on a dimension other than the representational value of stimuli.     

Dissociation between the behavioural and electrophysiological effects of the face and body composite illusions

Several studies have reported similarities between perceptual processes underlying face and body perception, particularly emphasizing the importance of configural processes. Differences between the perception of faces and the perception of bodies were observed by means of a manipulation targeting a specific subtype of configural processing: the composite illusion. The composite face illusion describes the fact that two identical top halves of a face are perceived as being different if they are presented with different bottom parts. This effect disappears, if both halves are laterally shifted. Crucially, the effect of misalignment is not observed for bodies. This study aimed to further explore differences in the time course of face and body perception by using the composite effect. The present results replicated behavioural effects illustrating that misalignment affects the perception of faces but not bodies. Thus, face but not body perception relies on holistic processing. However, differences in the time course of the processing of both stimulus categories emerged at the N170 and P200. The pattern of the behavioural data seemed to be related to the P200. Thus, the present data indicate that holistic processes associated with the effect of misalignment might occur 200 ms after stimulus onset.     

The composite face illusion: A whole window into our understanding of holistic face perception

Two identical top halves of a face are perceived as being different when their bottom halves belong to different faces, showing that the parts of a face cannot be perceived independently from the whole face. When this visual illusion is inserted in a matching task, observers make more mistakes and/or are slower at matching identical top face halves aligned with different bottom halves than when the bottom halves are spatially offset: The composite face effect. This composite face paradigm has been used in more than 60 studies that have provided information about the specificity and nature of perceptual integration between facial parts (“holistic face perception”), the impairment of this process in acquired prosopagnosia, its developmental course, temporal dynamics, and neural basis. Following a review of the main contributions made with the paradigm, I explain its rationale and strengths, and discuss its methodological parameters, making a number of proposals for its optimal use and refinement in order to improve our understanding of holistic face perception. Finally, I explain how this standard composite face paradigm is fundamentally different than the application to facial parts of a congruency/interference paradigm that has a long tradition in experimental psychology since Stroop (1935), and which was originally developed to measure attentional and response interference between different representations rather than perceptual integration. Moreover, a version of this congruency/interference paradigm used extensively over the past years with composite faces lacks a baseline measure and has decisional, attentional, and stimulus confounds, making the findings of these studies impossible to interpret in terms of holistic perception. I conclude by encouraging researchers in this field to concentrate fully on the standard composite face paradigm, gaze contingency, and other behavioural measures that can help us take one of the most important challenges of visual perception research: Understanding the neural mechanisms of holistic face perception.     

Discrimination of faces and houses by rhesus monkeys: the role of stimulus expertise and rotation angle

The face inversion effect, or impaired recognition of upside down compared to upright faces, is used as a marker for the configural processing of faces in primates. The inversion effect in humans and chimpanzees is strongest for categories of stimuli for which subjects have considerable expertise, primarily conspecifics’ faces. Moreover, discrimination performance decreases linearly as faces are incrementally rotated from upright to inverted. This suggests that rotated faces must be transformed, or normalized back into their most typical viewpoint before configural processing can ensue, and the greater the required normalization, the greater the likelihood of errors resulting. Previous studies in our lab have demonstrated a general face inversion effect in rhesus monkeys that was not influenced by expertise. Therefore, the present study examined the influence of rotation angle on the visual perception of face and nonface stimuli that varied in their level of expertise to further delineate the processes underlying the inversion effect in rhesus monkeys. Five subjects discriminated images in five orientation angles. Results showed significant linear impairments for all stimulus categories, including houses. However, compared to the upright images, only rhesus faces resulted in worse performance at rotation angles greater than 45°, suggesting stronger configural processing for stimuli for which subjects had the greatest expertise.     

The Thatcher illusion in squirrel monkeys (Saimiri sciureus)

Like humans, Old World monkeys are known to use configural face processing to distinguish among individuals. The ability to recognize an individual through the perception of subtle differences in the configuration of facial features plays an important role in social cognition. To test this ability in New World monkeys, this study examined whether squirrel monkeys experience the Thatcher illusion, a measure of face processing ability in which changes in facial features are difficult to detect in an inverted face. In the experiment, the monkeys were required to distinguish between a target face and each of the three kinds of distracter faces whose features were altered to be different from those of the target. For each of the pairs of target and distracter faces, four rotation-based combinations of upright and inverted face presentations were used. The results revealed that when both faces were inverted and the eyes of the distracter face were altered by rotating them at an angle of 180° from those of the target face, the monkeys' discrimination learning was obstructed to a greater extent than it was under the other conditions. Thus, these results suggest that the squirrel monkey does experience the Thatcher illusion. Furthermore, it seems reasonable to assume that squirrel monkeys can utilize information about facial configurations in individual recognition and that this facial configuration information could be useful in their social communications.