Pulling faces: an investigation of the face-distortion aftereffect

After adaptation to a face distorted to look unnaturally thin or fat, a normal face appears distorted in the opposite direction (Webster and MacLin 1999 Psychonomic Bulletin & Review 6 647-653). When the adapting face is oriented 45 degrees from vertically upright and the test face 45 degrees in the opposite direction, the axis of perceived distortion changes with the orientation of the face. The magnitude of this aftereffect shows a reduction of approximately 40% from that found when both adapting and test faces are tilted identically. This finding suggests that to a large degree the aftereffect is mediated not by low-level retinotopic (image-based) visual mechanisms but at a higher level of object-based processing. Aftereffects of a similar magnitude are obtained when adapting and test images are both either upright or inverted, or for an upright adapter and an inverted test; but aftereffects are smaller when the adapter is inverted and the test upright. This pattern of results suggests that the face-distortion aftereffect is mediated by object-processing mechanisms including, but not restricted to, configurational face-processing mechanisms.     

Can holistic processing be learned for inverted faces?

The origin of "special" processing for upright faces has been a matter of ongoing debate. If it is due to generic expertise, as opposed to having some innate component, holistic processing should be learnable for stimuli other than upright faces. Here we assess inverted faces. We trained subjects to discriminate identical twins using up to 1100 exposures to each twin in different poses and images. In the upright orientation, twin discrimination was supported by holistic processing. Removal of a single face feature had no effect on performance, and a composite effect (Young, A. W., Hellawell, D., & Hay, D.C. (1987). Configurational information in face perception. Perception 16 (6), 747-759) was obtained. In the inverted orientation, however, above chance identification ability relied on (a) image specific learning, or (b) tiny local feature differences not noticed in the upright faces. The failure to learn holistic processing for inverted faces indicates that, in contrast to the situation for objects (Tarr, M.J., & Pinker, S. (1989). Mental rotation and orientation-dependence in shape recognition. Cognitive Psychology 21 (2), 233-282), orientation specificity of face processing is highly stable against practice.     

Effect of visual experience on face processing: a developmental study of inversion and non-native effects

In adults, three phenomena are taken to demonstrate an experience effect on face recognition: an inversion effect, a non-native face effect (so-called 'other-race' effect) and their interaction. It is crucial for our understanding of the developmental perception mechanisms of object processing to discover when these effects are present in childhood. Three- to 5-year-old Caucasian children (N = 64) were asked to recognize upright and inverted Caucasian and Asian faces. Recognition was tested with a forced-choice procedure. Overall performance improved with age. However, there was an interaction between the inversion and non-native effects that did not change with age between ages 3 and 5: (a) the inversion effect with native (Caucasian) faces was larger than with non-native (Asian) faces, and (b) upright native faces were recognized better than upright non-native faces. These results show that face orientation and morphology constrain face processing in 3- to 5-year-olds. The first 3 years of life during which the brain and the environment interact are sufficient to build a face-processing system that constrains recognition.     

知觉场理论对面孔知觉年龄偏差效应的解释

使用融合面孔范式和倒置面孔范式来研究面孔知觉的年龄偏差效应,检验知觉场能否作为面孔整体加工的指标,并以此发展年龄偏差的整体加工解释。结果发现：（1）成人和儿童在加工正立面孔时的知觉场均大于加工倒置面孔时的知觉场;（2）在加工正立面孔时,成人加工本年龄面孔比加工他年龄面孔的知觉场更大。上述结果表明：（1）知觉场大小可以作为面孔整体加工的指标,且受面孔朝向的影响;（2）知觉场假设可以解释面孔的年龄偏差效应。     

知觉场理论对面孔知觉年龄偏差效应的解释

使用融合面孔范式和倒置面孔范式来研究面孔知觉的年龄偏差效应,检验知觉场能否作为面孔整体加工的指标,并以此发展年龄偏差的整体加工解释。结果发现：（1）成人和儿童在加工正立面孔时的知觉场均大于加工倒置面孔时的知觉场;（2）在加工正立面孔时,成人加工本年龄面孔比加工他年龄面孔的知觉场更大。上述结果表明：（1）知觉场大小可以作为面孔整体加工的指标,且受面孔朝向的影响;（2）知觉场假设可以解释面孔的年龄偏差效应。     

Face inversion disproportionately impairs the perception of vertical but not horizontal relations between features

Upside-down inversion disrupts the processing of spatial relations between the features of a face, while largely preserving local feature analysis. However, recent studies on face inversion failed to observe a clear dissociation between relational and featural processing. To resolve these discrepancies and clarify how inversion affects face perception, the authors monitored inversion effects separately for vertical and horizontal distances between features. Inversion dramatically declined performance in the vertical-relational condition, but it impaired featural and horizontal-relational performance only moderately. Identical observations were made whether upright and inverted trials were blocked or randomly interleaved. The largest performance decrement was found for vertical relations even when faces were rotated by 90 degrees. Evidence that inversion dramatically disrupts the ability to extract vertical but not horizontal feature relations supports the view that inversion qualitatively changes face perception by rendering some of the processes activated by upright faces largely ineffective.     

The role of eyes in early face processing: a rapid adaptation study of the inversion effect

The current study employed a rapid adaptation procedure to test the neuronal mechanisms of the face inversion effect (FIE) on the early face-sensitive event-related potential (ERP) component N170. Five categories of face-related stimuli (isolated eyes, isolated mouths, eyeless faces, mouthless faces, and full faces) and houses were presented in upright and inverted orientations as adaptors for inverted full face test stimuli. Strong adaptation was found for all face-related stimuli except mouths. The adaptation effect was larger for inverted than upright stimuli, but only when eyes were present. These results underline an important role of eyes in early face processing. A mechanism of eye-dependent orientation sensitivity during the structural encoding stage of faces is proposed.     

The effects of orientation on detection and identification of facial expressions of emotion

Signal detection procedures were used to examine the ability of participants to detect and label facial expressions of emotion in an upright or inverted orientation when the faces were rapid videotaped presentations. The detection and identification of facial expressions were remarkably accurate. In the upright orientation, the A′ measure of sensitivity was above .9 for detection and identification of all six facial expressions of emotion. Sensitivity to inverted expressions was diminished for all emotions; however, the extent of the decline in sensitivity depended upon the specific facial expression. If the expression was difficult to detect or label in the upright orientation, the sensitivity score was lower in the inverted orientation. An assessment of the errors made in the detection and labelling process allowed a demonstration of the specific facial expressions that were confused in either the upright or inverted orientation. The assessment of sensitivity and analysis of the errors suggests that the nature of perceptual processing of some, but not all, facial expressions is changed by inversion.     

Carryover of scanning behaviour affects upright face recognition differently to inverted face recognition

Face perception is characterized by a distinct scanpath. While eye movements are considered functional, there has not been direct evidence that disrupting this scanpath affects face recognition performance. The present experiment investigated the influence of an irrelevant letter-search task (with letter strings arranged horizontally, vertically, or randomly) on the subsequent scanning strategies in processing upright and inverted famous faces. Participants’ response time to identify the face and the direction of their eye movements were recorded. The orientation of the letter search influenced saccadic direction when viewing the face images, such that a direct carryover-effect was observed. Following a vertically oriented letter-search task, the recognition of famous faces was slower and less accurate for upright faces, and faster for inverted faces. These results extend the carryover findings of Thompson and Crundall into a novel domain. Crucially they also indicate that upright and inverted faces are better processed by different eye movements, highlighting the importance of scanpaths in face recognition.     

The influence of divided attention on holistic face perception.

There is evidence that upright, but not inverted, faces are encoded holistically. The holistic coding of faces was examined in four experiments by manipulating the attention allocated to target faces. In Experiment 1, participants in a divided attention condition were asked to match two upright flanker faces while encoding a centrally presented upright target face. Although holistic coding was evident in the full attention conditions, dividing attention disrupted holistic coding of target faces. In Experiment 2, we found that while matching upright flanker faces disrupted holistic coding, matching inverted flanker faces did not. Experiment 3 demonstrated that the differential effects of flanker orientation were not due to participants taking longer to match upright, than inverted, flanker faces. In Experiment 4, we found that matching fractured faces had an intermediate effect to that of matching upright and inverted flankers, on the holistic coding of the target faces. The findings emphasize the differences in processing of upright, fractured and inverted faces and suggest that there are limitations in the number of faces that can be holistically coded in a brief time.     

Orientation specificity in biological motion perception

We addressed the issue of how display orientation affects the perception of biological motion. In Experiment 1, spontaneous recognition of a point-light walker improved abruptly with image-plane display rotation from inverted to upright orientation. Within a range of orientations from 180 degrees to 90 degrees, it was dramatically impeded. Using ROC analysis, we showed (Experiments 2 and 3) that despite prior familiarization with a point-light figure at all orientations, its detectability within a mask decreased with a change in orientation from upright to a range of 90 degrees-180 degrees. In Experiment 4, a priming effect in biological motion was observed only if a prime corresponded to a range of deviations from upright orientation within which the display was spontaneously recognizable. The findings indicate that display orientation nonmonotonically affects the perception of biological motion. Moreover, top-down influence on the perception of biological motion is limited by display orientation.     

The effect of object and event orientation on perception of biological motion

Detection and recognition of point-light walking is reduced when the display is inverted, or turned upside down. This indicates that past experience influences biological motion perception. The effect could be the result of either presenting the human form in a novel orientation or presenting the event of walking in a novel orientation, as the two are confounded in the case of walking on feet. This study teased apart the effects of object and event orientation by examining detection accuracy for upright and inverted displays of a point-light figure walking on his hands. Detection of this walker was greater in the upright display, which had a familiar event orientation and an unfamiliar object orientation, than in the inverted display, which had a familiar object orientation and an unfamiliar event orientation. This finding supports accounts of event perception and recognition that are based on spatiotemporal patterns of motion associated with the dynamics of an event.     

Upright versus upside-down faces: How interface attractiveness varies with orientation

A choice experiment is reported in which all pairs and triples of faces from a set of eight moderately attractive faces were presented, both upright and upside down, to 103 subjects. In each orientation, the subjects had to select the face that appeared more (pairs) or most (triples) attractive to them. For each orientation, the preference probabilities that arose from the pair and triple comparisons could be described by the BTL rule (Luce, 1959). Thus, each face was represented by two scores, one reflecting its attractiveness in the upright orientation and the other reflecting its attractiveness in the inverted orientation. Orientation affected the preference probabilities. Qualitatively, score ratios between faces decreased from upright to inverted orientation, suggesting that the faces became less discriminable by inversion. Quantitatively, the effect of inversion could be described by a simple rule that assumes a face’s two attractiveness scores to be affinely related across orientations. This result indicates that inversion affected all faces about equally. The present findings are discussed with respect to faces’ first- and second-order relational properties, a distinction emphasized in current theories of face perception. They suggest that the processing of first- and secondorder relational properties is impaired by inversion to roughly the same degree.     

Discrimination of faces and houses by rhesus monkeys: the role of stimulus expertise and rotation angle

The face inversion effect, or impaired recognition of upside down compared to upright faces, is used as a marker for the configural processing of faces in primates. The inversion effect in humans and chimpanzees is strongest for categories of stimuli for which subjects have considerable expertise, primarily conspecifics’ faces. Moreover, discrimination performance decreases linearly as faces are incrementally rotated from upright to inverted. This suggests that rotated faces must be transformed, or normalized back into their most typical viewpoint before configural processing can ensue, and the greater the required normalization, the greater the likelihood of errors resulting. Previous studies in our lab have demonstrated a general face inversion effect in rhesus monkeys that was not influenced by expertise. Therefore, the present study examined the influence of rotation angle on the visual perception of face and nonface stimuli that varied in their level of expertise to further delineate the processes underlying the inversion effect in rhesus monkeys. Five subjects discriminated images in five orientation angles. Results showed significant linear impairments for all stimulus categories, including houses. However, compared to the upright images, only rhesus faces resulted in worse performance at rotation angles greater than 45°, suggesting stronger configural processing for stimuli for which subjects had the greatest expertise.     

Face processing in humans and new world monkeys: the influence of experiential and ecological factors

This study tests whether the face-processing system of humans and a nonhuman primate species share characteristics that would allow for early and quick processing of socially salient stimuli: a sensitivity toward conspecific faces, a sensitivity toward highly practiced face stimuli, and an ability to generalize changes in the face that do not suggest a new identity, such as a face differently oriented. The look rates by adult tamarins and humans toward conspecific and other primate faces were examined to determine if these characteristics are shared. A visual paired comparison (VPC) task presented subjects with either a human face, chimpanzee face, tamarin face, or an object as a sample, and then a pair containing the previous stimulus and a novel stimulus was presented. The stimuli were either presented all in an upright orientation, or all in an inverted orientation. The novel stimulus in the pair was either an orientation change of the same face/object or a new example of the same type of face/object, and the stimuli were shown either in an upright orientation or in an inverted orientation. Preference to novelty scores revealed that humans attended most to novel individual human faces, and this effect decreased significantly if the stimuli were inverted. Tamarins showed preferential looking toward novel orientations of previously seen tamarin faces in the upright orientation, but not in an inverted orientation. Similarly, their preference to look longer at novel tamarin and human faces within the pair was reduced significantly with inverted stimuli. The results confirmed prior findings in humans that novel human faces generate more attention in the upright than in the inverted orientation. The monkeys also attended more to faces of conspecifics, but showed an inversion effect to orientation change in tamarin faces and to identity changes in tamarin and human faces. The results indicate configural processing restricted to particular kinds of primate faces by a New World monkey species, with configural processing influenced by life experience (human faces and tamarin faces) and specialized to process orientation changes specific to conspecific faces.     

Binocular rivalry: a window into emotional processing in aging

Previous binocular rivalry studies with younger adults have shown that emotional stimuli dominate perception over neutral stimuli. Here we investigated the effects of age on patterns of emotional dominance during binocular rivalry. Participants performed a face/house rivalry task where the emotion of the face (happy, angry, neutral) and orientation (upright, inverted) of the face and house stimuli were varied systematically. Age differences were found with younger adults showing a general emotionality effect (happy and angry faces were more dominant than neutral faces) and older adults showing inhibition of anger (neutral faces were more dominant than angry faces) and positivity effects (happy faces were more dominant than both angry and neutral faces). Age differences in dominance patterns were reflected by slower rivalry rates for both happy and angry compared to neutral face/house pairs in younger adults, and slower rivalry rates for happy compared to both angry and neutral face/house pairs in older adults. Importantly, these patterns of emotional dominance and slower rivalry rates for emotional-face/house pairs disappeared when the stimuli were inverted. This suggests that emotional valence, and not low-level image features, were responsible for the emotional bias in both age groups. Given that binocular rivalry has a limited role for voluntary control, the findings imply that anger suppression and positivity effects in older adults may extend to more automatic tasks.     

Categorical perception effects for facial identity in robustly represented familiar and self-faces: the role of configural and featural information

Categorical perception of robustly represented faces (self, friend) and unfamiliar faces is investigated, and the relative roles of configural and featural information are examined. Participants performed identification and discrimination tasks on morph series containing the self-face and a friend's face (self-Friend 1), two friends' faces (Friend 2-Friend 3), and two unfamiliar faces (Unfamiliar 1-Unfamiliar 2), presented in upright and inverted orientations. For upright faces, categorical perception effects were observed for both familiar morph series but not for the unfamiliar morph series, suggesting that robust representation is a requirement for categorical perception in facial identity. For inverted faces, categorical perception was observed for the self-Friend 1 morph series only. This suggests that categorical perception is tied to configural processing for familiar non-self-faces, but can be observed for self-faces during featural processing-consistent with evidence that self-face representations contain strong configural and featural components. Finally, categorical perception is not enhanced by the presence of the self-face relative to other familiar faces when upright, but shows a trend of being enhanced for self-faces when inverted, adding to the debate on the ways in which robustly represented faces can elicit categorical perception.     

Revisiting the perception of upside-down faces

In two experiments, the effect of orientation on face perception was assessed. Using a scale from 1 ( normal ) to 7 ( bizarre ), participants rated normal, unaltered faces and faces in which changes had been made to spatial-relational properties (eyes and mouth inverted or relative position of the eyes and mouth altered) or to component properties (eyes whitened and teeth blackened). For unaltered and component-distortion faces, bizarreness ratings increased linearly as orientation increased from 0° to 180°. For spatial-distortion faces, a discontinuity in the function relating orientation and bizarreness was in evidence between 90° and 120°. The results provide support for the view that there is a qualitative difference in the processing of upright and inverted faces due to the disproportionate effect of inversion on the encoding of spatial-relational information.     

Perceptual integrality of componential and configural information in faces

The relative contribution of componential and configural information to face perception is controversial. We addressed this issue in the present study by examining how componential information and configural information interact during face processing, using Garner’s (1974) speeded classification paradigm. When classifying upright faces varying in components (eyes, nose, and mouth) and configural information (intereyes and nose-mouth spacing), observers could not selectively attend to components without being influenced by irrelevant variation in configural information, and vice versa, indicating that componential information and configural information are integral in upright face processing. Performance with inverted faces showed selective attention to components but not to configural information, implying dominance of componential information in processing inverted faces. When faces varied only in components, selective attention to different components was observed in upright and inverted faces, indicating that facial components are perceptually separable. These results provide strong evidence that integrality of componential and configural information, rather than the relative dominance of either, is the hallmark of upright face perception.     

Effects of motion and audio-visual redundancy on upright and inverted face and feature preferences in 4-13-month old pre- and full-term NICU graduates

NICU infants are reported to have diminished social orientation and increased risk of socio-communicative disorders. In this eye tracking study, we used a preference for upright compared to inverted faces as a gauge of social interest in high medical risk full- and pre-term NICU infants. We examined the effects of facial motion and audio-visual redundancy on face and eye/mouth preferences across the first year. Upright and inverted baby faces were simultaneously presented in a paired-preference paradigm with motion and synchronized vocalization varied. NICU risk factors including birth weight, sex, and degree of CNS injury were examined. Overall, infants preferred the more socially salient upright faces, making this the first report, to our knowledge, of an upright compared to inverted face preference among high medical risk NICU infants. Infants with abnormalities on cranial ultrasound displayed lower social interest, i.e. less of a preferential interest in upright faces, when viewing static faces. However, motion selectively increased their upright face looking time to a level equal that of infants in other CNS injury groups. We also observed an age-related sex effect suggesting higher risk in NICU males. Females increased their attention to the mouth in upright faces across the first year, especially between 7–10 months, but males did not. Although vocalization increased diffuse attention toward the screen, contrary to our predictions, there was no evidence that the audio-visual redundancy embodied in a vocalizing face focused additional attention on upright faces or mouths. This unexpected result may suggest a vulnerability in response to talking faces among NICU infants that could potentially affect later verbal and socio-communicative development.